-- Logs begin at Sat 2022-05-14 20:01:12 UTC, end at Sat 2022-05-14 22:44:22 UTC. -- May 14 21:00:14.264214 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 14 21:00:14.272965 ncdv-master-1 devstack@n-api.service[115035]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 14 21:00:14 2022] *** May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: nodename: ncdv-master-1 May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: machine: x86_64 May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: clock source: unix May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: pcre jit disabled May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: detected number of CPU cores: 4 May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: current working directory: / May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: detected binary path: /usr/bin/uwsgi-core May 14 21:00:14.275108 ncdv-master-1 devstack@n-api.service[115035]: your processes number limit is 47680 May 14 21:00:14.275895 ncdv-master-1 devstack@n-api.service[115035]: your memory page size is 4096 bytes May 14 21:00:14.275895 ncdv-master-1 devstack@n-api.service[115035]: detected max file descriptor number: 2048 May 14 21:00:14.275895 ncdv-master-1 devstack@n-api.service[115035]: lock engine: pthread robust mutexes May 14 21:00:14.275895 ncdv-master-1 devstack@n-api.service[115035]: thunder lock: enabled May 14 21:00:14.275895 ncdv-master-1 devstack@n-api.service[115035]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 14 21:00:14.275895 ncdv-master-1 devstack@n-api.service[115035]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 14 21:00:14.325288 ncdv-master-1 devstack@n-api.service[115035]: Python main interpreter initialized at 0x55cbb9fa99c0 May 14 21:00:14.325288 ncdv-master-1 devstack@n-api.service[115035]: python threads support enabled May 14 21:00:14.325288 ncdv-master-1 devstack@n-api.service[115035]: your server socket listen backlog is limited to 100 connections May 14 21:00:14.325288 ncdv-master-1 devstack@n-api.service[115035]: your mercy for graceful operations on workers is 90 seconds May 14 21:00:14.325678 ncdv-master-1 devstack@n-api.service[115035]: mapped 403077 bytes (393 KB) for 2 cores May 14 21:00:14.325755 ncdv-master-1 devstack@n-api.service[115035]: *** Operational MODE: preforking *** May 14 21:00:14.325949 ncdv-master-1 devstack@n-api.service[115035]: *** uWSGI is running in multiple interpreter mode *** May 14 21:00:14.325949 ncdv-master-1 devstack@n-api.service[115035]: spawned uWSGI master process (pid: 115035) May 14 21:00:14.326152 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 14 21:00:14.327211 ncdv-master-1 devstack@n-api.service[115035]: spawned uWSGI worker 1 (pid: 115036, cores: 1) May 14 21:00:14.327211 ncdv-master-1 devstack@n-api.service[115035]: spawned uWSGI worker 2 (pid: 115037, cores: 1) May 14 21:00:14.327211 ncdv-master-1 devstack@n-api.service[115035]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 14 21:00:15.614018 ncdv-master-1 devstack@n-api.service[115036]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 21:00:15.646443 ncdv-master-1 devstack@n-api.service[115037]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 21:00:16.363440 ncdv-master-1 devstack@n-api.service[115037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:00:16.363440 ncdv-master-1 devstack@n-api.service[115037]: from cryptography.utils import int_from_bytes May 14 21:00:16.363720 ncdv-master-1 devstack@n-api.service[115037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:00:16.363720 ncdv-master-1 devstack@n-api.service[115037]: from cryptography.utils import int_from_bytes May 14 21:00:16.363988 ncdv-master-1 devstack@n-api.service[115036]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:00:16.363988 ncdv-master-1 devstack@n-api.service[115036]: from cryptography.utils import int_from_bytes May 14 21:00:16.364319 ncdv-master-1 devstack@n-api.service[115036]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:00:16.364319 ncdv-master-1 devstack@n-api.service[115036]: from cryptography.utils import int_from_bytes May 14 21:00:18.990182 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 21:00:18.990890 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 21:00:18.991630 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 21:00:18.992016 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 21:00:18.992390 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 21:00:18.992474 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 21:00:18.992712 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 21:00:18.992851 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 21:00:18.993119 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.993217 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 21:00:18.993458 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 21:00:18.993544 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.993787 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.993872 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.994116 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.994200 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.994457 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.994569 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.994766 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.994864 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.995095 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.995191 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.995420 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.995670 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.995770 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.995860 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.996036 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.996182 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.996363 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.996526 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.996681 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.996830 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.996971 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.997120 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.997260 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.997400 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.997548 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.997688 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.997836 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.997993 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.998140 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.998281 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.998420 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.998570 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.998717 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.998870 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.999012 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.999285 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:18.999438 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.000954 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.001159 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.001327 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.001488 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.001630 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.001782 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.001782 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.002098 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.002242 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.002986 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.003138 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.003279 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.003428 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.003611 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.003754 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.003901 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.004054 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.004196 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.004196 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.004470 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.004470 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.004747 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.004747 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.005022 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.005169 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.005309 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.005462 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.005608 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.005608 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.005891 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.006051 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.006202 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.006366 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.006514 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.006654 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.006793 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.006947 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.007099 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.007247 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.007388 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.007562 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.007733 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.007886 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.008028 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.008168 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.008307 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.008448 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.008601 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.008742 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.008893 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.009033 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.009172 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.009323 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.009478 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.009636 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.009777 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.009916 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.010056 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.010281 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.010428 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.010569 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.010710 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.010857 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.010998 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.011147 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.011287 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.011433 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.011619 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.011769 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.011910 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.012083 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.012325 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.012477 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.012630 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.012775 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.012932 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.013074 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.013242 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.013383 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.013524 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.013674 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.013821 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.013970 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.014110 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.014250 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.014389 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.014541 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.014541 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.014857 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.015008 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.015158 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.015314 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.015464 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.015640 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.015783 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.015929 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.016077 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.016228 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.016381 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.016522 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.016684 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.016927 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.017085 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.017226 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.017394 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.017536 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.017677 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.017826 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.017984 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.018170 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.018314 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.018469 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.018612 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.018753 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.018901 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.019063 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.019212 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.019353 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.019353 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.019666 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.019820 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.019972 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020113 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020260 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020411 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020551 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020690 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020847 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020999 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.020999 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.021270 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.021410 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.021579 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.021691 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.021805 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.021919 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022028 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022135 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022258 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022367 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022480 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022595 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022709 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022824 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.022945 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.023061 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.023175 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.023283 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.023389 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.023585 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027112 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027238 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027337 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027420 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027601 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027693 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027783 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027864 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.027942 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028028 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028115 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028204 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028334 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028426 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028507 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028585 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028671 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028764 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028845 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.028932 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029012 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029091 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029169 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029255 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029336 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029430 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029510 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029596 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029665 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029752 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029841 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.029920 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030005 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030086 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030164 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030250 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030337 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030416 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030505 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030585 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030585 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030745 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030824 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030903 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.030981 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031058 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031136 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031223 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031303 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031398 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031499 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031584 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031679 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031767 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031848 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.031926 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032004 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032082 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032224 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032310 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032437 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032530 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032611 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032767 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.032872 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.033073 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.033162 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.033379 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.033467 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.033733 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.033858 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.034063 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.034153 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.034366 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.034461 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.034664 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.034762 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.034962 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.035050 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.035274 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.035363 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.035635 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.035757 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.035940 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.036027 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.036255 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.036349 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.036579 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:00:19.036669 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.036901 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.037007 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.037227 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.037316 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.037540 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.037636 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.037846 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.037948 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.038155 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.038253 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.038484 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.038621 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.038790 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.038885 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.039097 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.039199 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.039402 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.039533 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.039742 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.039831 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.040056 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.040160 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.040370 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.040456 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.040685 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.040805 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.041011 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.041119 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.041323 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.041417 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.041629 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.041717 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.041941 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.042040 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.042264 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.042433 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.042591 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.042731 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.042873 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.043034 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.043185 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.043338 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.043512 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.043659 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.043818 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.043958 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.044133 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.044281 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.044451 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.044599 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.044761 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.044903 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.045054 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.045196 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.045391 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.045539 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.045689 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.045840 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.045982 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.046124 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.046265 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.046405 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.046555 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.046697 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.046844 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.046986 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.047179 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.047349 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.047520 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.047662 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.047772 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.047880 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.052831 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.052986 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053077 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053168 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053250 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053339 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053428 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053518 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053599 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053679 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053758 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053836 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.053915 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054007 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054089 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054089 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054232 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054311 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054396 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054485 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054566 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054667 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054746 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054831 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.054920 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055002 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055080 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055165 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055252 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055332 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055423 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055528 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055614 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055704 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055786 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055864 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.055952 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056039 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056119 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056206 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056287 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056365 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056452 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056532 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056611 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056690 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056770 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056867 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.056948 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057027 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057105 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057195 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057275 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057362 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057442 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057520 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057605 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057686 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057765 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057851 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.057931 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058029 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058157 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058250 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058320 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058476 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058559 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058665 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058834 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.058925 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.059145 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.059236 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.059455 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.059600 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.059798 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.060006 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.060173 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.060326 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.060476 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.060630 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.060780 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.060929 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.061090 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.061247 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.061425 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.061627 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.061778 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.061928 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.062085 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.062235 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.062235 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.062516 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.062670 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.062833 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.062998 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.063154 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.063308 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.063467 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.063665 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.063826 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.063974 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.064121 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.064319 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.064467 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.064614 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.064771 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.065511 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.065672 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.065823 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.065972 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.066141 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.066299 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.066448 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.066606 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.066754 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.066902 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.067063 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.067212 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.067361 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.067544 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.067700 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.067848 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.068018 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.068168 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.068322 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.068470 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.068618 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.068867 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.069031 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.069182 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.069329 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.069477 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.069624 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.069771 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.069927 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.070089 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.070240 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.070388 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.070547 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.070706 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.070853 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.071029 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.071193 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.071343 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.071518 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.071686 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.071835 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.071989 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.072156 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.072306 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.072453 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.072610 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.072764 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.072919 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.073066 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.073213 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.073360 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.073529 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.073676 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.073830 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.073977 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.074133 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.074280 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.074436 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.074584 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.074731 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.074877 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.075024 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.075179 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.075327 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.075490 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.075771 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.075927 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.076076 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.076248 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.076403 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.076553 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.076553 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.076832 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.076992 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.077148 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.077297 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.077445 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.077593 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.077740 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.077886 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.078052 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.078200 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.078347 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.078494 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.078642 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.078794 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.078991 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.079106 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.079214 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.079321 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.079427 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.084485 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.084628 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.084715 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.084783 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.084875 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.084957 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085047 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085129 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085208 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085329 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085424 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085505 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085593 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085716 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085803 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085883 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.085961 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086049 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086130 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086207 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086285 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086362 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086440 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086527 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086614 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086693 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086779 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086858 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086937 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.086937 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087089 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087167 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087244 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087322 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087399 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087539 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087624 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087703 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087781 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087859 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.087959 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088042 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088121 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088199 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088285 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088365 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088456 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088554 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088644 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088767 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088854 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.088933 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089112 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089196 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089275 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089354 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089431 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089509 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089620 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089703 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089784 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089863 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.089945 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090024 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090118 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090200 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090280 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090361 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090443 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090531 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090618 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090698 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090776 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090854 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.090931 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091018 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091106 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091187 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091265 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091343 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091343 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091512 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091595 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091686 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091769 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091855 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.091942 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.092031 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.092209 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.092310 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.092513 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.092603 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.092818 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.092995 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.093133 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.093230 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.093428 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.093517 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.093732 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.093820 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.094036 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.094123 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.094339 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.094426 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.094639 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.094728 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.094943 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.095039 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.095253 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.095341 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.095596 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.095848 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.095936 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.096266 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.096481 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.096577 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.096655 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.096883 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.096981 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.097196 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.097283 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.097505 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.097593 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.097820 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.097917 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.098138 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.098231 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.098482 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.098703 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.098804 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.099040 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.099137 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.099361 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.099524 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.099690 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.099821 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.099999 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.100120 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.100302 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.100432 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.100603 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.100734 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.100904 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.101033 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.101214 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.101353 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.101515 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.101656 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.101816 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.101944 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.102114 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.102258 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.102452 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.102591 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.102721 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.102853 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.102978 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.103102 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.103289 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.103420 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.103600 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.103723 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.103920 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.104052 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.104225 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.104355 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.104524 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.104653 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.104823 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.104953 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.105121 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.105251 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.105461 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.105606 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.105764 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.105896 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.106078 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.106206 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.106394 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.106529 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.106723 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.106861 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.107022 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.107149 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.107323 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.107444 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.107652 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.107794 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.107959 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.108095 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.108259 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.108389 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.108558 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.108695 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.108863 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.108991 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.109167 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.109338 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.109474 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.109601 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.109758 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.109887 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.110063 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.110193 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.110392 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.110528 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.110655 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.110779 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.110942 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.111079 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.111244 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.111374 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.111565 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.112205 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.112393 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.112600 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.112743 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.112877 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113011 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113137 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113253 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113394 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113561 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113691 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113865 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.113994 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.114163 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.114306 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.114468 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.114608 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.114764 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.114907 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.115075 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.115213 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.115377 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.115589 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.115727 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.115860 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.115992 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.116127 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.116262 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.116388 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.116573 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.116710 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.116873 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.117003 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.117192 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.117320 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.117499 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.117628 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.117799 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.117929 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.118098 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.118227 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.118403 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.118541 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.118705 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.118847 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.119003 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.119131 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.119306 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.119430 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.119649 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.119790 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.119960 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.120089 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.120260 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.120403 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.120564 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.120693 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.120864 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.120993 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.121162 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.121300 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.121461 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.121584 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.121766 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.121894 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.122061 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.122196 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.122360 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.122488 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.122661 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.122793 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.122962 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.123097 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.123259 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.123372 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.123599 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.123700 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.123903 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.124001 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.124200 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.124287 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.124499 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.124586 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.124795 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.125217 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.125385 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.125481 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.125686 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.125777 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.125993 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.126081 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.126303 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.126391 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.126630 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.126723 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.126945 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.127032 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.127248 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.127407 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.128152 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.128251 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.128461 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.128578 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.128810 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.128905 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.129123 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.129225 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.129485 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.129570 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.129784 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.129878 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.130081 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.130182 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.130381 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.130469 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.130698 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.130791 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.131005 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.131110 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.131311 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.131399 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.131643 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.131731 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.131960 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.132060 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.132271 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.132358 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.132569 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.132655 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.132875 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.132965 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.133177 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.133261 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.133532 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.133628 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.133778 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.133870 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.134081 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.134170 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.134387 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.134474 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.134694 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.134784 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.134999 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.135086 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.135306 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.135393 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.135636 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.135727 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.135937 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.136024 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.136242 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.136344 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.136551 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.136641 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.136851 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.136938 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.137170 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.137269 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.137472 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.137558 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.137771 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.137859 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.138074 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.138170 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.138372 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.138460 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.138675 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.138770 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.138973 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.139070 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.139285 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.139399 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.139618 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.139720 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.139952 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.140043 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.140268 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.140357 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.140576 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.140663 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.140888 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.140974 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.141194 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.141280 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.141503 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.141590 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.141808 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.141896 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.142220 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.142305 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.142527 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.142615 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.142835 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.142920 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.143716 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.143819 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.144036 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.144139 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.144356 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.144445 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.144681 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.144769 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.145003 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.145105 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.145314 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.145401 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.145613 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.145741 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.145915 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.146061 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.146233 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.146376 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.146541 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.146701 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.146858 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.147014 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.147273 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.147360 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.147604 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.147697 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.147907 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.148005 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.148261 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.148347 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.148572 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.148667 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.148883 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.148980 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.149208 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.149293 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.149519 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.149604 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.149836 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.149931 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.150139 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.150260 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.150448 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.150582 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.150754 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.150896 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.151076 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.151319 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.151406 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.151661 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.151781 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.151978 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.152079 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.152308 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.152397 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.152623 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.152717 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.152941 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.153027 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.153249 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.153337 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.153564 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.153650 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.153879 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.153979 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.154210 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.154298 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.154540 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.154628 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.154857 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.154947 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.155177 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.155267 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.155520 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.155612 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.155809 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.155908 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.156120 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.156220 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.156429 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.156527 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.156733 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.156821 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.157054 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.157178 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.157356 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.157510 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.157663 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.157828 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.157969 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.158157 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.158275 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.158488 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.159130 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.159348 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.159537 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.159704 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.159798 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.159987 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.160102 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.160292 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.160382 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.160604 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.160701 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.160933 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.161023 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.161243 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.161339 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.161560 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.161677 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.161879 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.161978 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.162179 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.162266 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.162481 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.162580 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.162782 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.162871 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.163081 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.163171 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.163401 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.163540 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.163732 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.163828 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.164052 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.164160 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.164375 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.164474 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.164697 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.164797 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.165005 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.165092 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.165334 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.165430 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.165649 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.165737 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.165957 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.166044 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.166264 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.166352 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.166580 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.166679 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.166879 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.166965 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.167182 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.167271 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.167507 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.167599 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.167813 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.167913 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.168115 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.168204 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.168415 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.168503 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.168719 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.168816 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.169017 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.169138 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.169320 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.169462 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.169620 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.169787 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.169937 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.170119 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.170237 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.170431 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.170555 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.170742 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.170859 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.171054 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.171143 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.171363 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.171460 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.171696 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.171787 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.172005 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.172102 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.172318 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.172423 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.172625 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.172720 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.172935 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.173023 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.173243 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.173339 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.173570 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.173659 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.173874 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.173956 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.174217 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.174331 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.174531 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.174621 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.174845 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.174932 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.175157 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.175254 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.175469 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.175602 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.175804 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.175894 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.176117 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.176212 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.176434 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.176523 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.176740 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.176827 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.177050 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.177146 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.177358 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.177446 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.177668 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.177764 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.178032 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.178189 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.178353 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.178518 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.178673 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.178880 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.178977 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.179145 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.179300 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.179455 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.179651 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.179794 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.179974 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.180104 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.180296 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.180415 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.180611 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.180778 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.180931 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.181019 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.181250 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.181337 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.181572 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.181674 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.181926 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.182101 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.182251 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.182436 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.182582 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.182756 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.182894 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.183075 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.183206 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.183392 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.183581 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.183738 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.183829 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.184058 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.184246 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.184360 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.184491 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.184675 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.184793 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.184991 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.185102 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.185306 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.185403 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.185638 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.185764 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.185964 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.186060 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.186295 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.186383 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.186611 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.186707 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.186920 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.187017 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.187230 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.187326 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.187560 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.187653 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.187872 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.187975 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.188180 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.188279 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.188499 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.188588 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.188829 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.188919 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.189143 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.189241 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.189450 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.189538 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.189761 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.190355 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.190592 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.190699 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.190947 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.191268 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.191365 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.191617 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.191709 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.191938 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.192040 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.192255 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.192353 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.192576 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.192665 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.192886 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.192972 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.193203 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.193292 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.193528 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.193616 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.193835 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.193924 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.194140 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.194229 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.194452 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.194552 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.194759 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.194846 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.195061 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.195280 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.195369 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.195634 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.195726 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.195983 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.196075 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.196298 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.196385 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.196605 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.196693 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.196945 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.197137 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.197276 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.197481 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.197611 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.197793 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.197926 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.198117 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.198238 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.198439 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.198557 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.198753 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.198859 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.199058 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.199168 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.199379 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.199514 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.199714 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.199839 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.200019 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.200151 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.200332 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.200477 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.200640 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.200793 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.200942 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.201265 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.201347 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.201536 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.201666 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.201841 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.201989 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.202141 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.202321 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.202446 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.202655 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.202744 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.202977 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.203066 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.203290 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.203387 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.203646 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.203737 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.203945 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.204043 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.204250 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.204353 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.204551 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.204651 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.204848 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.204937 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.205148 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.205245 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.205508 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.206128 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.206435 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.206525 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.206737 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.206833 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.207044 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.207141 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.207351 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.207440 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.207683 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.207775 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.207987 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.208075 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.208293 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.208381 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.208617 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.208705 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.208931 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.209026 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.209231 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.209325 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.209533 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.209622 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.209840 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.209935 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.210144 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.210231 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.210452 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.210539 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.210754 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.210841 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.211060 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.211227 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.211373 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.211460 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.211711 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.211791 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.212027 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.212308 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.212389 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.212639 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.212993 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.213324 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.213584 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.213681 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.213903 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.213993 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.214233 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.214320 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.214567 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.214661 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.214854 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.214942 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.215159 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.215246 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.215465 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.215594 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.215808 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.215899 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.216117 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.216213 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.216426 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.216665 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.216761 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.217007 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.217096 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.217319 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.217419 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.217626 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.217714 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.217938 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.218025 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.218244 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.218334 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.218551 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.218646 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.218857 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.218946 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.219163 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.219253 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.219469 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.219580 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.219802 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.219900 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.220116 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.220211 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.220431 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.220520 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.220742 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.220828 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.221075 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.221164 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.221391 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.221572 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.221778 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.221876 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.222091 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.222179 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.222397 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.222485 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.222704 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.222801 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.223017 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.223109 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.223344 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.223434 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.223680 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.223777 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.223984 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.224072 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.224373 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.224463 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.224691 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.224773 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.225007 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.225095 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.225320 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.225414 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.225624 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.225712 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.225936 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.226022 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.226250 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.226339 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.226558 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.226646 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.226874 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.226962 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.227181 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.227277 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.227516 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.227607 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.227857 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.227947 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.228182 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.228285 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.228505 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.228602 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.228807 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.228896 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.229108 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.229206 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.229409 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.229506 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.229716 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.229805 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.230033 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.230123 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.230339 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.230428 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.230641 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.230730 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.230943 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.231032 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.231249 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.231337 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.231571 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.231696 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.231877 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.232029 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.232180 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.232340 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.232482 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.232650 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.232787 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.232958 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.233086 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.233272 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.233384 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.233610 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.233751 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.233910 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.233999 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.234220 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.234310 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.234531 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.234628 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.234832 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.234918 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.235132 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.235221 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.235432 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.235574 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.235754 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.235846 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.236057 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.236154 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.236357 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.236447 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.236676 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.236766 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.236992 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.237095 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.237308 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.237407 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.237613 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.237702 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.237921 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.238019 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.238227 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.238316 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.238537 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.238636 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.238845 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.238947 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.239153 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.239242 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.239458 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.239580 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.239794 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.239893 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.240104 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.240193 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.240435 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.240522 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.240746 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.240838 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.241056 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.241153 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.241363 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.241451 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.241668 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.241765 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.241972 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.242061 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.242294 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.242389 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.242614 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.242708 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.242919 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.243008 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.243241 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.243338 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.243576 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.243668 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.243895 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.243986 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.244205 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.244304 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.244513 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.244602 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.244825 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.244911 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.245133 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.245236 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.245440 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.245537 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.245751 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.245839 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.246055 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.246142 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.246362 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.246452 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.246673 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.246763 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.246985 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.247075 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.247310 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.247398 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.247658 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.247747 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.247967 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.248057 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.248282 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.248369 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.248602 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.248688 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.248921 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.249009 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.249238 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.249333 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.249559 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.249658 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.249875 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.250214 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.250442 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.250528 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.250754 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.250862 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.251058 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.251147 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.251300 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 21:00:19.251388 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.251738 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.252055 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.252996 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.253348 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.253705 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.254028 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.254380 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.254717 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.255038 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.255355 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.255704 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:00:19.255956 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 21:00:19.277566 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.280216 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.344470 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.context [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=115037) load_cells /opt/stack/nova/nova/context.py:464}} May 14 21:00:19.345668 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.context [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=115036) load_cells /opt/stack/nova/nova/context.py:464}} May 14 21:00:19.348902 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:00:19.350195 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_concurrency.lockutils [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:00:19.350458 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:00:19.351244 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:00:19.351811 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_concurrency.lockutils [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:00:19.352621 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_concurrency.lockutils [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:00:19.353193 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:00:19.354582 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_concurrency.lockutils [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:00:19.366402 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.368257 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.371564 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.374438 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.528839 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.543063 ncdv-master-1 devstack@n-api.service[115036]: DEBUG oslo_db.sqlalchemy.engines [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:00:19.965529 ncdv-master-1 devstack@n-api.service[115037]: WARNING keystonemiddleware.auth_token [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:00:19.973878 ncdv-master-1 devstack@n-api.service[115037]: WARNING keystonemiddleware.auth_token [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:00:19.989624 ncdv-master-1 devstack@n-api.service[115036]: WARNING keystonemiddleware.auth_token [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:00:19.997637 ncdv-master-1 devstack@n-api.service[115036]: WARNING keystonemiddleware.auth_token [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:00:20.327852 ncdv-master-1 devstack@n-api.service[115037]: WARNING keystonemiddleware.auth_token [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:00:20.334597 ncdv-master-1 devstack@n-api.service[115037]: WARNING keystonemiddleware.auth_token [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:00:20.339912 ncdv-master-1 devstack@n-api.service[115037]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbb9fa99c0 pid: 115037 (default app) May 14 21:00:20.341985 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:00:20.343165 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 May 14 21:00:20.343592 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Sat May 14 21:00:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:00:20.350963 ncdv-master-1 devstack@n-api.service[115036]: WARNING keystonemiddleware.auth_token [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:00:20.357338 ncdv-master-1 devstack@n-api.service[115036]: WARNING keystonemiddleware.auth_token [None req-1a7be60b-d8e2-4b03-9898-19bc1d659ae2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:00:20.362509 ncdv-master-1 devstack@n-api.service[115036]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbb9fa99c0 pid: 115036 (default app) May 14 21:01:42.832056 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:01:42.835582 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002479 May 14 21:01:42.836532 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:01:43.275167 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-10c04e5f-6ba0-4298-8c76-43d6d25d04d5 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:01:43.305907 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-10c04e5f-6ba0-4298-8c76-43d6d25d04d5 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.464197 May 14 21:01:43.306675 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:01:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:01:45.677273 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:01:45.678265 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-5fa3c6bd-cd66-46d9-b16f-6beac1ae29f1 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 14 21:01:45.678669 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:01:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:01:45.737873 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-87ede00a-4648-46b1-b7d3-c452558f3614 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:45.757388 ncdv-master-1 devstack@n-api.service[115036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:01:45.757388 ncdv-master-1 devstack@n-api.service[115036]: warnings.warn(msg) May 14 21:01:45.846819 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-87ede00a-4648-46b1-b7d3-c452558f3614 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.162385 May 14 21:01:45.847379 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:01:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:01:46.077997 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-84e932e8-861c-479c-86b9-0fd5b793df1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:46.080654 ncdv-master-1 devstack@n-api.service[115037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:01:46.080654 ncdv-master-1 devstack@n-api.service[115037]: warnings.warn(msg) May 14 21:01:46.189685 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-84e932e8-861c-479c-86b9-0fd5b793df1f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.334123 May 14 21:01:46.190627 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1335 bytes} [Sat May 14 21:01:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:01:48.589803 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-87ede00a-4648-46b1-b7d3-c452558f3614 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:01:48.590830 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-87ede00a-4648-46b1-b7d3-c452558f3614 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 14 21:01:48.591232 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:01:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:01:48.695905 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-b88de6d8-aa68-4987-b953-345ca27d1ab7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "id": "d1"}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:48.714105 ncdv-master-1 devstack@n-api.service[115037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:01:48.714105 ncdv-master-1 devstack@n-api.service[115037]: warnings.warn(msg) May 14 21:01:48.922994 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-b88de6d8-aa68-4987-b953-345ca27d1ab7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.325211 May 14 21:01:48.924470 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:01:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:01:48.935979 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-da22d275-fe6f-4c23-bacd-d6dd0ad2431d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:48.938967 ncdv-master-1 devstack@n-api.service[115036]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:01:48.938967 ncdv-master-1 devstack@n-api.service[115036]: warnings.warn(msg) May 14 21:01:49.096029 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-da22d275-fe6f-4c23-bacd-d6dd0ad2431d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.163593 May 14 21:01:49.097088 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1335 bytes} [Sat May 14 21:01:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:01:51.540256 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-b88de6d8-aa68-4987-b953-345ca27d1ab7 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:01:51.542294 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-b88de6d8-aa68-4987-b953-345ca27d1ab7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002262 May 14 21:01:51.553693 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:01:51 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:01:51.608109 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-89f00843-665d-456d-8252-c8c38f05eff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "vcpus": 1, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:51.692371 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-89f00843-665d-456d-8252-c8c38f05eff8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142492 May 14 21:01:51.693749 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:01:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:01:51.705712 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-690f3823-b6d5-41be-9073-ff987c08c985 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:51.808468 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-690f3823-b6d5-41be-9073-ff987c08c985 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.106931 May 14 21:01:51.825388 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1335 bytes} [Sat May 14 21:01:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:01:54.554098 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-89f00843-665d-456d-8252-c8c38f05eff8 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:01:54.555186 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-89f00843-665d-456d-8252-c8c38f05eff8 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 May 14 21:01:54.555625 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:01:54.620317 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-9956db7f-0015-408a-a1f2-182aae0bf858 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "disk": 10, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:54.812069 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-9956db7f-0015-408a-a1f2-182aae0bf858 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140486 May 14 21:01:54.812069 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:01:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:01:54.813056 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-313f013b-c648-42c9-8c4a-847e5ad6cffa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:54.843284 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-313f013b-c648-42c9-8c4a-847e5ad6cffa admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120784 May 14 21:01:54.843284 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1335 bytes} [Sat May 14 21:01:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:01:57.612212 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-9956db7f-0015-408a-a1f2-182aae0bf858 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:01:57.613169 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-9956db7f-0015-408a-a1f2-182aae0bf858 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 May 14 21:01:57.613567 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:01:57.683098 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-03c64703-99ab-4ba4-8af8-20cfcf06617a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:57.725698 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-03c64703-99ab-4ba4-8af8-20cfcf06617a admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.106291 May 14 21:01:57.726468 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:01:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:01:57.740296 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-55e4a1ad-c584-46a7-90b6-83e78baf8180 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:01:57.815545 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-55e4a1ad-c584-46a7-90b6-83e78baf8180 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080265 May 14 21:01:57.816139 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1335 bytes} [Sat May 14 21:01:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:02:00.185101 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-03c64703-99ab-4ba4-8af8-20cfcf06617a admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:00.186037 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-03c64703-99ab-4ba4-8af8-20cfcf06617a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 14 21:02:00.187368 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:02:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:00.245956 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-5e3bc8dc-9761-4111-b96e-4a43dc47888f admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:00.271302 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-5e3bc8dc-9761-4111-b96e-4a43dc47888f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077632 May 14 21:02:00.272101 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:02:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:02:02.683288 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-03c64703-99ab-4ba4-8af8-20cfcf06617a admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:02.685135 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-03c64703-99ab-4ba4-8af8-20cfcf06617a admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002108 May 14 21:02:02.685672 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:02.749626 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-f18a68ab-ec1e-4eac-8816-9067317f076d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "name": "m1.tiny", "swap": 0, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:02.855906 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-f18a68ab-ec1e-4eac-8816-9067317f076d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.163944 May 14 21:02:02.856823 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:02:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:02:02.869093 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-598d6419-4850-4f0d-8c0d-4409beb20616 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:02.966572 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-598d6419-4850-4f0d-8c0d-4409beb20616 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101217 May 14 21:02:02.967170 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1332 bytes} [Sat May 14 21:02:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:02:05.528289 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-f18a68ab-ec1e-4eac-8816-9067317f076d admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:05.536186 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-f18a68ab-ec1e-4eac-8816-9067317f076d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 14 21:02:05.536186 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:02:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:05.595965 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-9c993b83-aae8-41c3-bfe6-adba142a36e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.small"}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:05.671849 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-9c993b83-aae8-41c3-bfe6-adba142a36e2 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135182 May 14 21:02:05.672464 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:02:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:02:05.684892 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-e1c86803-f25c-45eb-85d8-669843d014b9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:05.828078 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-e1c86803-f25c-45eb-85d8-669843d014b9 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116191 May 14 21:02:05.828078 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1332 bytes} [Sat May 14 21:02:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:02:08.294609 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-9c993b83-aae8-41c3-bfe6-adba142a36e2 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:08.295713 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-9c993b83-aae8-41c3-bfe6-adba142a36e2 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 14 21:02:08.296118 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:02:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:08.355747 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-41d56770-69a1-4c3d-ab40-75a380b9250d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:08.431859 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-41d56770-69a1-4c3d-ab40-75a380b9250d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.129717 May 14 21:02:08.432647 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:02:08 2022] POST /compute/v2.1/flavors => generated 406 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:02:08.444731 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d8cb5027-aed4-4c09-9a4b-ae1c586937db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:08.790895 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d8cb5027-aed4-4c09-9a4b-ae1c586937db admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.350231 May 14 21:02:08.792306 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1332 bytes} [Sat May 14 21:02:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:02:11.400235 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-41d56770-69a1-4c3d-ab40-75a380b9250d admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:11.401292 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-41d56770-69a1-4c3d-ab40-75a380b9250d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 14 21:02:11.401699 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:02:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:11.460249 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-a7c04653-b668-4854-a4b2-010f17460593 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "ram": 8192}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:11.551979 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-a7c04653-b668-4854-a4b2-010f17460593 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.143556 May 14 21:02:11.552566 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:02:11 2022] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 21:02:11.564892 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-9c175558-754f-4dc0-a84d-02cfa492b2f0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:11.636938 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-9c175558-754f-4dc0-a84d-02cfa492b2f0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076174 May 14 21:02:11.637449 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1332 bytes} [Sat May 14 21:02:11 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:02:14.022119 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-a7c04653-b668-4854-a4b2-010f17460593 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:14.023188 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-a7c04653-b668-4854-a4b2-010f17460593 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 14 21:02:14.023600 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:02:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:14.081809 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-37bc4ba5-c57f-4f46-91f1-ec212bc45a34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5"}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:14.158208 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-37bc4ba5-c57f-4f46-91f1-ec212bc45a34 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.128771 May 14 21:02:14.158766 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1282 bytes} [Sat May 14 21:02:14 2022] POST /compute/v2.1/flavors => generated 408 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 21:02:14.170425 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-67fd79f7-8a33-4ae6-8d60-9eba7954cb33 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:14.248040 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-67fd79f7-8a33-4ae6-8d60-9eba7954cb33 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081220 May 14 21:02:14.252112 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1332 bytes} [Sat May 14 21:02:14 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:02:41.046784 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-37bc4ba5-c57f-4f46-91f1-ec212bc45a34 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:41.047859 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-37bc4ba5-c57f-4f46-91f1-ec212bc45a34 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 14 21:02:41.048257 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:41.104678 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-9b9885ec-e0c5-4639-a0fd-995779be9253 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:41.122092 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-9b9885ec-e0c5-4639-a0fd-995779be9253 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068025 May 14 21:02:41.122630 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:02:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:02:42.163820 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-37bc4ba5-c57f-4f46-91f1-ec212bc45a34 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:42.164864 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-37bc4ba5-c57f-4f46-91f1-ec212bc45a34 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 14 21:02:42.165265 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:42.416426 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-112baeb9-f9d3-4872-bca9-1070d9db1bc7 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:42.422295 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.wsgi [None req-112baeb9-f9d3-4872-bca9-1070d9db1bc7 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-112baeb9-f9d3-4872-bca9-1070d9db1bc7 admin admin] Request method failure captured: May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: Accept: application/json May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: Accept-Encoding: gzip, deflate May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: Connection: keep-alive May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: Content-Length: 0 May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: Host: 10.222.0.52 May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: Openstack-Api-Version: compute 2.90 May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: Openstack-System-Scope: None May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: User-Agent: python-novaclient May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Auth-Token: gAAAAABigBjytkwbNFkOv2suIt5Jh2_8RUknsHi8K8pLXpoNekhbEuvE55QmC9C0mzTEibMIcefW7qxpwSWDrBqU6ErZMkQ1T5shUl4TzCabF6zBspjouKtNNCMQqfaYnJq1ICFEMI3N5kqUQWWwKTLOKAV0jkM3Fxn8BpLweq9qpqlWZqtG1Hs May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Domain-Id: None May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Domain-Name: None May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Identity-Status: Confirmed May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Is-Admin-Project: True May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Openstack-Nova-Api-Version: 2.90 May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Domain-Id: default May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Domain-Name: Default May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Name: admin May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Role: reader,admin,member May 14 21:02:42.427184 ncdv-master-1 devstack@n-api.service[115036]: X-Roles: reader,admin,member May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_96a027574eeb4536a94751bde54cf3b1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant: admin May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant-Name: admin May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-User: admin May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-User-Domain-Id: default May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-User-Domain-Name: Default May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-User-Id: 9e6b0e25d0144f868beb29eb9540ea7e May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: X-User-Name: admin May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: method: > May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: exception: Flavor 42 could not be found. May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: action_args: {'id': '42'} May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:02:42.428899 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:42.430220 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:42.431750 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-112baeb9-f9d3-4872-bca9-1070d9db1bc7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:02:42.433099 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-112baeb9-f9d3-4872-bca9-1070d9db1bc7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063777 May 14 21:02:42.433099 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:02:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 21:02:42.438907 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-65931d30-aa3c-47ce-a180-c583b90e9f11 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:42.460417 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-65931d30-aa3c-47ce-a180-c583b90e9f11 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025721 May 14 21:02:42.460979 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:02:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:02:42.471355 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-f9efe356-e4b9-41ac-8c6e-c9d229895e51 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:42.492773 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-f9efe356-e4b9-41ac-8c6e-c9d229895e51 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025118 May 14 21:02:42.493324 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:02:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:02:42.503695 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-1d182270-b1dc-409a-b088-aee03be1f373 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:42.509263 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.wsgi [None req-1d182270-b1dc-409a-b088-aee03be1f373 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-1d182270-b1dc-409a-b088-aee03be1f373 admin admin] Request method failure captured: May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: Accept: application/json May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: Accept-Encoding: gzip, deflate May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: Connection: keep-alive May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: Content-Length: 0 May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: Host: 10.222.0.52 May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: Openstack-Api-Version: compute 2.90 May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: Openstack-System-Scope: None May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: User-Agent: python-novaclient May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Auth-Token: gAAAAABigBjytkwbNFkOv2suIt5Jh2_8RUknsHi8K8pLXpoNekhbEuvE55QmC9C0mzTEibMIcefW7qxpwSWDrBqU6ErZMkQ1T5shUl4TzCabF6zBspjouKtNNCMQqfaYnJq1ICFEMI3N5kqUQWWwKTLOKAV0jkM3Fxn8BpLweq9qpqlWZqtG1Hs May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Domain-Id: None May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Domain-Name: None May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Identity-Status: Confirmed May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Is-Admin-Project: True May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Openstack-Nova-Api-Version: 2.90 May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Domain-Id: default May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Domain-Name: Default May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Name: admin May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Role: reader,admin,member May 14 21:02:42.512515 ncdv-master-1 devstack@n-api.service[115037]: X-Roles: reader,admin,member May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_96a027574eeb4536a94751bde54cf3b1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant: admin May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant-Name: admin May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-User: admin May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-User-Domain-Id: default May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-User-Domain-Name: Default May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-User-Id: 9e6b0e25d0144f868beb29eb9540ea7e May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: X-User-Name: admin May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: method: > May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: exception: Flavor 42 could not be found. May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: action_args: {'id': '42'} May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:02:42.515041 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:42.516233 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:42.517524 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-1d182270-b1dc-409a-b088-aee03be1f373 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:02:42.518848 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-1d182270-b1dc-409a-b088-aee03be1f373 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014686 May 14 21:02:42.518848 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:02:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 21:02:43.406511 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-f9efe356-e4b9-41ac-8c6e-c9d229895e51 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:43.407585 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-f9efe356-e4b9-41ac-8c6e-c9d229895e51 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 14 21:02:43.407985 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:43.604701 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-20926a8f-1f3a-426d-b9c7-74ef44ea164d admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:43.610455 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.wsgi [None req-20926a8f-1f3a-426d-b9c7-74ef44ea164d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-20926a8f-1f3a-426d-b9c7-74ef44ea164d admin admin] Request method failure captured: May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: Accept: application/json May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: Accept-Encoding: gzip, deflate May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: Connection: keep-alive May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: Content-Length: 0 May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: Host: 10.222.0.52 May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: Openstack-Api-Version: compute 2.90 May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: Openstack-System-Scope: None May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: User-Agent: python-novaclient May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Auth-Token: gAAAAABigBjz0Ma3q6_xSKxA_IGlY14oBCCBkTqDY7akxwoGdxH_cqVbdyu_6hO-8pIWGRBotg58A2yJyBibr3U48ZtHUA3NVSYJV8-z0qg6mSjwdM47ZcQ166PTZKMHUDtSZZyPfh3E7vg1kZTcKAjvL5o13n2Ywo3UbLADaelNLt3m035enJ4 May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Domain-Id: None May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Domain-Name: None May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Identity-Status: Confirmed May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Is-Admin-Project: True May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Openstack-Nova-Api-Version: 2.90 May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Domain-Id: default May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Domain-Name: Default May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Name: admin May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Role: reader,admin,member May 14 21:02:43.613276 ncdv-master-1 devstack@n-api.service[115037]: X-Roles: reader,admin,member May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_96a027574eeb4536a94751bde54cf3b1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant: admin May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant-Name: admin May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-User: admin May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-User-Domain-Id: default May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-User-Domain-Name: Default May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-User-Id: 9e6b0e25d0144f868beb29eb9540ea7e May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: X-User-Name: admin May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: method: > May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: exception: Flavor 84 could not be found. May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: action_args: {'id': '84'} May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:02:43.615046 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:43.616120 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:43.617534 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-20926a8f-1f3a-426d-b9c7-74ef44ea164d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:02:43.618969 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-20926a8f-1f3a-426d-b9c7-74ef44ea164d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061820 May 14 21:02:43.618969 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:02:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 21:02:43.623605 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-053c3e03-9b5c-4a3d-a542-c0069b6f6d28 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:43.637446 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-053c3e03-9b5c-4a3d-a542-c0069b6f6d28 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018142 May 14 21:02:43.638671 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:02:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:02:43.647782 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-70cfd6f5-9d54-4154-bc23-8ea20017af2d admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:43.661511 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-70cfd6f5-9d54-4154-bc23-8ea20017af2d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017313 May 14 21:02:43.662065 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:02:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:02:43.672053 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d47cc014-9ea5-4d7b-9033-f6ba598f1149 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:43.677226 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.wsgi [None req-d47cc014-9ea5-4d7b-9033-f6ba598f1149 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d47cc014-9ea5-4d7b-9033-f6ba598f1149 admin admin] Request method failure captured: May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: Accept: application/json May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: Accept-Encoding: gzip, deflate May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: Connection: keep-alive May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: Content-Length: 0 May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: Host: 10.222.0.52 May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: Openstack-Api-Version: compute 2.90 May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: Openstack-System-Scope: None May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: User-Agent: python-novaclient May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Auth-Token: gAAAAABigBjz0Ma3q6_xSKxA_IGlY14oBCCBkTqDY7akxwoGdxH_cqVbdyu_6hO-8pIWGRBotg58A2yJyBibr3U48ZtHUA3NVSYJV8-z0qg6mSjwdM47ZcQ166PTZKMHUDtSZZyPfh3E7vg1kZTcKAjvL5o13n2Ywo3UbLADaelNLt3m035enJ4 May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Domain-Id: None May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Domain-Name: None May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Identity-Status: Confirmed May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Is-Admin-Project: True May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Openstack-Nova-Api-Version: 2.90 May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Domain-Id: default May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Domain-Name: Default May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Name: admin May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Role: reader,admin,member May 14 21:02:43.678711 ncdv-master-1 devstack@n-api.service[115036]: X-Roles: reader,admin,member May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_96a027574eeb4536a94751bde54cf3b1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant: admin May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant-Name: admin May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-User: admin May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-User-Domain-Id: default May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-User-Domain-Name: Default May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-User-Id: 9e6b0e25d0144f868beb29eb9540ea7e May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: X-User-Name: admin May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: method: > May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: exception: Flavor 84 could not be found. May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: action_args: {'id': '84'} May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:02:43.680337 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:43.681266 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:43.682442 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d47cc014-9ea5-4d7b-9033-f6ba598f1149 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:02:43.683527 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d47cc014-9ea5-4d7b-9033-f6ba598f1149 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012438 May 14 21:02:43.683527 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:02:43 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 14 21:02:44.586777 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-70cfd6f5-9d54-4154-bc23-8ea20017af2d admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:44.587833 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-70cfd6f5-9d54-4154-bc23-8ea20017af2d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 14 21:02:44.588241 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:44.792960 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-ec08e5b9-9993-4a7c-9ab5-8e7b920b2f8a admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:44.799790 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.wsgi [None req-ec08e5b9-9993-4a7c-9ab5-8e7b920b2f8a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-ec08e5b9-9993-4a7c-9ab5-8e7b920b2f8a admin admin] Request method failure captured: May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: Accept: application/json May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: Accept-Encoding: gzip, deflate May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: Connection: keep-alive May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: Content-Length: 0 May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: Host: 10.222.0.52 May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: Openstack-Api-Version: compute 2.90 May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: Openstack-System-Scope: None May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: User-Agent: python-novaclient May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Auth-Token: gAAAAABigBj0PVGuiEwsBJqWs4taVZ9nDs4mrq88i68nxdjhLyzMurKlzABtFRkgiuN6InMTjHN3bEuPbP6A-IkK9_XuIaqKt3zHuxVCGSmbCYB9uJo3g-65qwDTZB0NHcz4hs2clxHxsNLO7UyrlZujdA-4zJN2OtOHIzTS5rwcoNvFSC_KqjY May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Domain-Id: None May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Domain-Name: None May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Identity-Status: Confirmed May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Is-Admin-Project: True May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Openstack-Nova-Api-Version: 2.90 May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Domain-Id: default May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Domain-Name: Default May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Project-Name: admin May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Role: reader,admin,member May 14 21:02:44.801210 ncdv-master-1 devstack@n-api.service[115036]: X-Roles: reader,admin,member May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_96a027574eeb4536a94751bde54cf3b1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant: admin May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-Tenant-Name: admin May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-User: admin May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-User-Domain-Id: default May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-User-Domain-Name: Default May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-User-Id: 9e6b0e25d0144f868beb29eb9540ea7e May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: X-User-Name: admin May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: method: > May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: exception: Flavor 451 could not be found. May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: action_args: {'id': '451'} May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:02:44.802570 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:44.803443 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: ERROR nova.api.openstack.wsgi May 14 21:02:44.805008 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-ec08e5b9-9993-4a7c-9ab5-8e7b920b2f8a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:02:44.806341 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-ec08e5b9-9993-4a7c-9ab5-8e7b920b2f8a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060966 May 14 21:02:44.806341 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:02:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 21:02:44.812232 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-8b9d43f7-e05c-49c7-b8b0-b2b64b395540 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:44.826140 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-8b9d43f7-e05c-49c7-b8b0-b2b64b395540 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017536 May 14 21:02:44.826664 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:02:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:02:44.836056 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:44.850438 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017869 May 14 21:02:44.850949 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:02:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:02:44.861122 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-ab86203d-54e5-40e6-899b-0977d8507db6 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:44.866241 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.wsgi [None req-ab86203d-54e5-40e6-899b-0977d8507db6 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-ab86203d-54e5-40e6-899b-0977d8507db6 admin admin] Request method failure captured: May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: Accept: application/json May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: Accept-Encoding: gzip, deflate May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: Connection: keep-alive May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: Content-Length: 0 May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: Host: 10.222.0.52 May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: Openstack-Api-Version: compute 2.90 May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: Openstack-System-Scope: None May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: User-Agent: python-novaclient May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Auth-Token: gAAAAABigBj0PVGuiEwsBJqWs4taVZ9nDs4mrq88i68nxdjhLyzMurKlzABtFRkgiuN6InMTjHN3bEuPbP6A-IkK9_XuIaqKt3zHuxVCGSmbCYB9uJo3g-65qwDTZB0NHcz4hs2clxHxsNLO7UyrlZujdA-4zJN2OtOHIzTS5rwcoNvFSC_KqjY May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Domain-Id: None May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Domain-Name: None May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Identity-Status: Confirmed May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Is-Admin-Project: True May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Openstack-Nova-Api-Version: 2.90 May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Domain-Id: default May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Domain-Name: Default May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Project-Name: admin May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Role: reader,admin,member May 14 21:02:44.867756 ncdv-master-1 devstack@n-api.service[115037]: X-Roles: reader,admin,member May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/96a027574eeb4536a94751bde54cf3b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_96a027574eeb4536a94751bde54cf3b1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant: admin May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant-Id: 96a027574eeb4536a94751bde54cf3b1 May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-Tenant-Name: admin May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-User: admin May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-User-Domain-Id: default May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-User-Domain-Name: Default May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-User-Id: 9e6b0e25d0144f868beb29eb9540ea7e May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: X-User-Name: admin May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: method: > May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: exception: Flavor 451 could not be found. May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: action_args: {'id': '451'} May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:02:44.869394 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:44.870339 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: ERROR nova.api.openstack.wsgi May 14 21:02:44.871406 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-ab86203d-54e5-40e6-899b-0977d8507db6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:02:44.873451 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-ab86203d-54e5-40e6-899b-0977d8507db6 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012615 May 14 21:02:44.874041 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:02:44 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 14 21:02:45.785311 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:45.786300 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 May 14 21:02:45.786688 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:02:45.984810 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-3c8c2aeb-e1e0-4f61-9bf6-4cbd13eb42f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:46.081970 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-3c8c2aeb-e1e0-4f61-9bf6-4cbd13eb42f1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.148377 May 14 21:02:46.082406 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Sat May 14 21:02:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:02:46.995913 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:46.996920 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 14 21:02:46.997348 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:47.192363 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-d4473abb-99de-4f33-b606-d4526e535f74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:47.287916 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-d4473abb-99de-4f33-b606-d4526e535f74 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.146936 May 14 21:02:47.288389 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Sat May 14 21:02:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:02:48.188658 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:48.189674 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 14 21:02:48.190084 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:48.387740 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-3576bec4-adbe-49b2-8f1f-280121397fe4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:48.477698 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-3576bec4-adbe-49b2-8f1f-280121397fe4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.141207 May 14 21:02:48.478172 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Sat May 14 21:02:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:02:49.387049 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:49.388082 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 14 21:02:49.389590 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:49.585702 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-9985ea54-3498-4678-9fa5-99ae0f6a2406 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:02:49.701754 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-9985ea54-3498-4678-9fa5-99ae0f6a2406 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.166992 May 14 21:02:49.702249 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Sat May 14 21:02:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:02:50.609013 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:50.610034 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 14 21:02:50.610431 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:02:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:02:50.811184 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-15d183a2-c36d-480e-a36b-9c528c8b4941 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:02:50.830949 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-15d183a2-c36d-480e-a36b-9c528c8b4941 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071563 May 14 21:02:50.831398 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Sat May 14 21:02:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:03:55.777017 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:03:55.778650 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-d0dc8bef-2691-40ec-8278-2f4808916c01 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 May 14 21:03:55.779061 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 930 bytes} [Sat May 14 21:03:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:03:55.835804 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-902eb1b6-82d5-4770-a31b-50c508af77f7 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:03:55.855422 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-902eb1b6-82d5-4770-a31b-50c508af77f7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070292 May 14 21:03:55.856373 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:03:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:03:55.879149 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-0de3b734-73f1-4377-a912-022319a036dd admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:03:55.886662 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-0de3b734-73f1-4377-a912-022319a036dd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011990 May 14 21:03:55.887820 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1282 bytes} [Sat May 14 21:03:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:03:55.899196 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-111190f9-c638-4fe4-be34-8c78b54c957f admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:03:55.906716 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-111190f9-c638-4fe4-be34-8c78b54c957f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011431 May 14 21:03:55.907232 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1285 bytes} [Sat May 14 21:03:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:03:55.917960 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-58236725-279d-44d8-a967-cf48a3a7c3ae admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:03:55.925698 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-58236725-279d-44d8-a967-cf48a3a7c3ae admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011251 May 14 21:03:55.926232 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1285 bytes} [Sat May 14 21:03:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:03:55.939313 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-851ae417-a865-4b21-b5f2-4eefd39e4bc7 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:03:55.946953 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-851ae417-a865-4b21-b5f2-4eefd39e4bc7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011252 May 14 21:03:55.947465 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1282 bytes} [Sat May 14 21:03:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:09:55.092093 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-58236725-279d-44d8-a967-cf48a3a7c3ae admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:09:55.093101 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-58236725-279d-44d8-a967-cf48a3a7c3ae admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 May 14 21:09:55.093500 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:09:55.366341 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-4ae5832b-3815-4e07-895c-725c3e2b3c18 admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:09:55.367645 ncdv-master-1 devstack@n-api.service[115037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:09:55.367645 ncdv-master-1 devstack@n-api.service[115037]: warnings.warn(msg) May 14 21:09:55.368884 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-4ae5832b-3815-4e07-895c-725c3e2b3c18 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:09:55.369320 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-4ae5832b-3815-4e07-895c-725c3e2b3c18 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:09:55.370115 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-4ae5832b-3815-4e07-895c-725c3e2b3c18 admin admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:09:55.370563 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-4ae5832b-3815-4e07-895c-725c3e2b3c18 admin admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:09:55.411089 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-4ae5832b-3815-4e07-895c-725c3e2b3c18 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.156376 May 14 21:09:55.411676 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:09:55 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:09:56.308497 ncdv-master-1 devstack@n-api.service[115036]: DEBUG nova.api.openstack.wsgi [None req-58236725-279d-44d8-a967-cf48a3a7c3ae admin admin] Calling method '>' {{(pid=115036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:09:56.309501 ncdv-master-1 devstack@n-api.service[115036]: INFO nova.api.openstack.requestlog [None req-58236725-279d-44d8-a967-cf48a3a7c3ae admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 May 14 21:09:56.309895 ncdv-master-1 devstack@n-api.service[115036]: [pid: 115036|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Sat May 14 21:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:09:56.505140 ncdv-master-1 devstack@n-api.service[115037]: DEBUG nova.api.openstack.wsgi [None req-d4cbec96-6269-4eb8-a878-557fd6d3592f admin admin] Calling method '>' {{(pid=115037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:09:56.506382 ncdv-master-1 devstack@n-api.service[115037]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:09:56.506382 ncdv-master-1 devstack@n-api.service[115037]: warnings.warn(msg) May 14 21:09:56.507628 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-d4cbec96-6269-4eb8-a878-557fd6d3592f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:09:56.508064 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-d4cbec96-6269-4eb8-a878-557fd6d3592f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:09:56.515249 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-d4cbec96-6269-4eb8-a878-557fd6d3592f admin admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:09:56.515249 ncdv-master-1 devstack@n-api.service[115037]: DEBUG oslo_concurrency.lockutils [None req-d4cbec96-6269-4eb8-a878-557fd6d3592f admin admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:09:56.541948 ncdv-master-1 devstack@n-api.service[115037]: INFO nova.api.openstack.requestlog [None req-d4cbec96-6269-4eb8-a878-557fd6d3592f admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.088214 May 14 21:09:56.542196 ncdv-master-1 devstack@n-api.service[115037]: [pid: 115037|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:09:56 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:10:40.573906 ncdv-master-1 devstack@n-api.service[115035]: Sat May 14 21:10:40 2022 - graceful shutdown triggered... May 14 21:10:40.574462 ncdv-master-1 devstack@n-api.service[115036]: Gracefully killing worker 1 (pid: 115036)... May 14 21:10:40.574032 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... May 14 21:10:40.575320 ncdv-master-1 devstack@n-api.service[115037]: Gracefully killing worker 2 (pid: 115037)... May 14 21:10:41.575034 ncdv-master-1 devstack@n-api.service[115035]: worker 1 buried after 1 seconds May 14 21:10:41.575034 ncdv-master-1 devstack@n-api.service[115035]: worker 2 buried after 1 seconds May 14 21:10:41.575034 ncdv-master-1 devstack@n-api.service[115035]: goodbye to uWSGI. May 14 21:10:41.576633 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. May 14 21:10:41.577258 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. May 14 21:10:41.580069 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 14 21:10:41.609474 ncdv-master-1 devstack@n-api.service[130631]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 14 21:10:41 2022] *** May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: nodename: ncdv-master-1 May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: machine: x86_64 May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: clock source: unix May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: pcre jit disabled May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: detected number of CPU cores: 4 May 14 21:10:41.611502 ncdv-master-1 devstack@n-api.service[130631]: current working directory: / May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: detected binary path: /usr/bin/uwsgi-core May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: your processes number limit is 47680 May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: your memory page size is 4096 bytes May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: detected max file descriptor number: 2048 May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: lock engine: pthread robust mutexes May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: thunder lock: enabled May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 14 21:10:41.612451 ncdv-master-1 devstack@n-api.service[130631]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 14 21:10:41.663760 ncdv-master-1 devstack@n-api.service[130631]: Python main interpreter initialized at 0x5581af1a59c0 May 14 21:10:41.663760 ncdv-master-1 devstack@n-api.service[130631]: python threads support enabled May 14 21:10:41.663760 ncdv-master-1 devstack@n-api.service[130631]: your server socket listen backlog is limited to 100 connections May 14 21:10:41.663760 ncdv-master-1 devstack@n-api.service[130631]: your mercy for graceful operations on workers is 90 seconds May 14 21:10:41.664183 ncdv-master-1 devstack@n-api.service[130631]: mapped 403077 bytes (393 KB) for 2 cores May 14 21:10:41.664183 ncdv-master-1 devstack@n-api.service[130631]: *** Operational MODE: preforking *** May 14 21:10:41.664417 ncdv-master-1 devstack@n-api.service[130631]: *** uWSGI is running in multiple interpreter mode *** May 14 21:10:41.664417 ncdv-master-1 devstack@n-api.service[130631]: spawned uWSGI master process (pid: 130631) May 14 21:10:41.664634 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 14 21:10:41.665302 ncdv-master-1 devstack@n-api.service[130631]: spawned uWSGI worker 1 (pid: 130637, cores: 1) May 14 21:10:41.667515 ncdv-master-1 devstack@n-api.service[130631]: spawned uWSGI worker 2 (pid: 130638, cores: 1) May 14 21:10:41.667515 ncdv-master-1 devstack@n-api.service[130631]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 14 21:10:42.973291 ncdv-master-1 devstack@n-api.service[130637]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 21:10:42.978310 ncdv-master-1 devstack@n-api.service[130638]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 14 21:10:43.799060 ncdv-master-1 devstack@n-api.service[130637]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:10:43.799060 ncdv-master-1 devstack@n-api.service[130637]: from cryptography.utils import int_from_bytes May 14 21:10:43.799371 ncdv-master-1 devstack@n-api.service[130637]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:10:43.799371 ncdv-master-1 devstack@n-api.service[130637]: from cryptography.utils import int_from_bytes May 14 21:10:43.800302 ncdv-master-1 devstack@n-api.service[130638]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:10:43.800302 ncdv-master-1 devstack@n-api.service[130638]: from cryptography.utils import int_from_bytes May 14 21:10:43.800768 ncdv-master-1 devstack@n-api.service[130638]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 14 21:10:43.800768 ncdv-master-1 devstack@n-api.service[130638]: from cryptography.utils import int_from_bytes May 14 21:10:46.303125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 21:10:46.303720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 21:10:46.303984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 21:10:46.304196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 14 21:10:46.304584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 21:10:46.304666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 14 21:10:46.304759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 21:10:46.304979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.305133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 14 21:10:46.305317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.305427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 14 21:10:46.305631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 14 21:10:46.305749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.305974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.306082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.306320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.306424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.306647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.306757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.306989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.307101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.307322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.307426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.307693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.307802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.307968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.308078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.308337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.308448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.308642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.308755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.308954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.309133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.309290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.309450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.309608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.309763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.309924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.310079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.310227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.310390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.310549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.310737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.310907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.311062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.311230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.311391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.312887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.313142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.313371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.313594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.313829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.314176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.314416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.314655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.314880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.316341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.316612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.316841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.317066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.317288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.317510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.317738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.317962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.318186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.318412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.318634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.318869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.319122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.319334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.319573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.319573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.319922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.320239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.320953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.321117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.321269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.321429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.321589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.321741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.322312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.322481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.322633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.322793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.323605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.323820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.323983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.324134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.324296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.324455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.324977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.325138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.325311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.326313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.326474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.326717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.326876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.327026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.327174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.327352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.327572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.327741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.327901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.328556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.328719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.328882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.328882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.329191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.329348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.329498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.329656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.329815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.329973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.330122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.330122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.330423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.330423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.330723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.330967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.331156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.331307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.331457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.331656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.331823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.332010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.332371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.332371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.332676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.332676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.333000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.333151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.333307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.333457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.333615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.333781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.333930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.334079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.334234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.334382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.334538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.334706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.334873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.335030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.335186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.335333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.335509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.336207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.336474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.336746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.336909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.336909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.337201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.337201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.337513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.337671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.337828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.337986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.338143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.338302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.338459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.338615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.338772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.338930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.339090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.339238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.339397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.339612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.339816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.339976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.340139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.340289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.340445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.340593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.340752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.340906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.341066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.341215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.341370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.341525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.341685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.341840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.342002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.342151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.342537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.342702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.342860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.343025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.343175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.343332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.343509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.343725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.343879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.344052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.344210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.344359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.344514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.344669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.344817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.344981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.345138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.345288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.345437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.345586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.346209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.346619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.346895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.347060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.347222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.347414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.347614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.347780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.348028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.348192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.348344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.348494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.348651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.348800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.348960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.349119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.349267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.349423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.349583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.349743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.349891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.350049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.350205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.350353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.350502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.350650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.350813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.350991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.351141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.351289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.351453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.351641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.351800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.351956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.352116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.352270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.352658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.352829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.352987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.353137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.353302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.353451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.353623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.353772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.353928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.354085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.354245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.354410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.354410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.354692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.354848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.355007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.355162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.355336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.355581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.355748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.356375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.356535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.356798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.356963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.356963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.357367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.357518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.357666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.357815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.357984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.358141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.358297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.358535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.358696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.358928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.359088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.359237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.359385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.359551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.359719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.359881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.360030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.360198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.360953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.361140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.361299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.361464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.361624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.361782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 14 21:10:46.361940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.362859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.363033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.363196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.363354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.363552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.363731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.363881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.364039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.364195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.364345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.364685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.364855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.365012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.365175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.365332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.365481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.365638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.365807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.366481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.366653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.366940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.367097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.367388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.367579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.367754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.367916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.368082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.368241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.368391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.368538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.368698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.368862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.369011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.369168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.369330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.369487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.369642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.369806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.369961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.370118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.370275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.370432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.370593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.370764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.370917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.371066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.371222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.371370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.371549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.371723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.371873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.372029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.372177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.372333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.372498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.372674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.373078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.373238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.373395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.373545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.373702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.373849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.373996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.374151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.374299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.374453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.374613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.374761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.374761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.375058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.375215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.375371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.375556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.375713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.375862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.376018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.376646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.376805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.377085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.377250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.377511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.377749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.377919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.378079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.378237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.378395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.378552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.378701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.378866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.379033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.379181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.379328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.379677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.379855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.380025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.380453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.380615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.380765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.380921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.381082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.381239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.381403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.381551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.381707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.381857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.382082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.382259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.382408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.382556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.382711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.383103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.383263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.383429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.383601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.383751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.383899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.384048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.384206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.384365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.384533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.384683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.384846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.385004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.385004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.385004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.385004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.385581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.385731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.385731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.386038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.386197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.386782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.386957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.387128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.387384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.387585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.387847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.388001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.388160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.388310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.388466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.388632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.388780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.388929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.389088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.389238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.389395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.389558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.389852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.390030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.390182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.390340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.390559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.390718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.390882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.391594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.392433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.392433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.392716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.392872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.393787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.393995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.394172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.394329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.394480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.394629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.394778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.394936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.395093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.395093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.395386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.395563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.395718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.395877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.396027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.396190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.396346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.396346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.397102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.397262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.397432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.397692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.397864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.398112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.398265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.398425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.398584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.398755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.398912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.399061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.399220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.399377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.399587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.399748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.399896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.400053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.400216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.400374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.400530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.400688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.400857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.401015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.401179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.401336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.401495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.401644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.401794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.401943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.402101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.402101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.402404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.402560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.402717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.402891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.403046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.403399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.403575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.403737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.403888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.404050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.404281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.404281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.404591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.404591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.404886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.405057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.405057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.405365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.405520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.405675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.405839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.406010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.406166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.406322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.406692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.407198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.407364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.407552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.407738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.408003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.408269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.408441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.408687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.408883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.409152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.409316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.409621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.409800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.409967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.409967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.409967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.410407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.410579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.410743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.410909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.411112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.411320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.411498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.411677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.411834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.412000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.412236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.412494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.412759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.413033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.413623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.413861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.414038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.414205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.414426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.414686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.414686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.415195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.415462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.415779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.416035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.416304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.416590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.417264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.417437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.417607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.417766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.417929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.418294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.418689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.418944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.419195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.419465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.419760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.419934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.420103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.420259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.420422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.420586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.420586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.420903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.421059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.421214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.421368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.421538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.421708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.421864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.422019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.422184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.422339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.422494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.422658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.422815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.422979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.423187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.423358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.423358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.424005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.424005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.424304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.424499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.424674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.425039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.425365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.425558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.425891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.426094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.426255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.426421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.426578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.426733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.426733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.427555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.427747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.427747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.428147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.428432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.428604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.428891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.429053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.429221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.429377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.429532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.429687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.429842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.430011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.430181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.430336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.430499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.430655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.430817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.430982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.431139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.431293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.431447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.431625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.431781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.431961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.432127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.432341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.432509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.432666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.432821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.432992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.433148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.433304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.433467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.433467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.434010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.434173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.434339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.434503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.434677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.434832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.434998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.435154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.435309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.435494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.435669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.435825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.435993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.436148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.436323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.436488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.436655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.436810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.436974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.438117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.438297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.438490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.438739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.438919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.439174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.439355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.439587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.439764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.439963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.440654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.440827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.441150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.441306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.441306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.441619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.441775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.441936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.442096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.442266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.442429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.442584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.442748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.442923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.443080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.443244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.443407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.443587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.443746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.444116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.444282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.444464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.444743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.444929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.445099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.445279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.445435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.445605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.446406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.446578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.446744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.446902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.447066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.447224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.447430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.447667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.447667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.448642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.448948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.449215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.449407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.449685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.449859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.450026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.450192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.450361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.450530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.450697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.450863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.451021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.451199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.451373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.451549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.451727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.451894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.452062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.452221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.452393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.452558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.452724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.452898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.453063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.453236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.453411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.453569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.453733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.453890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.454295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.454480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.454639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.454803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.454961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.454961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.455274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.455503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.455669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.455896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.456566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.456724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.457680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.457855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.458839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.459143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.459320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.459544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.459739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.460071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.460071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.460407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.460577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.460753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.460934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.461087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.461238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.461449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.461601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.461753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.461913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.462058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.462209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.462363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.462520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.462684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.462829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.462983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.463131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.463131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.463414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.463595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.463752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.463909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.464064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.464252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.464504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.464675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.464834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.464990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.465143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.465300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.465455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.465677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.465825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.465825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.466111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.466262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.466424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.466569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.466731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.466884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.467030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.467187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.467346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.467544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.467702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.467851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.467995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.468955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.469892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.470942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.471960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.472951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.473957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.474943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.475921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.476952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.477958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.478956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.479993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.480953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.481915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.482916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.483875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.484920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.485974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.486098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.486214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.486338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.486480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.486608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.486725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.486944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.487092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.487216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.487347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.487514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.487668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.487786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.487902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.488950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.489074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.489190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.489305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.489430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.489553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.489817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.489958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.490951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.491987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.492845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.493912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.494910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.495990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.496985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.497995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.498920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.499966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.500985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.501958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.502072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.502196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.502312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.502429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.502560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.503989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.504894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.505931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.506915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.507967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.508985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.509990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.510912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.511920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.512975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.513986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.514199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.514307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.514525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.514632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.514855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.514960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.515182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.515286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.515525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.515647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.515852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.515950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.516180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.516277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.516507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.516613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.516831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.516941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.517155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.517253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.517482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.517593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.517809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.517905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.518146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.518312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.518568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.518678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.518893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.518990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.519219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.519327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.519566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.519678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.519896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.520120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.520427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.520524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.520758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.520856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.521105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.521204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.521474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.521630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.521787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.521922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.522181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.522453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.522778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.522874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.523104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.523219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.523454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.523612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.523787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.523993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.524111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.524327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.524431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.524654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.524741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.524978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.525065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.525299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.525408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.525765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.526093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.526416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.526752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.526914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.527065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.527231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.527447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.527672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.527820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.527992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.528146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.528326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.528500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.528669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.528774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.529013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.529109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.529345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.529456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.529668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.529773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.530008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.530111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.530330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.530442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.530651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.530748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.530977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.531084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.531299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.531408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.531656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.531982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.532313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.532668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.532825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.533007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.533105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.533330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.533531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.533662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.534387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.534526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.534633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.534831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.534929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.535173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.535332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.535537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.535713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.535855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.536221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.536321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.536554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.536665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.536961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.537110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.537299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.537464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.537625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.537802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.537951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.538155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.538276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.538506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.538603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.538832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.538928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.539156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.539271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.539610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.539723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.539846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.539969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.540176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.540284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.540511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.540622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.540841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.540945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.541169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.541275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.541495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.541600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.541822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.541925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.542147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.542257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.542475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.542588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.542796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.542901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.543119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.543229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.543445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.543564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.543798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.543894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.544129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.544224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.544476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.544623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.544810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.545027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.545134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.545379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.545523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.545716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.545848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.546064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.546179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.546404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.546499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.546723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.546817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.547045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.547149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.547378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.547584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.547754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.547851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.548080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.548178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.548400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.548501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.548721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.548845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.549045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.549174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.549368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.550080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.550441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.550607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.550771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.550869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.551114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.551248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.551436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.551603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.551787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.551885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.552114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.552210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.552438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.552553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.552770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.552866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.553124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.553273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.553458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.553557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.553789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.553895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.554112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.554221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.554436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.554534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.554797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.554914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.555085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.555182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.555407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.555528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.555761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.555858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.556084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.556193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.556405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.556502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.556731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.556831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.557045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.557151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.557361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.557487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.557681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.557810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.558003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.558141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.558327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.558474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.558645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.558796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.559005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.559152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.559261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.559455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.559607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.559802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.559943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.560136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.560272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.560466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.560601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.560832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.560973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.561131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.561262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.561452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.561577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.561774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.561908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.562093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.562218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.562415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.562546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.562733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.562956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.563087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.563204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.563426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.563780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.563986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.564121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.564327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.564451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.564652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.564784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.564975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.565131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.565344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.565646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.565785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.565976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.566177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.566304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.566430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.566602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.566734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.566966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.567081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.567300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.567398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.567641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.567738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.568016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.568182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.568284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.568374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.568582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.568721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.568899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.569016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.569218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.569316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.569606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.569728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.569922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.570027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.570238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.570344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.570596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.570703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.570918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.571023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.571266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.571360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.571698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.571831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.571948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.572093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.572281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.572435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.572612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.572725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.572947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.573087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.573556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.573674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.573756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.573843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.573927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.574001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.574248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.574372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.574574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.574681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.574914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.575010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.575236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.575331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.575601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.575703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.575931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.576044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.576621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.576724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.576845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.576929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.577011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.577087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.577215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.577325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.577559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.577666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.577818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130637) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 21:10:46.577905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.578208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.578563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.578876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.579207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.579564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.579909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.580336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.580551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.580907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.581257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.581583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.581911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.582258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.582581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.582922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.583246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.583616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.583960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.584322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.584649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.585006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.585349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.585676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.586075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.586402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 14 21:10:46.586659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130638) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 14 21:10:46.601864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_db.sqlalchemy.engines [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:46.612038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_db.sqlalchemy.engines [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:46.668438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.context [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=130637) load_cells /opt/stack/nova/nova/context.py:464}} May 14 21:10:46.679395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:10:46.679395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:10:46.679395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:10:46.679395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:10:46.688047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.context [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=130638) load_cells /opt/stack/nova/nova/context.py:464}} May 14 21:10:46.691596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_db.sqlalchemy.engines [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:46.692884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:10:46.693425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_db.sqlalchemy.engines [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:46.694639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:10:46.695464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:10:46.697498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:10:46.709785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_db.sqlalchemy.engines [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:46.711260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_db.sqlalchemy.engines [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:46.864790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_db.sqlalchemy.engines [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130637) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:46.881931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_db.sqlalchemy.engines [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130638) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 14 21:10:47.196228 ncdv-master-1 devstack@n-api.service[130637]: WARNING keystonemiddleware.auth_token [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:10:47.203846 ncdv-master-1 devstack@n-api.service[130637]: WARNING keystonemiddleware.auth_token [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:10:47.204350 ncdv-master-1 devstack@n-api.service[130638]: WARNING keystonemiddleware.auth_token [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:10:47.212063 ncdv-master-1 devstack@n-api.service[130638]: WARNING keystonemiddleware.auth_token [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:10:47.556217 ncdv-master-1 devstack@n-api.service[130637]: WARNING keystonemiddleware.auth_token [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:10:47.560616 ncdv-master-1 devstack@n-api.service[130638]: WARNING keystonemiddleware.auth_token [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 14 21:10:47.563137 ncdv-master-1 devstack@n-api.service[130637]: WARNING keystonemiddleware.auth_token [None req-e06e7203-dcb4-49c5-837b-b2cb38d46aa3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:10:47.567501 ncdv-master-1 devstack@n-api.service[130638]: WARNING keystonemiddleware.auth_token [None req-b5c6024a-0536-44f8-a94e-0639813e8807 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 14 21:10:47.569030 ncdv-master-1 devstack@n-api.service[130637]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581af1a59c0 pid: 130637 (default app) May 14 21:10:47.572925 ncdv-master-1 devstack@n-api.service[130638]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581af1a59c0 pid: 130638 (default app) May 14 21:11:37.618780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Calling method '.version_select at 0x7fb1b6609310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:37.621718 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:37.621718 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:37.628891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2022908765", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:37.629460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=130637) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 14 21:11:37.629991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:37.630697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:37.670384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:37.671313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:37.688877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:37.690053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:37.699612 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e23c011a-9416-487c-94b5-ba9c742c813b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.512018 May 14 21:11:37.700387 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1207 bytes} [Sat May 14 21:11:36 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:11:37.834276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e475a16-b88d-4ef1-a495-0fef28a25de9 tempest-AZAdminNegativeTestJSON-1358219151 tempest-AZAdminNegativeTestJSON-1358219151-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:37.835689 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:37.835689 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:37.836842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e475a16-b88d-4ef1-a495-0fef28a25de9 tempest-AZAdminNegativeTestJSON-1358219151 tempest-AZAdminNegativeTestJSON-1358219151-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '187b7fcb1e2a40ebaa484ad813116e67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ef6150a042b4fb0be291048656e5e9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e475a16-b88d-4ef1-a495-0fef28a25de9 tempest-AZAdminNegativeTestJSON-1358219151 tempest-AZAdminNegativeTestJSON-1358219151-project] Request method failure captured: May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsFHTuYwWn2J3bIObNeCcqpW_Dh-4zA42M58dOTWG1lFRsl0r-jlibuxp56ChDOlM74uURnHOQmXCxsEY0Ex7iQtvQbkZXJ4OVLLzlp-GVw8-0LwDVdNz8XXnIcid8hivjDcNYtBbSzeVdJgSN1ipJvw32U24fG0komfKgpK6XMf4o May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 6ef6150a042b4fb0be291048656e5e9c May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1358219151 May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:11:37.840704 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ef6150a042b4fb0be291048656e5e9c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6ef6150a042b4fb0be291048656e5e9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6ef6150a042b4fb0be291048656e5e9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6ef6150a042b4fb0be291048656e5e9c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AZAdminNegativeTestJSON-1358219151 May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 6ef6150a042b4fb0be291048656e5e9c May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1358219151 May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AZAdminNegativeTestJSON-1358219151-project May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 187b7fcb1e2a40ebaa484ad813116e67 May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AZAdminNegativeTestJSON-1358219151-project May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 14 21:11:37.842006 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:11:37.842629 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 14 21:11:37.843774 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:37.845557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e475a16-b88d-4ef1-a495-0fef28a25de9 tempest-AZAdminNegativeTestJSON-1358219151 tempest-AZAdminNegativeTestJSON-1358219151-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:11:37.846759 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e475a16-b88d-4ef1-a495-0fef28a25de9 tempest-AZAdminNegativeTestJSON-1358219151 tempest-AZAdminNegativeTestJSON-1358219151-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.145259 May 14 21:11:37.847821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2/2] 10.222.0.52 () {58 vars in 1184 bytes} [Sat May 14 21:11:37 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 147 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:11:37.991369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:11:38.068077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59ad8180-589f-4c0e-9008-1954c88124e1 tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-771150040", "id": 2122287652, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:38.086332 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:38.086332 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:38.165068 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59ad8180-589f-4c0e-9008-1954c88124e1 tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.315657 May 14 21:11:38.165661 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3/3] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:11:37 2022] POST /compute/v2.1/flavors => generated 470 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:38.361846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c52b3931-eaec-414b-8be3-5aa46526ffef tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:38.364136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c52b3931-eaec-414b-8be3-5aa46526ffef tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:38.364587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c52b3931-eaec-414b-8be3-5aa46526ffef tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:38.365573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c52b3931-eaec-414b-8be3-5aa46526ffef tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:38.366371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c52b3931-eaec-414b-8be3-5aa46526ffef tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:38.407963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:11:38.408597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:11:38.409406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:11:38.410340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:11:38.410921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:11:38.436019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:38.436772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:38.437608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:38.438479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:38.463166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c52b3931-eaec-414b-8be3-5aa46526ffef tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.296082 May 14 21:11:38.464159 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1163 bytes} [Sat May 14 21:11:38 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:11:38.537269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Getting quotas for project 313d5b39fe10417993b28718eb6e6f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:11:38.557033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Getting quotas for user 7d7d10a70c364505af3b2b8294238615 and project 313d5b39fe10417993b28718eb6e6f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:11:38.595834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:11:38.601870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:11:38.821625 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7f69173b-538e-4549-aaee-50ff46a5bd4d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.390541 May 14 21:11:38.823022 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1/5] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:11:38.841929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '.version_select at 0x7fb1b645a1f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:38.843174 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:38.843174 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:38.844964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:38.845647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:38.869819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:38.876618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:38.903274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:38.903984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:38.932818 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffdb1bad-b995-4f5e-98a1-053b5ca7252f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.467339 May 14 21:11:38.939703 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 5/6] 10.222.0.52 () {58 vars in 1166 bytes} [Sat May 14 21:11:38 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:38.950932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a9f99e24-b973-4aaf-9eab-6fc964b2d75a tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-467592123"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:38.954185 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:38.954185 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:38.956269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.aggregate [None req-a9f99e24-b973-4aaf-9eab-6fc964b2d75a tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Generated uuid 8c71762d-ab8a-4a65-9f4a-becf6aa512a3 for aggregate {{(pid=130637) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:11:38.999337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c9d5a7eb-811c-4212-9959-681a489411f3 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1947551402", "id": 210690328, "os-flavor-access:is_public": "True"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:39.001963 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.001963 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:39.108716 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c9d5a7eb-811c-4212-9959-681a489411f3 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.283977 May 14 21:11:39.109815 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2/7] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:38 2022] POST /compute/v2.1/flavors => generated 427 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:39.116371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-149c5afe-6b4c-4db0-9afa-873555337dbb tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:39.118711 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.118711 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:39.145364 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a9f99e24-b973-4aaf-9eab-6fc964b2d75a tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.201593 May 14 21:11:39.146310 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 6/8] 10.222.0.52 () {62 vars in 1204 bytes} [Sat May 14 21:11:38 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:39.155033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e029b03d-0a7b-4912-8c9d-8a30df69a4d0 tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:39.156025 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.156025 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:39.157167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e029b03d-0a7b-4912-8c9d-8a30df69a4d0 tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:39.158989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e029b03d-0a7b-4912-8c9d-8a30df69a4d0 tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:39.160387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e029b03d-0a7b-4912-8c9d-8a30df69a4d0 tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:39.160833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e029b03d-0a7b-4912-8c9d-8a30df69a4d0 tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:39.192697 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e029b03d-0a7b-4912-8c9d-8a30df69a4d0 tempest-AZAdminV2TestJSON-1739827462 tempest-AZAdminV2TestJSON-1739827462-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.045176 May 14 21:11:39.193533 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 7/9] 10.222.0.52 () {58 vars in 1184 bytes} [Sat May 14 21:11:39 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:39.205768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c28b1aff-3d2e-4e4c-aff9-25bc0c1b3518 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:39.206663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c28b1aff-3d2e-4e4c-aff9-25bc0c1b3518 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:39.548289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-149c5afe-6b4c-4db0-9afa-873555337dbb tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2122287652/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.435899 May 14 21:11:39.548289 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3/10] 10.222.0.52 () {62 vars in 1264 bytes} [Sat May 14 21:11:39 2022] POST /compute/v2.1/flavors/2122287652/os-extra_specs => generated 62 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:39.560101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-90a8639d-330d-4743-a7e7-3cb1027e2b53 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:39.561521 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.561521 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:39.608580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c28b1aff-3d2e-4e4c-aff9-25bc0c1b3518 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:39.628075 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c28b1aff-3d2e-4e4c-aff9-25bc0c1b3518 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1220 microversion: 2.1 time: 0.432600 May 14 21:11:39.629590 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 8/11] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:39 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1220 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:39.636431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4196f572-4856-4796-9ce6-561b4a6bed4b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-145050670"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:39.685828 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-90a8639d-330d-4743-a7e7-3cb1027e2b53 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/210690328" status: 202 len: 0 microversion: 2.1 time: 0.136642 May 14 21:11:39.686452 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 4/12] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:11:39 2022] DELETE /compute/v2.1/flavors/210690328 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:39.697243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2cbc5cc7-c887-4011-af28-723abbac23f4 tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:39.750994 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.750994 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:39.847518 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2cbc5cc7-c887-4011-af28-723abbac23f4 tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2122287652" status: 202 len: 0 microversion: 2.86 time: 0.159457 May 14 21:11:39.849702 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 5/13] 10.222.0.52 () {60 vars in 1201 bytes} [Sat May 14 21:11:39 2022] DELETE /compute/v2.1/flavors/2122287652 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:11:39.884386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0afd2ca0-c77c-4739-a336-ffa7ed6cf43c tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:39.925856 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0afd2ca0-c77c-4739-a336-ffa7ed6cf43c tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074700 May 14 21:11:39.931214 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 6/14] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:39.932872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4196f572-4856-4796-9ce6-561b4a6bed4b tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.301473 May 14 21:11:39.933898 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 9/15] 10.222.0.52 () {62 vars in 1209 bytes} [Sat May 14 21:11:39 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:39.947632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93f8a487-8853-44ed-9462-efa21eae7299 tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:39.948405 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.948405 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:39.956962 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93f8a487-8853-44ed-9462-efa21eae7299 tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.013786 May 14 21:11:39.957935 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 10/16] 10.222.0.52 () {60 vars in 1189 bytes} [Sat May 14 21:11:39 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:39.969224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-586eedc7-2d92-49ee-b214-32f57da40bcc tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1371720453", "id": 31243550, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:39.969224 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:39.969224 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:39.971134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f43de257-acc7-4cab-badd-3aa5e9842f8c tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:40.006143 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f43de257-acc7-4cab-badd-3aa5e9842f8c tempest-FlavorMetadataValidation-1289410358 tempest-FlavorMetadataValidation-1289410358-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.073134 May 14 21:11:40.011523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 7/17] 10.222.0.52 () {60 vars in 1186 bytes} [Sat May 14 21:11:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:11:40.012240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddb286ca-22cf-4b68-a0de-a658312d6cdb tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:40.013725 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:40.013725 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:40.049285 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-586eedc7-2d92-49ee-b214-32f57da40bcc tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.088893 May 14 21:11:40.049918 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 11/18] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:39 2022] POST /compute/v2.1/flavors => generated 411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:40.061571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f9059fd-3a9a-4dc0-9d4f-9d09b9dd022f tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:40.107093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddb286ca-22cf-4b68-a0de-a658312d6cdb tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:40.108094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddb286ca-22cf-4b68-a0de-a658312d6cdb tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:40.183548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5f9059fd-3a9a-4dc0-9d4f-9d09b9dd022f tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.126694 May 14 21:11:40.196969 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 12/19] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:40 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:40.220995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8f79a78-1e03-4294-acc8-c4f463085e97 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:40.221934 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:40.221934 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:40.356294 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8f79a78-1e03-4294-acc8-c4f463085e97 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/31243550" status: 202 len: 0 microversion: 2.1 time: 0.148558 May 14 21:11:40.357731 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 13/20] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:11:40 2022] DELETE /compute/v2.1/flavors/31243550 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:40.370034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e712ddf-f0fa-47f7-9882-1bdf1719cf82 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:40.417875 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9e712ddf-f0fa-47f7-9882-1bdf1719cf82 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052391 May 14 21:11:40.419067 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 14/21] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:40.434877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8a8d52e-284d-4177-ad7f-04a9449bd461 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-183667825", "id": 1610504325, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:40.556562 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8a8d52e-284d-4177-ad7f-04a9449bd461 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.125038 May 14 21:11:40.557183 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 15/22] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:40 2022] POST /compute/v2.1/flavors => generated 428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:40.578080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6371e2cb-0b69-4199-9e8c-d44c23cea718 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:40.673982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6371e2cb-0b69-4199-9e8c-d44c23cea718 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1610504325" status: 202 len: 0 microversion: 2.1 time: 0.103567 May 14 21:11:40.674571 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 16/23] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:40 2022] DELETE /compute/v2.1/flavors/1610504325 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:40.679731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c9dddd4f-079e-4162-963f-047008633723 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:40.680466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c9dddd4f-079e-4162-963f-047008633723 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:40.906232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c9dddd4f-079e-4162-963f-047008633723 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:40.919971 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c9dddd4f-079e-4162-963f-047008633723 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1220 microversion: 2.1 time: 0.243900 May 14 21:11:40.920792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 17/24] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:40 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1220 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:40.941111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-da16207d-0081-41f2-9a3c-72aadb0c3c4f tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:40.964187 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-da16207d-0081-41f2-9a3c-72aadb0c3c4f tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026904 May 14 21:11:40.964986 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 18/25] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:40.985003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fc2d3fff-a622-480a-8474-84ff096749ed tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1637180845", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:40.986598 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:40.986598 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:41.087874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fc2d3fff-a622-480a-8474-84ff096749ed tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.109558 May 14 21:11:41.095298 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 19/26] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:40 2022] POST /compute/v2.1/flavors => generated 507 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:11:41.101458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66304d51-30f0-4515-9efb-da6c6c3e207a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:41.102390 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:41.102390 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:41.207669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-66304d51-30f0-4515-9efb-da6c6c3e207a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/fe652165-f4ee-4229-8a7f-deb045581aa8" status: 202 len: 0 microversion: 2.1 time: 0.110775 May 14 21:11:41.214321 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 20/27] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:11:41 2022] DELETE /compute/v2.1/flavors/fe652165-f4ee-4229-8a7f-deb045581aa8 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:41.221210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e4fd0fc-a5d8-4c58-81db-6cc54228690d tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:41.252481 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e4fd0fc-a5d8-4c58-81db-6cc54228690d tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036549 May 14 21:11:41.256437 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 21/28] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:41.281114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-546036a5-a7aa-4b8c-8689-560bba7cdd80 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-179813413", "id": "1ac03047-22ee-4777-b483-329ca597f8ed", "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:41.325586 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ddb286ca-22cf-4b68-a0de-a658312d6cdb tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 1.316766 May 14 21:11:41.326870 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 8/29] 10.222.0.52 () {62 vars in 1231 bytes} [Sat May 14 21:11:40 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:41.339258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-228efa37-7d77-4f36-859e-f3e4fda39642 tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:41.341385 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:41.341385 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:41.355841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-228efa37-7d77-4f36-859e-f3e4fda39642 tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:41.356526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-228efa37-7d77-4f36-859e-f3e4fda39642 tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:41.465806 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-546036a5-a7aa-4b8c-8689-560bba7cdd80 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.191762 May 14 21:11:41.469093 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 22/30] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:41 2022] POST /compute/v2.1/flavors => generated 506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:11:41.499452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb0c37f6-54c6-4c3c-9cf4-b4a984c29e42 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:41.622387 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb0c37f6-54c6-4c3c-9cf4-b4a984c29e42 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1ac03047-22ee-4777-b483-329ca597f8ed" status: 202 len: 0 microversion: 2.1 time: 0.132957 May 14 21:11:41.624825 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 23/31] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:11:41 2022] DELETE /compute/v2.1/flavors/1ac03047-22ee-4777-b483-329ca597f8ed => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:41.638551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a78e1ba-5a27-40ec-a18b-27c645f6e28e tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:41.710664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a78e1ba-5a27-40ec-a18b-27c645f6e28e tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.080370 May 14 21:11:41.722608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 24/32] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:41.727596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1070345-75c9-40e6-b017-e85885652ff1 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1819619440", "id": 1214575685, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:41.792332 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-228efa37-7d77-4f36-859e-f3e4fda39642 tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.457638 May 14 21:11:41.794482 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 9/33] 10.222.0.52 () {62 vars in 1231 bytes} [Sat May 14 21:11:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:41.806620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-989e1413-4aa6-4bcd-92ec-56d9d10d39db tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:41.807595 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:41.807595 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:41.850452 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1070345-75c9-40e6-b017-e85885652ff1 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.126612 May 14 21:11:41.851336 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 25/34] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:41 2022] POST /compute/v2.1/flavors => generated 414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:41.874888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c58dabd2-6999-4b17-8c86-0a144089f25f tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:41.921777 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-989e1413-4aa6-4bcd-92ec-56d9d10d39db tempest-AggregatesAdminTestV241-1281806980 tempest-AggregatesAdminTestV241-1281806980-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.119637 May 14 21:11:41.922666 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 10/35] 10.222.0.52 () {60 vars in 1192 bytes} [Sat May 14 21:11:41 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:11:41.938193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:41.938951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:41.941146 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c58dabd2-6999-4b17-8c86-0a144089f25f tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/1214575685" status: 200 len: 414 microversion: 2.1 time: 0.082177 May 14 21:11:41.955460 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 26/36] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:11:41 2022] GET /compute/v2.1/flavors/1214575685 => generated 414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:41.966767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:41.967285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:41.973156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:41.977273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:42.406034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:42.421850 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-080f5c7a-fa2e-4edb-930c-8917a727c339 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1216 microversion: 2.1 time: 0.487639 May 14 21:11:42.430748 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 11/37] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:41 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1216 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:42.435766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab5888fc-3283-4f00-b6be-673665432b2a tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1304088852", "name": "tempest-test_aggregate-220495579"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:42.473797 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:42.473797 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:42.474904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-ab5888fc-3283-4f00-b6be-673665432b2a tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid fd765641-b9f0-44dc-8509-b0e94ab78195 for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:11:42.535219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44f4eb30-52ac-408c-93bd-934ded633a21 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:42.570839 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44f4eb30-52ac-408c-93bd-934ded633a21 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.614049 May 14 21:11:42.571541 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 27/38] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:41 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:42.602572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5398b3e8-6a46-4118-9632-4582232595d3 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:42.634100 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab5888fc-3283-4f00-b6be-673665432b2a tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.201890 May 14 21:11:42.640603 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 12/39] 10.222.0.52 () {60 vars in 1164 bytes} [Sat May 14 21:11:42 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:42.647202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-55d31ab0-615d-4275-9ac8-441a994c80f2 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:42.648495 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:42.648495 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:42.668286 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-55d31ab0-615d-4275-9ac8-441a994c80f2 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.022197 May 14 21:11:42.671754 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 13/40] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:11:42 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:42.679092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e73a25d9-b30a-48a3-acfc-626eca184d74 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:42.679314 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5398b3e8-6a46-4118-9632-4582232595d3 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1214575685" status: 202 len: 0 microversion: 2.1 time: 0.086896 May 14 21:11:42.683756 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 28/41] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:42 2022] DELETE /compute/v2.1/flavors/1214575685 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:42.684283 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:42.684283 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:42.690367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a0e563d-de7a-46a1-a6b2-8a494547dfcc tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:42.699836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e73a25d9-b30a-48a3-acfc-626eca184d74 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:42.700457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e73a25d9-b30a-48a3-acfc-626eca184d74 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:42.720693 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a0e563d-de7a-46a1-a6b2-8a494547dfcc tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035576 May 14 21:11:42.721572 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 29/42] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:42.746445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5f0de24-991a-4f88-9064-0447d4ac1638 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-54895627", "id": 1909782173, "os-flavor-access:is_public": "False"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:42.893675 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5f0de24-991a-4f88-9064-0447d4ac1638 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.157077 May 14 21:11:42.893977 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 30/43] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:42 2022] POST /compute/v2.1/flavors => generated 428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:42.914377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50d6aaf9-b697-4407-9523-b7723076e191 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "1909782173"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:42.954429 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-50d6aaf9-b697-4407-9523-b7723076e191 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] HTTP exception thrown: Flavor 1909782173 could not be found. May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50d6aaf9-b697-4407-9523-b7723076e191 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] Request method failure captured: May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 107 May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsGXChbpoNMmrO0N4vwI7x0j7-qqlFFCa4qdaRWG31f9SAG5P6qxF_KHy3G6H2IRCliOLmkHDKJkPDNk9_PiAYDDb4NOXp__Occsah8qMf4D8GJ3cGSEPN09ywm4CFerkX1IsjV0VA7VGa-YaHtfquiQHf57dGrq7z7bK-IIwgBRJM May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 8bf7d2dbcd5748dd97172b86455bdbca May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsAdminTestJSON-1412277173 May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:11:42.967323 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bf7d2dbcd5748dd97172b86455bdbca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bf7d2dbcd5748dd97172b86455bdbca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bf7d2dbcd5748dd97172b86455bdbca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bf7d2dbcd5748dd97172b86455bdbca", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsAdminTestJSON-1412277173 May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 8bf7d2dbcd5748dd97172b86455bdbca May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1412277173 May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsAdminTestJSON-1412277173-project May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c0af14c87b2c4487ba2535a95d5cdf51 May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsAdminTestJSON-1412277173-project May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "test", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "1909782173"}} May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:11:42.968526 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor 1909782173 could not be found. May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '1909782173'}}} May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1909782173 could not be found. May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:42.969177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1909782173 could not be found. May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:11:42.970247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1909782173 could not be found. May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50d6aaf9-b697-4407-9523-b7723076e191 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] Returning 400 to user: Flavor 1909782173 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-50d6aaf9-b697-4407-9523-b7723076e191 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.067850 May 14 21:11:42.982435 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 31/44] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:42 2022] POST /compute/v2.1/servers => generated 81 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:11:42.988322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6201c1f2-4a37-4103-9e71-108a4aff9804 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.091522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6201c1f2-4a37-4103-9e71-108a4aff9804 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1909782173" status: 202 len: 0 microversion: 2.1 time: 0.107365 May 14 21:11:43.092241 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 32/45] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:42 2022] DELETE /compute/v2.1/flavors/1909782173 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:43.097595 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e73a25d9-b30a-48a3-acfc-626eca184d74 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 0.423835 May 14 21:11:43.100167 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 14/46] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:11:42 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:43.104624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f47c434-dbe4-4f80-a5b0-0a1da384ccd5 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.127580 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f47c434-dbe4-4f80-a5b0-0a1da384ccd5 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026536 May 14 21:11:43.128072 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 33/47] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:43.147102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2863b7d4-eea2-4afa-bb46-aedd6c8d3b58 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-493617553", "id": 1169294967, "os-flavor-access:is_public": "False"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:43.148792 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:43.148792 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:43.225583 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2863b7d4-eea2-4afa-bb46-aedd6c8d3b58 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.081936 May 14 21:11:43.241015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-484597d9-aff8-4bba-8e31-cc9ed62728f5 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1615982395", "id": 1309103645, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:43.246759 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 15/48] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:43 2022] POST /compute/v2.1/flavors => generated 414 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:43.323344 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-484597d9-aff8-4bba-8e31-cc9ed62728f5 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.090060 May 14 21:11:43.324137 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 34/49] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:43 2022] POST /compute/v2.1/flavors => generated 414 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:43.335279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7808daaa-2898-4359-9707-b1723c9db1ee tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.362956 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7808daaa-2898-4359-9707-b1723c9db1ee tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.029986 May 14 21:11:43.363791 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 16/50] 10.222.0.52 () {58 vars in 1168 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:43.374498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14e3aa01-f124-4b6b-914f-189a61d3d106 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.391839 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14e3aa01-f124-4b6b-914f-189a61d3d106 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.020841 May 14 21:11:43.392649 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 35/51] 10.222.0.52 () {58 vars in 1176 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:11:43.403442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b1c743bd-cbde-4666-8c30-d2ba3fb5f181 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.416774 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b1c743bd-cbde-4666-8c30-d2ba3fb5f181 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.017003 May 14 21:11:43.417477 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 17/52] 10.222.0.52 () {58 vars in 1170 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:43.430975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78f90d45-62e3-4b9d-b3b2-75ebee65cdc8 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.439768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.440809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:43.443841 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78f90d45-62e3-4b9d-b3b2-75ebee65cdc8 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.017720 May 14 21:11:43.444724 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 36/53] 10.222.0.52 () {58 vars in 1168 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:11:43.453306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:43.453787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:43.454710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:43.455425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:43.472617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47aa3a1c-406c-4beb-bf12-0a335ab42cce tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.519997 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47aa3a1c-406c-4beb-bf12-0a335ab42cce tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.055352 May 14 21:11:43.520956 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 37/54] 10.222.0.52 () {58 vars in 1168 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:43.536123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0312b4e-1f89-4ba9-a0cc-bb1754eb5589 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.575657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0312b4e-1f89-4ba9-a0cc-bb1754eb5589 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.043570 May 14 21:11:43.576990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:43.593480 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-514b1d43-3809-4531-96c9-7e972988fb9b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1312 microversion: 2.1 time: 0.158128 May 14 21:11:43.593757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 38/55] 10.222.0.52 () {58 vars in 1174 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:43.602210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cbdf350d-0739-453c-8eb8-53f912c80683 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.603945 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 18/56] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:43.680820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cbdf350d-0739-453c-8eb8-53f912c80683 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.083281 May 14 21:11:43.693985 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 39/57] 10.222.0.52 () {58 vars in 1172 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:43.704248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73eed60f-b635-4b44-870d-cfd00b74853a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.758930 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73eed60f-b635-4b44-870d-cfd00b74853a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.062279 May 14 21:11:43.765829 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 19/58] 10.222.0.52 () {58 vars in 1168 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:43.780610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ee6e7af0-4a08-40e9-9b7d-0fb38e82d0d7 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.864256 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ee6e7af0-4a08-40e9-9b7d-0fb38e82d0d7 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1309103645" status: 202 len: 0 microversion: 2.1 time: 0.087181 May 14 21:11:43.866795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 40/59] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:43 2022] DELETE /compute/v2.1/flavors/1309103645 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:43.882245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9a793132-d1bb-4133-8069-82347f00d015 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:43.905378 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9a793132-d1bb-4133-8069-82347f00d015 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027367 May 14 21:11:43.915932 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 41/60] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:43.925370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ced91ed-acb7-46b2-bc74-223c5effb30a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.028538 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ced91ed-acb7-46b2-bc74-223c5effb30a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1169294967" status: 202 len: 0 microversion: 2.1 time: 0.108253 May 14 21:11:44.030221 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 42/61] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:43 2022] DELETE /compute/v2.1/flavors/1169294967 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:44.041057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3ef832b7-0851-4b29-8188-43343d515c1b tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.090160 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3ef832b7-0851-4b29-8188-43343d515c1b tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054369 May 14 21:11:44.092780 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 43/62] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:44.112507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f963e6bb-1f31-4181-88ab-67b1d56b90ce tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1797247505", "id": 1398446022, "os-flavor-access:is_public": "False"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:44.215191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f963e6bb-1f31-4181-88ab-67b1d56b90ce tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.108379 May 14 21:11:44.216899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 44/63] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:44 2022] POST /compute/v2.1/flavors => generated 415 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:44.233061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19cebc92-3463-4364-a617-42c27c71949a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.272996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19cebc92-3463-4364-a617-42c27c71949a tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049200 May 14 21:11:44.285766 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 45/64] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:44.294341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d64767f-a018-407f-87ff-f6b37dbd8981 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.315745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1d64767f-a018-407f-87ff-f6b37dbd8981 tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027277 May 14 21:11:44.316272 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 46/65] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:44.335109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-20217f16-a0f8-4128-b7f6-e349c1b8cb7c tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.417082 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-20217f16-a0f8-4128-b7f6-e349c1b8cb7c tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1398446022" status: 202 len: 0 microversion: 2.1 time: 0.089908 May 14 21:11:44.418099 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 47/66] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:44 2022] DELETE /compute/v2.1/flavors/1398446022 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:44.431687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6643121-50ef-4b82-abe7-2076989229fc tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.479156 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c6643121-50ef-4b82-abe7-2076989229fc tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052568 May 14 21:11:44.490163 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 48/67] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:44.499690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f70bb3a0-0be8-41cd-828f-b6abd6476296 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-282406578", "id": 1160257306, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:44.520906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-520790319", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "availability_zone": "tempest-test_az-1304088852"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:44.541980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:44.545006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:44.547980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:44.550592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:44.606229 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f70bb3a0-0be8-41cd-828f-b6abd6476296 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.113040 May 14 21:11:44.607199 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 49/68] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:44 2022] POST /compute/v2.1/flavors => generated 413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:44.625022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ebfc3f93-9c6e-4ea8-86f4-7652ae0e58ee tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.660832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:11:44.673855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ebfc3f93-9c6e-4ea8-86f4-7652ae0e58ee tempest-FlavorsAdminTestJSON-1412277173 tempest-FlavorsAdminTestJSON-1412277173-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.060428 May 14 21:11:44.680074 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 50/69] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:44 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:44.694484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.696064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:44.709230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:44.709945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:44.711060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:44.711692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:44.922394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:44.927850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:11:44.928281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:11:44.929137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:11:44.929562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:11:44.930769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:11:44.947132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:44.948381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:44.950034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:44.950498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:44.958803 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03e39a79-124d-44ed-aeeb-5e7f1a76e065 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1300 microversion: 2.1 time: 0.275820 May 14 21:11:44.960095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 51/70] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:44 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1300 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:44.975514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9c9ce9bd-44fd-420a-864c-403e7ebc6c96 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:44.975514 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:44.975514 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:44.993803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Getting quotas for project 7284e17654bc4a62a6d92db0f9fe2b5e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:11:45.000688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Getting quotas for user bbd1715608f64bcfbff6bf07039389c9 and project 7284e17654bc4a62a6d92db0f9fe2b5e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:11:45.024651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:11:45.028777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:11:45.052246 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9c9ce9bd-44fd-420a-864c-403e7ebc6c96 tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1160257306" status: 202 len: 0 microversion: 2.1 time: 0.090636 May 14 21:11:45.059388 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 52/71] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:44 2022] DELETE /compute/v2.1/flavors/1160257306 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:45.061513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9c5da2c-6d2e-47fa-8af1-1b6973bf348e tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:45.127626 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9c5da2c-6d2e-47fa-8af1-1b6973bf348e tempest-FlavorsAdminTestJSON-1358647592 tempest-FlavorsAdminTestJSON-1358647592-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068859 May 14 21:11:45.130470 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 53/72] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:45 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:45.231989 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-373e831a-043c-4abb-b1b6-523a829edca3 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382202 May 14 21:11:45.234999 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 20/73] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:11:45.248693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18fe3f96-3b07-4dc4-8e35-bc14020460b2 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:45.249578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18fe3f96-3b07-4dc4-8e35-bc14020460b2 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:45.532285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18fe3f96-3b07-4dc4-8e35-bc14020460b2 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:45.555510 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18fe3f96-3b07-4dc4-8e35-bc14020460b2 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1242 microversion: 2.1 time: 0.309231 May 14 21:11:45.565590 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 54/74] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:45 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1242 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:46.027142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:46.027142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:46.027142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:46.027142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:46.029642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:46.029642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:46.280423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:46.294703 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2aefd3ab-a2c3-46ef-8a56-340f037a9a4e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.317547 May 14 21:11:46.306884 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 21/75] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:45 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:46.572526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-179db3dc-ec7b-426b-9fcf-da145d264abe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:46.573200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-179db3dc-ec7b-426b-9fcf-da145d264abe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:46.633869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-179db3dc-ec7b-426b-9fcf-da145d264abe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:46.644013 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-179db3dc-ec7b-426b-9fcf-da145d264abe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1242 microversion: 2.1 time: 0.075006 May 14 21:11:46.651121 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 55/76] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:46 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:47.319744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:47.321297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:47.340715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:47.341424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:47.342480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:47.343399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:47.685610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9ace47a-5ab6-483b-82e1-b4f47fb882cd tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:47.688760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9ace47a-5ab6-483b-82e1-b4f47fb882cd tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:48.049421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9ace47a-5ab6-483b-82e1-b4f47fb882cd tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:48.052300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:48.056713 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9ace47a-5ab6-483b-82e1-b4f47fb882cd tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1242 microversion: 2.1 time: 0.389426 May 14 21:11:48.075898 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 56/77] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:47 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1242 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:48.088589 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3fe56d47-80aa-4edc-8978-352959750203 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.776039 May 14 21:11:48.100432 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 22/78] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:47 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:49.080461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:49.081751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:49.091926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:49.092396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:49.094616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:49.097316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:49.109061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:49.111388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:49.147585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:49.148493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:49.149529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:49.150127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:49.268068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:49.279844 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7837664b-45d2-4d52-9466-4c2fddcd7b14 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1290 microversion: 2.1 time: 0.200232 May 14 21:11:49.280903 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 57/79] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:49 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1290 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:49.767917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:49.779850 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-665e8c6a-f8a6-4278-9acb-22e6842d41ec tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.677264 May 14 21:11:49.781749 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 23/80] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:49 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:11:50.311173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:50.313769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:50.332317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:50.333001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:50.335213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:50.341585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:50.602018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:50.632490 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44d12da5-c46b-4308-a302-f46048d66f9b tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1290 microversion: 2.1 time: 0.336394 May 14 21:11:50.636223 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 58/81] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:50 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1290 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:50.800502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:50.801122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:50.820003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:50.824375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:50.824375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:50.824375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:51.642730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:51.658693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6cc80a0-6caa-4006-b06f-ebd29d20348c tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.861489 May 14 21:11:51.661279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:51.662755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:51.670680 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 24/82] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:50 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:51.678619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:51.678619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:51.681355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:51.681871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:52.260894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:52.271401 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b44f2042-20ce-4457-8280-3d13e1bcb88c tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1296 microversion: 2.1 time: 0.622150 May 14 21:11:52.277019 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 59/83] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:51 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1296 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:52.676687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:52.677309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:52.695200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:52.695853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:52.696703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:52.697139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:53.271122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:53.279438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99babecb-0312-40a2-b6f6-3d926ca0b1ab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.606826 May 14 21:11:53.285215 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 25/84] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:52 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:53.505001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-bd8b0358-4ed4-488e-99a9-37096a32b1e5 req-a9f97e8f-4370-4a56-abc2-be623473a6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f", "tag": "184c6858-4c0a-4d04-9766-8a49c780f6ad"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:53.547779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-bd8b0358-4ed4-488e-99a9-37096a32b1e5 req-a9f97e8f-4370-4a56-abc2-be623473a6f1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:53.549978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-bd8b0358-4ed4-488e-99a9-37096a32b1e5 req-a9f97e8f-4370-4a56-abc2-be623473a6f1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:53.641395 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-bd8b0358-4ed4-488e-99a9-37096a32b1e5 req-a9f97e8f-4370-4a56-abc2-be623473a6f1 service nova] Creating event network-changed:184c6858-4c0a-4d04-9766-8a49c780f6ad for instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f on nch2-master-1 May 14 21:11:53.644324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-bd8b0358-4ed4-488e-99a9-37096a32b1e5 req-a9f97e8f-4370-4a56-abc2-be623473a6f1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:11:53.645834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd73db75-3272-49d1-8438-ce99968d27bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:53.650089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd73db75-3272-49d1-8438-ce99968d27bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:53.652497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd73db75-3272-49d1-8438-ce99968d27bd None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:53.653823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd73db75-3272-49d1-8438-ce99968d27bd None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:53.701243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.rpcapi [None req-bd73db75-3272-49d1-8438-ce99968d27bd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 14 21:11:53.712638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd73db75-3272-49d1-8438-ce99968d27bd None None] Releasing lock "compute-rpcapi-router" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:11:53.763287 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bd73db75-3272-49d1-8438-ce99968d27bd None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.848290 May 14 21:11:53.764681 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 60/85] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:53.776416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:53.779987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:53.801493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:53.810025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:53.811850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:53.812695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:53.944641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a5a0906-a8bb-44d3-81f1-1894573aad27 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1079745803", "id": 1699176012, "os-flavor-access:is_public": "False"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:53.948639 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:53.948639 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:54.036996 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a5a0906-a8bb-44d3-81f1-1894573aad27 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.750581 May 14 21:11:54.075402 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 26/86] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:53 2022] POST /compute/v2.1/flavors => generated 431 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:54.108105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-296949f1-9273-4689-a1b4-e893cec4967f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1ecabb816bab433d81c64af18cfdb59e"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:54.112989 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:54.112989 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:54.570594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:54.581852 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b297311b-fb0b-462b-8554-87b63c2c6f6f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.815681 May 14 21:11:54.596462 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 61/87] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:53 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:54.615650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:54.619503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:54.640687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:54.641163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:54.642070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:54.642517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:55.221153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:55.231880 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b6cb9bc4-2ec0-4549-9e0c-3a84a9c43e92 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.633933 May 14 21:11:55.240672 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 62/88] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:54 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:55.746286 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-296949f1-9273-4689-a1b4-e893cec4967f tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1699176012/action" status: 200 len: 97 microversion: 2.1 time: 1.668930 May 14 21:11:55.753187 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 27/89] 10.222.0.52 () {60 vars in 1199 bytes} [Sat May 14 21:11:54 2022] POST /compute/v2.1/flavors/1699176012/action => generated 97 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:11:55.787293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:55.788574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:55.797445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:55.798397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:55.800112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:55.800710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:56.321651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff8280c5-bd8b-406f-bf84-3264d02f5788 tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-991075048", "id": 1316026637, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:56.323401 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:56.323401 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:56.435661 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff8280c5-bd8b-406f-bf84-3264d02f5788 tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 1.192344 May 14 21:11:56.435661 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 63/90] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:11:55 2022] POST /compute/v2.1/flavors => generated 448 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:56.472051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:56.510046 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b99d550f-b0eb-4c2a-ae81-9144dc9a7194 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.752641 May 14 21:11:56.512654 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 28/91] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:55 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:56.527041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:56.528380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:56.547267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:56.547771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:56.554771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:56.555233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:56.771658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00618239-7adc-42ac-9eac-ce9f4952f012 tempest-FlavorsAccessTestJSON-1735428532 tempest-FlavorsAccessTestJSON-1735428532-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:56.832753 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00618239-7adc-42ac-9eac-ce9f4952f012 tempest-FlavorsAccessTestJSON-1735428532 tempest-FlavorsAccessTestJSON-1735428532-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5829 microversion: 2.1 time: 0.396146 May 14 21:11:56.840117 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 64/92] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:56 2022] GET /compute/v2.1/flavors/detail => generated 5829 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:56.841488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00618239-7adc-42ac-9eac-ce9f4952f012 tempest-FlavorsAccessTestJSON-1735428532 tempest-FlavorsAccessTestJSON-1735428532-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:56.842894 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00618239-7adc-42ac-9eac-ce9f4952f012 tempest-FlavorsAccessTestJSON-1735428532 tempest-FlavorsAccessTestJSON-1735428532-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001734 May 14 21:11:56.843671 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 65/93] 10.222.0.52 () {56 vars in 885 bytes} [Sat May 14 21:11:56 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 14 21:11:57.271524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:57.283832 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dce5658e-6e10-4259-8e6c-16d7b76b1d58 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.766013 May 14 21:11:57.284740 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 29/94] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:56 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:57.290622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a5c31b94-24e1-45d7-a1cf-22115f7dca76 req-af072c96-a713-4a28-9ef8-78b01982083f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5177b64-d9cc-4897-8d54-06f1d7dd250a", "tag": "88977556-23b1-4102-b801-82c6a337b4c9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:57.323256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a5c31b94-24e1-45d7-a1cf-22115f7dca76 req-af072c96-a713-4a28-9ef8-78b01982083f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:57.324984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a5c31b94-24e1-45d7-a1cf-22115f7dca76 req-af072c96-a713-4a28-9ef8-78b01982083f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:57.372823 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a5c31b94-24e1-45d7-a1cf-22115f7dca76 req-af072c96-a713-4a28-9ef8-78b01982083f service nova] Creating event network-changed:88977556-23b1-4102-b801-82c6a337b4c9 for instance e5177b64-d9cc-4897-8d54-06f1d7dd250a on nch2-master-1 May 14 21:11:57.378878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a5c31b94-24e1-45d7-a1cf-22115f7dca76 req-af072c96-a713-4a28-9ef8-78b01982083f service nova] Acquired lock "compute-rpcapi-router" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:11:57.379256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-409dface-4ac1-4402-99cd-30f67766637b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:57.379953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-409dface-4ac1-4402-99cd-30f67766637b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:57.383965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-409dface-4ac1-4402-99cd-30f67766637b None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:57.384685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-409dface-4ac1-4402-99cd-30f67766637b None None] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:57.406179 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.compute.rpcapi [None req-409dface-4ac1-4402-99cd-30f67766637b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 14 21:11:57.409074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-409dface-4ac1-4402-99cd-30f67766637b None None] Releasing lock "compute-rpcapi-router" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:11:57.448755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-409dface-4ac1-4402-99cd-30f67766637b None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154020 May 14 21:11:57.449473 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 30/95] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:57.459297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f99faeaa-027f-443b-ad02-ec3b44db8386 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1ecabb816bab433d81c64af18cfdb59e"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:57.463079 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:57.463079 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:57.525525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c6809c7-9d2e-4ea0-bd16-870474a381b6 tempest-FlavorsV255TestJSON-1283195954 tempest-FlavorsV255TestJSON-1283195954-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:57.540072 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c6809c7-9d2e-4ea0-bd16-870474a381b6 tempest-FlavorsV255TestJSON-1283195954 tempest-FlavorsV255TestJSON-1283195954-project] 10.222.0.52 "GET /compute/v2.1/flavors/1316026637" status: 200 len: 448 microversion: 2.55 time: 0.695024 May 14 21:11:57.541808 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 66/96] 10.222.0.52 () {60 vars in 1198 bytes} [Sat May 14 21:11:56 2022] GET /compute/v2.1/flavors/1316026637 => generated 448 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:57.559084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:57.560194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:57.574176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:57.574963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:57.576536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:57.577181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:57.960198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:57.996258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7d08b00-562e-4b58-87f1-a1f8ec592c34 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.442120 May 14 21:11:57.997546 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 67/97] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:57 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:58.006646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3410ec1e-c54c-4d38-a550-e22617ff314f tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b6a45ee0>, body: {"flavor": {"description": "new"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:58.036263 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:58.036263 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:58.177334 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3410ec1e-c54c-4d38-a550-e22617ff314f tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/1316026637" status: 200 len: 449 microversion: 2.55 time: 0.178387 May 14 21:11:58.178342 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 68/98] 10.222.0.52 () {62 vars in 1218 bytes} [Sat May 14 21:11:57 2022] PUT /compute/v2.1/flavors/1316026637 => generated 449 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:11:58.190375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34eb3707-beae-4077-b27f-43310f87315b tempest-FlavorsV255TestJSON-1283195954 tempest-FlavorsV255TestJSON-1283195954-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.271180 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34eb3707-beae-4077-b27f-43310f87315b tempest-FlavorsV255TestJSON-1283195954 tempest-FlavorsV255TestJSON-1283195954-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.085862 May 14 21:11:58.273336 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 69/99] 10.222.0.52 () {60 vars in 1186 bytes} [Sat May 14 21:11:58 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:11:58.293392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-92f9ae27-b5a4-4706-a0e3-83ff5536970d tempest-FlavorsV255TestJSON-1283195954 tempest-FlavorsV255TestJSON-1283195954-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.349145 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-92f9ae27-b5a4-4706-a0e3-83ff5536970d tempest-FlavorsV255TestJSON-1283195954 tempest-FlavorsV255TestJSON-1283195954-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.062466 May 14 21:11:58.350178 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 70/100] 10.222.0.52 () {60 vars in 1165 bytes} [Sat May 14 21:11:58 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:11:58.364913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.365713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:58.372828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:58.377466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:58.379775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:58.380339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:58.636304 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f99faeaa-027f-443b-ad02-ec3b44db8386 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1699176012/action" status: 200 len: 21 microversion: 2.1 time: 1.179692 May 14 21:11:58.638518 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 31/101] 10.222.0.52 () {60 vars in 1199 bytes} [Sat May 14 21:11:57 2022] POST /compute/v2.1/flavors/1699176012/action => generated 21 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:11:58.756223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7f7e9490-eed5-420a-b1a9-44a7450d4494 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.757766 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:58.757766 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:58.759338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f7e9490-eed5-420a-b1a9-44a7450d4494 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:58.760959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f7e9490-eed5-420a-b1a9-44a7450d4494 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:58.761966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f7e9490-eed5-420a-b1a9-44a7450d4494 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:58.762623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f7e9490-eed5-420a-b1a9-44a7450d4494 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:58.780694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:58.788821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21f89699-13c1-4bf3-a7b9-8154e7beadbf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.437262 May 14 21:11:58.789687 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 71/102] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:58 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:58.791900 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7f7e9490-eed5-420a-b1a9-44a7450d4494 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 402 microversion: 2.1 time: 0.151944 May 14 21:11:58.796977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b9c6d96b-8732-4111-8eda-c5189a5e7004 tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.800309 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 32/103] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:11:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 402 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:58.800430 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:58.800430 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:58.804004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a3e75bc-38d7-4f56-820e-f1770f6558d5 tempest-FlavorsAccessTestJSON-1735428532 tempest-FlavorsAccessTestJSON-1735428532-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.843680 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a3e75bc-38d7-4f56-820e-f1770f6558d5 tempest-FlavorsAccessTestJSON-1735428532 tempest-FlavorsAccessTestJSON-1735428532-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.039343 May 14 21:11:58.846621 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 33/104] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:58 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:58.856087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e3e7589-0995-4f17-8826-1ca55d55a0f0 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.858004 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:58.858004 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:11:58.920646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b9c6d96b-8732-4111-8eda-c5189a5e7004 tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1316026637" status: 202 len: 0 microversion: 2.55 time: 0.129505 May 14 21:11:58.923156 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 72/105] 10.222.0.52 () {60 vars in 1201 bytes} [Sat May 14 21:11:58 2022] DELETE /compute/v2.1/flavors/1316026637 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:11:58.931077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-25f53173-70f9-42ef-a15c-d3812b07d252 tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:58.950184 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-25f53173-70f9-42ef-a15c-d3812b07d252 tempest-FlavorsV255TestJSON-125655420 tempest-FlavorsV255TestJSON-125655420-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.022724 May 14 21:11:58.957749 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 73/106] 10.222.0.52 () {60 vars in 1186 bytes} [Sat May 14 21:11:58 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:11:58.999425 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e3e7589-0995-4f17-8826-1ca55d55a0f0 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1699176012" status: 202 len: 0 microversion: 2.1 time: 0.148039 May 14 21:11:59.000762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 34/107] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:11:58 2022] DELETE /compute/v2.1/flavors/1699176012 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:11:59.008422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-525eb2ec-8c39-4151-a3d1-4c66b228219d tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:59.015829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:59.017776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:59.029382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:59.030995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:59.033071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:59.036469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:59.049873 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-525eb2ec-8c39-4151-a3d1-4c66b228219d tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045140 May 14 21:11:59.050690 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 74/108] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:59.071459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0de0436-2db6-40aa-843b-b178b8f7a804 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-542543665", "id": 748577757, "os-flavor-access:is_public": "False"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:11:59.079955 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:59.079955 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:59.192846 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0de0436-2db6-40aa-843b-b178b8f7a804 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.124973 May 14 21:11:59.193469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 75/109] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:11:59 2022] POST /compute/v2.1/flavors => generated 427 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:11:59.208626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcd635d7-e1fa-43a2-9c35-195457c27a6e tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:59.209618 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:11:59.209618 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:11:59.224105 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bcd635d7-e1fa-43a2-9c35-195457c27a6e tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/748577757/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.020617 May 14 21:11:59.225447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 76/110] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:11:59 2022] GET /compute/v2.1/flavors/748577757/os-flavor-access => generated 21 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:11:59.234442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c0fe4a2-7559-4257-bc91-81bd5ac0da4d tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:59.276864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:59.287021 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d4c0aa16-fe11-4409-acc0-423299b7cbab tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.276738 May 14 21:11:59.296583 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 35/111] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:59 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:59.353843 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c0fe4a2-7559-4257-bc91-81bd5ac0da4d tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/748577757" status: 202 len: 0 microversion: 2.1 time: 0.122578 May 14 21:11:59.354045 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 77/112] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:11:59 2022] DELETE /compute/v2.1/flavors/748577757 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:11:59.362733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4b29384-c355-4356-aadc-05a42f487cb8 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:59.405590 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4b29384-c355-4356-aadc-05a42f487cb8 tempest-FlavorsAccessTestJSON-1189733697 tempest-FlavorsAccessTestJSON-1189733697-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047049 May 14 21:11:59.418282 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 36/113] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:11:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:11:59.806637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:11:59.809175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:11:59.820463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:59.820931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:59.821755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:11:59.822199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:11:59.986225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:11:59.994825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0967b30e-7013-4fb0-a7b7-dee9cddd2e69 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.192223 May 14 21:11:59.997520 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 78/114] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:11:59 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:00.305218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:00.306107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:00.316378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:00.316378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:00.316378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:00.316378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:00.459256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:00.466756 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b204b0ad-5ef0-4bc3-b2e4-1d545fe83b44 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.165584 May 14 21:12:00.468371 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 79/115] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:00 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:00.673728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71186ee4-05a5-466e-9143-0df0ec81893a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:00.691369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71186ee4-05a5-466e-9143-0df0ec81893a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.449417 May 14 21:12:00.705148 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 37/116] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:12:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:00.936185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0bf5dfba-05e1-4c1e-b08e-e936ce7a744b tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-932449928", "id": 1398027056, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:00.938949 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:00.938949 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:01.084753 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0bf5dfba-05e1-4c1e-b08e-e936ce7a744b tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.369798 May 14 21:12:01.084753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 80/117] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:00 2022] POST /compute/v2.1/flavors => generated 424 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:01.093081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:01.096931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:01.112645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.113488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.114539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.117195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.170749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Calling method '.version_select at 0x7fb1b4a48310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:01.172277 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:01.172277 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:01.180247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=130638) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 14 21:12:01.181575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.182426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.207824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.213966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.248921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.249618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.257032 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99e92e68-865c-4fac-a9d6-4cab98a0ad89 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.296129 May 14 21:12:01.257755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 38/118] 10.222.0.52 () {60 vars in 1186 bytes} [Sat May 14 21:12:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 21:12:01.262605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e307041-a6bf-4f00-9de5-b9b1fdede23f tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:01.270154 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8e307041-a6bf-4f00-9de5-b9b1fdede23f tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011401 May 14 21:12:01.270714 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 39/119] 10.222.0.52 () {58 vars in 1181 bytes} [Sat May 14 21:12:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:01.279284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7bf727c0-b0f0-4697-a2bb-db8319458100 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Calling method '.version_select at 0x7fb1b4976ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:01.279284 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:01.279284 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:01.279284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bf727c0-b0f0-4697-a2bb-db8319458100 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.279284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bf727c0-b0f0-4697-a2bb-db8319458100 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.293346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bf727c0-b0f0-4697-a2bb-db8319458100 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.293967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bf727c0-b0f0-4697-a2bb-db8319458100 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.300813 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7bf727c0-b0f0-4697-a2bb-db8319458100 tempest-HypervisorAdminV228Test-345875433 tempest-HypervisorAdminV228Test-345875433-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.029143 May 14 21:12:01.301425 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 40/120] 10.222.0.52 () {60 vars in 1192 bytes} [Sat May 14 21:12:01 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:12:01.305898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9d3ccc56-3451-4c97-b281-8115c707a1e0 tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1302417294", "id": 1595958437, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:01.309108 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:01.309108 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:01.342442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:01.351545 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a20727b-f2fd-4535-8ff2-6982a756ac34 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.266977 May 14 21:12:01.352269 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 81/121] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:01 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:01.415773 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9d3ccc56-3451-4c97-b281-8115c707a1e0 tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.113268 May 14 21:12:01.425261 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 41/122] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:01 2022] POST /compute/v2.1/flavors => generated 425 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:01.431835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d26d1f65-e064-4352-a23b-ef79afa9243c tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:01.440274 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d26d1f65-e064-4352-a23b-ef79afa9243c tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011920 May 14 21:12:01.441232 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 82/123] 10.222.0.52 () {58 vars in 1181 bytes} [Sat May 14 21:12:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:12:01.461974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f5ffdb3d-fb81-4a05-9e3a-b6ef311830cb tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Action: 'create', calling method: .version_select at 0x7fb1b494baf0>, body: {"keypair": {"name": "tempest-keypair-1126718949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVfa8jE17t/jhyFJZ0ndCmAlub47lA5NcPiudWCmr7bVZwEL+G7kjFjJVmbswzzgTFkK8YmSFGuhAie7pGr9I7c0NA67ZEkRf/ru/vYBx3DZMjk009JMfF3eNLlofohGg=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:01.488914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:01.489989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:01.497186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.498166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.499265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:01.499970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:01.508765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f5ffdb3d-fb81-4a05-9e3a-b6ef311830cb tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Getting quotas for project 97eb48c86b4d49f1b11b2b6380020f4b. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:01.516921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f5ffdb3d-fb81-4a05-9e3a-b6ef311830cb tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Getting quotas for user 36c32d3de24045bdbfce30559ea022e7 and project 97eb48c86b4d49f1b11b2b6380020f4b. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:01.631567 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f5ffdb3d-fb81-4a05-9e3a-b6ef311830cb tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.180287 May 14 21:12:01.631859 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 42/124] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:12:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:01.711308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:01.718787 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a821be76-84ec-44bc-9a1e-a379783b26ff tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.236233 May 14 21:12:01.719369 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 83/125] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:01 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:02.369760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:02.370504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:02.377990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:02.378576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:02.379698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:02.380257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:02.710851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:02.721916 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-663ce28b-d5b6-4a70-b8d5-9057eda2568b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.353865 May 14 21:12:02.722969 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 43/126] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:02 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:02.739705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:02.741981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:02.761580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:02.762356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:02.763274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:02.763816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:02.983431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:02.992623 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-73a92898-6a60-4251-8faa-6153090544d7 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.260378 May 14 21:12:02.993839 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 84/127] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:02 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:03.742571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:03.743304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:03.770589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:03.770589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:03.775190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:03.779511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:04.024599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:04.026887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:04.038081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:04.038559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:04.040010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:04.040454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:04.041137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:04.050576 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a3330fdc-8fbe-496d-9125-ba97beae30e5 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.312691 May 14 21:12:04.065072 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 44/128] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:03 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:04.254494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:04.263922 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec3650e6-663d-462a-8049-74d41f0996da tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.257328 May 14 21:12:04.264703 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 85/129] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:04 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:05.068096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:05.069122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:05.077165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:05.083772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:05.083772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:05.083772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:05.091789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-813625185", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "1595958437", "adminPass": "***", "networks": [{"uuid": "824318b0-331e-4da1-8622-b2d8e9a5e85d"}], "security_groups": [{"name": "tempest-securitygroup--165261146"}], "key_name": "tempest-keypair-1126718949", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:05.262094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:05.270780 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-beeced3f-5847-4203-b300-b7f131907b09 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.207773 May 14 21:12:05.280987 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 45/130] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:05 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:05.288956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:05.289828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:05.289943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] validate_networks() for [('824318b0-331e-4da1-8622-b2d8e9a5e85d', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:12:05.296723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:05.298150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:05.299791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:05.300379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:05.531149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:05.539852 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-853b342d-96fe-4033-ac60-4e687ce3d087 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.256340 May 14 21:12:05.540376 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 46/131] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:05 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:06.040315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d4eb3756-18a5-4c3e-afb3-cbdf0f30c7fc tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Action: 'create', calling method: .version_select at 0x7fb1b49428b0>, body: {"keypair": {"name": "tempest-keypair-1662742110", "type": "ssh", "user_id": "72b3ed0768f3432eb4ee966a72f28615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMO5ZZPZxH+qKTtadG2i94Vw2SDXhzyzGZKBeOZgN/srnSCXtqEBa8+12i/csx0MYZocL5r0ioBt0ih43r7Hk7WkFghd4IQA88gBbx+Ae8od2WuKJktR+fYL0t4504em0g=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:06.054657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d4eb3756-18a5-4c3e-afb3-cbdf0f30c7fc tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Getting quotas for project 1809ec840ff040de8bc3163c7e723838. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:06.058539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d4eb3756-18a5-4c3e-afb3-cbdf0f30c7fc tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Getting quotas for user 68b64be896a9403888c05a33dfea02b9 and project 1809ec840ff040de8bc3163c7e723838. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:06.196649 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d4eb3756-18a5-4c3e-afb3-cbdf0f30c7fc tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.518401 May 14 21:12:06.202087 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 47/132] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:12:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 520 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 21:12:06.211103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-55d3012d-a087-44a7-904f-b66943fe2106 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Action: 'create', calling method: .version_select at 0x7fb1b4942af0>, body: {"keypair": {"name": "tempest-keypair-842043027", "type": "ssh", "user_id": "72b3ed0768f3432eb4ee966a72f28615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzktqPH8/yGVArR0lBruQ/si+bJg6oblpUjp8aE9ROcj8VVZKOtEuMlA+C7PtZFqXnxGqMSRmUI6bpOv7A4Atli7ueLTSWLEAAymZHw+iQdZMrifdOB1ex4vSviD/yl1w=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:06.233328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-55d3012d-a087-44a7-904f-b66943fe2106 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Getting quotas for project 1809ec840ff040de8bc3163c7e723838. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:06.236041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-55d3012d-a087-44a7-904f-b66943fe2106 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Getting quotas for user 68b64be896a9403888c05a33dfea02b9 and project 1809ec840ff040de8bc3163c7e723838. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:06.293433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:12:06.293992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:12:06.298265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:12:06.298265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:12:06.298265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:12:06.308942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:06.309338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:06.310162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:06.310609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:06.338523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Getting quotas for project 97eb48c86b4d49f1b11b2b6380020f4b. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:06.345271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Getting quotas for user 36c32d3de24045bdbfce30559ea022e7 and project 97eb48c86b4d49f1b11b2b6380020f4b. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:06.356847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:12:06.359677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:12:06.367780 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-55d3012d-a087-44a7-904f-b66943fe2106 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.159523 May 14 21:12:06.369568 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 48/133] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:12:06 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 14 21:12:06.380630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:06.381517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:06.397922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:06.402144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:06.403125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:06.403744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:06.516441 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a546bbb9-2874-4e2a-b37b-f90df845f468 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.429335 May 14 21:12:06.518739 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 86/134] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:12:06.530933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04fa5645-3d80-4047-8e44-256ef5b13765 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Calling method '.version_select at 0x7fb1b4a064c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:06.554079 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04fa5645-3d80-4047-8e44-256ef5b13765 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1662742110?user_id=72b3ed0768f3432eb4ee966a72f28615" status: 200 len: 512 microversion: 2.10 time: 0.034061 May 14 21:12:06.554951 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 87/135] 10.222.0.52 () {60 vars in 1339 bytes} [Sat May 14 21:12:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1662742110?user_id=72b3ed0768f3432eb4ee966a72f28615 => generated 512 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:12:06.567144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21a9b3d2-7e69-4cff-a815-17f50a1a0dc9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:06.567733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21a9b3d2-7e69-4cff-a815-17f50a1a0dc9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:06.640751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:06.649879 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82ed4728-6fb5-4941-ba47-c5ebaa615aab tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.278982 May 14 21:12:06.650836 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 49/136] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:06 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:06.656269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-21a9b3d2-7e69-4cff-a815-17f50a1a0dc9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:06.664661 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21a9b3d2-7e69-4cff-a815-17f50a1a0dc9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1264 microversion: 2.1 time: 0.107210 May 14 21:12:06.665258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 88/137] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:06 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1264 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:06.667403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:06.668117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:06.677900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:06.677900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:06.678098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0f59a1a-49a0-4539-86ab-252bde565d99 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Action: 'create', calling method: .version_select at 0x7fb1b4b508b0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-179857516", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSfWzJ+zz8Sa62TpVhnbHurVVFyVvlQPfOupS/whNITMEJ5QJR/AL3W2TMbMzaLTTfCOmOf9vncQQesEJL0RMiqirzPx4yuqbZKHkhzrvQnuQISYhXYtRmCH6E9MetV/Q=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:06.678202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:06.678541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:06.709378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b0f59a1a-49a0-4539-86ab-252bde565d99 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Getting quotas for project 1809ec840ff040de8bc3163c7e723838. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:06.716643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b0f59a1a-49a0-4539-86ab-252bde565d99 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Getting quotas for user 68b64be896a9403888c05a33dfea02b9 and project 1809ec840ff040de8bc3163c7e723838. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:06.853152 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0f59a1a-49a0-4539-86ab-252bde565d99 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.186004 May 14 21:12:06.858951 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 89/138] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:12:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 188 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 21:12:06.867040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1e976da5-bdca-4a8b-afe8-1408894befa2 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Calling method '.version_select at 0x7fb1b493bca0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:06.867852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:06.871256 ncdv-master-1 devstack@n-api.service[130637]: WARNING oslo_db.sqlalchemy.utils [None req-1e976da5-bdca-4a8b-afe8-1408894befa2 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 14 21:12:06.877885 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-36949d9b-c41b-4009-be8e-96ca417116e8 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.225821 May 14 21:12:06.878634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 50/139] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:06 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:06.884574 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1e976da5-bdca-4a8b-afe8-1408894befa2 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "GET /compute/v2.1/os-keypairs?user_id=72b3ed0768f3432eb4ee966a72f28615" status: 200 len: 725 microversion: 2.10 time: 0.022782 May 14 21:12:06.886671 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 90/140] 10.222.0.52 () {60 vars in 1258 bytes} [Sat May 14 21:12:06 2022] GET /compute/v2.1/os-keypairs?user_id=72b3ed0768f3432eb4ee966a72f28615 => generated 725 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:12:06.909260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d15017c4-aca3-45e9-8539-1aafd60860c8 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Calling method '.version_select at 0x7fb1b494b670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:07.033906 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d15017c4-aca3-45e9-8539-1aafd60860c8 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-179857516" status: 204 len: 0 microversion: 2.10 time: 0.128960 May 14 21:12:07.034822 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 51/141] 10.222.0.52 () {60 vars in 1321 bytes} [Sat May 14 21:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-179857516 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:12:07.045124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3db3a81c-d9e2-483c-8920-e3def19d67f3 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Calling method '.version_select at 0x7fb1b48c4550>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:07.143975 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3db3a81c-d9e2-483c-8920-e3def19d67f3 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-842043027?user_id=72b3ed0768f3432eb4ee966a72f28615" status: 204 len: 0 microversion: 2.10 time: 0.103992 May 14 21:12:07.144889 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 91/142] 10.222.0.52 () {60 vars in 1339 bytes} [Sat May 14 21:12:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-842043027?user_id=72b3ed0768f3432eb4ee966a72f28615 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:12:07.153105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e32dca0d-fec5-47ed-bbc0-74ef238219b0 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] Calling method '.version_select at 0x7fb1b48c4820>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:07.293534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e32dca0d-fec5-47ed-bbc0-74ef238219b0 tempest-KeyPairsV210TestJSON-1353234461 tempest-KeyPairsV210TestJSON-1353234461-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662742110?user_id=72b3ed0768f3432eb4ee966a72f28615" status: 204 len: 0 microversion: 2.10 time: 0.144093 May 14 21:12:07.304613 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 92/143] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:12:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1662742110?user_id=72b3ed0768f3432eb4ee966a72f28615 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 21:12:07.385692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a3029761-403c-4a88-8c24-7d88965fe51d req-beb3d98e-ed10-464e-a82b-4127955b9626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f", "name": "network-vif-plugged", "status": "completed", "tag": "184c6858-4c0a-4d04-9766-8a49c780f6ad"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:07.397773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a3029761-403c-4a88-8c24-7d88965fe51d req-beb3d98e-ed10-464e-a82b-4127955b9626 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:07.398393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a3029761-403c-4a88-8c24-7d88965fe51d req-beb3d98e-ed10-464e-a82b-4127955b9626 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:07.412109 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a3029761-403c-4a88-8c24-7d88965fe51d req-beb3d98e-ed10-464e-a82b-4127955b9626 service nova] Creating event network-vif-plugged:184c6858-4c0a-4d04-9766-8a49c780f6ad for instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f on nch2-master-1 May 14 21:12:07.418575 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a3029761-403c-4a88-8c24-7d88965fe51d req-beb3d98e-ed10-464e-a82b-4127955b9626 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331614 May 14 21:12:07.419426 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 52/144] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:07.667940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:07.668729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:07.682358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:07.683255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:07.685187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:07.686493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:07.897152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:07.920382 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8bf08e7e-99c5-4609-a3f8-64cedca2f8a4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.255263 May 14 21:12:07.921567 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 53/145] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:07 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:07.927417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:07.928218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:07.937301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:07.938029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:07.939242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:07.939886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.014678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:08.023320 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0eff9446-cda9-4714-9c58-be47f6333525 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1268 microversion: 2.1 time: 0.100339 May 14 21:12:08.023964 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 54/146] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:07 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:08.028818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:08.029484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:08.036971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.037144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.037955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.038403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.082010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-841582024", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:08.198813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:12:08.230537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:08.240337 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-327182c4-1e36-4560-9c3a-23393c3e098a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.214633 May 14 21:12:08.241652 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 55/147] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:08 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:08.432720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:12:08.433279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:12:08.433936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:12:08.434645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:12:08.435216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:12:08.436302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b0cd585-7cdf-4c77-a170-5a995ff1fe33 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b49198b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:08.438777 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:08.438777 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:08.441103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b0cd585-7cdf-4c77-a170-5a995ff1fe33 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.442246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b0cd585-7cdf-4c77-a170-5a995ff1fe33 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.443269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b0cd585-7cdf-4c77-a170-5a995ff1fe33 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.443929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b0cd585-7cdf-4c77-a170-5a995ff1fe33 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.449674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.450151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.452061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.452421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.477795 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b0cd585-7cdf-4c77-a170-5a995ff1fe33 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.218829 May 14 21:12:08.478670 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 56/148] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:12:08 2022] GET /compute/v2.1/os-hosts => generated 401 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:08.478946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Getting quotas for project 9ffe47c465e1480d91f689bed8e9ed94. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:08.483066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Getting quotas for user 6ca2cafc3b794c88b48510b5d466b580 and project 9ffe47c465e1480d91f689bed8e9ed94. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:08.489665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df302c06-922e-4474-a57d-ef29da6d95cd tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b6b01820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:08.491178 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:08.491178 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:08.492692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df302c06-922e-4474-a57d-ef29da6d95cd tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.493143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df302c06-922e-4474-a57d-ef29da6d95cd tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.493942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df302c06-922e-4474-a57d-ef29da6d95cd tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.494434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df302c06-922e-4474-a57d-ef29da6d95cd tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.504900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:12:08.507502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:12:08.518863 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df302c06-922e-4474-a57d-ef29da6d95cd tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 401 microversion: 2.1 time: 0.032660 May 14 21:12:08.519601 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 57/149] 10.222.0.52 () {58 vars in 1138 bytes} [Sat May 14 21:12:08 2022] GET /compute/v2.1/os-hosts?zone= => generated 401 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:08.529942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b2805c9-702c-4a33-bf3a-141b3eb45fce tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b4919550>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:08.531250 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:08.531250 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:08.533390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b2805c9-702c-4a33-bf3a-141b3eb45fce tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.533920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b2805c9-702c-4a33-bf3a-141b3eb45fce tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.534824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b2805c9-702c-4a33-bf3a-141b3eb45fce tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.535327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b2805c9-702c-4a33-bf3a-141b3eb45fce tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.562580 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0b2805c9-702c-4a33-bf3a-141b3eb45fce tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.036021 May 14 21:12:08.563715 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 58/150] 10.222.0.52 () {58 vars in 1144 bytes} [Sat May 14 21:12:08 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:08.634669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-38296554-a3b8-4e42-9403-eeaaf20f1d62 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.003488 May 14 21:12:08.635270 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 93/151] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:12:08.646026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1304ad78-621c-437d-abfc-a657cdec825e tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:08.646642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1304ad78-621c-437d-abfc-a657cdec825e tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:08.734831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1304ad78-621c-437d-abfc-a657cdec825e tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:08.761345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1304ad78-621c-437d-abfc-a657cdec825e tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1218 microversion: 2.1 time: 0.118990 May 14 21:12:08.762533 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 59/152] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:08 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:08.938318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:08.938949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:08.945292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.945750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:08.946558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:08.947001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.052139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:09.052758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:09.066390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.066778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.067618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.068012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.130225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:09.147431 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24985502-354b-477e-9703-046610fa0e5a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1342 microversion: 2.1 time: 0.208215 May 14 21:12:09.154154 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 94/153] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:08 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1342 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:09.163910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:09.176900 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c9e6f9eb-f939-4cb2-a0de-7002908d9d8b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1316 microversion: 2.1 time: 0.124325 May 14 21:12:09.177665 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 60/154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:09 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1316 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:09.258247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:09.258880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:09.275754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.276311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.277270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.277950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.419923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:09.431804 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8ba622f1-b69a-4ba0-8f72-7a7d9e49b9f9 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.177552 May 14 21:12:09.432777 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 61/155] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:09 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:09.446160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-32c6685f-dad4-4dc4-b9c0-4cc8df758aa1 req-c79a2922-c66e-4afa-ab05-dd4fc4992297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5177b64-d9cc-4897-8d54-06f1d7dd250a", "name": "network-vif-plugged", "status": "completed", "tag": "88977556-23b1-4102-b801-82c6a337b4c9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:09.473314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-32c6685f-dad4-4dc4-b9c0-4cc8df758aa1 req-c79a2922-c66e-4afa-ab05-dd4fc4992297 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.473878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-32c6685f-dad4-4dc4-b9c0-4cc8df758aa1 req-c79a2922-c66e-4afa-ab05-dd4fc4992297 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.490986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-32c6685f-dad4-4dc4-b9c0-4cc8df758aa1 req-c79a2922-c66e-4afa-ab05-dd4fc4992297 service nova] Creating event network-vif-plugged:88977556-23b1-4102-b801-82c6a337b4c9 for instance e5177b64-d9cc-4897-8d54-06f1d7dd250a on nch2-master-1 May 14 21:12:09.497434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-32c6685f-dad4-4dc4-b9c0-4cc8df758aa1 req-c79a2922-c66e-4afa-ab05-dd4fc4992297 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061084 May 14 21:12:09.498611 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 62/156] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:09.578181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Calling method '.version_select at 0x7fb1b48c4700>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:09.581215 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:09.581215 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:09.582855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.583304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.604301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.604949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.642324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.642994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.653857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.654226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.675113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.675604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.682359 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53c73c62-02b2-4302-bb04-f4aabced5b3a tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.461429 May 14 21:12:09.683095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 95/157] 10.222.0.52 () {60 vars in 1242 bytes} [Sat May 14 21:12:09 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:09.698466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Calling method '.version_select at 0x7fb1b49763a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:09.700676 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:09.700676 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:09.701897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.702365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.726398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.727117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.779218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-90307db4-7cc9-4c91-9e36-1a247f4c49ed tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:09.781651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-90307db4-7cc9-4c91-9e36-1a247f4c49ed tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:09.782592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.783625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.796423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.797253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.823083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.824142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.832875 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6aedf3e0-dc84-4dfb-b4c0-51edbb4cbc88 tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.138804 May 14 21:12:09.833561 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 63/158] 10.222.0.52 () {60 vars in 1221 bytes} [Sat May 14 21:12:09 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:12:09.851254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02f92df8-a434-407b-ba96-ab375cee666c tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Calling method '.version_select at 0x7fb1b49f6d30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:09.852691 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:09.852691 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:09.854059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f92df8-a434-407b-ba96-ab375cee666c tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.854581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f92df8-a434-407b-ba96-ab375cee666c tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.885796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f92df8-a434-407b-ba96-ab375cee666c tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:09.886555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f92df8-a434-407b-ba96-ab375cee666c tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:09.902358 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02f92df8-a434-407b-ba96-ab375cee666c tempest-HypervisorAdminV253TestBase-87445476 tempest-HypervisorAdminV253TestBase-87445476-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/fcab8d4a-3198-4a97-8083-93dcc92d3ad3" status: 200 len: 792 microversion: 2.53 time: 0.054830 May 14 21:12:09.902997 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 64/159] 10.222.0.52 () {60 vars in 1297 bytes} [Sat May 14 21:12:09 2022] GET /compute/v2.1/os-hypervisors/fcab8d4a-3198-4a97-8083-93dcc92d3ad3 => generated 792 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 21:12:10.043210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-90307db4-7cc9-4c91-9e36-1a247f4c49ed tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:10.060842 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-90307db4-7cc9-4c91-9e36-1a247f4c49ed tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1218 microversion: 2.1 time: 0.283174 May 14 21:12:10.061506 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 96/160] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:09 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1218 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:10.161643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:10.162405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:10.169103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.169827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:10.170848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.171534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:10.202021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:10.203180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:10.213481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.216182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:10.217060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.217521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:10.317919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:10.336831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0032a74d-61ca-4aec-851a-749f436f84d1 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1322 microversion: 2.1 time: 0.139417 May 14 21:12:10.348398 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 97/161] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:10 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1322 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:10.455434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:10.456275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:10.495512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.502460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:10.502460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.502460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:10.636996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:10.674031 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c9961d6d-78b6-4d42-9f44-8906412c3c70 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1492 microversion: 2.1 time: 0.508589 May 14 21:12:10.674031 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 65/162] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:10 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1492 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:10.767836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:10.778867 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eda12a27-5290-4387-95c6-5e65d7c6fe4f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1338 microversion: 2.1 time: 0.328141 May 14 21:12:10.780232 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 98/163] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:10 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1338 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:10.989411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:10.990067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:10.996494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.997514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:10.998535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:10.998969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.081969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:12:11.085713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:11.085713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:11.090920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.091582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.092541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.093070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.216702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:11.227343 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f6e84a72-ffef-4cf7-9adf-c9794747aaf3 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1222 microversion: 2.1 time: 0.148992 May 14 21:12:11.228626 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 99/164] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:11 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:11.379086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:11.380044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:11.396226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.396655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.397447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.397938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.598021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:11.606773 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab71e25b-8752-4bf8-930f-ea2ca3df2cba tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.254072 May 14 21:12:11.607862 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 100/165] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:11 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:11.650466 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-475d4eb5-46d4-4f55-b67f-27d5503718ee tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 204 len: 0 microversion: 2.1 time: 0.962278 May 14 21:12:11.651333 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 66/166] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:12:10 2022] DELETE /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 0 bytes in 964 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:12:11.667215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:11.668027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:11.675856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.676467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.677203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.677648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.797773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:11.798670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:11.806119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.806940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.808284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:11.808983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:11.837677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:11.851301 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ee51ed2e-b28f-4571-8560-b0ef75822dcd tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1498 microversion: 2.1 time: 0.188129 May 14 21:12:11.851931 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 101/167] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:11 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:11.968778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:11.978701 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a0011ce-6bbd-4aad-a296-7a08486292fe tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1487 microversion: 2.1 time: 0.183971 May 14 21:12:11.978701 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 67/168] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:11 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1487 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:11.995759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26901bee-bdcc-4743-b501-f1cb7f49175b tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:11.996705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26901bee-bdcc-4743-b501-f1cb7f49175b tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:12.003418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26901bee-bdcc-4743-b501-f1cb7f49175b tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.004163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26901bee-bdcc-4743-b501-f1cb7f49175b tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.004944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26901bee-bdcc-4743-b501-f1cb7f49175b tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.005387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26901bee-bdcc-4743-b501-f1cb7f49175b tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.244824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:12.245718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:12.252103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.252563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.253359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.253809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.317857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:12.327025 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d80c4d7f-d475-4b8c-a01a-f3c53cd0af42 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1222 microversion: 2.1 time: 0.085860 May 14 21:12:12.330612 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 68/169] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:12 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:12.393154 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26901bee-bdcc-4743-b501-f1cb7f49175b tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1638 microversion: 2.1 time: 0.401741 May 14 21:12:12.393763 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 102/170] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:11 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1638 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:12.409820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:12.410390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:12.416293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.416749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.417528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.417969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.444459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:12:12.625470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:12.626937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:12.633670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.634126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.634968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.635607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.803399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:12.834627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27aa67a0-6997-4bd9-9466-72b98d3394b7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.213513 May 14 21:12:12.835660 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c525e19-aeca-4ee2-b9a4-3f7cddfcaac5 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 204 len: 0 microversion: 2.1 time: 0.429916 May 14 21:12:12.837590 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 69/171] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:12:12 2022] DELETE /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:12:12.842557 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 103/172] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:12 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:12.845892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:12.846613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:12.866806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.867263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.868117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.868715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.870793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:12.871673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:12.879131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.879759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:12.881053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:12.881723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:13.042421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:13.052594 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2e9be53-3eb0-4e7a-99b7-b50628fc4387 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1493 microversion: 2.1 time: 0.210801 May 14 21:12:13.053870 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 70/173] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:12 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1493 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:13.068854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:13.077393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-73739161-db49-4c27-8ae5-ad71456ef2d0 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1498 microversion: 2.1 time: 0.211346 May 14 21:12:13.078456 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 104/174] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:12 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:13.349629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:13.350722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:13.356953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:13.357403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:13.358518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:13.358956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:13.436544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:13.444663 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-949d30e2-f798-4eb6-8eef-1c96e737bbf9 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1222 microversion: 2.1 time: 0.104140 May 14 21:12:13.445431 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 71/175] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:13 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:13.516896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-213988678", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:13.581376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:12:13.792560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:12:13.792982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:12:13.793453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:12:13.794027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:12:13.794636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:12:13.804353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:13.804847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:13.805691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:13.806145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:13.825367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:13.829849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for user 5b93d6c3d03d407f8be4aa38e2fbb154 and project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:13.841182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:12:13.843358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:12:13.856239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:13.856874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:13.863544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:13.864010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:13.864872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:13.865319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:14.001979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-51c03b93-e04f-42a7-9f36-6c38066ddbfd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621576 May 14 21:12:14.003214 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 105/176] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:12:14.014718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8810f3db-5ca5-4612-a9e6-7c302eecfde3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:14.025827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8810f3db-5ca5-4612-a9e6-7c302eecfde3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:14.122012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8810f3db-5ca5-4612-a9e6-7c302eecfde3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:14.132667 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8810f3db-5ca5-4612-a9e6-7c302eecfde3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1212 microversion: 2.1 time: 0.122392 May 14 21:12:14.136770 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 106/177] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:14 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1212 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:14.142470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:14.143278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:14.152321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:14.153187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:14.154183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:14.154943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:14.159989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:14.168506 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24dc4250-9caa-4788-bba8-e3626d7ce75e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.316020 May 14 21:12:14.169103 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 72/178] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:13 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:14.188680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:14.209915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:14.222799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:14.223703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:14.225816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:14.226525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:14.415038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:14.426448 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15778706-e55c-40f6-914c-4b092a060f77 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1498 microversion: 2.1 time: 0.241700 May 14 21:12:14.427719 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 73/179] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:14 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1498 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:14.462227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:14.470079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:14.470669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:14.471135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:14.471961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:14.472408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:14.477708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:14.485521 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1737263b-42b4-4701-9ec9-f3db17eacb52 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1493 microversion: 2.1 time: 0.346817 May 14 21:12:14.497973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 107/180] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:14 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1493 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:14.552085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:14.562373 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7696fc1e-1fba-48b0-a9d9-173beeada90f tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1222 microversion: 2.1 time: 0.104270 May 14 21:12:14.563007 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 74/181] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:14 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1222 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:15.115604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-9b37cf7d-90f6-44d6-af13-b93e2a073ddd req-398c540e-6a79-499a-8cad-63ea3c4d3cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f", "name": "network-vif-deleted", "tag": "184c6858-4c0a-4d04-9766-8a49c780f6ad"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:15.126018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9b37cf7d-90f6-44d6-af13-b93e2a073ddd req-398c540e-6a79-499a-8cad-63ea3c4d3cb3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.126767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9b37cf7d-90f6-44d6-af13-b93e2a073ddd req-398c540e-6a79-499a-8cad-63ea3c4d3cb3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.140144 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9b37cf7d-90f6-44d6-af13-b93e2a073ddd req-398c540e-6a79-499a-8cad-63ea3c4d3cb3 service nova] Creating event network-vif-deleted:184c6858-4c0a-4d04-9766-8a49c780f6ad for instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f on nch2-master-1 May 14 21:12:15.145986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-9b37cf7d-90f6-44d6-af13-b93e2a073ddd req-398c540e-6a79-499a-8cad-63ea3c4d3cb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035655 May 14 21:12:15.147684 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 75/182] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:15.163222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-62a217e5-9100-4d72-b48d-dc9efd3fd996 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.164194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-62a217e5-9100-4d72-b48d-dc9efd3fd996 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:15.243159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-62a217e5-9100-4d72-b48d-dc9efd3fd996 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:15.257686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Calling method '.version_select at 0x7fb1b48c4160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.258212 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-62a217e5-9100-4d72-b48d-dc9efd3fd996 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1212 microversion: 2.1 time: 0.107434 May 14 21:12:15.259501 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:15.259501 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:15.259968 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 76/183] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1212 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:15.261396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.262003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.264790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.265567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:15.272651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.273335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.274285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.275180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.283403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.284314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.323081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.323638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.348870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-74bc8999-7732-4a04-b2e3-5aa5a5733999 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.339689 May 14 21:12:15.351625 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 108/184] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:15.472483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:15.482740 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3af4f0b8-4d4d-4d73-a190-5ae0f5200db9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.221382 May 14 21:12:15.485865 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 77/185] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:15.498420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.499054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:15.510081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.514288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.519662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.520414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.532439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c579409-e234-4895-9d7e-bda1ab382c50 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Calling method '.version_select at 0x7fb1b4859e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.533267 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:15.533267 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:15.534378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c579409-e234-4895-9d7e-bda1ab382c50 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '0fda09f388884efaa038bd40c6d8c418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95b9f9f7fbd4c0583841a5fcac655bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c579409-e234-4895-9d7e-bda1ab382c50 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Request method failure captured: May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBst2LS6MSFG6Jvhe1zLmqPG57zrFsRMVXIq1nXHFfajLoSejNLyF0MZBpyi2djo2VXemP4d2L_LCXNPrPPAn3tdxSEXgMu-Mn7eRiykiSu_W0tRDH8_ZmD7tuUcZWhzGbWPb-1qFdtXCQBezoQToE5qYpCa5WYD-nhG-KocktQM2TY May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b95b9f9f7fbd4c0583841a5fcac655bf May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1076804414 May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:15.551052 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b95b9f9f7fbd4c0583841a5fcac655bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b95b9f9f7fbd4c0583841a5fcac655bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b95b9f9f7fbd4c0583841a5fcac655bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b95b9f9f7fbd4c0583841a5fcac655bf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1076804414 May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b95b9f9f7fbd4c0583841a5fcac655bf May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1076804414 May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 0fda09f388884efaa038bd40c6d8c418 May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 14 21:12:15.555369 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'nch2-master-1'} May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:15.556109 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 14 21:12:15.557161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:15.558172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c579409-e234-4895-9d7e-bda1ab382c50 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:15.558172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c579409-e234-4895-9d7e-bda1ab382c50 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.196330 May 14 21:12:15.561515 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 109/186] 10.222.0.52 () {58 vars in 1208 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 14 21:12:15.570726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.588576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:15.604061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.604754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.605811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.608866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.638601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:15.658858 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92b580c1-d26e-4072-bc0f-123adcb22d7f tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 200 len: 1327 microversion: 2.1 time: 0.171363 May 14 21:12:15.660300 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 78/187] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 1327 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:15.666760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-966d34b6-2ecb-4ee5-be74-57c2bde3279b tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Calling method '.version_select at 0x7fb1b49195e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.666760 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:15.666760 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:15.667239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-966d34b6-2ecb-4ee5-be74-57c2bde3279b tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.667925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-966d34b6-2ecb-4ee5-be74-57c2bde3279b tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.686073 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-966d34b6-2ecb-4ee5-be74-57c2bde3279b tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-966d34b6-2ecb-4ee5-be74-57c2bde3279b tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Request method failure captured: May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsuxcbIOpbTSW-5IjfKcxeOe9QmsbPkABMxrb2enEM7KTmnNZ7g_XaMuMOpKWbxa4kuGTMg-31ofXGGUz6bS-DLJCcx7bZ8Qq1yJVmoeO9xIWUUkFqY9pbaWROsyBSlP-HTX1Skr963QNoYX4v6a0sJMEJLyx8obPLG89wEaeudXQY May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7e6b293613e54e6e81db74bb1880d696 May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1068219952 May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:15.689150 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e6b293613e54e6e81db74bb1880d696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e6b293613e54e6e81db74bb1880d696"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e6b293613e54e6e81db74bb1880d696"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e6b293613e54e6e81db74bb1880d696", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1068219952 May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7e6b293613e54e6e81db74bb1880d696 May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1068219952 May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 84299f967d3444bea04c395235740a94 May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 14 21:12:15.690738 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'nonexistent_hypervisor_name'} May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.691753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.693049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.693049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:15.693049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:15.693049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 14 21:12:15.693049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:15.695773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-966d34b6-2ecb-4ee5-be74-57c2bde3279b tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:15.696703 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-966d34b6-2ecb-4ee5-be74-57c2bde3279b tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.035323 May 14 21:12:15.697606 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 79/188] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:15.706713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.707695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:15.713745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.714187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.715975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.716414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.731888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:15.751543 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58d162fe-6809-46f0-809c-8f1f48f7836a tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1451 microversion: 2.1 time: 0.188558 May 14 21:12:15.754177 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 110/189] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1451 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:15.778389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Calling method '.version_select at 0x7fb1b4859940>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.779201 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:15.779201 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:15.780392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.780845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.796139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.796591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.808306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.808759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.815202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:15.815734 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-686ba390-f1ba-48e8-952c-3149c834f9b8 tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.058868 May 14 21:12:15.816337 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 111/190] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:15.826776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-832ab2d8-87ad-4b2b-a629-5406c8131c90 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Calling method '.version_select at 0x7fb1b48591f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.827820 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:15.827820 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:15.829964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-832ab2d8-87ad-4b2b-a629-5406c8131c90 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '0fda09f388884efaa038bd40c6d8c418', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b95b9f9f7fbd4c0583841a5fcac655bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-832ab2d8-87ad-4b2b-a629-5406c8131c90 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Request method failure captured: May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBst2LS6MSFG6Jvhe1zLmqPG57zrFsRMVXIq1nXHFfajLoSejNLyF0MZBpyi2djo2VXemP4d2L_LCXNPrPPAn3tdxSEXgMu-Mn7eRiykiSu_W0tRDH8_ZmD7tuUcZWhzGbWPb-1qFdtXCQBezoQToE5qYpCa5WYD-nhG-KocktQM2TY May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b95b9f9f7fbd4c0583841a5fcac655bf May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1076804414 May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:15.831612 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b95b9f9f7fbd4c0583841a5fcac655bf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b95b9f9f7fbd4c0583841a5fcac655bf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b95b9f9f7fbd4c0583841a5fcac655bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b95b9f9f7fbd4c0583841a5fcac655bf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1076804414 May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b95b9f9f7fbd4c0583841a5fcac655bf May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1076804414 May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 0fda09f388884efaa038bd40c6d8c418 May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 14 21:12:15.833009 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1'} May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:15.833781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 14 21:12:15.834969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:15.836227 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8cb38433-9dd4-498e-ae6a-6b6aedd5b525 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1214 microversion: 2.1 time: 0.133680 May 14 21:12:15.836227 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 80/191] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:15.837112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-832ab2d8-87ad-4b2b-a629-5406c8131c90 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:15.837971 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-832ab2d8-87ad-4b2b-a629-5406c8131c90 tempest-HypervisorAdminNegativeUnderV252Test-1076804414 tempest-HypervisorAdminNegativeUnderV252Test-1076804414-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.015170 May 14 21:12:15.838495 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 112/192] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:15.847404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-782d27b5-dfad-49a3-b001-1834ce80c64e tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Calling method '.version_select at 0x7fb1b47a73a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:15.848221 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:15.848221 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:15.849402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-782d27b5-dfad-49a3-b001-1834ce80c64e tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:15.849850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-782d27b5-dfad-49a3-b001-1834ce80c64e tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:15.857483 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-782d27b5-dfad-49a3-b001-1834ce80c64e tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] HTTP exception thrown: No hypervisor matching '6d4be316-0745-4a07-a965-67f96d950693' could be found. May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-782d27b5-dfad-49a3-b001-1834ce80c64e tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Request method failure captured: May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hypervisors/6d4be316-0745-4a07-a965-67f96d950693/servers HTTP/1.1 May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsuxcbIOpbTSW-5IjfKcxeOe9QmsbPkABMxrb2enEM7KTmnNZ7g_XaMuMOpKWbxa4kuGTMg-31ofXGGUz6bS-DLJCcx7bZ8Qq1yJVmoeO9xIWUUkFqY9pbaWROsyBSlP-HTX1Skr963QNoYX4v6a0sJMEJLyx8obPLG89wEaeudXQY May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7e6b293613e54e6e81db74bb1880d696 May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1068219952 May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:15.860364 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e6b293613e54e6e81db74bb1880d696"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7e6b293613e54e6e81db74bb1880d696"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7e6b293613e54e6e81db74bb1880d696"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7e6b293613e54e6e81db74bb1880d696", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1068219952 May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7e6b293613e54e6e81db74bb1880d696 May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1068219952 May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 84299f967d3444bea04c395235740a94 May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: exception: No hypervisor matching '6d4be316-0745-4a07-a965-67f96d950693' could be found. May 14 21:12:15.861780 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6d4be316-0745-4a07-a965-67f96d950693'} May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6d4be316-0745-4a07-a965-67f96d950693' could be found. May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:15.862573 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:15.863795 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:15.863795 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:15.863795 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:15.863795 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:15.863795 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6d4be316-0745-4a07-a965-67f96d950693' could be found. May 14 21:12:15.863795 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:15.863795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-782d27b5-dfad-49a3-b001-1834ce80c64e tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] Returning 404 to user: No hypervisor matching '6d4be316-0745-4a07-a965-67f96d950693' could be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:15.866765 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-782d27b5-dfad-49a3-b001-1834ce80c64e tempest-HypervisorAdminNegativeUnderV252Test-1068219952 tempest-HypervisorAdminNegativeUnderV252Test-1068219952-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/6d4be316-0745-4a07-a965-67f96d950693/servers" status: 404 len: 123 microversion: 2.1 time: 0.020020 May 14 21:12:15.867360 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 81/193] 10.222.0.52 () {58 vars in 1280 bytes} [Sat May 14 21:12:15 2022] GET /compute/v2.1/os-hypervisors/6d4be316-0745-4a07-a965-67f96d950693/servers => generated 123 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:12:16.276847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:16.277544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:16.285722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.286179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.286958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.287631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.388740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:16.398945 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-938e99cf-8092-4d45-ba04-bf5316459375 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1264 microversion: 2.1 time: 0.126295 May 14 21:12:16.401634 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 113/194] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:16 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1264 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:16.501751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:16.510617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:16.510617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.510617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.511367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.512033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.676909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:16.678392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:16.686868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.687779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.689624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.690068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.707578 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] HTTP exception thrown: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Request method failure captured: May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f HTTP/1.1 May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsFQFNrV5TPQX0XEV4uqUfcv2uhH1hcOyD6QmGhQTwUlH4yyEStWEL9D-qx16RlpFP417wZx-7eHYSAZ5A-faPl9oSwnzMq9PNVPbwQqqeOi4HMgP7P7xVxXf2uQXs0OZtL3xD_tZMk8HpWJunN3zkl2MEIAWU7RfWUpGt03rD-4mI May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:16.712042 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_313d5b39fe10417993b28718eb6e6f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 7d7d10a70c364505af3b2b8294238615 May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:16.715597 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f'} May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:16.716297 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:16.717322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:16.718246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Returning 404 to user: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:16.718318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:16.718403 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d937172-5ceb-4a60-9511-73bd9f8768ca tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 404 len: 111 microversion: 2.1 time: 0.042138 May 14 21:12:16.720299 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 114/195] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:16 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:16.729023 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9b727d8-448a-42d7-9ffe-34e1300fa29f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.230714 May 14 21:12:16.729621 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 82/196] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:16 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:16.772884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:16.773784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:16.783999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.784463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.785840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.786458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.819735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.820184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.820663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lazy-loading 'fault' on Instance uuid e5177b64-d9cc-4897-8d54-06f1d7dd250a {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:16.842974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2123539625", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:16.894995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbd1715608f64bcfbff6bf07039389c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7284e17654bc4a62a6d92db0f9fe2b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:16.905912 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01ba776e-cbea-45c2-865c-ff97a2483e6e tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 200 len: 1328 microversion: 2.1 time: 0.137187 May 14 21:12:16.907648 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 115/197] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:16 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 1328 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:16.912385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:16.912992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:16.917630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:12:16.927232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.927814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:16.928556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:16.929044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.038682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:17.056696 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86953ae3-2707-4a9c-918a-6d2ec09e89ca tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1270 microversion: 2.1 time: 0.147809 May 14 21:12:17.057292 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 116/198] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:16 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1270 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:17.173331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2716c83e-ca57-4726-8a12-249f34905c6c req-0ae62ea8-7b40-4203-bc53-a83a12768090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5177b64-d9cc-4897-8d54-06f1d7dd250a", "name": "network-vif-deleted", "tag": "88977556-23b1-4102-b801-82c6a337b4c9"}, {"name": "network-changed", "server_uuid": "406fb98b-cfdf-42ed-b684-bcabeee2633e", "tag": "e509da02-863e-4b7a-95be-11eee591d1dc"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:17.184699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2716c83e-ca57-4726-8a12-249f34905c6c req-0ae62ea8-7b40-4203-bc53-a83a12768090 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.185575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2716c83e-ca57-4726-8a12-249f34905c6c req-0ae62ea8-7b40-4203-bc53-a83a12768090 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.200609 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2716c83e-ca57-4726-8a12-249f34905c6c req-0ae62ea8-7b40-4203-bc53-a83a12768090 service nova] Creating event network-vif-deleted:88977556-23b1-4102-b801-82c6a337b4c9 for instance e5177b64-d9cc-4897-8d54-06f1d7dd250a on nch2-master-1 May 14 21:12:17.201307 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2716c83e-ca57-4726-8a12-249f34905c6c req-0ae62ea8-7b40-4203-bc53-a83a12768090 service nova] Creating event network-changed:e509da02-863e-4b7a-95be-11eee591d1dc for instance 406fb98b-cfdf-42ed-b684-bcabeee2633e on nch1-master-1 May 14 21:12:17.241556 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2716c83e-ca57-4726-8a12-249f34905c6c req-0ae62ea8-7b40-4203-bc53-a83a12768090 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.071978 May 14 21:12:17.243169 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 117/199] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:17.278319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:12:17.278785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:12:17.279277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:12:17.279734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:12:17.282745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:12:17.293311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.293768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.294580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.295178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.321984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Getting quotas for project 313d5b39fe10417993b28718eb6e6f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:17.325379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Getting quotas for user 7d7d10a70c364505af3b2b8294238615 and project 313d5b39fe10417993b28718eb6e6f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:17.345479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:12:17.355371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:12:17.420794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:17.421534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:17.428844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.429402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.430438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.431004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.490811 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-49cc4bf7-37d3-4021-a207-46ef082b1341 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652227 May 14 21:12:17.491887 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 83/200] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:12:17.521539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7dc43f6c-a35e-4a73-bef5-252a360b7dea tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:17.522242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7dc43f6c-a35e-4a73-bef5-252a360b7dea tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:17.588690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7dc43f6c-a35e-4a73-bef5-252a360b7dea tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:17.596812 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7dc43f6c-a35e-4a73-bef5-252a360b7dea tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1220 microversion: 2.1 time: 0.094434 May 14 21:12:17.597393 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 84/201] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:17 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:17.692682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:17.706494 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a9098c3e-ec44-4a28-aa9f-dcee047bf610 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1270 microversion: 2.1 time: 0.291350 May 14 21:12:17.708424 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 118/202] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:17 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1270 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:17.751176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:17.751828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:17.759241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.759730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.760501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.761104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.932560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:17.933995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:17.936264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:17.941310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.943244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.944436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.944878 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-64fce01a-b3c6-4ca2-bf29-74f33f79445b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.197832 May 14 21:12:17.945236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:17.957105 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 85/203] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:17 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:17.964013 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] HTTP exception thrown: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Request method failure captured: May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a HTTP/1.1 May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsGIZYB7CKXNuLonZtMVe65YaESa-ucHwxS8ltPHUK1MXT4JCse7c2MJdlnEb7HkVqUnrz4gp987Og0hSCtMyY1jRbKGJZoIynN-a2ZuyeS_E8_5b6V0Gd3GET2ZltppuoYmA5Tfv2HOijN1Js_WuiFC4tNRe2NYR2r9jtKhcCBXGQ May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 7284e17654bc4a62a6d92db0f9fe2b5e May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:17.965680 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7284e17654bc4a62a6d92db0f9fe2b5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 7284e17654bc4a62a6d92db0f9fe2b5e May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminTestJSON-1698933114-project May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: bbd1715608f64bcfbff6bf07039389c9 May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminTestJSON-1698933114-project May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:17.972112 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'e5177b64-d9cc-4897-8d54-06f1d7dd250a'} May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:17.972808 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:17.974342 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:17.975244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Returning 404 to user: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:17.975244 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d94c1e78-dfa5-48b1-a448-ecbcda9062bb tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 404 len: 111 microversion: 2.1 time: 0.039677 May 14 21:12:17.975244 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 119/204] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:17 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:17.980712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8a89ca8-2c91-4c68-82c6-3a47f98c44ab tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:17.982446 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:17.982446 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:17.992203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8a89ca8-2c91-4c68-82c6-3a47f98c44ab tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:17.993070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8a89ca8-2c91-4c68-82c6-3a47f98c44ab tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.074073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:18.074833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:18.082238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.082981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.083999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.084448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.150162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:18.158772 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2f58511-33d9-4274-bc7c-81afe2c49c59 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1276 microversion: 2.1 time: 0.088843 May 14 21:12:18.162304 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 120/205] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:18 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:18.294835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8a89ca8-2c91-4c68-82c6-3a47f98c44ab tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.319454 May 14 21:12:18.296086 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 86/206] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:17 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:18.307509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2af86b1b-521d-4fd8-897a-a0269f53f118 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:18.308750 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:18.308750 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:18.426003 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2af86b1b-521d-4fd8-897a-a0269f53f118 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.122622 May 14 21:12:18.430646 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 121/207] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:18 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:18.441493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-87f1e848-89e3-48c7-89db-1d1841d77ddb tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1934320288"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:18.443024 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:18.443024 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:18.444050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-87f1e848-89e3-48c7-89db-1d1841d77ddb tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid 4221efc4-27fa-4193-ac0d-04a6eebb7e0b for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:18.579975 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-87f1e848-89e3-48c7-89db-1d1841d77ddb tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.141425 May 14 21:12:18.582143 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 87/208] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:18.590602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e4022130-1862-4021-ae4f-007dfe5499b7 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:18.592298 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:18.592298 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:18.603017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4022130-1862-4021-ae4f-007dfe5499b7 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.603639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4022130-1862-4021-ae4f-007dfe5499b7 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.640077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:18.640793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:18.660035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.660495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.661269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.661701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.742158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:18.752810 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6822e9f-6819-4a1e-b28a-2b6871a74c00 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1246 microversion: 2.1 time: 0.132855 May 14 21:12:18.753393 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 88/209] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:18 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:18.769477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:18.770022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:18.777205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.777654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.778428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.778864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.962548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:18.975863 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-577f2b29-c5c6-4117-9d1f-b1b94676cd98 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.210551 May 14 21:12:18.976634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 89/210] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:18 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:18.982250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:18.983142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:18.990456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.991195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:18.992361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:18.992803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:19.166980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:19.176069 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df9f85a3-ab80-4d73-8f74-4d3f3da50e1f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.198209 May 14 21:12:19.184463 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 90/211] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:18 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:19.224366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:19.226880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:19.240014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:19.240544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:19.241541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:19.243721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:19.338214 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e4022130-1862-4021-ae4f-007dfe5499b7 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.751370 May 14 21:12:19.339313 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 122/212] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:18 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:19.350203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a70ba459-e292-4818-861c-50120059deb9 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:19.351323 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:19.351323 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:19.365829 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a70ba459-e292-4818-861c-50120059deb9 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.019628 May 14 21:12:19.366584 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 123/213] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:12:19 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:19.381959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efb9dd38-1f53-48c5-b778-ee2cd9107695 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:19.383607 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:19.383607 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:19.394281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efb9dd38-1f53-48c5-b778-ee2cd9107695 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:19.394948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efb9dd38-1f53-48c5-b778-ee2cd9107695 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:19.426406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:19.431049 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd771d95-ebb7-4987-af40-73d3f27478ba tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.242712 May 14 21:12:19.432341 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 91/214] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:19 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:19.690528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efb9dd38-1f53-48c5-b778-ee2cd9107695 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.312731 May 14 21:12:19.691446 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 124/215] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:19 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:19.705948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3e1d37a-614a-43c5-a793-94d9e08c09b6 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:19.706698 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:19.706698 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:19.770458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:19.773826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:19.779659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:19.780830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:19.781995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:19.782482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:19.851588 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3e1d37a-614a-43c5-a793-94d9e08c09b6 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.154089 May 14 21:12:19.853393 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 92/216] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:19 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:19.863543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4cf920b2-9e97-4853-8bcd-4c9f693a92ed tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1478454772"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:19.865377 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:19.865377 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:19.866417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-4cf920b2-9e97-4853-8bcd-4c9f693a92ed tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid 1ea9a365-378c-4455-b3d0-a13564d42dc9 for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:19.956250 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4cf920b2-9e97-4853-8bcd-4c9f693a92ed tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.097214 May 14 21:12:19.957519 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 93/217] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:19.969116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84edc649-3a90-4d2c-aa7c-a02f16a145bd tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:19.971210 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:19.971210 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:19.980486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84edc649-3a90-4d2c-aa7c-a02f16a145bd tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:19.981248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84edc649-3a90-4d2c-aa7c-a02f16a145bd tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.050352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:20.058820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4abe45a1-0e1b-487b-9e49-1046e2ec204d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1272 microversion: 2.1 time: 0.293077 May 14 21:12:20.059732 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 125/218] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:19 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:20.065926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:20.071919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:20.074989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:20.075443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.076302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:20.077057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.284372 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84edc649-3a90-4d2c-aa7c-a02f16a145bd tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.319742 May 14 21:12:20.286169 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 94/219] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:19 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:20.289691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:20.291621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:20.298602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:20.302153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.303052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:20.303432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.448424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:20.457277 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-32295507-4996-4ce5-af2f-468504316fd9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.171351 May 14 21:12:20.457853 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 95/220] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:20 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:20.462206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-85881b1a-5b2d-498e-a86d-d72ab2df197e tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:20.462962 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:20.462962 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:20.469189 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-85881b1a-5b2d-498e-a86d-d72ab2df197e tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.010242 May 14 21:12:20.471092 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 96/221] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:12:20 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:20.477476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:20.478427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:20.486749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:20.494312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.496289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:20.497942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.639956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:20.649286 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-75063c4e-c61d-4861-91cd-c6e705ce9fdc tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.176930 May 14 21:12:20.649895 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 97/222] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:20 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:20.657788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02af7a0d-0c5a-411d-9b0a-bc732e88ed98 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:20.659061 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:20.659061 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:20.669425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02af7a0d-0c5a-411d-9b0a-bc732e88ed98 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:20.669902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02af7a0d-0c5a-411d-9b0a-bc732e88ed98 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:20.800828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:20.809418 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99a45641-3c80-4ac1-ad67-e261af58fb40 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.748646 May 14 21:12:20.810079 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 126/223] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:20 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:20.900296 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02af7a0d-0c5a-411d-9b0a-bc732e88ed98 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.249240 May 14 21:12:20.901257 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 98/224] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:20 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:20.915792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2addeeef-bace-4140-b762-634d5e4aaf2c tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:20.916689 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:20.916689 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:21.018699 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2addeeef-bace-4140-b762-634d5e4aaf2c tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.109565 May 14 21:12:21.019295 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 127/225] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:20 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:21.030590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82428098-8ee9-4f8f-9252-5425b8375bb7 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-432441874"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:21.043969 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:21.043969 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:21.045359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.aggregate [None req-82428098-8ee9-4f8f-9252-5425b8375bb7 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid a149d83e-8968-47b4-bb92-b76f4b1972db for aggregate {{(pid=130637) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:21.059723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94d605be-9b1a-469b-a461-65bdc351aa82 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:21.060533 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:21.060533 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:21.063369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-94d605be-9b1a-469b-a461-65bdc351aa82 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94d605be-9b1a-469b-a461-65bdc351aa82 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950-project-admin] Request method failure captured: May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBs0pRnKa_xdnid0R-gXxE6PkTGVp2ltJd6tij-b6WDN5AamRUgpLNxRsmHuEuEHAepMGafhzyZR7o_UrQ9-UodyR4YEdaxTliBVY5MHMvZ0VncHYud4sWZ45LcNGZxSFY9YRo0wT6ZcK7TK7JqKSYvqHFxTdDrBs8rDS_y27FtoQAI May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 3dafa8dbd6e64b59b2c0c5f7f36f915d May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:21.073402 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3dafa8dbd6e64b59b2c0c5f7f36f915d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3dafa8dbd6e64b59b2c0c5f7f36f915d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3dafa8dbd6e64b59b2c0c5f7f36f915d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3dafa8dbd6e64b59b2c0c5f7f36f915d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 3dafa8dbd6e64b59b2c0c5f7f36f915d May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950-project-admin May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 5190e584da704393b66c824b8bb73cd1 May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950-project-admin May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:21.074580 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid timestamp for date invalid_time May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'invalid_time'} May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:21.075213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 14 21:12:21.076855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:21.079202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94d605be-9b1a-469b-a461-65bdc351aa82 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:21.080644 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-94d605be-9b1a-469b-a461-65bdc351aa82 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950 tempest-InstanceUsageAuditLogNegativeTestJSON-1729325950-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.159805 May 14 21:12:21.081788 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 99/226] 10.222.0.52 () {58 vars in 1223 bytes} [Sat May 14 21:12:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:12:21.088881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:21.089598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:21.097343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.097806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.098838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.099470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.143269 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82428098-8ee9-4f8f-9252-5425b8375bb7 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.115042 May 14 21:12:21.149194 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 128/227] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:21.191516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:21.199498 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f4e156ee-73d8-4a02-973e-5411bd022b30 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1278 microversion: 2.1 time: 0.115775 May 14 21:12:21.200208 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 100/228] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:21 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:21.204984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fdf64238-38ca-4194-a5b3-7218d6ed8b73 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:21.207629 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:21.207629 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:21.216707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fdf64238-38ca-4194-a5b3-7218d6ed8b73 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.217436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fdf64238-38ca-4194-a5b3-7218d6ed8b73 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.309015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd4c8a83-dd9e-4701-90a9-2968b935ecef tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:21.309867 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:21.309867 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:21.311232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cd4c8a83-dd9e-4701-90a9-2968b935ecef tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ffab27037bd74cb780bb175db35b341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d100b7d10340adafb28f400696917d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd4c8a83-dd9e-4701-90a9-2968b935ecef tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Request method failure captured: May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBszYY8LePM1vaqq-qNxbcvJX_k0HZnqr-fKsSAs8WLjkoFy291xdjIqbDFqT8EwKMWHiM_rL8sPHzqxtHZH8F7s6VWB3gIVx2kKOj2hFU9sUR3FrH6CwQLxedD28aDLCT3n9NHcrzudlnYUJHO-bHmghczkUT9-cu684dL_-lnZSj4 May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 09d100b7d10340adafb28f400696917d May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:21.313836 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09d100b7d10340adafb28f400696917d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09d100b7d10340adafb28f400696917d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09d100b7d10340adafb28f400696917d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09d100b7d10340adafb28f400696917d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 09d100b7d10340adafb28f400696917d May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ffab27037bd74cb780bb175db35b341c May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:21.315002 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:21.315668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:21.316866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd4c8a83-dd9e-4701-90a9-2968b935ecef tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:21.317768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd4c8a83-dd9e-4701-90a9-2968b935ecef tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.169725 May 14 21:12:21.317768 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 129/229] 10.222.0.52 () {58 vars in 1184 bytes} [Sat May 14 21:12:21 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 171 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:21.324361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9471a5cd-1961-42ca-a937-93550710265f tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:21.325130 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:21.325130 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:21.326323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9471a5cd-1961-42ca-a937-93550710265f tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ffab27037bd74cb780bb175db35b341c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d100b7d10340adafb28f400696917d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9471a5cd-1961-42ca-a937-93550710265f tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Request method failure captured: May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-14%2021:12:21 HTTP/1.1 May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBszYY8LePM1vaqq-qNxbcvJX_k0HZnqr-fKsSAs8WLjkoFy291xdjIqbDFqT8EwKMWHiM_rL8sPHzqxtHZH8F7s6VWB3gIVx2kKOj2hFU9sUR3FrH6CwQLxedD28aDLCT3n9NHcrzudlnYUJHO-bHmghczkUT9-cu684dL_-lnZSj4 May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 09d100b7d10340adafb28f400696917d May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:21.328094 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09d100b7d10340adafb28f400696917d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/09d100b7d10340adafb28f400696917d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/09d100b7d10340adafb28f400696917d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_09d100b7d10340adafb28f400696917d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 09d100b7d10340adafb28f400696917d May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ffab27037bd74cb780bb175db35b341c May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:21.330196 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '2022-05-14 21:12:21'} May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:21.330772 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:21.332375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9471a5cd-1961-42ca-a937-93550710265f tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:21.333879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9471a5cd-1961-42ca-a937-93550710265f tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268 tempest-InstanceUsageAuditLogNegativeTestJSON-1315795268-project] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-14 21:12:21" status: 403 len: 128 microversion: 2.1 time: 0.010101 May 14 21:12:21.333879 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 130/230] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:12:21 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-14%2021%3A12%3A21 => generated 128 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 14 21:12:21.461080 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fdf64238-38ca-4194-a5b3-7218d6ed8b73 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 241 microversion: 2.1 time: 0.259810 May 14 21:12:21.461671 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 101/231] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:21 2022] POST /compute/v2.1/os-aggregates/5/action => generated 241 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:21.473558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b704b7b3-df1d-4de1-a9a8-8a40ac7e72c6 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:21.473819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:21.474643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:21.475054 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:21.475054 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:21.481495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.481979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.482940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.495255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.495542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b704b7b3-df1d-4de1-a9a8-8a40ac7e72c6 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.495542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b704b7b3-df1d-4de1-a9a8-8a40ac7e72c6 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.687247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:21.696588 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea3a1492-781f-4f5d-99a4-08232b61bdc5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.227324 May 14 21:12:21.707760 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 102/232] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:21 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:21.707760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a0c853a2-6c9a-4f5a-bcc5-876c29720f04 req-beea2db8-d1c9-40fb-b696-92631a0ddefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5a5886-95f4-4ee4-9bf7-013456bfa20b", "tag": "18b50999-4ef7-4c21-8dba-c0606fe826e1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:21.713500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a0c853a2-6c9a-4f5a-bcc5-876c29720f04 req-beea2db8-d1c9-40fb-b696-92631a0ddefd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.713947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a0c853a2-6c9a-4f5a-bcc5-876c29720f04 req-beea2db8-d1c9-40fb-b696-92631a0ddefd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.728333 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a0c853a2-6c9a-4f5a-bcc5-876c29720f04 req-beea2db8-d1c9-40fb-b696-92631a0ddefd service nova] Creating event network-changed:18b50999-4ef7-4c21-8dba-c0606fe826e1 for instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b on nch1-master-1 May 14 21:12:21.734508 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a0c853a2-6c9a-4f5a-bcc5-876c29720f04 req-beea2db8-d1c9-40fb-b696-92631a0ddefd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035821 May 14 21:12:21.735103 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 103/233] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:21.740808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:21.741699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:21.749469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.750648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.751974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.759679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.819011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b704b7b3-df1d-4de1-a9a8-8a40ac7e72c6 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 226 microversion: 2.1 time: 0.350725 May 14 21:12:21.820295 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 131/234] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:21 2022] POST /compute/v2.1/os-aggregates/5/action => generated 226 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:21.837601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:21.838233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:21.846963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.847427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.848245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:21.848712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:21.976175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:21.986797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d354a8ce-75c1-4358-9f94-fc9b189a9b8a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.250277 May 14 21:12:21.988007 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 104/235] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:21 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:22.002306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-735d8151-d37c-4ed4-ac56-2eeaa92cb770 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.005341 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.005341 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:22.146567 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-735d8151-d37c-4ed4-ac56-2eeaa92cb770 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.156742 May 14 21:12:22.147424 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 105/236] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:21 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:22.160720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2bd8ed2c-65f2-41eb-9877-c242090656e0 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-294299577"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:22.163064 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.163064 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:22.164255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-2bd8ed2c-65f2-41eb-9877-c242090656e0 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid eaaf5ace-3569-4e7d-953e-f89fda15ec54 for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:22.243957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:22.254337 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14c28e3e-2cbb-415a-b318-1309779d1ff4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.427208 May 14 21:12:22.264854 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 132/237] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:21 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:22.264854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9c7a1fd8-433a-4900-9922-e039f567042f tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b4716ee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.264854 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.264854 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.264854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fd8-433a-4900-9922-e039f567042f tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.264854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fd8-433a-4900-9922-e039f567042f tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.266749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fd8-433a-4900-9922-e039f567042f tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.267354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7a1fd8-433a-4900-9922-e039f567042f tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.278015 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2bd8ed2c-65f2-41eb-9877-c242090656e0 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.121416 May 14 21:12:22.286642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 106/238] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:22 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:22.286642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.286642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:22.300447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.301392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.302186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.302636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.324287 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9c7a1fd8-433a-4900-9922-e039f567042f tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.066090 May 14 21:12:22.325381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 133/239] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:22.333096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52a05f54-ea1a-4781-a2a4-2fb385dcdc87 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.334057 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.334057 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.425795 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52a05f54-ea1a-4781-a2a4-2fb385dcdc87 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.099360 May 14 21:12:22.426612 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 134/240] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:22.435663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6b36d715-d47d-413c-a64b-6c98ee0f0919 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b4716790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.437138 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.437138 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.439691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b36d715-d47d-413c-a64b-6c98ee0f0919 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.440152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b36d715-d47d-413c-a64b-6c98ee0f0919 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.440972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b36d715-d47d-413c-a64b-6c98ee0f0919 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.441404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b36d715-d47d-413c-a64b-6c98ee0f0919 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.503027 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6b36d715-d47d-413c-a64b-6c98ee0f0919 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.074969 May 14 21:12:22.503687 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 135/241] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:22.514483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b9ae9a6-d52a-4eb0-aa4a-4483ea41ac89 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.521392 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.521392 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.529770 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-7b9ae9a6-d52a-4eb0-aa4a-4483ea41ac89 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b9ae9a6-d52a-4eb0-aa4a-4483ea41ac89 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Request method failure captured: May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsJ4UkWewZh4IK08LzpHTBSm9K9waLBmUEaVZ-JXfIlTgLAhdyX0FWMyJ5tbI96kEpcxGWaCsxQjAiAuGsYHPkvnBWSEeIvzHRXw_zlO9rtOrAF-zGwdoagvEovW8UzB8PNVJXwWHeZAVTFbOZFNXj1MGnu-UQ_NX_AmrmtH0TTy4E May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:22.534355 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0486a488dff8466eab866f24429eab4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0486a488dff8466eab866f24429eab4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 63d4ee28ddbc4d5885f048e4cbefc85d May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: exception: Aggregate 6 could not be found. May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '6'} May 14 21:12:22.535806 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:22.536640 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 14 21:12:22.537844 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.539304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b9ae9a6-d52a-4eb0-aa4a-4483ea41ac89 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:22.547872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b9ae9a6-d52a-4eb0-aa4a-4483ea41ac89 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.032835 May 14 21:12:22.548384 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 136/242] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:22.553256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04998e71-9969-455e-83ef-167b5f6b3747 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b493b940>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.554707 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.554707 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.555991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04998e71-9969-455e-83ef-167b5f6b3747 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.556581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04998e71-9969-455e-83ef-167b5f6b3747 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.557583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04998e71-9969-455e-83ef-167b5f6b3747 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.558086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04998e71-9969-455e-83ef-167b5f6b3747 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.615599 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04998e71-9969-455e-83ef-167b5f6b3747 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.065897 May 14 21:12:22.629353 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 137/243] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:22.649144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87d037e0-4b13-4430-895f-94145e7f6427 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.651472 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.651472 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.673366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:22.684310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-87d037e0-4b13-4430-895f-94145e7f6427 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] HTTP exception thrown: Aggregate 6 could not be found. May 14 21:12:22.685948 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bc40d0ea-61df-417f-b43f-5fecb845882b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.405990 May 14 21:12:22.688633 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 107/244] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87d037e0-4b13-4430-895f-94145e7f6427 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Request method failure captured: May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsJ4UkWewZh4IK08LzpHTBSm9K9waLBmUEaVZ-JXfIlTgLAhdyX0FWMyJ5tbI96kEpcxGWaCsxQjAiAuGsYHPkvnBWSEeIvzHRXw_zlO9rtOrAF-zGwdoagvEovW8UzB8PNVJXwWHeZAVTFbOZFNXj1MGnu-UQ_NX_AmrmtH0TTy4E May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:22.690209 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0486a488dff8466eab866f24429eab4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0486a488dff8466eab866f24429eab4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 63d4ee28ddbc4d5885f048e4cbefc85d May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: exception: Aggregate 6 could not be found. May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '6'} May 14 21:12:22.691492 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:22.692178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:22.693162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:22.694625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:22.694625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:22.694625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:22.694625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. May 14 21:12:22.694625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:22.698431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87d037e0-4b13-4430-895f-94145e7f6427 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:22.701945 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87d037e0-4b13-4430-895f-94145e7f6427 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.068808 May 14 21:12:22.702768 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 138/245] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:22 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:22.704140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d7b4017-5989-4cc4-b2b1-e2a31a303ffa tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1717606776"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:22.706734 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.706734 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:22.709520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-2d7b4017-5989-4cc4-b2b1-e2a31a303ffa tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid 45e5b002-3a5b-417c-ad2a-3f9a97d49aff for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:22.716804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cf1ba2e5-fa78-45f8-8855-df4caecd6918 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b4743d30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.717938 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.717938 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.733255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2e5-fa78-45f8-8855-df4caecd6918 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.733928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2e5-fa78-45f8-8855-df4caecd6918 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.749347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2e5-fa78-45f8-8855-df4caecd6918 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.751610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf1ba2e5-fa78-45f8-8855-df4caecd6918 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.768358 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cf1ba2e5-fa78-45f8-8855-df4caecd6918 tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 467 microversion: 2.1 time: 0.063228 May 14 21:12:22.769201 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 139/246] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 467 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:22.778089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-17a913af-90ec-4238-ae4b-6a43a3da649d tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2038440316", "name": "tempest-test_aggregate-1331100160"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:22.799085 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d7b4017-5989-4cc4-b2b1-e2a31a303ffa tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109214 May 14 21:12:22.802187 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 108/247] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:22.807722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:22.812436 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:22.812436 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:22.812436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.aggregate [None req-17a913af-90ec-4238-ae4b-6a43a3da649d tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid 00a43687-7d73-40a2-8960-06f7d8a07232 for aggregate {{(pid=130637) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:22.814925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:22.822291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.823150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.824283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:22.825010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:22.983272 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-17a913af-90ec-4238-ae4b-6a43a3da649d tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.210084 May 14 21:12:22.991197 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 140/248] 10.222.0.52 () {60 vars in 1164 bytes} [Sat May 14 21:12:22 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:23.002136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a0b50a6-e841-4faf-b311-4a57a8c7e5ef tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Calling method '.version_select at 0x7fb1b4716e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.002136 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.002136 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:23.007724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0b50a6-e841-4faf-b311-4a57a8c7e5ef tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.011884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0b50a6-e841-4faf-b311-4a57a8c7e5ef tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.031341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:23.032695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0b50a6-e841-4faf-b311-4a57a8c7e5ef tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.032838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0b50a6-e841-4faf-b311-4a57a8c7e5ef tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.040604 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-18588853-cecc-45e7-852b-7706066b6bf0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.237133 May 14 21:12:23.041190 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 109/249] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:23.052662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f4d4960-6c1a-480c-9d22-fe01f4280641 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:23.054694 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.054694 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:23.063365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f4d4960-6c1a-480c-9d22-fe01f4280641 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.063851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f4d4960-6c1a-480c-9d22-fe01f4280641 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.080591 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a0b50a6-e841-4faf-b311-4a57a8c7e5ef tempest-HostsAdminTestJSON-1689831534 tempest-HostsAdminTestJSON-1689831534-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.088113 May 14 21:12:23.084017 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 141/250] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:12:22 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:23.090965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5bcc0a28-4ce5-4cab-9292-29c67c5c96e4 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.092091 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.092091 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:23.202353 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5bcc0a28-4ce5-4cab-9292-29c67c5c96e4 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.116377 May 14 21:12:23.206106 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 142/251] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:23 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:23.212714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.213573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:23.225481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.226266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.227620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.228477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.294515 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f4d4960-6c1a-480c-9d22-fe01f4280641 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.252301 May 14 21:12:23.300277 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 110/252] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:23 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:23.300277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0936901-1031-4e93-9e68-1768f81ca67c tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.300885 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.300885 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:23.306668 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d0936901-1031-4e93-9e68-1768f81ca67c tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] HTTP exception thrown: Aggregate 8 could not be found. May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0936901-1031-4e93-9e68-1768f81ca67c tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Request method failure captured: May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsJ4UkWewZh4IK08LzpHTBSm9K9waLBmUEaVZ-JXfIlTgLAhdyX0FWMyJ5tbI96kEpcxGWaCsxQjAiAuGsYHPkvnBWSEeIvzHRXw_zlO9rtOrAF-zGwdoagvEovW8UzB8PNVJXwWHeZAVTFbOZFNXj1MGnu-UQ_NX_AmrmtH0TTy4E May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:23.311860 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0486a488dff8466eab866f24429eab4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0486a488dff8466eab866f24429eab4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 63d4ee28ddbc4d5885f048e4cbefc85d May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: exception: Aggregate 8 could not be found. May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '8'} May 14 21:12:23.313714 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.314523 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. May 14 21:12:23.315589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.317611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0936901-1031-4e93-9e68-1768f81ca67c tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:23.317611 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0936901-1031-4e93-9e68-1768f81ca67c tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.017731 May 14 21:12:23.317611 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 111/253] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:12:23 2022] GET /compute/v2.1/os-aggregates/8 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:23.322040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.322675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:23.332882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.333416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.334203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.334640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.428203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:23.439783 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76ac616b-6428-4d13-a34b-b0dc36d363a7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.235339 May 14 21:12:23.440359 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 143/254] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:23 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:23.444770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04450bfd-ad08-4a85-b7db-e0f0389503b1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:23.446064 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.446064 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:23.460891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04450bfd-ad08-4a85-b7db-e0f0389503b1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.461231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04450bfd-ad08-4a85-b7db-e0f0389503b1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.495337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:23.503151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0087b16-25f3-434d-ae40-eb0077ce987d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.186114 May 14 21:12:23.503872 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 112/255] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:23 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:23.508695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b52c39d1-e228-4a41-a004-a54ef06bc875 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.509449 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.509449 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:23.515211 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-04450bfd-ad08-4a85-b7db-e0f0389503b1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] HTTP exception thrown: Aggregate 7 already has host nch2-master-1. May 14 21:12:23.528179 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-b52c39d1-e228-4a41-a004-a54ef06bc875 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] HTTP exception thrown: Aggregate 8 could not be found. May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b52c39d1-e228-4a41-a004-a54ef06bc875 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Request method failure captured: May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsJ4UkWewZh4IK08LzpHTBSm9K9waLBmUEaVZ-JXfIlTgLAhdyX0FWMyJ5tbI96kEpcxGWaCsxQjAiAuGsYHPkvnBWSEeIvzHRXw_zlO9rtOrAF-zGwdoagvEovW8UzB8PNVJXwWHeZAVTFbOZFNXj1MGnu-UQ_NX_AmrmtH0TTy4E May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:23.530482 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0486a488dff8466eab866f24429eab4e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0486a488dff8466eab866f24429eab4e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0486a488dff8466eab866f24429eab4e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 0486a488dff8466eab866f24429eab4e May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1744637187 May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 63d4ee28ddbc4d5885f048e4cbefc85d May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminTestJSON-1744637187-project-admin May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: exception: Aggregate 8 could not be found. May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '8'} May 14 21:12:23.532610 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:23.533441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 8 could not be found. May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 8 could not be found. May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.538783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 8 could not be found. May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b52c39d1-e228-4a41-a004-a54ef06bc875 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Returning 404 to user: Aggregate 8 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b52c39d1-e228-4a41-a004-a54ef06bc875 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/8" status: 404 len: 77 microversion: 2.1 time: 0.028043 May 14 21:12:23.540188 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 113/256] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:23 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 77 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04450bfd-ad08-4a85-b7db-e0f0389503b1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-aggregates/7/action HTTP/1.1 May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 39 May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:23.540707 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: {"add_host": {"host": "nch2-master-1"}} May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:23.542100 ncdv-master-1 devstack@n-api.service[130637]: exception: Aggregate 7 already has host nch2-master-1. May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '7', 'body': {'add_host': {'host': 'nch2-master-1'}}} May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = self._query(query) May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi conn.query(q) May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result.read() May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:12:23.543175 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi session.flush() May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._flush(objects) May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 21:12:23.544955 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi compat.raise_( May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi flush_context.execute() May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi rec.execute(self) May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 21:12:23.546286 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = self._query(query) May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi conn.query(q) May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:12:23.547634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result.read() May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-7' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 14, 21, 12, 23, 478148), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 7}] May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.548830 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 7 already has host nch2-master-1. May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.549962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 7 already has host nch2-master-1. May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:23.551354 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:23.553492 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 already has host nch2-master-1. May 14 21:12:23.553492 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:23.553492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04450bfd-ad08-4a85-b7db-e0f0389503b1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 409 to user: Aggregate 7 already has host nch2-master-1. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:23.553492 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04450bfd-ad08-4a85-b7db-e0f0389503b1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 409 len: 95 microversion: 2.1 time: 0.097860 May 14 21:12:23.553492 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 144/257] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:23 2022] POST /compute/v2.1/os-aggregates/7/action => generated 95 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 14 21:12:23.553492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6e6ce1e1-4bfe-4cc9-96b3-53fdc97bdbe3 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:23.554537 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.554537 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:23.554778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1ad6bd10-2c2f-42ec-9533-d552caa3a184 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1937752735"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:23.554778 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.554778 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:23.554778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-1ad6bd10-2c2f-42ec-9533-d552caa3a184 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid 7f68ad63-6913-4f2f-adb3-e75fbd5ad508 for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:23.557148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e6ce1e1-4bfe-4cc9-96b3-53fdc97bdbe3 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.557655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e6ce1e1-4bfe-4cc9-96b3-53fdc97bdbe3 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.689021 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1ad6bd10-2c2f-42ec-9533-d552caa3a184 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.148392 May 14 21:12:23.691120 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 114/258] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:23.705297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.705894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:23.724315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.724315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.724315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.724315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.825284 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6e6ce1e1-4bfe-4cc9-96b3-53fdc97bdbe3 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.281517 May 14 21:12:23.827014 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 145/259] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:23 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:23.836877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf25e7d2-f027-4acd-91d6-febd43ca1478 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.837657 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.837657 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:23.852750 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf25e7d2-f027-4acd-91d6-febd43ca1478 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 227 microversion: 2.1 time: 0.024602 May 14 21:12:23.859362 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 146/260] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:12:23 2022] GET /compute/v2.1/os-aggregates/9 => generated 227 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:23.871579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cbc80e2c-6bc0-40bb-99eb-dfb1d90f46c9 req-ff6d23a5-8cb6-445b-a679-7eb926af8dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90932695-580a-4ed5-8d1e-6e47d0d11693", "tag": "074dfa89-1f3d-4b74-9c88-b07bed760e13"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:23.885403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cbc80e2c-6bc0-40bb-99eb-dfb1d90f46c9 req-ff6d23a5-8cb6-445b-a679-7eb926af8dd7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:23.886046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cbc80e2c-6bc0-40bb-99eb-dfb1d90f46c9 req-ff6d23a5-8cb6-445b-a679-7eb926af8dd7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:23.898857 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cbc80e2c-6bc0-40bb-99eb-dfb1d90f46c9 req-ff6d23a5-8cb6-445b-a679-7eb926af8dd7 service nova] Creating event network-changed:074dfa89-1f3d-4b74-9c88-b07bed760e13 for instance 90932695-580a-4ed5-8d1e-6e47d0d11693 on nch1-master-1 May 14 21:12:23.904460 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cbc80e2c-6bc0-40bb-99eb-dfb1d90f46c9 req-ff6d23a5-8cb6-445b-a679-7eb926af8dd7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042356 May 14 21:12:23.905677 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 147/261] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:23.911929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c68aace6-f9a6-4f7c-92df-1434d641f690 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:23.912845 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:23.912845 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:24.035381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c68aace6-f9a6-4f7c-92df-1434d641f690 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.127242 May 14 21:12:24.037760 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 148/262] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:23 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:24.059305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0791992b-b273-4810-849b-226bd0aee941 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:24.068922 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:24.068922 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:24.124664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:24.134011 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-af3d8623-e321-4c0e-809f-2d88014d06d6 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.433525 May 14 21:12:24.134922 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 115/263] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:23 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:24.139729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2d32b33-5967-47de-8cd0-6354733f1054 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-937461750"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:24.141548 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:24.141548 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:24.142703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-d2d32b33-5967-47de-8cd0-6354733f1054 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid 27d69fdb-fd35-4efd-873e-21fe6af12283 for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:24.161154 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0791992b-b273-4810-849b-226bd0aee941 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 265 microversion: 2.1 time: 0.121872 May 14 21:12:24.168151 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 149/264] 10.222.0.52 () {60 vars in 1190 bytes} [Sat May 14 21:12:24 2022] POST /compute/v2.1/os-aggregates/9/action => generated 265 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:24.175095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:24.175874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:24.183574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:24.184031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:24.185321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:24.185940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:24.260039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2d32b33-5967-47de-8cd0-6354733f1054 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.119929 May 14 21:12:24.261304 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 116/265] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:24.273062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-551c71df-71c9-45b0-aee8-9e909db79366 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:24.274140 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:24.274140 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:24.284928 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-551c71df-71c9-45b0-aee8-9e909db79366 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.021209 May 14 21:12:24.285773 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 117/266] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:12:24 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:24.559225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67ac0cd2-0304-4039-bf0f-932f22542685 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:24.560758 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:24.560758 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:24.561628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-67ac0cd2-0304-4039-bf0f-932f22542685 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9c6eeaaeaddc449294b0231b93d9218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c736aeec5a841eeabb4213d8e0e1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67ac0cd2-0304-4039-bf0f-932f22542685 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Request method failure captured: May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 39 May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsbIjS4HPhsQGIuCngBWfWLB02cVrtMTetWOoTUlvBdP7EUDocPO407Le7XoUjqMxuDsy7U1pdEHhAc2oEt1-7LQvX6ApyepOkM2vfTntMtUq2e5bSO-GYpXc5HppnZB2svSt5Y4_nlejMV_GWB33PneB22X3axwsiIIPA0pQ4e3_Q May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:24.565982 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c736aeec5a841eeabb4213d8e0e1a80", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9c6eeaaeaddc449294b0231b93d9218b May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: {"add_host": {"host": "nch2-master-1"}} May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:24.570824 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '10', 'body': {'add_host': {'host': 'nch2-master-1'}}} May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:24.571646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 14 21:12:24.572654 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:24.575240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67ac0cd2-0304-4039-bf0f-932f22542685 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:24.575240 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-67ac0cd2-0304-4039-bf0f-932f22542685 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/10/action" status: 403 len: 118 microversion: 2.1 time: 0.277406 May 14 21:12:24.575240 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 118/267] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:12:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 118 bytes in 279 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:24.575240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9f4b6a82-9cd9-4d52-b7c9-2847d416c88f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:24.575240 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:24.575240 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:24.742850 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9f4b6a82-9cd9-4d52-b7c9-2847d416c88f tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.173547 May 14 21:12:24.743765 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 119/268] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:24 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:24.752574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:24.754119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:24.761539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:24.762531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:24.763497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:24.763957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:24.934708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:24.942458 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b25b69cc-6581-4fe3-bd2a-d3db9f3ab916 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.773002 May 14 21:12:24.951842 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 150/269] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:24 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:24.957894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:24.958711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:24.967972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:24.970098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:24.974041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:24.975511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:25.021706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:25.030935 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dbb1d4f5-036b-4b15-8d33-226c1ecbe707 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.285030 May 14 21:12:25.032488 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 120/270] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:24 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:25.037296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-144f2b5c-ea44-4136-a941-6e0660117668 req-7ed81e76-d4d6-49d3-9abf-e7214bdfe846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406fb98b-cfdf-42ed-b684-bcabeee2633e", "name": "network-vif-plugged", "status": "completed", "tag": "e509da02-863e-4b7a-95be-11eee591d1dc"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:25.046373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-144f2b5c-ea44-4136-a941-6e0660117668 req-7ed81e76-d4d6-49d3-9abf-e7214bdfe846 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:25.046373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-144f2b5c-ea44-4136-a941-6e0660117668 req-7ed81e76-d4d6-49d3-9abf-e7214bdfe846 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:25.059197 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-144f2b5c-ea44-4136-a941-6e0660117668 req-7ed81e76-d4d6-49d3-9abf-e7214bdfe846 service nova] Creating event network-vif-plugged:e509da02-863e-4b7a-95be-11eee591d1dc for instance 406fb98b-cfdf-42ed-b684-bcabeee2633e on nch1-master-1 May 14 21:12:25.065110 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-144f2b5c-ea44-4136-a941-6e0660117668 req-7ed81e76-d4d6-49d3-9abf-e7214bdfe846 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 May 14 21:12:25.069564 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 121/271] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:25.074584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6b1e536-2338-4239-a98f-802e217badb9 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:25.075425 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:25.075425 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:25.200994 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6b1e536-2338-4239-a98f-802e217badb9 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.130207 May 14 21:12:25.205572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 122/272] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:25 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:25.208238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9d173eb9-0e1a-4512-9173-483725fda194 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2128887468", "availability_zone": "tempest-test_az-98455659"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:25.209678 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:25.209678 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:25.211003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-9d173eb9-0e1a-4512-9173-483725fda194 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid abccf030-ff9c-4be6-b5b2-b95cb38a43fa for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:25.263585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:25.279611 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a20fd00d-1101-4a98-abd1-dc21958ae296 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.318684 May 14 21:12:25.279611 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 151/273] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:24 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:25.284421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:25.285238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:25.291456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:25.291931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:25.292869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:25.293489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:25.304809 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9d173eb9-0e1a-4512-9173-483725fda194 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.102229 May 14 21:12:25.307029 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 123/274] 10.222.0.52 () {60 vars in 1164 bytes} [Sat May 14 21:12:25 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:25.316466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9235a836-e872-460f-bba0-346ae9c65af1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1749628075"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:25.317998 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:25.317998 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:25.318888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-9235a836-e872-460f-bba0-346ae9c65af1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid 5d9959f1-bf5c-44f3-b42f-778fb48dd0ba for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:25.388162 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9235a836-e872-460f-bba0-346ae9c65af1 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.079902 May 14 21:12:25.388906 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 124/275] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:25.399843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f46a7731-c25b-425e-97f9-59172d3cbebf tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2128887468_new", "availability_zone": "tempest-test_az-98455659_new"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:25.481098 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:25.481098 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:25.892673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:25.892673 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-48c03c00-6bd7-4385-9f0b-fe75f5b4588a tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.264908 May 14 21:12:25.892673 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 152/276] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:25 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:25.892673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-382383316"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:25.893695 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:25.893695 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:25.893695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:25.893695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:25.893695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-382383316 could not be found. May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 57 May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:25.894489 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: {"add_host": {"host": "tempest-nonexist_host-382383316"}} May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:25.896193 ncdv-master-1 devstack@n-api.service[130637]: exception: Compute host tempest-nonexist_host-382383316 could not be found. May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '12', 'body': {'add_host': {'host': 'tempest-nonexist_host-382383316'}}} May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-382383316' is not mapped to any cell May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:25.897011 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate May 14 21:12:25.898278 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-382383316 could not be found. May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-382383316 could not be found. May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:25.899704 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-382383316 could not be found. May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-382383316 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2a290cd-91b4-4062-aeaa-7dbb1fac2143 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/12/action" status: 404 len: 110 microversion: 2.1 time: 0.042500 May 14 21:12:25.901092 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 153/277] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:12:25 2022] POST /compute/v2.1/os-aggregates/12/action => generated 110 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:25.901770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47d7cefe-a2f0-442f-8f05-33f73af4cecd tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:25.901770 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:25.901770 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:25.967127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f46a7731-c25b-425e-97f9-59172d3cbebf tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:25.967127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f46a7731-c25b-425e-97f9-59172d3cbebf tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.316410 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47d7cefe-a2f0-442f-8f05-33f73af4cecd tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.701116 May 14 21:12:26.316410 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 154/278] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 14 21:12:26.316410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:26.316410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:26.316410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.317473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.317473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.317473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.551603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:26.562020 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c98d15cf-83be-4746-a14f-b845259602f5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.270430 May 14 21:12:26.573705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 155/279] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:26 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:26.581378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-80e4f1ce-ef6a-42c6-b63e-018cac0fb26e req-5d3dabca-b133-4e61-b7a4-0bf9cd1ca788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56d82378-9805-462c-80ed-eda32e4ac59c", "tag": "a1f814e9-3098-42d8-a275-d715b407239c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:26.590591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-80e4f1ce-ef6a-42c6-b63e-018cac0fb26e req-5d3dabca-b133-4e61-b7a4-0bf9cd1ca788 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.591036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-80e4f1ce-ef6a-42c6-b63e-018cac0fb26e req-5d3dabca-b133-4e61-b7a4-0bf9cd1ca788 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.602127 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-80e4f1ce-ef6a-42c6-b63e-018cac0fb26e req-5d3dabca-b133-4e61-b7a4-0bf9cd1ca788 service nova] Creating event network-changed:a1f814e9-3098-42d8-a275-d715b407239c for instance 56d82378-9805-462c-80ed-eda32e4ac59c on nch2-master-1 May 14 21:12:26.614854 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-80e4f1ce-ef6a-42c6-b63e-018cac0fb26e req-5d3dabca-b133-4e61-b7a4-0bf9cd1ca788 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038868 May 14 21:12:26.615471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 156/280] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:26.620631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:26.621327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:26.628356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.628818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.629616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.630058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.774398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:26.781762 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-042af744-6988-4ad8-803c-082ba69a12ae tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.164993 May 14 21:12:26.782323 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 157/281] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:26 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:26.786766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:26.787310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:26.793025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.793478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.794246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.794684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.825400 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f46a7731-c25b-425e-97f9-59172d3cbebf tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/11" status: 200 len: 333 microversion: 2.1 time: 1.429151 May 14 21:12:26.826013 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 125/282] 10.222.0.52 () {60 vars in 1172 bytes} [Sat May 14 21:12:25 2022] PUT /compute/v2.1/os-aggregates/11 => generated 333 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:26.831237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac8cfcc9-0d0e-447e-855e-92795b0429ae tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac8cfcc9-0d0e-447e-855e-92795b0429ae tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 283 May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:26.840944 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:26.842434 ncdv-master-1 devstack@n-api.service[130638]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:12:26.843042 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:12:26.847812 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:12:26.848865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:12:26.849589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:12:26.849589 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:26.849589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac8cfcc9-0d0e-447e-855e-92795b0429ae tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:26.849589 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac8cfcc9-0d0e-447e-855e-92795b0429ae tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.015561 May 14 21:12:26.849882 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 126/283] 10.222.0.52 () {60 vars in 1164 bytes} [Sat May 14 21:12:26 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:26.849882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:26.849882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:26.855747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.856200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.856980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:26.857517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:26.956196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:26.963458 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78e59085-60a6-4fcb-9e62-a6a54ba0e623 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.180090 May 14 21:12:26.964091 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 158/284] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:26 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:26.969665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f12a1e0-a7f6-49df-8e0a-f21e47b59876 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:26.970635 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:26.970635 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:26.981677 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f12a1e0-a7f6-49df-8e0a-f21e47b59876 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.016211 May 14 21:12:26.988295 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 159/285] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:12:26 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:26.988295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3661d58-f2b2-44a5-a166-860e51779f14 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3661d58-f2b2-44a5-a166-860e51779f14 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 27 May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:26.991227 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: {"aggregate": {"name": ""}} May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:26.992706 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute name. Value: . '' is too short May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'aggregate': {'name': ''}}} May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi '' May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:26.993569 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 14 21:12:26.994762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.002963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3661d58-f2b2-44a5-a166-860e51779f14 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.002963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3661d58-f2b2-44a5-a166-860e51779f14 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.009101 May 14 21:12:27.002963 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 160/286] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:26 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:27.006735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae6a04ca-e7d7-454e-90d7-e46bcaf2b8be tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.007529 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.007529 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:27.100704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:27.108450 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cab8bf9d-d7db-4e87-b81a-7ca6587dcddf tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.264151 May 14 21:12:27.110511 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 127/287] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:26 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:27.115686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e94a961-973b-4ca0-ad9a-d29da2306f63 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1317903289"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:27.117164 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.117164 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.118317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e94a961-973b-4ca0-ad9a-d29da2306f63 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9c6eeaaeaddc449294b0231b93d9218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c736aeec5a841eeabb4213d8e0e1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e94a961-973b-4ca0-ad9a-d29da2306f63 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Request method failure captured: May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 60 May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsbIjS4HPhsQGIuCngBWfWLB02cVrtMTetWOoTUlvBdP7EUDocPO407Le7XoUjqMxuDsy7U1pdEHhAc2oEt1-7LQvX6ApyepOkM2vfTntMtUq2e5bSO-GYpXc5HppnZB2svSt5Y4_nlejMV_GWB33PneB22X3axwsiIIPA0pQ4e3_Q May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:27.120274 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c736aeec5a841eeabb4213d8e0e1a80", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9c6eeaaeaddc449294b0231b93d9218b May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: {"aggregate": {"name": "tempest-test_aggregate-1317903289"}} May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:27.121562 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1317903289'}}} May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:27.122348 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:27.123331 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 14 21:12:27.124430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.125877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e94a961-973b-4ca0-ad9a-d29da2306f63 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.126976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7e94a961-973b-4ca0-ad9a-d29da2306f63 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.014998 May 14 21:12:27.128102 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 128/288] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:27 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:27.140447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cdb04f22-ce6e-49b0-a254-d36249a21958 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-647392891"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:27.140447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-cdb04f22-ce6e-49b0-a254-d36249a21958 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid 93e68956-35d1-4267-b356-9898cc1f2f44 for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:27.181701 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae6a04ca-e7d7-454e-90d7-e46bcaf2b8be tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.180366 May 14 21:12:27.186290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 161/289] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:26 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:27.192964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4b0568cb-2a65-4930-8239-86fd42bfd2b0 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1798711892"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:27.194262 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.194262 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:27.195125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.aggregate [None req-4b0568cb-2a65-4930-8239-86fd42bfd2b0 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Generated uuid 654e46bd-e372-4039-ac95-64d3f42de45d for aggregate {{(pid=130637) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:27.288671 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cdb04f22-ce6e-49b0-a254-d36249a21958 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.154917 May 14 21:12:27.289936 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 129/290] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:27.301295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b1e446c-d133-447b-af7b-b9f73d01d837 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-647392891"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:27.302876 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.302876 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.304101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-8b1e446c-d133-447b-af7b-b9f73d01d837 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid 11f5dcb7-e1e0-40b7-ab53-e1bdedb1ccee for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:27.314564 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4b0568cb-2a65-4930-8239-86fd42bfd2b0 tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.125257 May 14 21:12:27.318486 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-8b1e446c-d133-447b-af7b-b9f73d01d837 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-647392891 already exists. May 14 21:12:27.318612 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 162/291] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b1e446c-d133-447b-af7b-b9f73d01d837 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 59 May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:27.319038 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: {"aggregate": {"name": "tempest-test_aggregate-647392891"}} May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:27.320140 ncdv-master-1 devstack@n-api.service[130638]: exception: Aggregate tempest-test_aggregate-647392891 already exists. May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-647392891'}}} May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi aggregate.create() May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 14 21:12:27.320838 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-647392891 already exists. May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:27.322670 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-647392891 already exists. May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-647392891 already exists. May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.325318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b1e446c-d133-447b-af7b-b9f73d01d837 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-647392891 already exists. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.327988 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b1e446c-d133-447b-af7b-b9f73d01d837 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.032009 May 14 21:12:27.329097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-954392a5-6a38-4f39-a5fa-ea3bc29c627a tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.329784 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 130/292] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:27 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 34 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 14 21:12:27.332060 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.332060 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:27.338292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f456976b-59f1-420e-b9c7-16246d3549be tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.339058 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.339058 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.342936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-954392a5-6a38-4f39-a5fa-ea3bc29c627a tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.019729 May 14 21:12:27.344252 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 163/293] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:12:27 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:27.358402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f4b322f-aa2a-4637-ab4a-3624838ffbec tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.361763 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.361763 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:27.450459 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f456976b-59f1-420e-b9c7-16246d3549be tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.115925 May 14 21:12:27.451163 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 131/294] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:27 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 14 21:12:27.461989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a3421008-089c-4787-9071-e1bdeb426aa6 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1103076540"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:27.463506 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.463506 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.464459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-a3421008-089c-4787-9071-e1bdeb426aa6 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid a26f586e-06af-4cc2-9613-1d188ea446c0 for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:27.473372 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5f4b322f-aa2a-4637-ab4a-3624838ffbec tempest-AggregatesAdminTestJSON-1744637187 tempest-AggregatesAdminTestJSON-1744637187-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.120754 May 14 21:12:27.479716 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 164/295] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:27 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:27.489217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.489752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:27.499208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.500885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.512610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.513153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.530348 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] HTTP exception thrown: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Request method failure captured: May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a HTTP/1.1 May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsGIZYB7CKXNuLonZtMVe65YaESa-ucHwxS8ltPHUK1MXT4JCse7c2MJdlnEb7HkVqUnrz4gp987Og0hSCtMyY1jRbKGJZoIynN-a2ZuyeS_E8_5b6V0Gd3GET2ZltppuoYmA5Tfv2HOijN1Js_WuiFC4tNRe2NYR2r9jtKhcCBXGQ May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 7284e17654bc4a62a6d92db0f9fe2b5e May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:27.532996 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7284e17654bc4a62a6d92db0f9fe2b5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 7284e17654bc4a62a6d92db0f9fe2b5e May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminTestJSON-1698933114-project May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: bbd1715608f64bcfbff6bf07039389c9 May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminTestJSON-1698933114-project May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.534429 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'e5177b64-d9cc-4897-8d54-06f1d7dd250a'} May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:27.535176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.536248 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.537309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Returning 404 to user: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.537309 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-66f64256-3931-4b34-a78a-c2bcb0e71d1f tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 404 len: 111 microversion: 2.1 time: 0.055285 May 14 21:12:27.538213 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 165/296] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:12:27 2022] DELETE /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:27.544961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.545802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] [instance: e5177b64-d9cc-4897-8d54-06f1d7dd250a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:27.551710 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a3421008-089c-4787-9071-e1bdeb426aa6 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.090238 May 14 21:12:27.551710 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 132/297] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:27.552975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.553589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.554532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.555112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.568465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c028f2d-8fe5-4790-8f1a-6bb82d2b59df tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.570206 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.570206 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.572407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4c028f2d-8fe5-4790-8f1a-6bb82d2b59df tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9c6eeaaeaddc449294b0231b93d9218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c736aeec5a841eeabb4213d8e0e1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:27.573441 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] HTTP exception thrown: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Request method failure captured: May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a HTTP/1.1 May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsGIZYB7CKXNuLonZtMVe65YaESa-ucHwxS8ltPHUK1MXT4JCse7c2MJdlnEb7HkVqUnrz4gp987Og0hSCtMyY1jRbKGJZoIynN-a2ZuyeS_E8_5b6V0Gd3GET2ZltppuoYmA5Tfv2HOijN1Js_WuiFC4tNRe2NYR2r9jtKhcCBXGQ May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 7284e17654bc4a62a6d92db0f9fe2b5e May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:27.575515 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7284e17654bc4a62a6d92db0f9fe2b5e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7284e17654bc4a62a6d92db0f9fe2b5e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 7284e17654bc4a62a6d92db0f9fe2b5e May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1698933114 May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminTestJSON-1698933114-project May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: bbd1715608f64bcfbff6bf07039389c9 May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminTestJSON-1698933114-project May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.589941 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'e5177b64-d9cc-4897-8d54-06f1d7dd250a'} May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:27.591765 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. May 14 21:12:27.596554 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:27.597809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] Returning 404 to user: Instance e5177b64-d9cc-4897-8d54-06f1d7dd250a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.597809 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dc8e4e3a-9212-4c1d-a362-0ca06d962755 tempest-AggregatesAdminTestJSON-1698933114 tempest-AggregatesAdminTestJSON-1698933114-project] 10.222.0.52 "GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a" status: 404 len: 111 microversion: 2.1 time: 0.035728 May 14 21:12:27.597809 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 166/298] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:27 2022] GET /compute/v2.1/servers/e5177b64-d9cc-4897-8d54-06f1d7dd250a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:27.597809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c028f2d-8fe5-4790-8f1a-6bb82d2b59df tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Request method failure captured: May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsbIjS4HPhsQGIuCngBWfWLB02cVrtMTetWOoTUlvBdP7EUDocPO407Le7XoUjqMxuDsy7U1pdEHhAc2oEt1-7LQvX6ApyepOkM2vfTntMtUq2e5bSO-GYpXc5HppnZB2svSt5Y4_nlejMV_GWB33PneB22X3axwsiIIPA0pQ4e3_Q May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:27.598127 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c736aeec5a841eeabb4213d8e0e1a80", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9c6eeaaeaddc449294b0231b93d9218b May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 14 21:12:27.599531 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '15'} May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:27.600347 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 14 21:12:27.602718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.604051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:27.604187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c028f2d-8fe5-4790-8f1a-6bb82d2b59df tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.604187 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c028f2d-8fe5-4790-8f1a-6bb82d2b59df tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.027702 May 14 21:12:27.604450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.604450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.604450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.608078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.608406 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 133/299] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:27.611532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66b1b4eb-e623-4612-a847-38d1d257a9d9 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.688228 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66b1b4eb-e623-4612-a847-38d1d257a9d9 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.081846 May 14 21:12:27.688779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 134/300] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:27 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:27.697806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-345f03f5-c300-4081-bc07-cafb41cdf516 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.698807 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.698807 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.709797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-345f03f5-c300-4081-bc07-cafb41cdf516 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-345f03f5-c300-4081-bc07-cafb41cdf516 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:27.711618 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: exception: Aggregate -1 could not be found. May 14 21:12:27.724206 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '-1'} May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 14 21:12:27.724879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.725929 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-345f03f5-c300-4081-bc07-cafb41cdf516 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-345f03f5-c300-4081-bc07-cafb41cdf516 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.019053 May 14 21:12:27.727028 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 135/301] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:27 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:27.731707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3873a58f-4021-450e-8c1c-ff6a1c972cc2 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-75013709"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:27.733132 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.733132 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.734092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-3873a58f-4021-450e-8c1c-ff6a1c972cc2 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid 4b29a6bc-426d-4955-ad87-5251bc6221fb for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:27.825122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:27.833623 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5a9af87-a6df-4e5d-93d0-85e3a8026ef2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1389 microversion: 2.1 time: 0.254178 May 14 21:12:27.834204 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 167/302] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:27 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1389 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:27.839313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.840115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:27.847068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.847610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.848318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:27.848755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:27.860601 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3873a58f-4021-450e-8c1c-ff6a1c972cc2 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.132454 May 14 21:12:27.862947 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 136/303] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:27 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:27.874124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6dc37660-c934-4ce0-a383-ab7c8239ea74 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.875815 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.875815 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:27.877068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6dc37660-c934-4ce0-a383-ab7c8239ea74 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9c6eeaaeaddc449294b0231b93d9218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c736aeec5a841eeabb4213d8e0e1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6dc37660-c934-4ce0-a383-ab7c8239ea74 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Request method failure captured: May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsbIjS4HPhsQGIuCngBWfWLB02cVrtMTetWOoTUlvBdP7EUDocPO407Le7XoUjqMxuDsy7U1pdEHhAc2oEt1-7LQvX6ApyepOkM2vfTntMtUq2e5bSO-GYpXc5HppnZB2svSt5Y4_nlejMV_GWB33PneB22X3axwsiIIPA0pQ4e3_Q May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:27.878667 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c736aeec5a841eeabb4213d8e0e1a80", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9c6eeaaeaddc449294b0231b93d9218b May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 14 21:12:27.879858 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '16'} May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:27.881339 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:27.882322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6dc37660-c934-4ce0-a383-ab7c8239ea74 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:27.883213 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6dc37660-c934-4ce0-a383-ab7c8239ea74 tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.011000 May 14 21:12:27.883213 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 137/304] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:27 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:27.889488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e67ca49b-ddac-4fef-9950-c645885c4ff3 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:27.890635 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:27.890635 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:28.003368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e67ca49b-ddac-4fef-9950-c645885c4ff3 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.114409 May 14 21:12:28.008276 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 138/305] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:27 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 14 21:12:28.011106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:28.011764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:28.025992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:28.025992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:28.025992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:28.025992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:28.042396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:28.050217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4cb61097-645e-4ff7-9597-f52de45c385d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.214501 May 14 21:12:28.050793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 168/306] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:27 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:28.055145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87598956-75bd-4205-a6ec-e6c6819a1a3a tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:28.056064 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:28.056064 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:28.061924 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-87598956-75bd-4205-a6ec-e6c6819a1a3a tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87598956-75bd-4205-a6ec-e6c6819a1a3a tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:28.063574 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: exception: Aggregate -1 could not be found. May 14 21:12:28.064705 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '-1'} May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:28.065395 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 14 21:12:28.066398 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.067324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87598956-75bd-4205-a6ec-e6c6819a1a3a tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:28.067324 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87598956-75bd-4205-a6ec-e6c6819a1a3a tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.013244 May 14 21:12:28.069873 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 169/307] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:28 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:28.077967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c31c4701-cf04-4009-a2d5-1939ecfe575f tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:28.079410 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:28.079410 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:28.080380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c31c4701-cf04-4009-a2d5-1939ecfe575f tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9c6eeaaeaddc449294b0231b93d9218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c736aeec5a841eeabb4213d8e0e1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c31c4701-cf04-4009-a2d5-1939ecfe575f tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Request method failure captured: May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsbIjS4HPhsQGIuCngBWfWLB02cVrtMTetWOoTUlvBdP7EUDocPO407Le7XoUjqMxuDsy7U1pdEHhAc2oEt1-7LQvX6ApyepOkM2vfTntMtUq2e5bSO-GYpXc5HppnZB2svSt5Y4_nlejMV_GWB33PneB22X3axwsiIIPA0pQ4e3_Q May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:28.082007 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c736aeec5a841eeabb4213d8e0e1a80", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 9c6eeaaeaddc449294b0231b93d9218b May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 14 21:12:28.083163 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:28.083864 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:28.084979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c31c4701-cf04-4009-a2d5-1939ecfe575f tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:28.086275 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c31c4701-cf04-4009-a2d5-1939ecfe575f tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.012574 May 14 21:12:28.088120 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 170/308] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:12:28 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:28.095305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-831be85e-ccf1-476c-929e-dc4f6c9e67bf tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1816582218"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:28.099723 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:28.099723 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:28.099723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.aggregate [None req-831be85e-ccf1-476c-929e-dc4f6c9e67bf tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid bd273659-8801-44f2-a5d3-eb5c70e765ec for aggregate {{(pid=130637) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:28.168872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:28.177317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b30bcad9-2a66-43cf-b1ce-c859a91a5554 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.171800 May 14 21:12:28.177894 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 139/309] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:28 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:28.188013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:28.188013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:28.195605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:28.196081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:28.196928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:28.197373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:28.284246 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-831be85e-ccf1-476c-929e-dc4f6c9e67bf tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.194275 May 14 21:12:28.290613 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 171/310] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:28.305098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5500e92d-1e8c-4f6c-9ac6-4bd6079581a4 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:28.306748 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:28.306748 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:28.318442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5500e92d-1e8c-4f6c-9ac6-4bd6079581a4 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:28.319095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5500e92d-1e8c-4f6c-9ac6-4bd6079581a4 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:28.379252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:28.388313 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4dce03ef-3e9a-4c39-a942-34b38620a649 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.208222 May 14 21:12:28.389245 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 140/311] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:28 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:28.624628 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5500e92d-1e8c-4f6c-9ac6-4bd6079581a4 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.328855 May 14 21:12:28.627022 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 172/312] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:12:28 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:28.639325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-117422f8-229f-46e2-9990-62a83307c40e tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:28.639325 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:28.639325 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:28.640216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-117422f8-229f-46e2-9990-62a83307c40e tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9c6eeaaeaddc449294b0231b93d9218b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c736aeec5a841eeabb4213d8e0e1a80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-117422f8-229f-46e2-9990-62a83307c40e tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Request method failure captured: May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 42 May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsbIjS4HPhsQGIuCngBWfWLB02cVrtMTetWOoTUlvBdP7EUDocPO407Le7XoUjqMxuDsy7U1pdEHhAc2oEt1-7LQvX6ApyepOkM2vfTntMtUq2e5bSO-GYpXc5HppnZB2svSt5Y4_nlejMV_GWB33PneB22X3axwsiIIPA0pQ4e3_Q May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:28.642539 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c736aeec5a841eeabb4213d8e0e1a80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c736aeec5a841eeabb4213d8e0e1a80", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6c736aeec5a841eeabb4213d8e0e1a80 May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264 May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9c6eeaaeaddc449294b0231b93d9218b May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1497297264-project May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: {"remove_host": {"host": "nch2-master-1"}} May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:28.643686 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch2-master-1'}}} May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:28.644457 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 14 21:12:28.645553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:28.649032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-117422f8-229f-46e2-9990-62a83307c40e tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:28.649032 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-117422f8-229f-46e2-9990-62a83307c40e tempest-AggregatesAdminNegativeTestJSON-1497297264 tempest-AggregatesAdminNegativeTestJSON-1497297264-project] 10.222.0.52 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.013407 May 14 21:12:28.649032 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 141/313] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:12:28 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:28.657217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc46f84e-72f7-49f4-85a7-e973483a6286 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:28.658989 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:28.658989 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:28.667888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc46f84e-72f7-49f4-85a7-e973483a6286 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:28.668720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc46f84e-72f7-49f4-85a7-e973483a6286 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:28.697137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0c8fcf9f-c618-4183-8b31-650df1173438 req-fdf3f74a-c7b9-4ed5-97c3-2c9fed003ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5a5886-95f4-4ee4-9bf7-013456bfa20b", "name": "network-vif-plugged", "status": "completed", "tag": "18b50999-4ef7-4c21-8dba-c0606fe826e1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:28.718057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0c8fcf9f-c618-4183-8b31-650df1173438 req-fdf3f74a-c7b9-4ed5-97c3-2c9fed003ea5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:28.719561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0c8fcf9f-c618-4183-8b31-650df1173438 req-fdf3f74a-c7b9-4ed5-97c3-2c9fed003ea5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:28.731076 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0c8fcf9f-c618-4183-8b31-650df1173438 req-fdf3f74a-c7b9-4ed5-97c3-2c9fed003ea5 service nova] Creating event network-vif-plugged:18b50999-4ef7-4c21-8dba-c0606fe826e1 for instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b on nch1-master-1 May 14 21:12:28.739244 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0c8fcf9f-c618-4183-8b31-650df1173438 req-fdf3f74a-c7b9-4ed5-97c3-2c9fed003ea5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048369 May 14 21:12:28.740885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 142/314] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:29.044519 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc46f84e-72f7-49f4-85a7-e973483a6286 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.392032 May 14 21:12:29.052654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 173/315] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:12:28 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:29.058989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:29.059747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:29.068482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.068947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.070162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.070614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.215793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:29.224587 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5351591c-09aa-4a14-a5da-38d29775821f tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1589 microversion: 2.1 time: 0.170627 May 14 21:12:29.225160 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 174/316] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:29 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1589 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:29.229766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2670fc83-85db-4e17-a103-131c9d06e317 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:29.230690 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:29.230690 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:29.300932 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2670fc83-85db-4e17-a103-131c9d06e317 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.074162 May 14 21:12:29.301731 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 175/317] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:29 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:29.305970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-905eba3b-a68d-4f8d-ac32-b5f87f1d0787 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Calling method '.version_select at 0x7fb1b455f670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:29.309196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:29.310021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:29.318161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.318733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.319628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.320159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.461440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-905eba3b-a68d-4f8d-ac32-b5f87f1d0787 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37" status: 200 len: 371 microversion: 2.1 time: 0.673514 May 14 21:12:29.461440 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 143/318] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:12:28 2022] GET /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37 => generated 371 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:29.461440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:29.461440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:29.465829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:29.468032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.468493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.469950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.470398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.474433 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb8eb696-b6c3-4447-bcfe-7b0f86305e01 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.171519 May 14 21:12:29.482979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 176/319] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:29 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:29.490172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b71fa66f-ef13-4c4d-89e2-eab9c512515b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:29.490668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b71fa66f-ef13-4c4d-89e2-eab9c512515b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:29.496882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b71fa66f-ef13-4c4d-89e2-eab9c512515b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.497335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b71fa66f-ef13-4c4d-89e2-eab9c512515b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.498114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b71fa66f-ef13-4c4d-89e2-eab9c512515b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.498621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b71fa66f-ef13-4c4d-89e2-eab9c512515b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.610255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:29.617946 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73d999eb-abad-4f07-904b-8d09452c055f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1312 microversion: 2.1 time: 0.161067 May 14 21:12:29.618793 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 144/320] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:29 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1312 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:29.623587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0503f001-6b6d-424f-b51f-cf7b79a04e2e tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1812887287"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:29.625115 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:29.625115 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:29.626409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.aggregate [None req-0503f001-6b6d-424f-b51f-cf7b79a04e2e tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Generated uuid 84a28e48-89f3-49f9-b77d-6731dec2f82a for aggregate {{(pid=130638) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:12:29.636817 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b71fa66f-ef13-4c4d-89e2-eab9c512515b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151478 May 14 21:12:29.636817 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 177/321] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:12:29 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e/os-interface => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:29.645202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:29.645878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:29.653603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.655441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.655441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.655930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.731810 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0503f001-6b6d-424f-b51f-cf7b79a04e2e tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.111555 May 14 21:12:29.732741 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 145/322] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:12:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:29.743983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-747ffbda-dab1-4735-8f02-6753341dc7d2 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b47b0040>, body: {"quota_set": {"ram": "5120"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:29.910070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:29.922398 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-917dfcb9-e9de-4b63-b0d8-3cb267cd6b1b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.283645 May 14 21:12:29.931718 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 178/323] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:29 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:29.935515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:29.935515 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:29.935515 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:29.975649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.976274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.984487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:29.985100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:29.998937 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.compute.aggregates [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 14 21:12:29.999549 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Request method failure captured: May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 42 May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsemEv1xIuoLVVo0cpKIU5SlQT6AsT6Sn3HicefHUvSEbMa8M7FDXF_GIHb9ky8R-miSMFc4I-6UNUQ5iWLYKyOXlpOz_V0-S9Yffd6zT0x0ksrpHkNnzy8d0kb4DSkkhBDGCmBzjg1sjybDPe6LmzEIG9m55WH5xTG_oftIPJnIms May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:30.002151 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c64daeb40257492c80bc37c6323473f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c64daeb40257492c80bc37c6323473f8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c64daeb40257492c80bc37c6323473f8 May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-937299836 May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 486797a29695490b931e7e7549d659f8 May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: {"remove_host": {"host": "nonexist_host"}} May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:30.003409 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot remove host nonexist_host in aggregate 18 May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 14 21:12:30.004247 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 14 21:12:30.009455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.010583 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f932cac-f28b-43d8-a40a-d504471ff214 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.078870 May 14 21:12:30.013801 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 179/324] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:12:29 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:30.195547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-747ffbda-dab1-4735-8f02-6753341dc7d2 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:30.196322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-747ffbda-dab1-4735-8f02-6753341dc7d2 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:30.197337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-747ffbda-dab1-4735-8f02-6753341dc7d2 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:30.198005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-747ffbda-dab1-4735-8f02-6753341dc7d2 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:30.204390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-377adb81-0fb7-4694-9025-37492475f012 tempest-InstanceUsageAuditLogTestJSON-528736711 tempest-InstanceUsageAuditLogTestJSON-528736711-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:30.205492 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:30.205492 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:30.248519 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-377adb81-0fb7-4694-9025-37492475f012 tempest-InstanceUsageAuditLogTestJSON-528736711 tempest-InstanceUsageAuditLogTestJSON-528736711-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-14 21:12:29" status: 200 len: 318 microversion: 2.1 time: 0.242602 May 14 21:12:30.256767 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 180/325] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:12:30 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-14%2021%3A12%3A29 => generated 318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:30.261654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc32a85c-fefb-472c-91e8-3dd705ebac00 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:30.262447 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:30.262447 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:30.372360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dc32a85c-fefb-472c-91e8-3dd705ebac00 tempest-AggregatesAdminNegativeTestJSON-937299836 tempest-AggregatesAdminNegativeTestJSON-937299836-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.114259 May 14 21:12:30.377104 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 181/326] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:12:30 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:30.380682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eedd65a5-0d1c-49d4-a1d9-1f7c97aa774e tempest-InstanceUsageAuditLogTestJSON-528736711 tempest-InstanceUsageAuditLogTestJSON-528736711-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:30.381750 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:30.381750 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:30.394193 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-747ffbda-dab1-4735-8f02-6753341dc7d2 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37" status: 200 len: 328 microversion: 2.1 time: 0.660203 May 14 21:12:30.395064 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 146/327] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:12:29 2022] PUT /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37 => generated 328 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:30.395186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eedd65a5-0d1c-49d4-a1d9-1f7c97aa774e tempest-InstanceUsageAuditLogTestJSON-528736711 tempest-InstanceUsageAuditLogTestJSON-528736711-project-admin] 10.222.0.52 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.020664 May 14 21:12:30.395714 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 182/328] 10.222.0.52 () {58 vars in 1184 bytes} [Sat May 14 21:12:30 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:30.408205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73a29162-f6b2-48f4-becb-ca053d887246 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:30.482732 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73a29162-f6b2-48f4-becb-ca053d887246 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37" status: 202 len: 0 microversion: 2.1 time: 0.080788 May 14 21:12:30.486172 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 147/329] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:12:30 2022] DELETE /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:12:30.497164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-484a5aff-192c-49fb-b920-f2aaafb78204 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Calling method '.version_select at 0x7fb1b4486700>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:30.512505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:30.513121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:30.522900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:30.523449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:30.524291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:30.526744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:30.819054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:30.826804 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-94b5cf91-c0ef-4a3c-8f1f-024e8ae407fa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.322865 May 14 21:12:30.827379 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 148/330] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:30 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:30.836543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:30.837578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:30.845273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:30.845914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:30.846864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:30.847462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:31.076379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:31.085871 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9c7ea0b-f144-4dca-81c2-40e9284ec42c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1462 microversion: 2.1 time: 0.256840 May 14 21:12:31.086784 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 149/331] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:30 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1462 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:31.093148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a2fc92f6-14b2-4236-8909-4d725e5cca06 req-6ea0f0eb-f23d-40d1-b7f2-226ac4526bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90932695-580a-4ed5-8d1e-6e47d0d11693", "name": "network-vif-plugged", "status": "completed", "tag": "074dfa89-1f3d-4b74-9c88-b07bed760e13"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:31.103994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a2fc92f6-14b2-4236-8909-4d725e5cca06 req-6ea0f0eb-f23d-40d1-b7f2-226ac4526bf9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:31.104460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a2fc92f6-14b2-4236-8909-4d725e5cca06 req-6ea0f0eb-f23d-40d1-b7f2-226ac4526bf9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:31.119282 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a2fc92f6-14b2-4236-8909-4d725e5cca06 req-6ea0f0eb-f23d-40d1-b7f2-226ac4526bf9 service nova] Creating event network-vif-plugged:074dfa89-1f3d-4b74-9c88-b07bed760e13 for instance 90932695-580a-4ed5-8d1e-6e47d0d11693 on nch1-master-1 May 14 21:12:31.127870 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a2fc92f6-14b2-4236-8909-4d725e5cca06 req-6ea0f0eb-f23d-40d1-b7f2-226ac4526bf9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039407 May 14 21:12:31.128631 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 150/332] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:31.142379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:31.146123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:31.155450 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-484a5aff-192c-49fb-b920-f2aaafb78204 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37" status: 200 len: 371 microversion: 2.1 time: 0.664521 May 14 21:12:31.156810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 183/333] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:12:30 2022] GET /compute/v2.1/os-quota-sets/ee19ac3a5cf4496fb0909a5418060b37 => generated 371 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:31.164363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:31.164840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:31.165675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:31.166113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:31.453712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-733e5983-4ef3-43b5-b0e7-8f5ce0184914 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:31.455313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-733e5983-4ef3-43b5-b0e7-8f5ce0184914 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:31.462413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-733e5983-4ef3-43b5-b0e7-8f5ce0184914 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:31.462868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-733e5983-4ef3-43b5-b0e7-8f5ce0184914 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:31.464179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-733e5983-4ef3-43b5-b0e7-8f5ce0184914 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:31.464906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-733e5983-4ef3-43b5-b0e7-8f5ce0184914 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:31.537949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:31.549829 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef1b92f5-b6c4-40d8-ae95-a8e42178270d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.418129 May 14 21:12:31.552558 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 151/334] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:31 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:31.560151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed8b803e-c2be-4dfc-bab4-a754c4ff7bd7 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Calling method '.version_select at 0x7fb1b44d93a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:31.949714 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ed8b803e-c2be-4dfc-bab4-a754c4ff7bd7 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.395504 May 14 21:12:31.953897 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 152/335] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:12:31 2022] GET /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b/defaults => generated 371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:31.962424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:31.963585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:31.970650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:31.974615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:31.974615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:31.974615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:32.216545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:32.226993 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee506c54-7e41-474a-be39-dd5eb3135405 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 200 len: 1589 microversion: 2.1 time: 0.271614 May 14 21:12:32.238836 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 153/336] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:31 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 1589 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:32.243180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:32.244043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:32.251340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:32.251851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:32.255041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:32.255765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:32.372888 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-733e5983-4ef3-43b5-b0e7-8f5ce0184914 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1613 microversion: 2.1 time: 1.214419 May 14 21:12:32.384099 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 184/337] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:31 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1613 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:32.492982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:32.504032 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-60d44643-aabc-4fed-85cf-6053ad5395f0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1318 microversion: 2.1 time: 0.270370 May 14 21:12:32.505834 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 154/338] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:32 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:32.514087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:32.516741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:32.532815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:32.533709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:32.534761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:32.535401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:32.835670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c8711faf-df21-4f56-987e-b6bacc3b1fa4 req-10d806e3-a797-433a-8cc2-b716d12b86a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "406fb98b-cfdf-42ed-b684-bcabeee2633e", "tag": "e509da02-863e-4b7a-95be-11eee591d1dc"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:32.846702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c8711faf-df21-4f56-987e-b6bacc3b1fa4 req-10d806e3-a797-433a-8cc2-b716d12b86a2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:32.847418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c8711faf-df21-4f56-987e-b6bacc3b1fa4 req-10d806e3-a797-433a-8cc2-b716d12b86a2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:32.859114 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c8711faf-df21-4f56-987e-b6bacc3b1fa4 req-10d806e3-a797-433a-8cc2-b716d12b86a2 service nova] Creating event network-changed:e509da02-863e-4b7a-95be-11eee591d1dc for instance 406fb98b-cfdf-42ed-b684-bcabeee2633e on nch1-master-1 May 14 21:12:32.864640 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c8711faf-df21-4f56-987e-b6bacc3b1fa4 req-10d806e3-a797-433a-8cc2-b716d12b86a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.478693 May 14 21:12:32.865675 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 185/339] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:32.871011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:32.871823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:32.878930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:32.879384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:32.880472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:32.881334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:33.112385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:33.139646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44eda0ca-00f3-469c-aad2-dc56ac1a84e2 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1320 microversion: 2.1 time: 0.254409 May 14 21:12:33.141278 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 186/340] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:32 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:33.162560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2c2c5747-f3c6-4243-9cec-c0104a0521d5 req-910d54b4-3711-42d5-bb02-9a6b74abedc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d82378-9805-462c-80ed-eda32e4ac59c", "name": "network-vif-plugged", "status": "completed", "tag": "a1f814e9-3098-42d8-a275-d715b407239c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:33.178815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2c2c5747-f3c6-4243-9cec-c0104a0521d5 req-910d54b4-3711-42d5-bb02-9a6b74abedc3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:33.179717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2c2c5747-f3c6-4243-9cec-c0104a0521d5 req-910d54b4-3711-42d5-bb02-9a6b74abedc3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:33.206578 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2c2c5747-f3c6-4243-9cec-c0104a0521d5 req-910d54b4-3711-42d5-bb02-9a6b74abedc3 service nova] Creating event network-vif-plugged:a1f814e9-3098-42d8-a275-d715b407239c for instance 56d82378-9805-462c-80ed-eda32e4ac59c on nch2-master-1 May 14 21:12:33.212971 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2c2c5747-f3c6-4243-9cec-c0104a0521d5 req-910d54b4-3711-42d5-bb02-9a6b74abedc3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054006 May 14 21:12:33.214203 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 187/341] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:33.450702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99ae42db-354f-4de8-bb76-f0fbd35c74e3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b48dca60>, body: {"quota_set": {"ram": "5120"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:33.955653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ae42db-354f-4de8-bb76-f0fbd35c74e3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:33.956247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ae42db-354f-4de8-bb76-f0fbd35c74e3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:33.957949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ae42db-354f-4de8-bb76-f0fbd35c74e3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:33.958638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ae42db-354f-4de8-bb76-f0fbd35c74e3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:33.989300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9847c635058343c096bb44d95e70bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4ed51cf6684302bed4497b2547ef09', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:33.989300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] flavor_id is None. Assuming migration. {{(pid=130638) resize /opt/stack/nova/nova/compute/api.py:4142}} May 14 21:12:33.989300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130638) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 21:12:34.123455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99ae42db-354f-4de8-bb76-f0fbd35c74e3 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4" status: 200 len: 328 microversion: 2.1 time: 0.677357 May 14 21:12:34.124287 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 188/342] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:12:33 2022] PUT /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4 => generated 328 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:34.129362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:34.130185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:34.136371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:34.136830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:34.137608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:34.138048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:34.277600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:34.286845 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8aae7b0a-0718-4b73-8101-c92076e736df tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1467 microversion: 2.1 time: 0.160955 May 14 21:12:34.287450 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 189/343] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:34 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1467 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:34.304561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-74e7178e-aa6f-4a84-89ea-4449b22e765d tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Calling method '.version_select at 0x7fb1b48dca60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:34.644446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74e7178e-aa6f-4a84-89ea-4449b22e765d tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:34.645112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74e7178e-aa6f-4a84-89ea-4449b22e765d tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:34.646098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74e7178e-aa6f-4a84-89ea-4449b22e765d tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:34.646698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74e7178e-aa6f-4a84-89ea-4449b22e765d tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:34.665240 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-74e7178e-aa6f-4a84-89ea-4449b22e765d tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4/detail" status: 200 len: 916 microversion: 2.1 time: 0.364286 May 14 21:12:34.666065 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 190/344] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:12:34 2022] GET /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4/detail => generated 916 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:34.677390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:34.678204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:34.684921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:34.685492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:34.686409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:34.686853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:34.843198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:34.853120 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-043ba59f-883a-4428-8a21-04c9759db19b tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1470 microversion: 2.1 time: 0.185508 May 14 21:12:34.854249 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 191/345] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:34 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1470 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:35.078557 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29fb453b-9a3b-40a4-a981-c9d480bfbb12 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b/action" status: 202 len: 0 microversion: 2.1 time: 2.568564 May 14 21:12:35.082813 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 155/346] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:12:32 2022] POST /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b/action => generated 0 bytes in 2575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:35.099854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-930273fb-2544-4581-a736-b5580bec6693 tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:35.101247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-930273fb-2544-4581-a736-b5580bec6693 tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:35.108873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-930273fb-2544-4581-a736-b5580bec6693 tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.109364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-930273fb-2544-4581-a736-b5580bec6693 tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.115543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-930273fb-2544-4581-a736-b5580bec6693 tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.115543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-930273fb-2544-4581-a736-b5580bec6693 tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.167432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1005723929", "block_migration": true, "disk_over_commit": false}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:35.169349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:35.179688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.192880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.193824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.194865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.315957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lazy-loading 'flavor' on Instance uuid 90932695-580a-4ed5-8d1e-6e47d0d11693 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:35.370778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Going to try to live migrate instance to tempest-host-1005723929 {{(pid=130637) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:12:35.377946 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] HTTP exception thrown: Compute host tempest-host-1005723929 could not be found. May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Request method failure captured: May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693/action HTTP/1.1 May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 107 May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsnCowrv4jd1UJAPXpvNQ49PT0HJvEH1GOKuz1Ptb4647FeJlSPNAZuefiuMqw7uDTlqP5tdpdrJdknprNTfK1VgszHrNVzVKINn_QKaAboraCwKdzijWuwJRAXU36G2118qXUttIABlL9UuQByIe1zaBNcCLQfPX5L2yNiIjkOipI May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b66b447c40c04f70b7375b342f88bec8 May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-LiveMigrationNegativeTest-1227557669 May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:35.382483 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b66b447c40c04f70b7375b342f88bec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b66b447c40c04f70b7375b342f88bec8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b66b447c40c04f70b7375b342f88bec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b66b447c40c04f70b7375b342f88bec8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-LiveMigrationNegativeTest-1227557669 May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b66b447c40c04f70b7375b342f88bec8 May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1227557669 May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-LiveMigrationNegativeTest-1227557669-project-admin May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 94856972be884cd7a06b4673411ffea8 May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-LiveMigrationNegativeTest-1227557669-project-admin May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: {"os-migrateLive": {"host": "tempest-host-1005723929", "block_migration": true, "disk_over_commit": false}} May 14 21:12:35.384239 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: exception: Compute host tempest-host-1005723929 could not be found. May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '90932695-580a-4ed5-8d1e-6e47d0d11693', 'body': {'os-migrateLive': {'host': 'tempest-host-1005723929', 'block_migration': True, 'disk_over_commit': False}}} May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:12:35.385568 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1005723929 could not be found. May 14 21:12:35.386634 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1005723929 could not be found. May 14 21:12:35.388611 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1005723929 could not be found. May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Returning 400 to user: Compute host tempest-host-1005723929 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3680cde7-9129-4907-92f6-8d28f774d07b tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693/action" status: 400 len: 100 microversion: 2.1 time: 0.528397 May 14 21:12:35.391353 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 192/347] 10.222.0.52 () {60 vars in 1278 bytes} [Sat May 14 21:12:34 2022] POST /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693/action => generated 100 bytes in 529 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:35.393271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:35.394201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:35.402188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.402651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.403457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.403942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.419471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-930273fb-2544-4581-a736-b5580bec6693 tempest-DeleteServersAdminTestJSON-2121350512 tempest-DeleteServersAdminTestJSON-2121350512-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c/action" status: 202 len: 0 microversion: 2.1 time: 0.335190 May 14 21:12:35.420642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 156/348] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:12:35 2022] POST /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:35.425950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b45691f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:35.556375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:35.564212 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efc1bb46-659a-4cf0-8d88-d513f8805331 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1471 microversion: 2.1 time: 0.178478 May 14 21:12:35.564957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 193/349] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:35 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:35.569713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:35.570358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:35.576611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.577073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.578473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.578962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.716601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:35.725317 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c8e2847-b399-4332-ab5a-450a61f8db07 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1467 microversion: 2.1 time: 0.159205 May 14 21:12:35.725884 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 194/350] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:35 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1467 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:35.730540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:35.731144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:35.742824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.743814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.745028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.745650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.784641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.785214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.785728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lazy-loading 'fault' on Instance uuid 56d82378-9805-462c-80ed-eda32e4ac59c {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:35.899312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:35.907145 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0935dd07-444d-4848-b64b-4f5dd3f6552d tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1453 microversion: 2.1 time: 0.180259 May 14 21:12:35.907757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 195/351] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:35 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:35.924749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:35.925415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:35.933747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.934426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.935225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:35.935875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:35.963597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:12:36.101358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.102604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.103844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.104535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.177614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.179054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.181582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.184109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.323205 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6958cd08-327a-4406-b86f-907b55a4f753 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "DELETE /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 204 len: 0 microversion: 2.1 time: 0.403328 May 14 21:12:36.324909 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 196/352] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:12:35 2022] DELETE /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:12:36.332805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1847762642", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:36.350383 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0969805-2f1e-4982-bb36-c3faf869745a tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4?user_id=86b7079d5fdd4f719796d771f4211f39" status: 200 len: 328 microversion: 2.1 time: 0.928771 May 14 21:12:36.351593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 157/353] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:12:35 2022] PUT /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4?user_id=86b7079d5fdd4f719796d771f4211f39 => generated 328 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:36.357171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:36.357913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:36.364462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.365173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.365930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.369296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.392425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:12:36.402491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.409485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.409485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lazy-loading 'fault' on Instance uuid 56d82378-9805-462c-80ed-eda32e4ac59c {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:36.557247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:36.564765 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ff8ca40c-5edc-4b98-8d42-eefd655a9dc4 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1459 microversion: 2.1 time: 0.212166 May 14 21:12:36.565346 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 158/354] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:36 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1459 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:36.570126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d7700bf5-ae96-4c67-8c19-81c27368397b tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Calling method '.version_select at 0x7fb1b44039d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:36.633524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:12:36.634118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:12:36.634752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:12:36.636234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:12:36.636234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:12:36.646480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.647142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.647981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.648560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.667102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Getting quotas for project 9ffe47c465e1480d91f689bed8e9ed94. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:36.671260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Getting quotas for user 6ca2cafc3b794c88b48510b5d466b580 and project 9ffe47c465e1480d91f689bed8e9ed94. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:36.682658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:12:36.685165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:12:36.851589 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3682b668-508b-44f0-a8a2-46f99291c7b6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.524949 May 14 21:12:36.852501 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 197/355] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:12:36.861444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:36.862182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:36.869071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.869615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:36.870478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:36.871134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:37.018256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:37.037387 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0697887-6eae-46b8-88f7-324cd94c57ed tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1471 microversion: 2.1 time: 0.183542 May 14 21:12:37.038044 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 198/356] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:36 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1471 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:37.043109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f492fcb4-a9c8-42d7-91d5-c9bf16c7555c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:37.046085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f492fcb4-a9c8-42d7-91d5-c9bf16c7555c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:37.106503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f492fcb4-a9c8-42d7-91d5-c9bf16c7555c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:37.114062 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f492fcb4-a9c8-42d7-91d5-c9bf16c7555c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1219 microversion: 2.1 time: 0.074877 May 14 21:12:37.114645 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 199/357] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:37 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:37.168547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d7700bf5-ae96-4c67-8c19-81c27368397b tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4?user_id=86b7079d5fdd4f719796d771f4211f39" status: 200 len: 370 microversion: 2.1 time: 0.601770 May 14 21:12:37.169105 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 159/358] 10.222.0.52 () {58 vars in 1322 bytes} [Sat May 14 21:12:36 2022] GET /compute/v2.1/os-quota-sets/902774b3ff584577a522cb8a7dbf1fb4?user_id=86b7079d5fdd4f719796d771f4211f39 => generated 370 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:37.582042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:37.585422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:37.589581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:37.590130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:37.590957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:37.591506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:37.629086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:37.629661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:37.630283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lazy-loading 'fault' on Instance uuid 56d82378-9805-462c-80ed-eda32e4ac59c {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:37.833301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:37.842870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b8a2ad3b-7408-4ef0-bfa6-b6998f8bddbe tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1459 microversion: 2.1 time: 0.264996 May 14 21:12:37.844455 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 200/359] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:37 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1459 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:38.055362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:38.056511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:38.063076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.063570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.064913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.066063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.134365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:38.135395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:38.148421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.149752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.157627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.157627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.239465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:38.249395 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-922743e8-8faa-4de0-92fa-8b298d679f63 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1223 microversion: 2.1 time: 0.119769 May 14 21:12:38.251074 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 201/360] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:38 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:38.259250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:38.270275 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-af7dc689-1429-43a0-9e50-0c55bdcaf5cb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1471 microversion: 2.1 time: 0.218932 May 14 21:12:38.270974 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 160/361] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:38 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1471 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:38.354829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0657d724-3427-4af4-a652-0ed57fa21b76 req-c7f79212-0aa0-4050-bfaa-1eb13d1c8e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56d82378-9805-462c-80ed-eda32e4ac59c", "name": "network-vif-deleted", "tag": "a1f814e9-3098-42d8-a275-d715b407239c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:38.367749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0657d724-3427-4af4-a652-0ed57fa21b76 req-c7f79212-0aa0-4050-bfaa-1eb13d1c8e56 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.368201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0657d724-3427-4af4-a652-0ed57fa21b76 req-c7f79212-0aa0-4050-bfaa-1eb13d1c8e56 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.382360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0657d724-3427-4af4-a652-0ed57fa21b76 req-c7f79212-0aa0-4050-bfaa-1eb13d1c8e56 service nova] Creating event network-vif-deleted:a1f814e9-3098-42d8-a275-d715b407239c for instance 56d82378-9805-462c-80ed-eda32e4ac59c on nch2-master-1 May 14 21:12:38.387461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0657d724-3427-4af4-a652-0ed57fa21b76 req-c7f79212-0aa0-4050-bfaa-1eb13d1c8e56 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037617 May 14 21:12:38.388094 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 202/362] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:38.462181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-049002dd-737d-49a3-bd21-86dfc1e02fed tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Calling method '.version_select at 0x7fb1b43c20d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:38.861824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:38.863218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:38.869728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.870189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.870968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.871406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.904081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:38.904545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:38.905009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lazy-loading 'fault' on Instance uuid 56d82378-9805-462c-80ed-eda32e4ac59c {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:38.962759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d7d10a70c364505af3b2b8294238615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313d5b39fe10417993b28718eb6e6f7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:38.970873 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23f78816-3f9c-4edd-a0aa-5a4196e1977e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 200 len: 1310 microversion: 2.1 time: 0.113446 May 14 21:12:38.981098 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 203/363] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:38 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 1310 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:39.106309 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-049002dd-737d-49a3-bd21-86dfc1e02fed tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b/defaults" status: 200 len: 371 microversion: 2.1 time: 0.647911 May 14 21:12:39.107072 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 161/364] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:12:38 2022] GET /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b/defaults => generated 371 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:39.117728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9d5b810a-32b8-4166-aa4c-3be36e4ca561 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b43c21f0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:39.173816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1181994050", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": "none"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:39.237388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:12:39.237388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:12:39.237388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:12:39.237388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:12:39.237388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:12:39.244295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.245083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.245941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.246380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.269863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Getting quotas for project f6c833726abf47f49b561df1966764d5. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:12:39.274212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Getting quotas for user 3bff40a84e6f4a82b0c9fb0b155684c4 and project f6c833726abf47f49b561df1966764d5. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:12:39.288622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:12:39.291072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:12:39.490107 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9347327e-f327-4c87-922b-e542500dab4d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.446356 May 14 21:12:39.491285 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 204/365] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 14 21:12:39.509740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:39.514795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:39.538928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.543865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.545903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.546582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.591851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d5b810a-32b8-4166-aa4c-3be36e4ca561 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.592315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d5b810a-32b8-4166-aa4c-3be36e4ca561 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.593100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d5b810a-32b8-4166-aa4c-3be36e4ca561 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.598843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d5b810a-32b8-4166-aa4c-3be36e4ca561 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.665542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:39.674299 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52c0b222-8904-4cb2-887e-9cfb5cbd8edb tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1279 microversion: 2.1 time: 0.181787 May 14 21:12:39.678777 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 205/366] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:39 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:39.691884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:39.693984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:39.710155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.712621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.713583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:39.715537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:39.961282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:39.969850 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a9cdd2a-c40f-4d3c-b18e-e4d1e4b8f091 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1471 microversion: 2.1 time: 0.289757 May 14 21:12:39.971084 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 206/367] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:39 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:39.976015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c8000e8-7bc4-495d-99bb-50aa1baaa161 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:39.977573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c8000e8-7bc4-495d-99bb-50aa1baaa161 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:40.052755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c8000e8-7bc4-495d-99bb-50aa1baaa161 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:40.063252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c8000e8-7bc4-495d-99bb-50aa1baaa161 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:40.064817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c8000e8-7bc4-495d-99bb-50aa1baaa161 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:40.073773 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c8000e8-7bc4-495d-99bb-50aa1baaa161 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "PUT /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1359 microversion: 2.75 time: 0.101428 May 14 21:12:40.074438 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 207/368] 10.222.0.52 () {62 vars in 1296 bytes} [Sat May 14 21:12:39 2022] PUT /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1359 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:40.261848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87945e55-a554-4761-a853-9d7fa8b91a21 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] Action: 'create', calling method: .version_select at 0x7fb1b42ad040>, body: {"security_group": {"name": "tempest-securitygroup-433040140", "description": "tempest-description-167452835"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:40.970601 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87945e55-a554-4761-a853-9d7fa8b91a21 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.894914 May 14 21:12:40.971560 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 208/369] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:12:40 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:40.980415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:40.981058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:41.003359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.003855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.004680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.005129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.021464 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] HTTP exception thrown: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Request method failure captured: May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c HTTP/1.1 May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsFQFNrV5TPQX0XEV4uqUfcv2uhH1hcOyD6QmGhQTwUlH4yyEStWEL9D-qx16RlpFP417wZx-7eHYSAZ5A-faPl9oSwnzMq9PNVPbwQqqeOi4HMgP7P7xVxXf2uQXs0OZtL3xD_tZMk8HpWJunN3zkl2MEIAWU7RfWUpGt03rD-4mI May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:41.023130 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_313d5b39fe10417993b28718eb6e6f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 7d7d10a70c364505af3b2b8294238615 May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.024611 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '56d82378-9805-462c-80ed-eda32e4ac59c'} May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:41.025506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.026843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:41.027856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Returning 404 to user: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:41.027856 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-98adebf6-568e-41f0-9b82-4a48d94f3e51 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 404 len: 111 microversion: 2.1 time: 0.051390 May 14 21:12:41.027856 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 209/370] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:40 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:41.134881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14090072-c2f1-4881-bc79-e0c40ad4008d tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-532455677", "id": 874334034, "os-flavor-access:is_public": "False"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:41.136573 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:41.136573 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:41.199798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14090072-c2f1-4881-bc79-e0c40ad4008d tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.172037 May 14 21:12:41.206444 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 210/371] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:41 2022] POST /compute/v2.1/flavors => generated 435 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:41.210051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:41.210669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:41.216935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.217435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.218724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.219163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.246822 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9d5b810a-32b8-4166-aa4c-3be36e4ca561 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b" status: 200 len: 329 microversion: 2.1 time: 2.133111 May 14 21:12:41.253613 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 162/372] 10.222.0.52 () {60 vars in 1262 bytes} [Sat May 14 21:12:39 2022] PUT /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b => generated 329 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:41.258835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:41.259583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:41.265962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.266651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.267422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.267968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.411907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:41.420251 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f416ccae-b85e-4ecd-8009-f1c46fe1fb51 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.165329 May 14 21:12:41.421105 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 163/373] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:41 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:41.435271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e9c004fa-1541-4f20-88b6-fe7fb264b4b4 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] Action: 'create', calling method: .version_select at 0x7fb1b4575280>, body: {"security_group": {"name": "tempest-securitygroup-787161275", "description": "tempest-description-1277241798"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:41.571163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:41.585378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:41.586947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:41.592232 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53e99a63-722a-4eae-a2d6-ffe707f7dadc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1363 microversion: 2.75 time: 0.390839 May 14 21:12:41.592810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 211/374] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:41 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:41.610129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:41.610750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:41.616825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.617282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.618067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.620400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.826086 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e9c004fa-1541-4f20-88b6-fe7fb264b4b4 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.395977 May 14 21:12:41.826938 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 164/375] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:12:41 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:41.832697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:41.833272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:41.847728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.848186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.849113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:41.849742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:41.875597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:41.880178 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] HTTP exception thrown: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Request method failure captured: May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c HTTP/1.1 May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsFQFNrV5TPQX0XEV4uqUfcv2uhH1hcOyD6QmGhQTwUlH4yyEStWEL9D-qx16RlpFP417wZx-7eHYSAZ5A-faPl9oSwnzMq9PNVPbwQqqeOi4HMgP7P7xVxXf2uQXs0OZtL3xD_tZMk8HpWJunN3zkl2MEIAWU7RfWUpGt03rD-4mI May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:41.882969 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_313d5b39fe10417993b28718eb6e6f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 7d7d10a70c364505af3b2b8294238615 May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.884263 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '56d82378-9805-462c-80ed-eda32e4ac59c'} May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:41.884914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:41.886080 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:41.887184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Returning 404 to user: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:41.887875 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-914858ea-9da6-4891-9450-fb493436fecc tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "DELETE /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 404 len: 111 microversion: 2.1 time: 0.059057 May 14 21:12:41.889344 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 165/376] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:12:41 2022] DELETE /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:41.891788 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ea05e6ab-a80a-476b-b63d-cd6c540962b6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1471 microversion: 2.1 time: 0.286669 May 14 21:12:41.896098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ebe4c6eb-40df-4b35-aa48-e85a378240b2 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:41.897708 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 212/377] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:41 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1471 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:41.897850 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:41.897850 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:41.903402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-95de0e3d-3f8c-4650-b8f1-dca493b5c6d9 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b4207550>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:42.107440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95de0e3d-3f8c-4650-b8f1-dca493b5c6d9 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:42.110645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95de0e3d-3f8c-4650-b8f1-dca493b5c6d9 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:42.110645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95de0e3d-3f8c-4650-b8f1-dca493b5c6d9 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:42.110645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95de0e3d-3f8c-4650-b8f1-dca493b5c6d9 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:42.126017 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ebe4c6eb-40df-4b35-aa48-e85a378240b2 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/874334034/action" status: 200 len: 96 microversion: 2.1 time: 0.233231 May 14 21:12:42.137355 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 166/378] 10.222.0.52 () {60 vars in 1196 bytes} [Sat May 14 21:12:41 2022] POST /compute/v2.1/flavors/874334034/action => generated 96 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:42.246531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a16736e2-e0f4-4bdc-81d3-9f6d6c4335f8 tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] Action: 'create', calling method: .version_select at 0x7fb1b4500160>, body: {"security_group": {"name": "tempest-securitygroup-499379009", "description": "tempest-description-181919765"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:42.774926 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a16736e2-e0f4-4bdc-81d3-9f6d6c4335f8 tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.636467 May 14 21:12:42.775572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 167/379] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:12:42 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:42.783854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:42.784473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 56d82378-9805-462c-80ed-eda32e4ac59c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:42.791240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:42.791732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:42.792506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:42.792949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:42.806710 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] HTTP exception thrown: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Request method failure captured: May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c HTTP/1.1 May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsFQFNrV5TPQX0XEV4uqUfcv2uhH1hcOyD6QmGhQTwUlH4yyEStWEL9D-qx16RlpFP417wZx-7eHYSAZ5A-faPl9oSwnzMq9PNVPbwQqqeOi4HMgP7P7xVxXf2uQXs0OZtL3xD_tZMk8HpWJunN3zkl2MEIAWU7RfWUpGt03rD-4mI May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:42.808259 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_313d5b39fe10417993b28718eb6e6f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 7d7d10a70c364505af3b2b8294238615 May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:42.809641 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '56d82378-9805-462c-80ed-eda32e4ac59c'} May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:42.810505 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. May 14 21:12:42.811973 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.813049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Returning 404 to user: Instance 56d82378-9805-462c-80ed-eda32e4ac59c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:42.813049 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f60c588-0d26-4d2d-a9e3-c7f6e350e028 tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c" status: 404 len: 111 microversion: 2.1 time: 0.033139 May 14 21:12:42.813049 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 168/380] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:42 2022] GET /compute/v2.1/servers/56d82378-9805-462c-80ed-eda32e4ac59c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:42.814961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5871c62a-0f5e-493c-b8a0-193958254784 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:42.816245 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:42.816245 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:42.904658 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5871c62a-0f5e-493c-b8a0-193958254784 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] HTTP exception thrown: Flavor access already exists for flavor 32 and project bc82fc4cb79444acbdf29af78e302e6a combination. May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5871c62a-0f5e-493c-b8a0-193958254784 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Request method failure captured: May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/flavors/874334034/action HTTP/1.1 May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 67 May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtGI7soQaqjo8pBN7J1_bpCz_vMsnaZAe-q5UERz0LnqIyvsHM9yhkexdyphM2j41b46ruzRi9xjwby7la9veBu_8QeIvXZw15SZAzYTUTPvIsx4f8oJ1MxXXAIvaKW4WNGFvTpiKdxXIXw6htonlWiYdRLLOPIqWnSQyfzd5qDtQM May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 782f075c7cc0430f85d614dc49b230c6 May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:42.916263 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782f075c7cc0430f85d614dc49b230c6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 782f075c7cc0430f85d614dc49b230c6 May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 09800a8572864b748da9fc581ea97e44 May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: {"addTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} May 14 21:12:42.917718 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: exception: Flavor access already exists for flavor 32 and project bc82fc4cb79444acbdf29af78e302e6a combination. May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '874334034', 'body': {'addTenantAccess': {'tenant': 'bc82fc4cb79444acbdf29af78e302e6a'}}} May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = self._query(query) May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi conn.query(q) May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result.read() May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:12:42.918497 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '32-bc82fc4cb79444acbdf29af78e302e6a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi project.save(context.session) May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi session.flush() May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._flush(objects) May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 21:12:42.919469 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi compat.raise_( May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi flush_context.execute() May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi rec.execute(self) May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 21:12:42.920647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = self._query(query) May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi conn.query(q) May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:12:42.922638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result.read() May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '32-bc82fc4cb79444acbdf29af78e302e6a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 14, 21, 12, 42, 872399), 'updated_at': None, 'flavor_id': 32, 'project_id': 'bc82fc4cb79444acbdf29af78e302e6a'}] May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:42.923899 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 32 and project bc82fc4cb79444acbdf29af78e302e6a combination. May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:42.925041 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 32 and project bc82fc4cb79444acbdf29af78e302e6a combination. May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:42.926414 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:42.928049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 32 and project bc82fc4cb79444acbdf29af78e302e6a combination. May 14 21:12:42.928049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:42.928049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5871c62a-0f5e-493c-b8a0-193958254784 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Returning 409 to user: Flavor access already exists for flavor 32 and project bc82fc4cb79444acbdf29af78e302e6a combination. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:42.928049 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5871c62a-0f5e-493c-b8a0-193958254784 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/874334034/action" status: 409 len: 152 microversion: 2.1 time: 0.106710 May 14 21:12:42.928049 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 169/381] 10.222.0.52 () {60 vars in 1196 bytes} [Sat May 14 21:12:42 2022] POST /compute/v2.1/flavors/874334034/action => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:42.928409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1b47dfb4-8f4a-43e0-8ce1-94f2784dad33 req-c6567262-8669-406d-9e7b-c92745fca093 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a955384b-6dbf-444d-bd67-2a1b9a33531b", "tag": "16d9a058-b772-4ae7-b4f3-0818f1b9074b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:42.936526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1b47dfb4-8f4a-43e0-8ce1-94f2784dad33 req-c6567262-8669-406d-9e7b-c92745fca093 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:42.937044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1b47dfb4-8f4a-43e0-8ce1-94f2784dad33 req-c6567262-8669-406d-9e7b-c92745fca093 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:42.947620 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1b47dfb4-8f4a-43e0-8ce1-94f2784dad33 req-c6567262-8669-406d-9e7b-c92745fca093 service nova] Creating event network-changed:16d9a058-b772-4ae7-b4f3-0818f1b9074b for instance a955384b-6dbf-444d-bd67-2a1b9a33531b on nch2-master-1 May 14 21:12:42.952602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1b47dfb4-8f4a-43e0-8ce1-94f2784dad33 req-c6567262-8669-406d-9e7b-c92745fca093 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032803 May 14 21:12:42.953247 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 170/382] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:42.958366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:42.959060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:42.965196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:42.965681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:42.966487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:42.966924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:43.094980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:43.102430 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df6e5b43-e1e6-4e7a-af93-13332f985dc1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.148016 May 14 21:12:43.102950 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 171/383] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:42 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:43.107410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:43.108033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:43.115381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:43.116184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:43.117095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:43.117588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:43.232713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:43.241198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:43.242878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:43.250688 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9021837d-e492-42ef-83e5-20a1a4dfad37 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1417 microversion: 2.75 time: 0.145791 May 14 21:12:43.251265 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 172/384] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:43 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1417 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:43.255645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e0fbbe3-5826-46e4-ab35-fba7d3dfa62c tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] Action: 'create', calling method: .version_select at 0x7fb1b41599d0>, body: {"security_group": {"name": "tempest-securitygroup-646770388", "description": "tempest-description-1740057788"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:43.693175 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e0fbbe3-5826-46e4-ab35-fba7d3dfa62c tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.440796 May 14 21:12:43.693773 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 173/385] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:12:43 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:43.698292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:43.698811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:43.705656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:43.706104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:43.706904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:43.707343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:43.721632 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] HTTP exception thrown: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Request method failure captured: May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f HTTP/1.1 May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsFQFNrV5TPQX0XEV4uqUfcv2uhH1hcOyD6QmGhQTwUlH4yyEStWEL9D-qx16RlpFP417wZx-7eHYSAZ5A-faPl9oSwnzMq9PNVPbwQqqeOi4HMgP7P7xVxXf2uQXs0OZtL3xD_tZMk8HpWJunN3zkl2MEIAWU7RfWUpGt03rD-4mI May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:43.723283 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_313d5b39fe10417993b28718eb6e6f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 7d7d10a70c364505af3b2b8294238615 May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:43.724667 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f'} May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:43.725456 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:43.726865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:43.728575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Returning 404 to user: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:43.728575 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-27047c5d-d382-4be2-b31b-8871693fde0e tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 404 len: 111 microversion: 2.1 time: 0.030002 May 14 21:12:43.728575 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 174/386] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:12:43 2022] DELETE /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:43.729788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:43.730389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:43.740744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:43.740744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:43.740744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:43.740744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:43.873692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:43.882484 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-340c35ae-e4ca-4be6-ab14-950f8d408167 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.156356 May 14 21:12:43.883043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 175/387] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:43 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:43.887381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce618463-fe19-47e5-b685-879db1e3786f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:43.888783 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:43.888783 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:44.009039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce618463-fe19-47e5-b685-879db1e3786f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/874334034/action" status: 200 len: 21 microversion: 2.1 time: 0.124806 May 14 21:12:44.009566 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 176/388] 10.222.0.52 () {60 vars in 1196 bytes} [Sat May 14 21:12:43 2022] POST /compute/v2.1/flavors/874334034/action => generated 21 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:44.013755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-314c6a85-5b18-418f-bbb2-483160c7628e tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] Calling method '.version_select at 0x7fb1b43b04c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.136108 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-95de0e3d-3f8c-4650-b8f1-dca493b5c6d9 tempest-QuotasAdminTestJSON-1042470066 tempest-QuotasAdminTestJSON-1042470066-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b" status: 200 len: 329 microversion: 2.1 time: 2.237251 May 14 21:12:44.136857 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 213/389] 10.222.0.52 () {60 vars in 1262 bytes} [Sat May 14 21:12:41 2022] PUT /compute/v2.1/os-quota-sets/48bf82bdace04c2f93e8c18a0e12626b => generated 329 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:44.142636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.142636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] [instance: 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:44.148693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:44.149194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:44.150154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:44.150703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:44.165889 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] HTTP exception thrown: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Request method failure captured: May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f HTTP/1.1 May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsFQFNrV5TPQX0XEV4uqUfcv2uhH1hcOyD6QmGhQTwUlH4yyEStWEL9D-qx16RlpFP417wZx-7eHYSAZ5A-faPl9oSwnzMq9PNVPbwQqqeOi4HMgP7P7xVxXf2uQXs0OZtL3xD_tZMk8HpWJunN3zkl2MEIAWU7RfWUpGt03rD-4mI May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:44.167530 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/313d5b39fe10417993b28718eb6e6f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_313d5b39fe10417993b28718eb6e6f7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 313d5b39fe10417993b28718eb6e6f7a May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-106715831 May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 7d7d10a70c364505af3b2b8294238615 May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersAdminTestJSON-106715831-project May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:44.169112 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f'} May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:44.169948 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. May 14 21:12:44.172475 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.178143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] Returning 404 to user: Instance 81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:44.178143 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-452456e2-c403-4f27-94b1-75cb4e2abbce tempest-DeleteServersAdminTestJSON-106715831 tempest-DeleteServersAdminTestJSON-106715831-project] 10.222.0.52 "GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f" status: 404 len: 111 microversion: 2.1 time: 0.031487 May 14 21:12:44.178143 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 214/390] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:44 2022] GET /compute/v2.1/servers/81b4b5d1-2d2e-4a37-ac6c-d010a1409e2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:44.178143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f13c7807-5736-432d-afa4-a48cadfd6d3c tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.178143 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:44.178143 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:44.234416 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f13c7807-5736-432d-afa4-a48cadfd6d3c tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/874334034" status: 202 len: 0 microversion: 2.1 time: 0.063370 May 14 21:12:44.236272 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 215/391] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:12:44 2022] DELETE /compute/v2.1/flavors/874334034 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:44.243087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.243959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:44.253004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:44.253692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:44.254658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:44.255502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:44.400045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:44.408113 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db40f8f5-aecd-4557-ad51-57fb4ab91b78 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.170422 May 14 21:12:44.408684 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 216/392] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:44 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:44.412909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2307feb5-afa9-4ed8-9abd-0f000fad5a76 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.442022 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2307feb5-afa9-4ed8-9abd-0f000fad5a76 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.032065 May 14 21:12:44.455514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 217/393] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:44 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:44.455514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.455514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:44.462855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:44.463563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:44.464751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:44.465412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:44.544657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:44.556229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:44.557187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:44.564315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-89ef1436-b02d-4fc7-914f-2db20239dfcc tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1417 microversion: 2.75 time: 0.119989 May 14 21:12:44.565089 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 218/394] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:44 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1417 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:44.577275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23490c92-b9aa-441b-b531-60ec7beccb37 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1481124553", "id": 400614761, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:44.579659 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:44.579659 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:44.676720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23490c92-b9aa-441b-b531-60ec7beccb37 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.103967 May 14 21:12:44.677328 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 219/395] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:44 2022] POST /compute/v2.1/flavors => generated 435 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:44.687810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53736a6f-9031-4b4b-9004-de29f0c15518 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.688749 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:44.688749 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:44.695304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-53736a6f-9031-4b4b-9004-de29f0c15518 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] HTTP exception thrown: Access list not available for public flavors. May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53736a6f-9031-4b4b-9004-de29f0c15518 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Request method failure captured: May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/flavors/400614761/os-flavor-access HTTP/1.1 May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtGI7soQaqjo8pBN7J1_bpCz_vMsnaZAe-q5UERz0LnqIyvsHM9yhkexdyphM2j41b46ruzRi9xjwby7la9veBu_8QeIvXZw15SZAzYTUTPvIsx4f8oJ1MxXXAIvaKW4WNGFvTpiKdxXIXw6htonlWiYdRLLOPIqWnSQyfzd5qDtQM May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 782f075c7cc0430f85d614dc49b230c6 May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:44.697045 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782f075c7cc0430f85d614dc49b230c6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 782f075c7cc0430f85d614dc49b230c6 May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 09800a8572864b748da9fc581ea97e44 May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: exception: Access list not available for public flavors. May 14 21:12:44.698346 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '400614761'} May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 14 21:12:44.698983 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:44.706759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53736a6f-9031-4b4b-9004-de29f0c15518 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:44.706759 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53736a6f-9031-4b4b-9004-de29f0c15518 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/400614761/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.017432 May 14 21:12:44.706759 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 220/396] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:12:44 2022] GET /compute/v2.1/flavors/400614761/os-flavor-access => generated 91 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 14 21:12:44.712102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-55311e9b-3ec2-4ffc-a610-703d930a8357 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.713114 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:44.713114 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:44.821711 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-55311e9b-3ec2-4ffc-a610-703d930a8357 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/400614761" status: 202 len: 0 microversion: 2.1 time: 0.113153 May 14 21:12:44.822296 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 221/397] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:12:44 2022] DELETE /compute/v2.1/flavors/400614761 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:44.830075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d75fd332-90ff-4e2a-8f68-3dd6a72c774f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:44.868137 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d75fd332-90ff-4e2a-8f68-3dd6a72c774f tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.041686 May 14 21:12:44.868742 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 222/398] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:44 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:44.886371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-002a2753-df6b-4a78-b807-662b76ce0dcd tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2036745069", "id": 1599982747, "os-flavor-access:is_public": "False"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:45.061959 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-002a2753-df6b-4a78-b807-662b76ce0dcd tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.178567 May 14 21:12:45.063112 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 223/399] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:44 2022] POST /compute/v2.1/flavors => generated 439 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:45.078936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:45.081611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:45.094217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.094788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:45.095468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.096120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:45.350140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-314c6a85-5b18-418f-bbb2-483160c7628e tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8991 microversion: 2.1 time: 1.339333 May 14 21:12:45.351188 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 177/400] 10.222.0.52 () {58 vars in 1190 bytes} [Sat May 14 21:12:44 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8991 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:45.398402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:45.411200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ddea76c-abf7-45f9-b655-53ae8ccd2690 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.346605 May 14 21:12:45.426405 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 224/401] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:45 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:45.450418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-69501495-b70d-463e-924f-a3de45305126 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] Calling method '.version_select at 0x7fb1b4218e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:45.572931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0deb76be-df83-4448-b95b-bfdf9d673d6d tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:45.574182 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:45.574182 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:45.575019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0deb76be-df83-4448-b95b-bfdf9d673d6d tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9539e4b48a0d49959780fae9a39cbce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc82fc4cb79444acbdf29af78e302e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0deb76be-df83-4448-b95b-bfdf9d673d6d tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Request method failure captured: May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/flavors/1599982747/action HTTP/1.1 May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 67 May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtEgAZc5Kb091KT_z87_pGDJR9xVHRA58dtHo6iweyp6-H0Rf3CjAVMphU4qqFCJxs1ic3YMhgSeq46wE1oR7n9keW9DVeCVgAvtRi1to-8Z3BDwdxlKYGrfr39oEjegxO2ltR5IbwszA4NJ3s8h0wLKD94SQI4mZav-bZY3nFr1tM May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bc82fc4cb79444acbdf29af78e302e6a May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1568496261 May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:45.576679 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc82fc4cb79444acbdf29af78e302e6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc82fc4cb79444acbdf29af78e302e6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bc82fc4cb79444acbdf29af78e302e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bc82fc4cb79444acbdf29af78e302e6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1568496261 May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bc82fc4cb79444acbdf29af78e302e6a May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1568496261 May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FlavorsAccessNegativeTestJSON-1568496261-project May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9539e4b48a0d49959780fae9a39cbce7 May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1568496261-project May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: {"addTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} May 14 21:12:45.577964 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1599982747', 'body': {'addTenantAccess': {'tenant': 'bc82fc4cb79444acbdf29af78e302e6a'}}} May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:45.578685 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 14 21:12:45.580729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:45.582073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0deb76be-df83-4448-b95b-bfdf9d673d6d tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:45.582073 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0deb76be-df83-4448-b95b-bfdf9d673d6d tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] 10.222.0.52 "POST /compute/v2.1/flavors/1599982747/action" status: 403 len: 130 microversion: 2.1 time: 0.225699 May 14 21:12:45.582073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 178/402] 10.222.0.52 () {60 vars in 1199 bytes} [Sat May 14 21:12:45 2022] POST /compute/v2.1/flavors/1599982747/action => generated 130 bytes in 227 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:45.583084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:45.583877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:45.591268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.591966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:45.593072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.593739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:45.748374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:45.758459 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f662f311-d956-4e8a-8541-ea6d192b50a6 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.178796 May 14 21:12:45.761832 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 179/403] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:45 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:45.766689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:45.767723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:45.775281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.776050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:45.777712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.778360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:45.806553 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-69501495-b70d-463e-924f-a3de45305126 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.373080 May 14 21:12:45.807135 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 225/404] 10.222.0.52 () {58 vars in 1190 bytes} [Sat May 14 21:12:45 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:45.812626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1122a29f-1e01-4158-98a3-4a5c1fb4a6be tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:45.813631 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:45.813631 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:45.865081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:45.873164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:45.874961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:45.879998 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-abe97400-cc60-49fd-9bbe-0ffd0c526d66 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1438 microversion: 2.75 time: 0.117049 May 14 21:12:45.880580 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 180/405] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:45 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1438 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:45.885211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a8e8e71b-065e-4ce6-95f6-a6dd3a67620b tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] Calling method '.version_select at 0x7fb1b4125dc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:45.903255 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1122a29f-1e01-4158-98a3-4a5c1fb4a6be tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1599982747" status: 202 len: 0 microversion: 2.1 time: 0.093991 May 14 21:12:45.904178 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 226/406] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:12:45 2022] DELETE /compute/v2.1/flavors/1599982747 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:45.914513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:45.923950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:45.930761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.931609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:45.936863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:45.936863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.014413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:12:46.015543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:12:46.018214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:12:46.018214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:12:46.018214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:12:46.135790 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a8e8e71b-065e-4ce6-95f6-a6dd3a67620b tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e73a7aee-77a6-49ce-bc24-25901639b4fb" status: 202 len: 0 microversion: 2.1 time: 0.253074 May 14 21:12:46.136778 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 181/407] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:12:45 2022] DELETE /compute/v2.1/os-security-groups/e73a7aee-77a6-49ce-bc24-25901639b4fb => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:46.142847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-408a0f21-e8be-4e78-a29f-d917cdeb20df tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:46.164620 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-408a0f21-e8be-4e78-a29f-d917cdeb20df tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.026745 May 14 21:12:46.168108 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 182/408] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:46 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:46.170134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6fd25135-326b-426a-85ee-06bf84f65339 tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] Calling method '.version_select at 0x7fb1b4159b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:46.212921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:46.219512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.220266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.221413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.222065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.292646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:46.302694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:46.304526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:46.309821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec713135-bd62-42bc-9b5d-a95f93ad4375 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "POST /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d/action" status: 202 len: 1495 microversion: 2.75 time: 0.401788 May 14 21:12:46.313846 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 227/409] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:12:45 2022] POST /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d/action => generated 1495 bytes in 403 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 14 21:12:46.315008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf0952be-2b32-4898-a137-f41665805174 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-406103946", "id": 1872856250, "os-flavor-access:is_public": "False"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:46.316608 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:46.316608 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:46.425732 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf0952be-2b32-4898-a137-f41665805174 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.114093 May 14 21:12:46.431716 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 228/410] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:46 2022] POST /compute/v2.1/flavors => generated 438 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:46.436465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:46.437129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:46.444218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.444678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.445500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.446080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.483268 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6fd25135-326b-426a-85ee-06bf84f65339 tempest-SecurityGroupsTestAdminJSON-521377261 tempest-SecurityGroupsTestAdminJSON-521377261-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0f58ad92-b2ee-4c8e-8cb4-7899ea10a162" status: 202 len: 0 microversion: 2.1 time: 0.316394 May 14 21:12:46.484552 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 183/411] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:12:46 2022] DELETE /compute/v2.1/os-security-groups/0f58ad92-b2ee-4c8e-8cb4-7899ea10a162 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:46.489902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:46.490325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:46.501166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.501620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.502405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.502837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.542194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:46.553021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:46.554665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:46.561011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-324c7522-b7d8-4602-9ad0-8d4aad721c18 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.127866 May 14 21:12:46.561937 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 229/412] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:46 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:46.568852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d058748c-7c86-45cd-b99a-86f16b173b5e tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:46.570235 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:46.570235 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:46.710916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:46.732573 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9ff8a4fa-21e5-4df3-b9fd-ece2ddda878d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.246628 May 14 21:12:46.733248 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 184/413] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:46 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:46.743452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b302c2b2-c1c3-4598-876f-03a24ec986f6 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] Calling method '.version_select at 0x7fb1b41599d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:46.940779 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d058748c-7c86-45cd-b99a-86f16b173b5e tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1872856250/action" status: 200 len: 97 microversion: 2.1 time: 0.377477 May 14 21:12:46.941392 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 230/414] 10.222.0.52 () {60 vars in 1199 bytes} [Sat May 14 21:12:46 2022] POST /compute/v2.1/flavors/1872856250/action => generated 97 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:46.950386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:46.950996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:46.958047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.958510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:46.959279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:46.959753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:47.044270 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b302c2b2-c1c3-4598-876f-03a24ec986f6 tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0b209bb8-0c5a-456e-beb5-3e5fd1e0af26" status: 202 len: 0 microversion: 2.1 time: 0.307025 May 14 21:12:47.045321 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 185/415] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:12:46 2022] DELETE /compute/v2.1/os-security-groups/0b209bb8-0c5a-456e-beb5-3e5fd1e0af26 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:47.051371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-51609bc0-f0bd-47b4-bb80-f275bac1b9f7 tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:47.052949 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:47.052949 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:47.056181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-51609bc0-f0bd-47b4-bb80-f275bac1b9f7 tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9539e4b48a0d49959780fae9a39cbce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc82fc4cb79444acbdf29af78e302e6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-51609bc0-f0bd-47b4-bb80-f275bac1b9f7 tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Request method failure captured: May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/flavors/1872856250/action HTTP/1.1 May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 70 May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtEgAZc5Kb091KT_z87_pGDJR9xVHRA58dtHo6iweyp6-H0Rf3CjAVMphU4qqFCJxs1ic3YMhgSeq46wE1oR7n9keW9DVeCVgAvtRi1to-8Z3BDwdxlKYGrfr39oEjegxO2ltR5IbwszA4NJ3s8h0wLKD94SQI4mZav-bZY3nFr1tM May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bc82fc4cb79444acbdf29af78e302e6a May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1568496261 May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:12:47.058259 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc82fc4cb79444acbdf29af78e302e6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bc82fc4cb79444acbdf29af78e302e6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bc82fc4cb79444acbdf29af78e302e6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bc82fc4cb79444acbdf29af78e302e6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1568496261 May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bc82fc4cb79444acbdf29af78e302e6a May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1568496261 May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FlavorsAccessNegativeTestJSON-1568496261-project May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9539e4b48a0d49959780fae9a39cbce7 May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1568496261-project May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: {"removeTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} May 14 21:12:47.059399 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1872856250', 'body': {'removeTenantAccess': {'tenant': 'bc82fc4cb79444acbdf29af78e302e6a'}}} May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can( May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:47.060095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 14 21:12:47.062276 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:47.064005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-51609bc0-f0bd-47b4-bb80-f275bac1b9f7 tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:47.064005 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-51609bc0-f0bd-47b4-bb80-f275bac1b9f7 tempest-FlavorsAccessNegativeTestJSON-1568496261 tempest-FlavorsAccessNegativeTestJSON-1568496261-project] 10.222.0.52 "POST /compute/v2.1/flavors/1872856250/action" status: 403 len: 133 microversion: 2.1 time: 0.012536 May 14 21:12:47.064005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 186/416] 10.222.0.52 () {60 vars in 1199 bytes} [Sat May 14 21:12:47 2022] POST /compute/v2.1/flavors/1872856250/action => generated 133 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:12:47.065169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9ae102b-3364-4cd3-98dd-45b35a87c95c tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] Calling method '.version_select at 0x7fb1b4569670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:47.111584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:47.122249 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e272ed35-6fdd-4eab-8a19-f63fc3bae0ec tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.174842 May 14 21:12:47.122928 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 231/417] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:46 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:47.128860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9477a55f-f2e4-4e9c-9712-bc9a08aea073 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc82fc4cb79444acbdf29af78e302e6a"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:47.141098 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:47.141098 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:47.381418 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9ae102b-3364-4cd3-98dd-45b35a87c95c tempest-SecurityGroupsTestAdminJSON-291057614 tempest-SecurityGroupsTestAdminJSON-291057614-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/57444468-559c-40b7-9288-e2f4910a55e7" status: 202 len: 0 microversion: 2.1 time: 0.319838 May 14 21:12:47.382135 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 187/418] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:12:47 2022] DELETE /compute/v2.1/os-security-groups/57444468-559c-40b7-9288-e2f4910a55e7 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:47.557930 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9477a55f-f2e4-4e9c-9712-bc9a08aea073 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/1872856250/action" status: 200 len: 21 microversion: 2.1 time: 0.433702 May 14 21:12:47.559469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 232/419] 10.222.0.52 () {60 vars in 1199 bytes} [Sat May 14 21:12:47 2022] POST /compute/v2.1/flavors/1872856250/action => generated 21 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:47.569768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6731f1c9-eea9-498d-be7b-2dfa540c6705 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:47.571150 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:47.571150 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:47.589536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:47.590628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:47.599295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:47.599892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:47.600815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:47.601263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:47.667402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:47.672523 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6731f1c9-eea9-498d-be7b-2dfa540c6705 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1872856250" status: 202 len: 0 microversion: 2.1 time: 0.107203 May 14 21:12:47.673437 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 188/420] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:12:47 2022] DELETE /compute/v2.1/flavors/1872856250 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:47.680079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:47.681708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-96683f69-9b16-4cf3-b3cb-a35174d01b0d tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:47.681991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:47.688304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-644686cd-3fca-4350-98f1-9947fb2541da tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.107533 May 14 21:12:47.688879 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 233/421] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:47 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:47.702023 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-96683f69-9b16-4cf3-b3cb-a35174d01b0d tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.024143 May 14 21:12:47.702796 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 189/422] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:47 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:47.720448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3824185-eaee-4f0a-8349-a101affff2aa tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2097956136", "id": 2117025897, "os-flavor-access:is_public": "False"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:47.720448 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:47.720448 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:47.751191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:47.751853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:47.758326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:47.758795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:47.759598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:47.760081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:47.868507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3824185-eaee-4f0a-8349-a101affff2aa tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.153652 May 14 21:12:47.869654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 234/423] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:47 2022] POST /compute/v2.1/flavors => generated 439 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:47.894123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-452513a7-b0e1-4dd8-be95-fb74b34db151 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "40acab3854134d1e85effc683181971e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:47.895590 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:47.895590 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:47.903820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:47.911912 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bcd5a758-18d8-48b0-8645-d194ca75f31a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.165227 May 14 21:12:47.912474 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 190/424] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:47 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:48.139771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:48.140375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:48.146186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:48.146633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:48.147419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:48.147877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:48.306770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:48.314316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8f3e7bb6-c79b-467b-b990-e5ddddd3c8d0 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.178417 May 14 21:12:48.324319 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 191/425] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:48 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:48.370420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-452513a7-b0e1-4dd8-be95-fb74b34db151 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] HTTP exception thrown: Flavor access not found for 36 / 40acab3854134d1e85effc683181971e combination. May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-452513a7-b0e1-4dd8-be95-fb74b34db151 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Request method failure captured: May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/flavors/2117025897/action HTTP/1.1 May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 70 May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtGI7soQaqjo8pBN7J1_bpCz_vMsnaZAe-q5UERz0LnqIyvsHM9yhkexdyphM2j41b46ruzRi9xjwby7la9veBu_8QeIvXZw15SZAzYTUTPvIsx4f8oJ1MxXXAIvaKW4WNGFvTpiKdxXIXw6htonlWiYdRLLOPIqWnSQyfzd5qDtQM May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 782f075c7cc0430f85d614dc49b230c6 May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:48.377178 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/782f075c7cc0430f85d614dc49b230c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_782f075c7cc0430f85d614dc49b230c6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 782f075c7cc0430f85d614dc49b230c6 May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498 May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 09800a8572864b748da9fc581ea97e44 May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: {"removeTenantAccess": {"tenant": "40acab3854134d1e85effc683181971e"}} May 14 21:12:48.378407 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor access not found for 36 / 40acab3854134d1e85effc683181971e combination. May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '2117025897', 'body': {'removeTenantAccess': {'tenant': '40acab3854134d1e85effc683181971e'}}} May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 14 21:12:48.379071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 36 / 40acab3854134d1e85effc683181971e combination. May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 36 / 40acab3854134d1e85effc683181971e combination. May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:48.380115 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 36 / 40acab3854134d1e85effc683181971e combination. May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-452513a7-b0e1-4dd8-be95-fb74b34db151 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Returning 404 to user: Flavor access not found for 36 / 40acab3854134d1e85effc683181971e combination. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:48.381754 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-452513a7-b0e1-4dd8-be95-fb74b34db151 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/2117025897/action" status: 404 len: 124 microversion: 2.1 time: 0.499433 May 14 21:12:48.382218 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 235/426] 10.222.0.52 () {60 vars in 1199 bytes} [Sat May 14 21:12:47 2022] POST /compute/v2.1/flavors/2117025897/action => generated 124 bytes in 505 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:12:48.394247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-05bf6812-c271-4061-bc74-3347ebb3e6f0 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:48.394247 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:48.394247 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:48.505443 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-05bf6812-c271-4061-bc74-3347ebb3e6f0 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/2117025897" status: 202 len: 0 microversion: 2.1 time: 0.118346 May 14 21:12:48.506574 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 192/427] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:12:48 2022] DELETE /compute/v2.1/flavors/2117025897 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:48.516226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f907ecf8-a188-48a8-ac95-acd3cc93b220 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:48.543565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f907ecf8-a188-48a8-ac95-acd3cc93b220 tempest-FlavorsAccessNegativeTestJSON-1564445498 tempest-FlavorsAccessNegativeTestJSON-1564445498-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.031890 May 14 21:12:48.555294 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 236/428] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:48 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:48.707940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:48.708543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:48.714541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:48.714993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:48.715822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:48.716261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:48.781125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:48.789359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:48.790840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:48.795889 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-12c3a19b-c59d-4c48-af51-49aeaf69a361 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.091798 May 14 21:12:48.796476 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 193/429] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:48 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:48.930240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:48.931653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:48.938599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:48.939060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:48.939878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:48.940480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:49.080944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:49.088483 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fef55dc4-9766-4077-a07e-60d0017324d9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.162291 May 14 21:12:49.089060 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 237/430] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:48 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:49.330827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:49.332044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:49.338082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:49.338537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:49.339309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:49.339776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:49.469845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:49.477522 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8239cae2-7038-418e-80ce-fe64a61e975d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.150685 May 14 21:12:49.478190 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 194/431] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:49 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:49.816052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:49.816788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:49.822912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:49.823467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:49.824279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:49.824726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:49.903191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:49.921501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:49.924497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:49.934654 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-765758e4-9b84-44ce-9e12-b74b0627feb6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.121197 May 14 21:12:49.934654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 238/432] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:49 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:50.106145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:50.106773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:50.112838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.113294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.115264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.115264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.269287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:50.278154 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b3ef996-e054-4ed6-9d8f-bdebec17f5fe tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.175848 May 14 21:12:50.280967 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 195/433] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:50 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:50.362210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-05b92eed-63eb-48d9-acbe-f1e869fed5e0 req-b4cedb11-9e4e-40c2-8316-1bffdaa18bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a955384b-6dbf-444d-bd67-2a1b9a33531b", "name": "network-vif-plugged", "status": "completed", "tag": "16d9a058-b772-4ae7-b4f3-0818f1b9074b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:50.372151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-05b92eed-63eb-48d9-acbe-f1e869fed5e0 req-b4cedb11-9e4e-40c2-8316-1bffdaa18bf8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.372605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-05b92eed-63eb-48d9-acbe-f1e869fed5e0 req-b4cedb11-9e4e-40c2-8316-1bffdaa18bf8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.387510 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-05b92eed-63eb-48d9-acbe-f1e869fed5e0 req-b4cedb11-9e4e-40c2-8316-1bffdaa18bf8 service nova] Creating event network-vif-plugged:16d9a058-b772-4ae7-b4f3-0818f1b9074b for instance a955384b-6dbf-444d-bd67-2a1b9a33531b on nch2-master-1 May 14 21:12:50.392660 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-05b92eed-63eb-48d9-acbe-f1e869fed5e0 req-b4cedb11-9e4e-40c2-8316-1bffdaa18bf8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038922 May 14 21:12:50.393798 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 239/434] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:50.496029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:50.496689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:50.503626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.504295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.505532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.506384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.650027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:50.658111 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-886ad2fb-8753-49e7-a323-a0bb242d0c52 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.166559 May 14 21:12:50.658688 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 196/435] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:50 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:50.941385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b439eb80>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:50.942337 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:50.942337 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:50.943662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.944334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.958979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.959433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.973092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.973541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.981076 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4b123376-747a-44fa-bcfc-612b2a84c0a8 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.383523 May 14 21:12:50.981656 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 240/436] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:50.986297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:50.987021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:50.993632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.994086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:50.994850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:50.995284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.021971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b45004c0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:51.023339 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.023339 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:51.024617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.025108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.034067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.034576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.043284 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] HTTP exception thrown: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Request method failure captured: May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7 HTTP/1.1 May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 56 May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtSZlI6iAoPvAgfgCSjHwBOUcYczVFcC4Bqh41nWnlv696AJHl-CnNJKEiHXtyP4XDK6BG_58I-3FCorLIsYHdftchKzcRv_yPRRwDv9u_RT_ZEaoomO_iWWzhG-05dCDVCjRsmBPPoJa6_1_XMmE2nZHW-TJjoE1yhoNlH7A2TjxU May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.53 May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7dbaf999504b4a958cd359678792edee May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:51.045492 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7dbaf999504b4a958cd359678792edee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7dbaf999504b4a958cd359678792edee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7dbaf999504b4a958cd359678792edee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7dbaf999504b4a958cd359678792edee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7dbaf999504b4a958cd359678792edee May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 7a109d9e95f74e48bc49e6ec51dfd754 May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: {"status": "disabled", "disabled_reason": "maintenance"} May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:12:51.047534 ncdv-master-1 devstack@n-api.service[130638]: exception: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'db9d7d74-4495-404f-8dd3-50440b3f1ea7', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.048389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.049885 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:51.051130 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:51.051130 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.051130 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.051130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Returning 404 to user: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:51.051130 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6fffc96-1f93-49c8-a4f1-c299b1371217 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7" status: 404 len: 110 microversion: 2.53 time: 0.186085 May 14 21:12:51.052690 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 197/437] 10.222.0.52 () {62 vars in 1308 bytes} [Sat May 14 21:12:50 2022] PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7 => generated 110 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:51.057367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b455f0d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.058165 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.058165 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:51.060954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.060954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.074707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.075165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.078176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:51.085794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.086249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.087573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:51.089915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:51.092384 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-852af9dc-5e8f-4075-91b2-b38ff0850cf6 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.038649 May 14 21:12:51.093668 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 198/438] 10.222.0.52 () {58 vars in 1166 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:51.098402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b4132700>, body: {"status": "disabled"} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:51.099851 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.099851 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:51.101971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.102590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.107546 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f5474743-b233-4a69-82e9-f44335cf1d45 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.121658 May 14 21:12:51.107546 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 241/439] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:50 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:51.112786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b4218ca0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.112939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.112939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.113471 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.113471 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.113471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.113786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.127669 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] HTTP exception thrown: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.129750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Request method failure captured: May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7 HTTP/1.1 May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 22 May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtSZlI6iAoPvAgfgCSjHwBOUcYczVFcC4Bqh41nWnlv696AJHl-CnNJKEiHXtyP4XDK6BG_58I-3FCorLIsYHdftchKzcRv_yPRRwDv9u_RT_ZEaoomO_iWWzhG-05dCDVCjRsmBPPoJa6_1_XMmE2nZHW-TJjoE1yhoNlH7A2TjxU May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.53 May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7dbaf999504b4a958cd359678792edee May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:51.129904 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7dbaf999504b4a958cd359678792edee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7dbaf999504b4a958cd359678792edee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7dbaf999504b4a958cd359678792edee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7dbaf999504b4a958cd359678792edee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7dbaf999504b4a958cd359678792edee May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 7a109d9e95f74e48bc49e6ec51dfd754 May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: {"status": "disabled"} May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: exception: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.132138 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'db9d7d74-4495-404f-8dd3-50440b3f1ea7', 'body': {'status': 'disabled'}} May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.133065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:51.134301 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:51.137367 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.137367 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.137502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.137592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Returning 404 to user: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:51.137592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37518fb2-21ad-4d04-bc52-01c74eb1b4b9 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7" status: 404 len: 110 microversion: 2.53 time: 0.037413 May 14 21:12:51.137592 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 199/440] 10.222.0.52 () {62 vars in 1308 bytes} [Sat May 14 21:12:51 2022] PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7 => generated 110 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:51.141856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.142268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b43c2670>, body: {"status": "enabled"} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:51.142364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.144737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.145172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.148505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cddc02c5-7309-47ac-82dd-6f5c8bf03d3d tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041888 May 14 21:12:51.149147 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 242/441] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:51.152081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.152531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.158390 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] HTTP exception thrown: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.159442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-094c697b-0abe-48db-a1aa-033b2a312bd4 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b4218790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Request method failure captured: May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7 HTTP/1.1 May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 21 May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtSZlI6iAoPvAgfgCSjHwBOUcYczVFcC4Bqh41nWnlv696AJHl-CnNJKEiHXtyP4XDK6BG_58I-3FCorLIsYHdftchKzcRv_yPRRwDv9u_RT_ZEaoomO_iWWzhG-05dCDVCjRsmBPPoJa6_1_XMmE2nZHW-TJjoE1yhoNlH7A2TjxU May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.53 May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7dbaf999504b4a958cd359678792edee May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:12:51.160226 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7dbaf999504b4a958cd359678792edee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7dbaf999504b4a958cd359678792edee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7dbaf999504b4a958cd359678792edee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7dbaf999504b4a958cd359678792edee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7dbaf999504b4a958cd359678792edee May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714 May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 7a109d9e95f74e48bc49e6ec51dfd754 May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: {"status": "enabled"} May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: exception: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.161720 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'db9d7d74-4495-404f-8dd3-50440b3f1ea7', 'body': {'status': 'enabled'}} May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.162656 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:51.164051 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:51.165830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. May 14 21:12:51.165830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:12:51.166039 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.166039 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.166206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Returning 404 to user: Service db9d7d74-4495-404f-8dd3-50440b3f1ea7 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:51.166291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094c697b-0abe-48db-a1aa-033b2a312bd4 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.166375 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c81b1c9-e80a-4082-b4ba-ef515b4b881c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7" status: 404 len: 110 microversion: 2.53 time: 0.023613 May 14 21:12:51.166467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094c697b-0abe-48db-a1aa-033b2a312bd4 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.166552 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 200/442] 10.222.0.52 () {62 vars in 1308 bytes} [Sat May 14 21:12:51 2022] PUT /compute/v2.1/os-services/db9d7d74-4495-404f-8dd3-50440b3f1ea7 => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:51.171257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4837cc7-5c06-44f4-bb46-a6d5e48b740c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.172569 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.172569 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:51.173835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4837cc7-5c06-44f4-bb46-a6d5e48b740c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.174312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4837cc7-5c06-44f4-bb46-a6d5e48b740c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.175135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4837cc7-5c06-44f4-bb46-a6d5e48b740c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.175598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4837cc7-5c06-44f4-bb46-a6d5e48b740c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.178964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094c697b-0abe-48db-a1aa-033b2a312bd4 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.179734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094c697b-0abe-48db-a1aa-033b2a312bd4 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.188619 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-094c697b-0abe-48db-a1aa-033b2a312bd4 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.030462 May 14 21:12:51.195623 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 243/443] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:51.202801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5474c7e1-1e53-4853-b2d8-212776419dd7 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b42185e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.203639 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.203639 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.204781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5474c7e1-1e53-4853-b2d8-212776419dd7 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.205265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5474c7e1-1e53-4853-b2d8-212776419dd7 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.207814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b4837cc7-5c06-44f4-bb46-a6d5e48b740c tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.040167 May 14 21:12:51.214832 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 201/444] 10.222.0.52 () {60 vars in 1177 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:51.220057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1da9278e-f925-4490-877d-bd968c97fccd tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.221812 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.221812 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:51.223112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1da9278e-f925-4490-877d-bd968c97fccd tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.223589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1da9278e-f925-4490-877d-bd968c97fccd tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.224176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5474c7e1-1e53-4853-b2d8-212776419dd7 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.025007 May 14 21:12:51.224516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1da9278e-f925-4490-877d-bd968c97fccd tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.224960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1da9278e-f925-4490-877d-bd968c97fccd tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.225352 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 244/445] 10.222.0.52 () {58 vars in 1178 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:51.236690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b42183a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.237746 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.237746 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.239170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.239870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.251264 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1da9278e-f925-4490-877d-bd968c97fccd tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.035175 May 14 21:12:51.256696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.257161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.258744 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 202/446] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:51.263883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d17a5677-fe5c-44dd-b7eb-c02e398dfb58 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.265745 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.265745 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:51.267113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17a5677-fe5c-44dd-b7eb-c02e398dfb58 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.267594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17a5677-fe5c-44dd-b7eb-c02e398dfb58 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.268580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17a5677-fe5c-44dd-b7eb-c02e398dfb58 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.269243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17a5677-fe5c-44dd-b7eb-c02e398dfb58 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.269541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.270025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.277770 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ddec669-3b2b-4c40-8d9f-69d2f0e1957f tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044908 May 14 21:12:51.278520 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 245/447] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:51.288693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f0c04a7-1513-4950-ad3c-8b22dc8aa412 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b4218160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.289530 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.289530 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.290720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f0c04a7-1513-4950-ad3c-8b22dc8aa412 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.291181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f0c04a7-1513-4950-ad3c-8b22dc8aa412 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.295420 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d17a5677-fe5c-44dd-b7eb-c02e398dfb58 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.035127 May 14 21:12:51.301737 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 203/448] 10.222.0.52 () {60 vars in 1177 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:51.306430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f0c04a7-1513-4950-ad3c-8b22dc8aa412 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.306669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.306942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f0c04a7-1513-4950-ad3c-8b22dc8aa412 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.307296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:51.313335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.318670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.318785 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f0c04a7-1513-4950-ad3c-8b22dc8aa412 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.029584 May 14 21:12:51.318866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.318866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.318995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 246/449] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:51.321886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c18cd6f-3931-42df-8426-bdd1bde63f36 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.323297 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.323297 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.325202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c18cd6f-3931-42df-8426-bdd1bde63f36 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.325717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c18cd6f-3931-42df-8426-bdd1bde63f36 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.326530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c18cd6f-3931-42df-8426-bdd1bde63f36 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.326979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c18cd6f-3931-42df-8426-bdd1bde63f36 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.355976 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c18cd6f-3931-42df-8426-bdd1bde63f36 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.039547 May 14 21:12:51.356747 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 247/450] 10.222.0.52 () {60 vars in 1236 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:51.361094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d2f2e28-22e9-4f41-8fc1-f1a4502f3433 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b41dd790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.361965 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.361965 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.363450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2f2e28-22e9-4f41-8fc1-f1a4502f3433 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.363657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2f2e28-22e9-4f41-8fc1-f1a4502f3433 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.376312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2f2e28-22e9-4f41-8fc1-f1a4502f3433 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.376765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2f2e28-22e9-4f41-8fc1-f1a4502f3433 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.383015 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d2f2e28-22e9-4f41-8fc1-f1a4502f3433 tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.025421 May 14 21:12:51.383642 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 248/451] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:51.391940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-90ca6db3-1e79-4e0a-a512-10c9e8d2a020 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.393130 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.393130 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.394365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90ca6db3-1e79-4e0a-a512-10c9e8d2a020 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.395097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90ca6db3-1e79-4e0a-a512-10c9e8d2a020 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.395932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90ca6db3-1e79-4e0a-a512-10c9e8d2a020 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.396375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90ca6db3-1e79-4e0a-a512-10c9e8d2a020 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.420432 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-90ca6db3-1e79-4e0a-a512-10c9e8d2a020 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.035770 May 14 21:12:51.421054 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 249/452] 10.222.0.52 () {60 vars in 1177 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:51.425791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Calling method '.version_select at 0x7fb1b41dd670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.426679 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.426679 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.427954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.428481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.441247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.441706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.452164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.453158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.467270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:51.476932 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-00ec0d4f-f515-4809-b491-87b4dbf86a4b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.173805 May 14 21:12:51.488066 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 204/453] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:51.493505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-05d64f9e-80b8-4606-847f-33b2e928f185 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.494308 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.494308 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:51.495528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05d64f9e-80b8-4606-847f-33b2e928f185 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.495983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05d64f9e-80b8-4606-847f-33b2e928f185 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.496788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05d64f9e-80b8-4606-847f-33b2e928f185 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.497226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05d64f9e-80b8-4606-847f-33b2e928f185 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.518883 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f0574f5-dbfb-495c-932b-a3f0d29fe1cb tempest-HypervisorAdminTestJSON-160072368 tempest-HypervisorAdminTestJSON-160072368-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.095939 May 14 21:12:51.519690 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 250/454] 10.222.0.52 () {58 vars in 1172 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:51.537879 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-05d64f9e-80b8-4606-847f-33b2e928f185 tempest-ServicesAdminNegativeV253TestJSON-1891590714 tempest-ServicesAdminNegativeV253TestJSON-1891590714-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.048731 May 14 21:12:51.539011 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 205/455] 10.222.0.52 () {60 vars in 1238 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:51.676870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.677479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:51.683443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.683914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.684693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:51.685131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:51.762159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61fe8686-dee2-486c-bd1d-cc9650fd90a3 tempest-ServicesAdminNegativeV253TestJSON-583816527 tempest-ServicesAdminNegativeV253TestJSON-583816527-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:51.764883 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:51.764883 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:51.766808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-61fe8686-dee2-486c-bd1d-cc9650fd90a3 tempest-ServicesAdminNegativeV253TestJSON-583816527 tempest-ServicesAdminNegativeV253TestJSON-583816527-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'c1bc27ae236b45ba959680d396ce104d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4164536b7ed841c2b88d28b51543a9a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61fe8686-dee2-486c-bd1d-cc9650fd90a3 tempest-ServicesAdminNegativeV253TestJSON-583816527 tempest-ServicesAdminNegativeV253TestJSON-583816527-project] Request method failure captured: May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-services HTTP/1.1 May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtRfijHy5WtGPQwmwFfMfLRhKzZJs3IORrHvP0BPbGGXs5QPy6BI-Ngj9yIdsLL2eA_IYkfuk_wZ4BwZAwv36AWoGWFRW8lNHx89QcTWUoc7cC1CFtnTFA0Jyf3lOXpTxjRYpMb8gm8opZF8fNdf4i3Qpv6BcOnh8YavyDpicHs_2Q May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.53 May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 4164536b7ed841c2b88d28b51543a9a2 May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-583816527 May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:51.769851 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4164536b7ed841c2b88d28b51543a9a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4164536b7ed841c2b88d28b51543a9a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4164536b7ed841c2b88d28b51543a9a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4164536b7ed841c2b88d28b51543a9a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-583816527 May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 4164536b7ed841c2b88d28b51543a9a2 May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-583816527 May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServicesAdminNegativeV253TestJSON-583816527-project May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c1bc27ae236b45ba959680d396ce104d May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-583816527-project May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 14 21:12:51.771276 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:51.771987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 14 21:12:51.773014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:51.775707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61fe8686-dee2-486c-bd1d-cc9650fd90a3 tempest-ServicesAdminNegativeV253TestJSON-583816527 tempest-ServicesAdminNegativeV253TestJSON-583816527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:51.776823 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-61fe8686-dee2-486c-bd1d-cc9650fd90a3 tempest-ServicesAdminNegativeV253TestJSON-583816527 tempest-ServicesAdminNegativeV253TestJSON-583816527-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.229097 May 14 21:12:51.778438 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 251/456] 10.222.0.52 () {60 vars in 1177 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/os-services => generated 112 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:51.850198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:51.857857 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b351d80-2f94-489e-8534-767313ab39f7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1319 microversion: 2.1 time: 0.187088 May 14 21:12:51.858428 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 206/457] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:51 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:52.132782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:52.133674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:52.146391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:52.146845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:52.147683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:52.148128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:52.213641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:52.221647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:52.223175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:52.227980 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-55f915c1-6ed4-454d-a6eb-9400e368e984 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.102316 May 14 21:12:52.228547 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 252/458] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:52 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:52.494330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:52.494872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:52.501357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:52.501799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:52.502751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:52.503197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:52.677793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:52.688537 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f74da047-3af6-4e04-8faa-32b9ec244577 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.198087 May 14 21:12:52.691600 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 207/459] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:52 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:52.878496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:52.879328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:52.887389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:52.888468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:52.890503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:52.891455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.079882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:53.087821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cee70d6-61e2-46d0-ba15-f1f986890531 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1468 microversion: 2.1 time: 0.214809 May 14 21:12:53.088448 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 253/460] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:52 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1468 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:53.104501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:53.105116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:53.111503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.111973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.112759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.113209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.149993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lazy-loading 'flavor' on Instance uuid a955384b-6dbf-444d-bd67-2a1b9a33531b {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:53.250328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:53.250958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:53.260328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.261888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.262622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.263320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.353100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:53.364016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:53.366130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:53.372802 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1280c15b-c72e-416c-b6ba-6dd49c08f086 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.127737 May 14 21:12:53.374030 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 254/461] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:53 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:53.494038 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cedabf6d-ee14-4e70-a5a1-632aa2f13517 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b/action" status: 202 len: 0 microversion: 2.1 time: 0.393071 May 14 21:12:53.495375 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 208/462] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:12:53 2022] POST /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:53.502975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:53.503640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:53.510234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.510694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.511461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.512021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.695554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:53.708645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:53.709593 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53fa5424-b4f4-4dad-87cf-225f997dd6aa tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1476 microversion: 2.1 time: 0.210670 May 14 21:12:53.720736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:53.720736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.720736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:53.721673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:53.722288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 255/463] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:53 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1476 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:53.722418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:54.022581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:54.030038 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a8cf1928-7b47-46a1-9465-cf61bb4b1dd8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.327528 May 14 21:12:54.031209 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 209/464] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:53 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:54.393202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:54.394404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:54.400642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:54.400986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:54.402066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:54.402658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:54.489388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:54.500019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:54.501312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:54.512783 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a75eea47-c485-416e-b0bc-5a58f12be311 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.124102 May 14 21:12:54.514092 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 256/465] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:54 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:54.728589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:54.728589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:54.734864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:54.735321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:54.736335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:54.737280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:54.970708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:54.985550 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-059e2846-a1ab-49d0-9338-c2fa45219205 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1459 microversion: 2.1 time: 0.261494 May 14 21:12:54.986186 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 210/466] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:54 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1459 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:55.015835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a7a1593-3b10-420b-8c5c-a77252c0f52e tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:55.016876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a7a1593-3b10-420b-8c5c-a77252c0f52e tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:55.025315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7a1593-3b10-420b-8c5c-a77252c0f52e tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.025883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7a1593-3b10-420b-8c5c-a77252c0f52e tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.027112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7a1593-3b10-420b-8c5c-a77252c0f52e tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.027660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7a1593-3b10-420b-8c5c-a77252c0f52e tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.049371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:55.050034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:55.060810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.064240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.065242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.065801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.269932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:55.291471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-30b1f3bf-962a-4319-bc44-3cea77fa9ef2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.247186 May 14 21:12:55.295887 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 211/467] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:55 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:55.541538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:55.542160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:55.548525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.549427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.550443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.551183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.622207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:55.631948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:55.633555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:55.638749 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-be52f63c-49be-42d9-94e3-01aaf1e8f36d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.109140 May 14 21:12:55.639334 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 212/468] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:55 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:55.839186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a7a1593-3b10-420b-8c5c-a77252c0f52e tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1610 microversion: 2.1 time: 0.828347 May 14 21:12:55.843362 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 257/469] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:55 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1610 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:55.857682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d258ac8-253f-4ebc-a40f-42bbdaf098e3 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:55.860425 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:55.860425 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:55.862526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d258ac8-253f-4ebc-a40f-42bbdaf098e3 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.862986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d258ac8-253f-4ebc-a40f-42bbdaf098e3 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.864081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d258ac8-253f-4ebc-a40f-42bbdaf098e3 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.864520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d258ac8-253f-4ebc-a40f-42bbdaf098e3 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.897943 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d258ac8-253f-4ebc-a40f-42bbdaf098e3 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043616 May 14 21:12:55.898602 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 213/470] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:12:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:55.910600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:55.911851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:55.918536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.919092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.920012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:55.920531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:55.965175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Lazy-loading 'flavor' on Instance uuid a955384b-6dbf-444d-bd67-2a1b9a33531b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:55.981738 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance a955384b-6dbf-444d-bd67-2a1b9a33531b while it is in vm_state suspended May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Request method failure captured: May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b/action HTTP/1.1 May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 97 May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsnCowrv4jd1UJAPXpvNQ49PT0HJvEH1GOKuz1Ptb4647FeJlSPNAZuefiuMqw7uDTlqP5tdpdrJdknprNTfK1VgszHrNVzVKINn_QKaAboraCwKdzijWuwJRAXU36G2118qXUttIABlL9UuQByIe1zaBNcCLQfPX5L2yNiIjkOipI May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b66b447c40c04f70b7375b342f88bec8 May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-LiveMigrationNegativeTest-1227557669 May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:55.984620 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b66b447c40c04f70b7375b342f88bec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b66b447c40c04f70b7375b342f88bec8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b66b447c40c04f70b7375b342f88bec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b66b447c40c04f70b7375b342f88bec8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-LiveMigrationNegativeTest-1227557669 May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b66b447c40c04f70b7375b342f88bec8 May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1227557669 May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-LiveMigrationNegativeTest-1227557669-project-admin May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 94856972be884cd7a06b4673411ffea8 May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-LiveMigrationNegativeTest-1227557669-project-admin May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} May 14 21:12:55.985928 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'os-migrateLive' instance a955384b-6dbf-444d-bd67-2a1b9a33531b while it is in vm_state suspended May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'a955384b-6dbf-444d-bd67-2a1b9a33531b', 'body': {'os-migrateLive': {'host': 'nch1-master-1', 'block_migration': True, 'disk_over_commit': False}}} May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 14 21:12:55.986612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a955384b-6dbf-444d-bd67-2a1b9a33531b in vm_state suspended. Cannot live_migrate while the instance is in this state. May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:55.987591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance a955384b-6dbf-444d-bd67-2a1b9a33531b while it is in vm_state suspended May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance a955384b-6dbf-444d-bd67-2a1b9a33531b while it is in vm_state suspended May 14 21:12:55.988623 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:55.992906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance a955384b-6dbf-444d-bd67-2a1b9a33531b while it is in vm_state suspended {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:55.994160 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-61e9e0c5-f3c3-4101-9085-dbeb985f7249 tempest-LiveMigrationNegativeTest-1227557669 tempest-LiveMigrationNegativeTest-1227557669-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b/action" status: 409 len: 155 microversion: 2.1 time: 0.088687 May 14 21:12:55.999735 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 258/471] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:12:55 2022] POST /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b/action => generated 155 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:12:56.011427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:56.011961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:56.027759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.028219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.029004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.029661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.068434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:12:56.312593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:56.313372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:56.320354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.321291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.322095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.322537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.516971 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e777864f-88d3-4510-aef9-ee9d3d9ac148 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 204 len: 0 microversion: 2.1 time: 0.509668 May 14 21:12:56.521179 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 214/472] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:12:56 2022] DELETE /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:12:56.528853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:56.529616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:56.538324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:56.552521 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88ca080c-01db-415f-9093-cb44335d62a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.244632 May 14 21:12:56.553484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 259/473] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:56 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:56.555058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.555471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.556457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.557031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.659828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:56.660832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:56.680455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.682141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.692349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:56.693064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:56.783108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:56.791519 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1fc1db95-143c-48de-8c9c-9e0f29ff3415 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1465 microversion: 2.1 time: 0.268638 May 14 21:12:56.792872 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 215/474] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:56 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1465 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:56.807407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:56.823801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:56.826838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:56.834335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbf2d700-319b-4665-80e6-ccdd8d67969c tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.180059 May 14 21:12:56.835068 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 260/475] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:56 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:57.325387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-995ba2c5-3639-4223-b631-f3c1498c156d tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1558597959", "ram": 512, "vcpus": 1, "disk": 10, "id": 640354139, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:57.327352 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:57.327352 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:57.570229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:57.570979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:57.578042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:57.578416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:57.579181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:57.579651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:57.672288 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-995ba2c5-3639-4223-b631-f3c1498c156d tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.838170 May 14 21:12:57.686157 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 216/476] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:12:56 2022] POST /compute/v2.1/flavors => generated 413 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:12:57.697968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aab2b80b-4bf2-466e-a03e-80a8981f93fb tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:57.701227 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:57.701227 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:57.786044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:57.794237 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e37c391f-44e7-4912-9b0e-b4e6216c1ec6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.227838 May 14 21:12:57.794824 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 261/477] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:57 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:12:57.810779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:57.814011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:57.828014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:57.828014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:57.828014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:57.828014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:57.854648 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aab2b80b-4bf2-466e-a03e-80a8981f93fb tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/640354139/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.166050 May 14 21:12:57.864577 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 217/478] 10.222.0.52 () {60 vars in 1220 bytes} [Sat May 14 21:12:57 2022] POST /compute/v2.1/flavors/640354139/os-extra_specs => generated 66 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:57.870149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:57.871116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:57.880621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:57.897538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:57.898642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:57.900298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:58.136437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:58.151432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:58.156527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:58.169611 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0520c61-41c1-453b-bc9e-560ff4d1fdda tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.311962 May 14 21:12:58.178969 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 218/479] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:57 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:58.385831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:58.402062 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe7ca952-06b9-4a82-ba4b-a746326ccc91 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1465 microversion: 2.1 time: 0.594393 May 14 21:12:58.404139 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 262/480] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:57 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1465 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:58.562345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0057d6fb-49bc-4fc0-99b6-f0c57d4f12ea tempest-FlavorsExtraSpecsTestJSON-1795566948 tempest-FlavorsExtraSpecsTestJSON-1795566948-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:58.580763 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0057d6fb-49bc-4fc0-99b6-f0c57d4f12ea tempest-FlavorsExtraSpecsTestJSON-1795566948 tempest-FlavorsExtraSpecsTestJSON-1795566948-project] 10.222.0.52 "GET /compute/v2.1/flavors/640354139/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.386191 May 14 21:12:58.582965 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 219/481] 10.222.0.52 () {58 vars in 1199 bytes} [Sat May 14 21:12:58 2022] GET /compute/v2.1/flavors/640354139/os-extra_specs => generated 66 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:58.596668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7de6d9dd-b3ab-4fdc-bc3d-902ae0c495c0 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:58.600761 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:58.600761 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:58.656504 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7de6d9dd-b3ab-4fdc-bc3d-902ae0c495c0 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/640354139/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067048 May 14 21:12:58.657173 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 220/482] 10.222.0.52 () {60 vars in 1220 bytes} [Sat May 14 21:12:58 2022] POST /compute/v2.1/flavors/640354139/os-extra_specs => generated 66 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:58.667450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddc51db7-2198-4980-84a6-391d50e47ec3 tempest-FlavorsExtraSpecsTestJSON-1795566948 tempest-FlavorsExtraSpecsTestJSON-1795566948-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:58.681365 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ddc51db7-2198-4980-84a6-391d50e47ec3 tempest-FlavorsExtraSpecsTestJSON-1795566948 tempest-FlavorsExtraSpecsTestJSON-1795566948-project] 10.222.0.52 "GET /compute/v2.1/flavors/640354139/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018720 May 14 21:12:58.682451 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 221/483] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:12:58 2022] GET /compute/v2.1/flavors/640354139/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:12:58.693355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8a21b0d4-ae5e-4027-a0cf-4ff17b70a78a tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:58.724692 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8a21b0d4-ae5e-4027-a0cf-4ff17b70a78a tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/640354139/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035833 May 14 21:12:58.726007 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 222/484] 10.222.0.52 () {60 vars in 1220 bytes} [Sat May 14 21:12:58 2022] POST /compute/v2.1/flavors/640354139/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:58.738400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-62b62ff8-e970-488f-b170-d10d13eb08fe tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:58.748648 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-62b62ff8-e970-488f-b170-d10d13eb08fe tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/640354139/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016970 May 14 21:12:58.749809 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 223/485] 10.222.0.52 () {58 vars in 1199 bytes} [Sat May 14 21:12:58 2022] GET /compute/v2.1/flavors/640354139/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:58.760704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c3232a2d-de7a-4dda-a01e-32508e85fbe9 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:58.788315 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:58.788315 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:58.849430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Calling method '.version_select at 0x7fb1b41a5c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:58.850240 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:58.850240 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:58.851400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:58.851898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:58.918808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:58.930887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:58.946700 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c3232a2d-de7a-4dda-a01e-32508e85fbe9 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/640354139/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.191245 May 14 21:12:58.954073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 224/486] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:12:58 2022] PUT /compute/v2.1/flavors/640354139/os-extra_specs/hw:numa_nodes => generated 22 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:12:58.958677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:58.959524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:58.964051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:58.964694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:58.967123 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d4d46cd-7e05-42c7-a55e-4d791771d564 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.561514 May 14 21:12:58.969743 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 263/487] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:58 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:58.974134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:58.974598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:58.976926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7c629d2-cd82-49ba-808e-7961561d1ac4 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:58.981432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:58.982347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:58.990968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7c629d2-cd82-49ba-808e-7961561d1ac4 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/640354139/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.019964 May 14 21:12:58.993402 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 264/488] 10.222.0.52 () {58 vars in 1199 bytes} [Sat May 14 21:12:58 2022] GET /compute/v2.1/flavors/640354139/os-extra_specs => generated 66 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:59.020127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Calling method '.version_select at 0x7fb1b41e6af0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.023682 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:59.023682 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:59.026629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.034445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.070735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.071249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.100217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.101276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.113998 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-15fd896d-c2fe-4535-b7e4-adddd3867cba tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 275 microversion: 2.1 time: 0.118936 May 14 21:12:59.132956 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 265/489] 10.222.0.52 () {58 vars in 1211 bytes} [Sat May 14 21:12:58 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:59.136626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0299439a-6520-4e30-a84a-9ef826091060 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.137625 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:59.137625 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:59.291612 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0299439a-6520-4e30-a84a-9ef826091060 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/640354139/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.160127 May 14 21:12:59.295440 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 266/490] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:12:59 2022] DELETE /compute/v2.1/flavors/640354139/os-extra_specs/hw:numa_nodes => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:59.302131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f6b72897-217e-412b-9911-abe5b9ab0ef2 req-deeab765-0437-4964-8c08-3093a1295702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a955384b-6dbf-444d-bd67-2a1b9a33531b", "name": "network-vif-deleted", "tag": "16d9a058-b772-4ae7-b4f3-0818f1b9074b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:12:59.314059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f6b72897-217e-412b-9911-abe5b9ab0ef2 req-deeab765-0437-4964-8c08-3093a1295702 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.314518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f6b72897-217e-412b-9911-abe5b9ab0ef2 req-deeab765-0437-4964-8c08-3093a1295702 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.341882 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f6b72897-217e-412b-9911-abe5b9ab0ef2 req-deeab765-0437-4964-8c08-3093a1295702 service nova] Creating event network-vif-deleted:16d9a058-b772-4ae7-b4f3-0818f1b9074b for instance a955384b-6dbf-444d-bd67-2a1b9a33531b on nch2-master-1 May 14 21:12:59.345914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:59.353509 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2efeabbd-8231-434e-8546-a2e2e933ee33 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.404543 May 14 21:12:59.354093 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 225/491] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:58 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:59.369748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Calling method '.version_select at 0x7fb1b4159670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.370599 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:59.370599 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:59.371899 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f6b72897-217e-412b-9911-abe5b9ab0ef2 req-deeab765-0437-4964-8c08-3093a1295702 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074917 May 14 21:12:59.372292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.372822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.376516 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 267/492] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:59.394358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.398951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:59.404909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.405829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.422245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.422937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.431240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.434299 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e5c9d2e2-df59-46e1-9977-e1161806eee2 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.069146 May 14 21:12:59.439819 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 226/493] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:59.440404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.441497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.442359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.448250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6fa51142-ada6-44b4-acb6-2e616eba31a5 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.450053 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:59.450053 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:59.541221 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6fa51142-ada6-44b4-acb6-2e616eba31a5 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/640354139/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.104568 May 14 21:12:59.542794 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 227/494] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:12:59 2022] DELETE /compute/v2.1/flavors/640354139/os-extra_specs/hw:cpu_policy => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:12:59.548925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.549871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:12:59.550574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:59.558046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.558811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.559697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:59.560168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.560823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.561217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:59.571166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-824acd68-f56e-4665-afdf-6f249ab44ee6 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.190358 May 14 21:12:59.581996 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 268/495] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:12:59.586828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2ebcac00-de3b-44aa-9985-ca88170900d1 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Calling method '.version_select at 0x7fb1b4218dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.587748 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:59.587748 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:12:59.588952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ebcac00-de3b-44aa-9985-ca88170900d1 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.589557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ebcac00-de3b-44aa-9985-ca88170900d1 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.603973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ebcac00-de3b-44aa-9985-ca88170900d1 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.604425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ebcac00-de3b-44aa-9985-ca88170900d1 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.608947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:12:59.609566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:12:59.610069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lazy-loading 'fault' on Instance uuid a955384b-6dbf-444d-bd67-2a1b9a33531b {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:12:59.614220 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2ebcac00-de3b-44aa-9985-ca88170900d1 tempest-HypervisorAdminUnderV252Test-1512093447 tempest-HypervisorAdminUnderV252Test-1512093447-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.029752 May 14 21:12:59.614220 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 269/496] 10.222.0.52 () {58 vars in 1208 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:12:59.688780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:59.702130 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-005f0377-4485-4b75-b461-fc1a927d90b7 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 200 len: 1309 microversion: 2.1 time: 0.157134 May 14 21:12:59.704023 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 228/497] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:59.710939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23570cd8-b6d2-4a7a-b210-5a47ad7ae8d9 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.744355 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-23570cd8-b6d2-4a7a-b210-5a47ad7ae8d9 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/640354139/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.032936 May 14 21:12:59.745147 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 229/498] 10.222.0.52 () {58 vars in 1199 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/flavors/640354139/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:12:59.756762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f1272a05-1fba-42b7-8213-944de2cbf433 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.758076 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:12:59.758076 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:12:59.820243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4fda79f2-5b48-417e-bd75-2dadf7406885 tempest-TenantUsagesNegativeTestJSON-1971681231 tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-13T21%3A12%3A59.475321&end=2022-05-15T21%3A12%3A59.475321" status: 404 len: 112 microversion: - time: 0.196307 May 14 21:12:59.825327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 270/499] 10.222.0.52 () {58 vars in 1315 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-13T21%3A12%3A59.475321&end=2022-05-15T21%3A12%3A59.475321 => generated 112 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 14 21:12:59.830721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0abc6020-f182-43fa-b50c-738049e04e9a tempest-TenantUsagesNegativeTestJSON-1971681231 tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin] Calling method '.version_select at 0x7fb1b41ddd30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.835136 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0abc6020-f182-43fa-b50c-738049e04e9a tempest-TenantUsagesNegativeTestJSON-1971681231 tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0abc6020-f182-43fa-b50c-738049e04e9a tempest-TenantUsagesNegativeTestJSON-1971681231 tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin] Request method failure captured: May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-simple-tenant-usage/c774ae2a876247f6bff20542ac5e9f14?start=2022-05-15T21%3A12%3A59.475321&end=2022-05-13T21%3A12%3A59.475321 HTTP/1.1 May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtb-2fcrWZMtKONKjF6XK9JFfPAOh33-0E95SubJcddAo4nYebaSwnfdF8WnJReiRvOkit3ugsf9cuN5O8e3GIBg0NbvR_8HkruIG-NpB0gMfiifK_9gwXMCUXO6VBJbWFOrCFwyWoczQ0X6xm6I9L11IdBURp-KqWzXWYL5-wN6T4 May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 52748c4cf00740c880b3cdcd92f5b90e May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1971681231 May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:12:59.837456 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52748c4cf00740c880b3cdcd92f5b90e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52748c4cf00740c880b3cdcd92f5b90e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/52748c4cf00740c880b3cdcd92f5b90e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_52748c4cf00740c880b3cdcd92f5b90e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1971681231 May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 52748c4cf00740c880b3cdcd92f5b90e May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1971681231 May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 72b8294dba324f4f92d6317496cece1f May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid start time. The start time cannot occur after the end time. May 14 21:12:59.838844 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'c774ae2a876247f6bff20542ac5e9f14'} May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 14 21:12:59.839588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0abc6020-f182-43fa-b50c-738049e04e9a tempest-TenantUsagesNegativeTestJSON-1971681231 tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:59.840720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0abc6020-f182-43fa-b50c-738049e04e9a tempest-TenantUsagesNegativeTestJSON-1971681231 tempest-TenantUsagesNegativeTestJSON-1971681231-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/c774ae2a876247f6bff20542ac5e9f14?start=2022-05-15T21%3A12%3A59.475321&end=2022-05-13T21%3A12%3A59.475321" status: 400 len: 111 microversion: 2.1 time: 0.011953 May 14 21:12:59.841444 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 271/500] 10.222.0.52 () {58 vars in 1411 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/os-simple-tenant-usage/c774ae2a876247f6bff20542ac5e9f14?start=2022-05-15T21%3A12%3A59.475321&end=2022-05-13T21%3A12%3A59.475321 => generated 111 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:12:59.866941 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f1272a05-1fba-42b7-8213-944de2cbf433 tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/640354139" status: 202 len: 0 microversion: 2.1 time: 0.114642 May 14 21:12:59.872314 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 230/501] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:12:59 2022] DELETE /compute/v2.1/flavors/640354139 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:12:59.889424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a925dcf3-cff9-4b65-a760-2679a632bfae tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.911928 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a925dcf3-cff9-4b65-a760-2679a632bfae tempest-FlavorsExtraSpecsTestJSON-531608374 tempest-FlavorsExtraSpecsTestJSON-531608374-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.037969 May 14 21:12:59.917045 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 231/502] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:12:59.978677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-201c5708-47d0-4f75-bf5d-11efc2449060 tempest-TenantUsagesNegativeTestJSON-313086728 tempest-TenantUsagesNegativeTestJSON-313086728-project] Calling method '.version_select at 0x7fb1b4158ee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:12:59.980968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-201c5708-47d0-4f75-bf5d-11efc2449060 tempest-TenantUsagesNegativeTestJSON-313086728 tempest-TenantUsagesNegativeTestJSON-313086728-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '47f7cec16cf44072b39fab108c531783', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c774ae2a876247f6bff20542ac5e9f14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-201c5708-47d0-4f75-bf5d-11efc2449060 tempest-TenantUsagesNegativeTestJSON-313086728 tempest-TenantUsagesNegativeTestJSON-313086728-project] Request method failure captured: May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-13T21%3A12%3A59.475321&end=2022-05-15T21%3A12%3A59.475321&detailed=1 HTTP/1.1 May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtakiyJe4bCUrE_SMkm9ouSiQzOKI5Nvh1v1ZsQhY4NshPOBBfFI6gH24R0pTVFpaQagn8lcJE5VqFvMZFIPd4_yBfwQUPtG_JSfDVAa1G9y9EdY4PC5dAf0yJ_pnpNs3nKdT55mQoRi2_e5ssNQh8PAJB_pM8wWJJ7bRnb-Bw0fyE May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c774ae2a876247f6bff20542ac5e9f14 May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-313086728 May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:12:59.982797 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c774ae2a876247f6bff20542ac5e9f14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c774ae2a876247f6bff20542ac5e9f14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c774ae2a876247f6bff20542ac5e9f14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c774ae2a876247f6bff20542ac5e9f14", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-313086728 May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c774ae2a876247f6bff20542ac5e9f14 May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-313086728 May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TenantUsagesNegativeTestJSON-313086728-project May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47f7cec16cf44072b39fab108c531783 May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-313086728-project May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:12:59.984632 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._index(req) May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:12:59.985399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:12:59.986420 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:12:59.987459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 14 21:12:59.987459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:12:59.991271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-201c5708-47d0-4f75-bf5d-11efc2449060 tempest-TenantUsagesNegativeTestJSON-313086728 tempest-TenantUsagesNegativeTestJSON-313086728-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:12:59.998802 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-201c5708-47d0-4f75-bf5d-11efc2449060 tempest-TenantUsagesNegativeTestJSON-313086728 tempest-TenantUsagesNegativeTestJSON-313086728-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-13T21%3A12%3A59.475321&end=2022-05-15T21%3A12%3A59.475321&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.148312 May 14 21:13:00.003913 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 272/503] 10.222.0.52 () {58 vars in 1334 bytes} [Sat May 14 21:12:59 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-13T21%3A12%3A59.475321&end=2022-05-15T21%3A12%3A59.475321&detailed=1 => generated 123 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:00.371150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:00.372254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:00.379082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.379745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.380664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.381463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.592744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:00.594051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:00.608718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.618161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.618161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.618161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.707525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:00.720668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:00.722402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:00.763260 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58456085-37f4-4680-a20e-f6529c159cae tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.178079 May 14 21:13:00.764177 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 273/504] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:00 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:13:00.768523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:00.769032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:00.769879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: a955384b-6dbf-444d-bd67-2a1b9a33531b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:00.776023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.776482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.777266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.777710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.793871 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] HTTP exception thrown: Instance a955384b-6dbf-444d-bd67-2a1b9a33531b could not be found. May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Request method failure captured: May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b HTTP/1.1 May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBslMuhdqZ0JTX8AGYv9NK0N81Zl0m8iOc_cOcmaXko7kULd7WrMzfddW9giNu94OoOFaqvZbY8rZlFNubjhfWxq-qurDibgmkviaZPi3R6BWFE_CW5HQlI9PWRho0mCkq0c9ipNj1SyyIvMhMUF1l6ia_mfFCZgYmOBYqRIeWSccDs May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9ffe47c465e1480d91f689bed8e9ed94 May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-LiveMigrationNegativeTest-1518369627 May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:00.798455 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9ffe47c465e1480d91f689bed8e9ed94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9ffe47c465e1480d91f689bed8e9ed94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9ffe47c465e1480d91f689bed8e9ed94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9ffe47c465e1480d91f689bed8e9ed94", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-LiveMigrationNegativeTest-1518369627 May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9ffe47c465e1480d91f689bed8e9ed94 May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1518369627 May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-LiveMigrationNegativeTest-1518369627-project May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6ca2cafc3b794c88b48510b5d466b580 May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-LiveMigrationNegativeTest-1518369627-project May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance a955384b-6dbf-444d-bd67-2a1b9a33531b could not be found. May 14 21:13:00.800054 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'a955384b-6dbf-444d-bd67-2a1b9a33531b'} May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a955384b-6dbf-444d-bd67-2a1b9a33531b could not be found. May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:00.801493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a955384b-6dbf-444d-bd67-2a1b9a33531b could not be found. May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a955384b-6dbf-444d-bd67-2a1b9a33531b could not be found. May 14 21:13:00.803310 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:00.804963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Returning 404 to user: Instance a955384b-6dbf-444d-bd67-2a1b9a33531b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:00.804963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f2c5fe0-28d9-4aca-bad6-6542beebaafe tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b" status: 404 len: 111 microversion: 2.1 time: 0.034905 May 14 21:13:00.804963 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 274/505] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:00 2022] GET /compute/v2.1/servers/a955384b-6dbf-444d-bd67-2a1b9a33531b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:00.809138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:00.809647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:00.814844 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c0d62e4c-c9ff-461d-b0b0-fbd25ca7c49e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.447146 May 14 21:13:00.817262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.817492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.818286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:00.818738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:00.819335 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 232/506] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:00 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:00.856159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:13:01.211689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1862450921", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8f639cbb-5c05-497c-8ba5-726cc4b3ec5b"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:01.231356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d42bd39-b464-4045-be3b-5e5e88a2b06c tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 204 len: 0 microversion: 2.1 time: 0.426033 May 14 21:13:01.232123 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 275/507] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:13:00 2022] DELETE /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:13:01.241884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:01.242776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:01.250019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:01.250474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:01.251396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:01.251871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:01.273666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] validate_networks() for [('8f639cbb-5c05-497c-8ba5-726cc4b3ec5b', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:01.513995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:01.523191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac6451c3-a02b-4d8c-a3dc-b5912e68fddf tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1473 microversion: 2.1 time: 0.285978 May 14 21:13:01.524373 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 276/508] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:01 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1473 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:01.785260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:01.786130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:01.797920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:01.801552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:01.805594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:01.805594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:01.848059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:01.848487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:01.849381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:01.849835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:01.850275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:01.862819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:01.863333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:01.864166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:01.864604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:01.886591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Getting quotas for project f9d24089740246829e483d7d6177125c. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:01.893477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Getting quotas for user 34cd5580db494d05a9ea9cb37f714d27 and project f9d24089740246829e483d7d6177125c. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:01.908219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:13:01.910579 ncdv-master-1 devstack@n-api.service[130638]: WARNING nova.utils [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1862450921 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-186245092 May 14 21:13:01.911377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:13:02.043109 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c3c37ef4-c4c4-4a3b-9b62-ffc01b0b6971 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980232 May 14 21:13:02.044534 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 233/509] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:13:02.054105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:02.055142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:02.079557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:02.080635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:02.081963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:02.083083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:02.182493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:02.194337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:02.196008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:02.202071 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f11f6c1d-3f14-4bbc-9c44-7bb0d35b0f61 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.421638 May 14 21:13:02.217381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 277/510] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:01 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:02.232199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b243b3bf-8381-4fd1-b138-ef871bc3042a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:02.232199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b243b3bf-8381-4fd1-b138-ef871bc3042a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:02.294349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b243b3bf-8381-4fd1-b138-ef871bc3042a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:02.303377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b243b3bf-8381-4fd1-b138-ef871bc3042a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1232 microversion: 2.1 time: 0.083343 May 14 21:13:02.304290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 278/511] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:02 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1232 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:02.320412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:02.334341 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-710e5ae0-01ca-4973-bf32-eca64a9d1efb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.287701 May 14 21:13:02.335492 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 234/512] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:02 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:02.543920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:02.544995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:02.551647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:02.552102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:02.552923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:02.553544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:02.731706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:02.739879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6239a83-6d73-480a-baa6-c651d2e1957b tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1473 microversion: 2.1 time: 0.203252 May 14 21:13:02.741010 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 279/513] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:02 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1473 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:03.222902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:03.224327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:03.234755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:03.235498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:03.236283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:03.236913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:03.322362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:03.325933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-599520b9-8471-4ac9-b06a-7fde292fd574 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:03.327229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-599520b9-8471-4ac9-b06a-7fde292fd574 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:03.332548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:03.334226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:03.366797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e430a707-a538-4400-8097-437de6a84d97 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.147940 May 14 21:13:03.368183 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 235/514] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:03 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:03.375670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:03.376284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:03.384399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:03.384985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:03.385776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:03.386684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:03.534644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-599520b9-8471-4ac9-b06a-7fde292fd574 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:03.550393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-599520b9-8471-4ac9-b06a-7fde292fd574 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1232 microversion: 2.1 time: 0.233069 May 14 21:13:03.556752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 280/515] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:03 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1232 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:03.582091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1a43c97b-96d8-4001-b57d-1c79b8ec207d req-7beaf4be-2d44-4eaf-a21c-ca4dd9f20e32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90932695-580a-4ed5-8d1e-6e47d0d11693", "name": "network-vif-deleted", "tag": "074dfa89-1f3d-4b74-9c88-b07bed760e13"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:03.618063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1a43c97b-96d8-4001-b57d-1c79b8ec207d req-7beaf4be-2d44-4eaf-a21c-ca4dd9f20e32 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:03.621276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1a43c97b-96d8-4001-b57d-1c79b8ec207d req-7beaf4be-2d44-4eaf-a21c-ca4dd9f20e32 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:03.656385 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1a43c97b-96d8-4001-b57d-1c79b8ec207d req-7beaf4be-2d44-4eaf-a21c-ca4dd9f20e32 service nova] Creating event network-vif-deleted:074dfa89-1f3d-4b74-9c88-b07bed760e13 for instance 90932695-580a-4ed5-8d1e-6e47d0d11693 on nch1-master-1 May 14 21:13:03.673148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1a43c97b-96d8-4001-b57d-1c79b8ec207d req-7beaf4be-2d44-4eaf-a21c-ca4dd9f20e32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100084 May 14 21:13:03.681790 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 281/516] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:03.729889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:03.741777 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c1970a9-8b8d-4579-ac1c-3bf964a60291 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.372199 May 14 21:13:03.760848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:03.761684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:03.766329 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 236/517] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:03 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:03.774526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:03.779701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:03.779701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:03.779701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:03.901179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:03.911597 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54a7b078-c032-42fb-bcdc-772883fa092a tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1431 microversion: 2.1 time: 0.155587 May 14 21:13:03.939586 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 282/518] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:03 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1431 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:04.388606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:04.389233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:04.399388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.399388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:04.400046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.400495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:04.551875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:04.567807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:04.569013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:04.576192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.580659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:04.584885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:04.588967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:04.595636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.602337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:04.614700 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2541fdb-39d8-43eb-9b8e-067d6ff3b75a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.229891 May 14 21:13:04.620102 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 237/519] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:04 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:04.715687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:04.724745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c9110152-0066-4216-9cad-e7ab8b946880 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1284 microversion: 2.1 time: 0.160670 May 14 21:13:04.725915 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 283/520] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:04 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:04.779299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:04.789489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:04.804186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.804645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:04.805428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.806027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:04.929777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:04.931627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:04.942857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.949263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:04.950730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:04.955823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:05.076710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:05.077991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:05.081690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lazy-loading 'fault' on Instance uuid 90932695-580a-4ed5-8d1e-6e47d0d11693 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:05.121391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:05.130183 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e39396fe-58a3-4ae0-bbdb-f91ff8d26911 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1476 microversion: 2.1 time: 0.372774 May 14 21:13:05.138266 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 238/521] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:04 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1476 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:05.191654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca2cafc3b794c88b48510b5d466b580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ffe47c465e1480d91f689bed8e9ed94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:05.206322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8a04e20-cddd-4d20-bfa3-9c026bca4ef1 tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 200 len: 1308 microversion: 2.1 time: 0.279692 May 14 21:13:05.220662 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 284/522] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:04 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:05.641784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:05.642649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:05.651586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:05.652506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:05.653917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:05.654555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:05.756079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:05.762875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:05.765728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:05.783341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:05.787916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:05.790277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:05.791265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:05.792141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:05.799942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:05.824369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fa915800-6d96-4cbf-8dcd-13c3f6e2165a tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.182736 May 14 21:13:05.840679 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 239/523] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:05 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:05.955456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:05.970793 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8de4d736-6c6a-4427-918a-009548c93f07 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1290 microversion: 2.1 time: 0.218960 May 14 21:13:05.972707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 285/524] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:05 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1290 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:06.154036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:06.154656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:06.163325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.163812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:06.171084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.172232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:06.228917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:06.229543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] [instance: 90932695-580a-4ed5-8d1e-6e47d0d11693] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:06.239120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.241037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:06.248496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.253758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:06.309509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] HTTP exception thrown: Instance 90932695-580a-4ed5-8d1e-6e47d0d11693 could not be found. May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Request method failure captured: May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 HTTP/1.1 May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBslMuhdqZ0JTX8AGYv9NK0N81Zl0m8iOc_cOcmaXko7kULd7WrMzfddW9giNu94OoOFaqvZbY8rZlFNubjhfWxq-qurDibgmkviaZPi3R6BWFE_CW5HQlI9PWRho0mCkq0c9ipNj1SyyIvMhMUF1l6ia_mfFCZgYmOBYqRIeWSccDs May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9ffe47c465e1480d91f689bed8e9ed94 May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-LiveMigrationNegativeTest-1518369627 May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:06.315669 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9ffe47c465e1480d91f689bed8e9ed94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9ffe47c465e1480d91f689bed8e9ed94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9ffe47c465e1480d91f689bed8e9ed94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9ffe47c465e1480d91f689bed8e9ed94", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-LiveMigrationNegativeTest-1518369627 May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9ffe47c465e1480d91f689bed8e9ed94 May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1518369627 May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-LiveMigrationNegativeTest-1518369627-project May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6ca2cafc3b794c88b48510b5d466b580 May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-LiveMigrationNegativeTest-1518369627-project May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 90932695-580a-4ed5-8d1e-6e47d0d11693 could not be found. May 14 21:13:06.317006 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '90932695-580a-4ed5-8d1e-6e47d0d11693'} May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90932695-580a-4ed5-8d1e-6e47d0d11693 could not be found. May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:06.317655 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90932695-580a-4ed5-8d1e-6e47d0d11693 could not be found. May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90932695-580a-4ed5-8d1e-6e47d0d11693 could not be found. May 14 21:13:06.318718 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:06.321229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] Returning 404 to user: Instance 90932695-580a-4ed5-8d1e-6e47d0d11693 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:06.332642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b8047da8-0330-47d7-8bd2-250069faa61d tempest-LiveMigrationNegativeTest-1518369627 tempest-LiveMigrationNegativeTest-1518369627-project] 10.222.0.52 "GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693" status: 404 len: 111 microversion: 2.1 time: 0.107443 May 14 21:13:06.333825 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 286/525] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:06 2022] GET /compute/v2.1/servers/90932695-580a-4ed5-8d1e-6e47d0d11693 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:13:06.457055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:06.469850 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cee20fcf-195c-4b43-a611-22df8ddb3255 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1475 microversion: 2.1 time: 0.319167 May 14 21:13:06.472200 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 240/526] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:06 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1475 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:06.627041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:06.627576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:06.638150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.638613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:06.639614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.643712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:06.708336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:13:06.855171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:06.856575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:06.869729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.870901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:06.872649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:06.873456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:07.005362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:07.040499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:07.044321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:07.054988 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-60485f0b-6a4d-47dd-9b60-884621d329b5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.208809 May 14 21:13:07.070832 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 241/527] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:06 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:07.081545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:07.082497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:07.093540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:07.094218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:07.096361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:07.097884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:07.233101 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-086cce84-6f45-45f6-b14f-1fc659c7c575 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 204 len: 0 microversion: 2.1 time: 0.610212 May 14 21:13:07.240552 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 287/528] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:13:06 2022] DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:13:07.255395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-34307dc3-5c93-49dd-a23f-51db5bb440e4 req-0031d6da-a0b2-49cb-bc89-2ab0f4f4ef62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5a5886-95f4-4ee4-9bf7-013456bfa20b", "name": "network-vif-unplugged", "status": "completed", "tag": "18b50999-4ef7-4c21-8dba-c0606fe826e1"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:07.285896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-34307dc3-5c93-49dd-a23f-51db5bb440e4 req-0031d6da-a0b2-49cb-bc89-2ab0f4f4ef62 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:07.286646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-34307dc3-5c93-49dd-a23f-51db5bb440e4 req-0031d6da-a0b2-49cb-bc89-2ab0f4f4ef62 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:07.341557 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-34307dc3-5c93-49dd-a23f-51db5bb440e4 req-0031d6da-a0b2-49cb-bc89-2ab0f4f4ef62 service nova] Creating event network-vif-unplugged:18b50999-4ef7-4c21-8dba-c0606fe826e1 for instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b on nch2-master-1 May 14 21:13:07.378976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:07.379521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-34307dc3-5c93-49dd-a23f-51db5bb440e4 req-0031d6da-a0b2-49cb-bc89-2ab0f4f4ef62 service nova] Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:13:07.387820 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b1396c1-e964-407e-a67f-980081711cfe tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.315386 May 14 21:13:07.391785 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 242/529] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:07 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:07.405713 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-34307dc3-5c93-49dd-a23f-51db5bb440e4 req-0031d6da-a0b2-49cb-bc89-2ab0f4f4ef62 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162824 May 14 21:13:07.406701 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 288/530] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:07.501439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:07.501988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:07.509617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:07.516376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:07.517346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:07.517825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:07.656391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1245940045", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "1398027056", "adminPass": "***", "networks": [{"uuid": "824318b0-331e-4da1-8622-b2d8e9a5e85d"}], "security_groups": [{"name": "tempest-securitygroup--165261146"}], "key_name": "tempest-keypair-1126718949", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:07.770218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:07.778863 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-01078f67-5edb-458c-b4a1-e0b0a4ae3136 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1475 microversion: 2.1 time: 0.281860 May 14 21:13:07.782117 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 243/531] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:07 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1475 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:08.033252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] validate_networks() for [('824318b0-331e-4da1-8622-b2d8e9a5e85d', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:08.079859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:08.082552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:08.101185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:08.104361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:08.109934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:08.111780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:08.289233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:08.345594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:08.347923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:08.362532 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa2941a5-c846-4c21-8d6d-f427f42c05d1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.290781 May 14 21:13:08.365438 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 244/532] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:08 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:08.409185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:08.410215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:08.428308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:08.428767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:08.429562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:08.433164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:08.876185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:08.884658 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4638323-d8b0-4cd8-9a2a-fee10a1f9edf tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.481878 May 14 21:13:08.888993 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 245/533] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:08 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:08.896132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:08.897116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:08.904387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:08.904909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:08.905755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:08.906233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:09.164886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:09.178304 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1465466e-2810-4355-aaa4-7223fbce6074 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1475 microversion: 2.1 time: 0.286018 May 14 21:13:09.179908 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 246/534] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:08 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1475 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:09.468173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be9262f7-ac58-4951-9e37-bcc31c791e0f tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] Calling method '.version_select at 0x7fb1b4569670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:09.468173 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:09.468173 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:09.485685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-be9262f7-ac58-4951-9e37-bcc31c791e0f tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.270410 May 14 21:13:09.487070 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 247/535] 10.222.0.52 () {60 vars in 1225 bytes} [Sat May 14 21:13:09 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:09.493121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:09.495299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:09.507843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:09.507843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:09.507843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:09.507843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:09.584329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:09.603924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:09.603924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:09.603924 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04a7a8b3-20a0-4791-8756-e03b8f53a65d tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.111245 May 14 21:13:09.604325 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 248/536] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:09 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:09.605858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4ccb502b-92df-4750-8411-72248d304b72 req-611a3db6-a142-4747-8ab7-11fb49ac03f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a5a5886-95f4-4ee4-9bf7-013456bfa20b", "tag": "18b50999-4ef7-4c21-8dba-c0606fe826e1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:09.624231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4ccb502b-92df-4750-8411-72248d304b72 req-611a3db6-a142-4747-8ab7-11fb49ac03f5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:09.624231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4ccb502b-92df-4750-8411-72248d304b72 req-611a3db6-a142-4747-8ab7-11fb49ac03f5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:09.645719 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4ccb502b-92df-4750-8411-72248d304b72 req-611a3db6-a142-4747-8ab7-11fb49ac03f5 service nova] Creating event network-changed:18b50999-4ef7-4c21-8dba-c0606fe826e1 for instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b on nch2-master-1 May 14 21:13:09.667973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-4ccb502b-92df-4750-8411-72248d304b72 req-611a3db6-a142-4747-8ab7-11fb49ac03f5 service nova] Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:13:09.687949 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4ccb502b-92df-4750-8411-72248d304b72 req-611a3db6-a142-4747-8ab7-11fb49ac03f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086037 May 14 21:13:09.688569 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 249/537] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:09.694129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99b12dd3-07b8-49dd-98cf-fe07a1d65791 tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b4071f70>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:09.695985 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:09.695985 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:10.051368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:10.051368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:10.051368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:10.051993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:10.051993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:10.064853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:10.065893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:10.067019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:10.067471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:10.090159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Getting quotas for project 97eb48c86b4d49f1b11b2b6380020f4b. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:10.095974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Getting quotas for user 36c32d3de24045bdbfce30559ea022e7 and project 97eb48c86b4d49f1b11b2b6380020f4b. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:10.121475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:13:10.131501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:13:10.298327 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fde863e0-a75e-42e0-8685-97c31976cb60 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.648222 May 14 21:13:10.304467 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 289/538] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:13:10.448363 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99b12dd3-07b8-49dd-98cf-fe07a1d65791 tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.758171 May 14 21:13:10.455388 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 250/539] 10.222.0.52 () {62 vars in 1246 bytes} [Sat May 14 21:13:09 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:10.670919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dff2ec77-9752-4cfe-8443-67849586a347 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-2098960193", "ram": 512, "vcpus": 1, "disk": 10, "id": 52615962, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:10.673844 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:10.673844 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:10.708755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-247705655", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8f75d233-b39d-4c19-a44f-6a34a157d017"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:10.762382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] validate_networks() for [('8f75d233-b39d-4c19-a44f-6a34a157d017', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:10.769749 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dff2ec77-9752-4cfe-8443-67849586a347 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.463652 May 14 21:13:10.770576 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 290/540] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:10 2022] POST /compute/v2.1/flavors => generated 410 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:10.787352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:10.788500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:10.798551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:10.799046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:10.800092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:10.800542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:11.206935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:11.207723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:11.208213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:11.208789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:11.212765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:11.219447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:11.220207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:11.221027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:11.221477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:11.240737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Getting quotas for project e4af8109ce4a4e98a2e7104125651db0. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:11.244457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Getting quotas for user 911b9cf4e9bc424bba387e2ff966cb46 and project e4af8109ce4a4e98a2e7104125651db0. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:11.258650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:13:11.261569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:13:11.409854 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-08e05a30-2b66-4b63-bbd1-f69db163b03f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953064 May 14 21:13:11.411262 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 251/541] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:13:11.416146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:11.417064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:11.425311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:11.425884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:11.426960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:11.427659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:11.509334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:11.521798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22825cec-58f9-4b64-9cb1-23009a14332f tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.742010 May 14 21:13:11.522395 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 291/542] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:10 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:11.534563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ab6b8ea-8897-42c3-800e-42276c92cd96 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:11.535492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ab6b8ea-8897-42c3-800e-42276c92cd96 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:11.612218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ab6b8ea-8897-42c3-800e-42276c92cd96 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:11.617440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:11.622555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ab6b8ea-8897-42c3-800e-42276c92cd96 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1265 microversion: 2.1 time: 0.096761 May 14 21:13:11.625311 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 292/543] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:11 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1265 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:11.626998 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68825c1d-3f69-4c83-925e-975be15c9d0c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1473 microversion: 2.1 time: 0.214430 May 14 21:13:11.628153 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 252/544] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:11 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1473 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:11.634762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:11.635587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:11.636164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba3d03cc-6d65-4cd3-b18c-8cfdb09470a8 tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] Calling method '.version_select at 0x7fb1b4207c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:11.636966 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:11.636966 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:11.644255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:11.645005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:11.646246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:11.646832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:11.677377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba3d03cc-6d65-4cd3-b18c-8cfdb09470a8 tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.050131 May 14 21:13:11.680196 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 293/545] 10.222.0.52 () {60 vars in 1225 bytes} [Sat May 14 21:13:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:11.739147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:11.750193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:11.752288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:11.760039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-da03614e-68fb-40fd-8c16-ddc34474f7c3 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.130328 May 14 21:13:11.772667 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 253/546] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:11 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:11.772667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ead3c215-bd63-4969-9c9d-4cb15623c68e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:11.772667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ead3c215-bd63-4969-9c9d-4cb15623c68e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:11.834663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ead3c215-bd63-4969-9c9d-4cb15623c68e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:11.844977 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ead3c215-bd63-4969-9c9d-4cb15623c68e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1217 microversion: 2.1 time: 0.082674 May 14 21:13:11.855440 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 254/547] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:11 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:11.855440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ba9897f-9e20-48df-8f0b-c0cca8bfc378 tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7fcb0d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:11.855440 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:11.855440 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:11.951429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef83d6c9-f15e-4089-b607-533841f1f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:11.962068 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ef83d6c9-f15e-4089-b607-533841f1f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] HTTP exception thrown: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef83d6c9-f15e-4089-b607-533841f1f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Request method failure captured: May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/flavors/52615962/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtjXqO_1IlAjmaN6f7j79SBTrOxeqIOUxfa2NIJH9ABgoPnaxpxg240rQHC8tgFPcy5eVsuanNLbsmhX5-8Ymn5s4y_EYKBNeG90eQZqPZ6p74rRPnE1JGwwKqZ5VgUTIXw7GkU60IzQ14Mf9Viv_AutoJLdcEAklUQbd_io7ku1JQ May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:11.964662 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2bea4301559473ea442e85b66e225b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6840e733cb0f49eb9492da7e4c042b58 May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:11.966068 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '52615962', 'id': 'hw:cpu_thread_policy'} May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:11.966839 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:11.968330 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:11.968330 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:11.968330 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:11.968330 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:11.968330 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:11.968330 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:11.968330 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:11.969766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef83d6c9-f15e-4089-b607-533841f1f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Returning 404 to user: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:11.970676 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ef83d6c9-f15e-4089-b607-533841f1f7a3 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] 10.222.0.52 "GET /compute/v2.1/flavors/52615962/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.289386 May 14 21:13:11.971924 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 294/548] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:13:11 2022] GET /compute/v2.1/flavors/52615962/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:11.978390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f063a447-cfe2-431e-9f68-7f4b7ec8cd9c req-06a79626-2a0d-4702-8ef7-bed52e766aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840d43fc-5b80-446f-8a49-9bd3739a0679", "tag": "b2de6a6b-fac3-4f46-8300-e24ecf292526"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:11.991218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f063a447-cfe2-431e-9f68-7f4b7ec8cd9c req-06a79626-2a0d-4702-8ef7-bed52e766aca service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:11.991926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f063a447-cfe2-431e-9f68-7f4b7ec8cd9c req-06a79626-2a0d-4702-8ef7-bed52e766aca service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:12.003820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f063a447-cfe2-431e-9f68-7f4b7ec8cd9c req-06a79626-2a0d-4702-8ef7-bed52e766aca service nova] Creating event network-changed:b2de6a6b-fac3-4f46-8300-e24ecf292526 for instance 840d43fc-5b80-446f-8a49-9bd3739a0679 on nch2-master-1 May 14 21:13:12.008712 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f063a447-cfe2-431e-9f68-7f4b7ec8cd9c req-06a79626-2a0d-4702-8ef7-bed52e766aca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035141 May 14 21:13:12.009310 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 295/549] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:12.015363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcdb0783-90df-4ace-8359-7d00576c1900 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:12.016761 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:12.016761 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:12.017624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bcdb0783-90df-4ace-8359-7d00576c1900 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '6840e733cb0f49eb9492da7e4c042b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bea4301559473ea442e85b66e225b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcdb0783-90df-4ace-8359-7d00576c1900 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Request method failure captured: May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/flavors/52615962/os-extra_specs HTTP/1.1 May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 66 May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtjXqO_1IlAjmaN6f7j79SBTrOxeqIOUxfa2NIJH9ABgoPnaxpxg240rQHC8tgFPcy5eVsuanNLbsmhX5-8Ymn5s4y_EYKBNeG90eQZqPZ6p74rRPnE1JGwwKqZ5VgUTIXw7GkU60IzQ14Mf9Viv_AutoJLdcEAklUQbd_io7ku1JQ May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:12.019273 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2bea4301559473ea442e85b66e225b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6840e733cb0f49eb9492da7e4c042b58 May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 14 21:13:12.020521 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '52615962', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:12.021206 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 14 21:13:12.022265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.023441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcdb0783-90df-4ace-8359-7d00576c1900 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:12.023441 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bcdb0783-90df-4ace-8359-7d00576c1900 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] 10.222.0.52 "POST /compute/v2.1/flavors/52615962/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.010110 May 14 21:13:12.023441 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 296/550] 10.222.0.52 () {60 vars in 1217 bytes} [Sat May 14 21:13:12 2022] POST /compute/v2.1/flavors/52615962/os-extra_specs => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:12.035076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-55fcf59a-be68-4a37-ad07-c9317b7812b8 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:12.147522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-55fcf59a-be68-4a37-ad07-c9317b7812b8 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/52615962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.117409 May 14 21:13:12.148981 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 297/551] 10.222.0.52 () {60 vars in 1217 bytes} [Sat May 14 21:13:12 2022] POST /compute/v2.1/flavors/52615962/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:13:12.173006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eeec94d6-4871-4d38-a027-2b07d391e872 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:12.175242 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:12.175242 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:12.176611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eeec94d6-4871-4d38-a027-2b07d391e872 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '6840e733cb0f49eb9492da7e4c042b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bea4301559473ea442e85b66e225b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eeec94d6-4871-4d38-a027-2b07d391e872 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Request method failure captured: May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes HTTP/1.1 May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtjXqO_1IlAjmaN6f7j79SBTrOxeqIOUxfa2NIJH9ABgoPnaxpxg240rQHC8tgFPcy5eVsuanNLbsmhX5-8Ymn5s4y_EYKBNeG90eQZqPZ6p74rRPnE1JGwwKqZ5VgUTIXw7GkU60IzQ14Mf9Viv_AutoJLdcEAklUQbd_io7ku1JQ May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:12.178397 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2bea4301559473ea442e85b66e225b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6840e733cb0f49eb9492da7e4c042b58 May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:12.179598 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '52615962', 'id': 'hw:numa_nodes'} May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:12.180232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 14 21:13:12.181315 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.183637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eeec94d6-4871-4d38-a027-2b07d391e872 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:12.184901 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eeec94d6-4871-4d38-a027-2b07d391e872 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] 10.222.0.52 "DELETE /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.016394 May 14 21:13:12.186079 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 298/552] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:13:12 2022] DELETE /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:12.198946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61bf2d47-94fb-4414-8463-e0971d65a94a tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:12.224360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-61bf2d47-94fb-4414-8463-e0971d65a94a tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors/52615962/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028933 May 14 21:13:12.236456 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 299/553] 10.222.0.52 () {60 vars in 1217 bytes} [Sat May 14 21:13:12 2022] POST /compute/v2.1/flavors/52615962/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:13:12.259604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-984eb90b-2140-4ff6-80b3-5ec61fb94c6f tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:12.275303 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:12.275303 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:12.276659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-984eb90b-2140-4ff6-80b3-5ec61fb94c6f tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '6840e733cb0f49eb9492da7e4c042b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2bea4301559473ea442e85b66e225b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-984eb90b-2140-4ff6-80b3-5ec61fb94c6f tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Request method failure captured: May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes HTTP/1.1 May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 22 May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtjXqO_1IlAjmaN6f7j79SBTrOxeqIOUxfa2NIJH9ABgoPnaxpxg240rQHC8tgFPcy5eVsuanNLbsmhX5-8Ymn5s4y_EYKBNeG90eQZqPZ6p74rRPnE1JGwwKqZ5VgUTIXw7GkU60IzQ14Mf9Viv_AutoJLdcEAklUQbd_io7ku1JQ May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:12.279174 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2bea4301559473ea442e85b66e225b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2bea4301559473ea442e85b66e225b3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d2bea4301559473ea442e85b66e225b3 May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6840e733cb0f49eb9492da7e4c042b58 May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: {"hw:numa_nodes": "1"} May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:12.281131 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '52615962', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:12.282305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 14 21:13:12.283677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.300013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-984eb90b-2140-4ff6-80b3-5ec61fb94c6f tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:12.301620 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-984eb90b-2140-4ff6-80b3-5ec61fb94c6f tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718 tempest-FlavorsExtraSpecsNegativeTestJSON-1862281718-project] 10.222.0.52 "PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.057069 May 14 21:13:12.302979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 300/554] 10.222.0.52 () {60 vars in 1258 bytes} [Sat May 14 21:13:12 2022] PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes => generated 124 bytes in 59 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:12.316409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ddb75bd6-d8c0-46d8-aa7b-8bad10adc84c tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:12.338913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ddb75bd6-d8c0-46d8-aa7b-8bad10adc84c tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] HTTP exception thrown: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ddb75bd6-d8c0-46d8-aa7b-8bad10adc84c tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Request method failure captured: May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/flavors/52615962/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtlKRqmxT81-oCOCh7DUhKDxRZU2XoBHHkVZP__7CHPSwq1A4TMI-Bo0Hz2bkmmEKMeQlBZnwvCM1QfP2VYJ6JgtuHDu1R8DIrssGft7qMdbLNFARf1TfZfFPdXgRwLI9mOTvEhnfCmQ9SxUzZLgK9Y-VTBablzWQCsnl3h9mrH9iI May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 0d7b6619a39d40d1b81148b9761ae960 May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:13:12.340331 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d7b6619a39d40d1b81148b9761ae960", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 0d7b6619a39d40d1b81148b9761ae960 May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 4e82245353e64a87967e346fedddf267 May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:12.341511 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '52615962', 'id': 'hw:cpu_thread_policy'} May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.342363 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ddb75bd6-d8c0-46d8-aa7b-8bad10adc84c tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Returning 404 to user: Flavor 52615962 has no extra specs with key hw:cpu_thread_policy. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ddb75bd6-d8c0-46d8-aa7b-8bad10adc84c tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/52615962/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.031447 May 14 21:13:12.343584 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 301/555] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:13:12 2022] DELETE /compute/v2.1/flavors/52615962/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:12.357272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e645809-1a15-4dce-ae1e-d3628f0e0644 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:12.384125 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-7e645809-1a15-4dce-ae1e-d3628f0e0644 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] HTTP exception thrown: Request body and URI mismatch May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e645809-1a15-4dce-ae1e-d3628f0e0644 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Request method failure captured: May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes HTTP/1.1 May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 27 May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtlKRqmxT81-oCOCh7DUhKDxRZU2XoBHHkVZP__7CHPSwq1A4TMI-Bo0Hz2bkmmEKMeQlBZnwvCM1QfP2VYJ6JgtuHDu1R8DIrssGft7qMdbLNFARf1TfZfFPdXgRwLI9mOTvEhnfCmQ9SxUzZLgK9Y-VTBablzWQCsnl3h9mrH9iI May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 0d7b6619a39d40d1b81148b9761ae960 May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:13:12.385889 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d7b6619a39d40d1b81148b9761ae960", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 0d7b6619a39d40d1b81148b9761ae960 May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 4e82245353e64a87967e346fedddf267 May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: {"hw:cpu_policy": "shared"} May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:12.387364 ncdv-master-1 devstack@n-api.service[130637]: exception: Request body and URI mismatch May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '52615962', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.388259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.390680 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:12.390680 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:12.390680 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 14 21:13:12.390680 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.391896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e645809-1a15-4dce-ae1e-d3628f0e0644 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:12.392951 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e645809-1a15-4dce-ae1e-d3628f0e0644 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.040174 May 14 21:13:12.393848 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 302/556] 10.222.0.52 () {60 vars in 1258 bytes} [Sat May 14 21:13:12 2022] PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes => generated 73 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 14 21:13:12.403237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31ed2158-276d-4e21-933e-25d65e5b037d tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31ed2158-276d-4e21-933e-25d65e5b037d tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Request method failure captured: May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes HTTP/1.1 May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 49 May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtlKRqmxT81-oCOCh7DUhKDxRZU2XoBHHkVZP__7CHPSwq1A4TMI-Bo0Hz2bkmmEKMeQlBZnwvCM1QfP2VYJ6JgtuHDu1R8DIrssGft7qMdbLNFARf1TfZfFPdXgRwLI9mOTvEhnfCmQ9SxUzZLgK9Y-VTBablzWQCsnl3h9mrH9iI May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 0d7b6619a39d40d1b81148b9761ae960 May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:13:12.416012 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0d7b6619a39d40d1b81148b9761ae960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0d7b6619a39d40d1b81148b9761ae960", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 0d7b6619a39d40d1b81148b9761ae960 May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 4e82245353e64a87967e346fedddf267 May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 14 21:13:12.421136 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'flavor_id': '52615962', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': ['string', May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'number']}}, May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance: May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 14 21:13:12.421792 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.423053 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31ed2158-276d-4e21-933e-25d65e5b037d tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31ed2158-276d-4e21-933e-25d65e5b037d tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.018573 May 14 21:13:12.424470 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 303/557] 10.222.0.52 () {60 vars in 1258 bytes} [Sat May 14 21:13:12 2022] PUT /compute/v2.1/flavors/52615962/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:13:12.429619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-291dfc5c-0a5e-4afd-8c2c-06f258adccfb tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:12.430409 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:12.430409 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:12.561289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ba9897f-9e20-48df-8f0b-c0cca8bfc378 tempest-QuotaClassesAdmin257Test-44397238 tempest-QuotaClassesAdmin257Test-44397238-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.714194 May 14 21:13:12.564768 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 255/558] 10.222.0.52 () {62 vars in 1246 bytes} [Sat May 14 21:13:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:12.578166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:12.582035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:12.587110 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-291dfc5c-0a5e-4afd-8c2c-06f258adccfb tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/52615962" status: 202 len: 0 microversion: 2.1 time: 0.162663 May 14 21:13:12.588687 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 304/559] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:13:12 2022] DELETE /compute/v2.1/flavors/52615962 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:13:12.598962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a66fe526-f30d-4c76-a6b3-2c0a5bccf2a8 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:12.602576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:12.603125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:12.606394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:12.606394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:12.671571 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a66fe526-f30d-4c76-a6b3-2c0a5bccf2a8 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950 tempest-FlavorsExtraSpecsNegativeTestJSON-710125950-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.075264 May 14 21:13:12.672941 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 305/560] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:13:12 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:12.698460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:12.705328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:12.729737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:12.730564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:12.734012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:12.736707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:12.919636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:12.931245 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-75ab395b-878b-4619-af81-c41602f9bea7 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1317 microversion: 2.1 time: 0.257042 May 14 21:13:12.944052 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 306/561] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:12 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:12.949657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:12.950649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:12.967616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:12.968246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:12.969899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:12.970641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:12.991224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:13.002976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e95de24-3c70-4557-8b1a-5efbb6c2d5be tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.435187 May 14 21:13:13.003603 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 256/562] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:12 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:13.009363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:13.010205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:13.017025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:13.017585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:13.018675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:13.019658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:13.209766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:13.218740 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-320779f9-7946-4bbc-be4b-9882e85b74c6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1473 microversion: 2.1 time: 0.273453 May 14 21:13:13.220059 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 307/563] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:12 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:13.226379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:13.227342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:13.244594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:13.245357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:13.246574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:13.247103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:13.320351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:13.341702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:13.354208 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-33e4f168-22f0-4a37-912c-ee5568211cc2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1221 microversion: 2.1 time: 0.131494 May 14 21:13:13.365060 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 308/564] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:13 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:13.365227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:13.365227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:13.375751 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e03d566-1013-424b-89ba-1818d3726cab tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1447 microversion: 2.75 time: 0.370419 May 14 21:13:13.377079 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 257/565] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:13 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1447 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:13.950525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:13.952530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:13.961366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:13.965130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:13.968309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:13.969046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:14.103811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:14.105422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7baed9ca-da68-416f-8df2-a655570db980 tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] Calling method '.version_select at 0x7fb1b40e54c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:14.106787 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:14.106787 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:14.125389 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7baed9ca-da68-416f-8df2-a655570db980 tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.436006 May 14 21:13:14.126275 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 309/566] 10.222.0.52 () {58 vars in 1184 bytes} [Sat May 14 21:13:13 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:14.130876 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c65b3f4b-532d-414d-8dea-2728f7eac755 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1323 microversion: 2.1 time: 0.183825 May 14 21:13:14.132183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:14.133059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:14.145291 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 258/567] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:13 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:14.152219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:14.152219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:14.152219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:14.152619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:14.152721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-3bc5d2a4-ce89-4fe1-881f-ce6015f03d37 req-451351c9-76b0-4d2f-a88d-3e2dab04fa5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "406fb98b-cfdf-42ed-b684-bcabeee2633e", "name": "network-vif-deleted", "tag": "e509da02-863e-4b7a-95be-11eee591d1dc"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:14.164277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3bc5d2a4-ce89-4fe1-881f-ce6015f03d37 req-451351c9-76b0-4d2f-a88d-3e2dab04fa5a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:14.164995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3bc5d2a4-ce89-4fe1-881f-ce6015f03d37 req-451351c9-76b0-4d2f-a88d-3e2dab04fa5a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:14.184867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-3bc5d2a4-ce89-4fe1-881f-ce6015f03d37 req-451351c9-76b0-4d2f-a88d-3e2dab04fa5a service nova] Creating event network-vif-deleted:e509da02-863e-4b7a-95be-11eee591d1dc for instance 406fb98b-cfdf-42ed-b684-bcabeee2633e on nch1-master-1 May 14 21:13:14.192126 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-3bc5d2a4-ce89-4fe1-881f-ce6015f03d37 req-451351c9-76b0-4d2f-a88d-3e2dab04fa5a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045178 May 14 21:13:14.196350 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 259/568] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:14.206674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9956e1b7-f253-472a-a048-002388a4d9dd tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b4018d30>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:14.208840 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:14.208840 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:14.501949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:14.534597 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21bdd156-988a-4e3c-9121-0efeb403d329 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.405612 May 14 21:13:14.537044 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 310/569] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:14 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:14.562185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:14.564917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:14.576109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:14.577542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:14.579113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:14.579832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.208540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:15.222258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f5407c43-d493-4ad1-a564-128c1a65ea61 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1470 microversion: 2.1 time: 0.680948 May 14 21:13:15.222258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 311/570] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:14 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1470 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:15.228206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:15.229490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:15.250008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.255558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.255558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.255558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.341257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:15.353650 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b78c757e-149e-402a-9f8c-4ee4e10f2e91 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1275 microversion: 2.1 time: 0.131476 May 14 21:13:15.356994 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 312/571] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:15 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1275 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:15.361248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:15.362014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:15.369035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.369496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.371582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.371965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.462075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:15.471630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:15.473574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:15.479025 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e04b7048-8e7a-445e-8956-115926fb8366 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1453 microversion: 2.75 time: 0.123056 May 14 21:13:15.479838 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 313/572] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:15 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:15.485423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:15.486249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:15.494057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.494518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.495335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.495778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.644753 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9956e1b7-f253-472a-a048-002388a4d9dd tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.445944 May 14 21:13:15.645872 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 260/573] 10.222.0.52 () {60 vars in 1205 bytes} [Sat May 14 21:13:14 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:15.651065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-62eb2263-8057-4fed-a099-9c3ae44d77ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:15.652007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-62eb2263-8057-4fed-a099-9c3ae44d77ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:15.658109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62eb2263-8057-4fed-a099-9c3ae44d77ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.658589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62eb2263-8057-4fed-a099-9c3ae44d77ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.659698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62eb2263-8057-4fed-a099-9c3ae44d77ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.660228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62eb2263-8057-4fed-a099-9c3ae44d77ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.834497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:15.847429 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dda05b12-0298-40c3-9e26-94ac801e1838 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.366149 May 14 21:13:15.848085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 314/574] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:15 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:15.855075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:15.863597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:15.870639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.871766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.875650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.875650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.925782 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-62eb2263-8057-4fed-a099-9c3ae44d77ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b/action" status: 204 len: 0 microversion: 2.1 time: 0.278333 May 14 21:13:15.926542 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 261/575] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:15 2022] POST /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b/action => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:13:15.936582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72e2899c-b26f-4afe-9c78-a59a6a495586 tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] Calling method '.version_select at 0x7fb1b4132790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:15.937691 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:15.937691 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:15.962348 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72e2899c-b26f-4afe-9c78-a59a6a495586 tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.031058 May 14 21:13:15.963099 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 262/576] 10.222.0.52 () {58 vars in 1184 bytes} [Sat May 14 21:13:15 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:15.969163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:15.970200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:15.977457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.978184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:15.979154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:15.979738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:16.305403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:16.317491 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6b51fff-dccd-486b-a541-707028fdf724 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1470 microversion: 2.1 time: 0.352947 May 14 21:13:16.318753 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 263/577] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:15 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1470 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:16.323706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82476192-ad79-4d4d-a72f-475c4c071dc9 tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7fcb0d0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:16.325487 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:16.325487 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:16.618599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:16.629274 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8d849459-4889-4316-8127-5edb088e6339 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.779911 May 14 21:13:16.642157 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 315/578] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:15 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:16.648107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:16.648810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:16.664066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:16.664643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:16.665444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:16.665930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:16.821790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:16.829993 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-929e226e-45a3-4460-81ea-0a50ad5e22d2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1275 microversion: 2.1 time: 0.195225 May 14 21:13:16.830709 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 316/579] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:16 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:16.835146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6595c9dd-abdc-4a70-884c-8f7a852baca9 req-d14c3fa6-7cec-4982-9dfb-b6a2f265313c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a5a5886-95f4-4ee4-9bf7-013456bfa20b", "name": "network-vif-plugged", "status": "completed", "tag": "18b50999-4ef7-4c21-8dba-c0606fe826e1"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:16.844171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6595c9dd-abdc-4a70-884c-8f7a852baca9 req-d14c3fa6-7cec-4982-9dfb-b6a2f265313c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:16.844626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6595c9dd-abdc-4a70-884c-8f7a852baca9 req-d14c3fa6-7cec-4982-9dfb-b6a2f265313c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:16.857265 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6595c9dd-abdc-4a70-884c-8f7a852baca9 req-d14c3fa6-7cec-4982-9dfb-b6a2f265313c service nova] Creating event network-vif-plugged:18b50999-4ef7-4c21-8dba-c0606fe826e1 for instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b on nch2-master-1 May 14 21:13:16.863398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-6595c9dd-abdc-4a70-884c-8f7a852baca9 req-d14c3fa6-7cec-4982-9dfb-b6a2f265313c service nova] Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:13:16.874596 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6595c9dd-abdc-4a70-884c-8f7a852baca9 req-d14c3fa6-7cec-4982-9dfb-b6a2f265313c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042691 May 14 21:13:16.875409 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 317/580] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:16.882530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:16.883413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:16.890312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:16.890768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:16.891751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:16.892351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:16.987325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:16.997888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:16.999357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:17.003930 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e16c8e0a-8493-4356-afec-f910ec884622 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1453 microversion: 2.75 time: 0.127037 May 14 21:13:17.005000 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 318/581] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:16 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:17.021379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:17.026645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:17.028661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:17.029479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:17.031041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:17.031756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:17.541910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82476192-ad79-4d4d-a72f-475c4c071dc9 tempest-QuotaClassesAdminTestJSON-30740469 tempest-QuotaClassesAdminTestJSON-30740469-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.221994 May 14 21:13:17.542678 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 264/582] 10.222.0.52 () {60 vars in 1205 bytes} [Sat May 14 21:13:16 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:17.556218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:17.556846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:17.571648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:17.572099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:17.572886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:17.573322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:17.782834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:17.799979 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-34f9b02f-b968-4947-b5b7-70b364b40a02 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1470 microversion: 2.1 time: 0.255749 May 14 21:13:17.816134 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 265/583] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:17 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:17.825062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:17.829020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:17.840895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:17.844528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:17.845618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:17.846236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.016528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:18.026795 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-add3dfbb-3dc9-49f5-b068-642eba7ebfdb tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.209313 May 14 21:13:18.035791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:18.039780 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 266/584] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:17 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:18.044921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:18.046245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:18.053461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.053607 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9b788c75-be82-4611-9bb6-9074c57b442d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 1.044263 May 14 21:13:18.054274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.055052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.056498 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 319/585] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:17 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:18.064581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.067784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:18.069300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:18.082221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.085530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.086453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.086972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.255768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:18.273101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:18.276494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:18.285809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:18.290004 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-154e255a-c8b7-4407-a51b-73ff3dd7b808 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1438 microversion: 2.75 time: 0.231505 May 14 21:13:18.291418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 320/586] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:18 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1438 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:18.297649 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-62fc0127-7fd1-463c-9e4b-b8c2f22ea764 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.256701 May 14 21:13:18.300005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 267/587] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:18 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:18.665025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-217e752a-9dae-48bc-bbd8-ae46b8a7fcdc req-b1255f85-df76-4759-b6e8-f3e25d0a4889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc3677c-c275-470e-97fc-e832134789c1", "tag": "d7b4c8ec-2c9b-4a8f-b571-ffd26783a122"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:18.692767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-217e752a-9dae-48bc-bbd8-ae46b8a7fcdc req-b1255f85-df76-4759-b6e8-f3e25d0a4889 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.694248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-217e752a-9dae-48bc-bbd8-ae46b8a7fcdc req-b1255f85-df76-4759-b6e8-f3e25d0a4889 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.712699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-217e752a-9dae-48bc-bbd8-ae46b8a7fcdc req-b1255f85-df76-4759-b6e8-f3e25d0a4889 service nova] Creating event network-changed:d7b4c8ec-2c9b-4a8f-b571-ffd26783a122 for instance 2fc3677c-c275-470e-97fc-e832134789c1 on nch1-master-1 May 14 21:13:18.721220 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-217e752a-9dae-48bc-bbd8-ae46b8a7fcdc req-b1255f85-df76-4759-b6e8-f3e25d0a4889 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065049 May 14 21:13:18.723073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 268/588] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:18.805020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:18.808050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:18.820803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:18.824144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:18.839742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.845839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.846856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.848194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.850255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.852145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:18.853191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:18.853918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.096338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:19.100079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:19.100582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:19.101916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:19.101916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:19.251205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:19.266555 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f82fefa-07e9-424e-a9d8-14d2ffe1ba6d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1470 microversion: 2.1 time: 0.451245 May 14 21:13:19.276019 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 269/589] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:18 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:19.279237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:19.282091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:19.295675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.297477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.300256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.300726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.393468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:19.404261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.405333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.406607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.407416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.652828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:19.663950 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24ac0021-9b6c-482a-8ae8-c6ecec2d1732 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.393671 May 14 21:13:19.676321 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 270/590] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:19 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:19.684106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:19.684983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:19.695081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.699273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:19.701800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.702444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.702900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.797519 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1608dba1-783a-48ff-9403-0d3f2e51c050 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d/action" status: 202 len: 1942 microversion: 2.75 time: 1.490573 May 14 21:13:19.813662 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 321/591] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:13:18 2022] POST /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d/action => generated 1942 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 14 21:13:19.826199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:19.828083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:19.843860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.844525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.846016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.846616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:19.978018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:19.985926 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02358a24-1925-49e1-bb38-986ef8f1af73 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.307783 May 14 21:13:19.987073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 271/592] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:19 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:19.991502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:19.992645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:19.998879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:19.999645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.001390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.002455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.146541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:20.210884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:20.219247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e8defea-fbe8-4277-97ea-59f756e3ef5e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.404360 May 14 21:13:20.230632 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 322/593] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:19 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:20.284375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:20.284994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:20.298227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.298700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.299531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.299988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.541102 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92890b0d-b254-4646-b83b-2e445cfa5013 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.552800 May 14 21:13:20.542386 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 272/594] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:19 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:20.566347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8fd97573-2e18-4465-8dae-35156783c9dd req-8f4af623-186d-4553-af94-61725dba95b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840d43fc-5b80-446f-8a49-9bd3739a0679", "name": "network-vif-plugged", "status": "completed", "tag": "b2de6a6b-fac3-4f46-8300-e24ecf292526"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:20.575356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8fd97573-2e18-4465-8dae-35156783c9dd req-8f4af623-186d-4553-af94-61725dba95b5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.575852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8fd97573-2e18-4465-8dae-35156783c9dd req-8f4af623-186d-4553-af94-61725dba95b5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.588517 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8fd97573-2e18-4465-8dae-35156783c9dd req-8f4af623-186d-4553-af94-61725dba95b5 service nova] Creating event network-vif-plugged:b2de6a6b-fac3-4f46-8300-e24ecf292526 for instance 840d43fc-5b80-446f-8a49-9bd3739a0679 on nch2-master-1 May 14 21:13:20.593927 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8fd97573-2e18-4465-8dae-35156783c9dd req-8f4af623-186d-4553-af94-61725dba95b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031206 May 14 21:13:20.594833 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 273/595] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:20.652371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:20.662836 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a557c16-fac2-496a-bfec-6cb787f80485 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1462 microversion: 2.1 time: 0.382175 May 14 21:13:20.668554 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 323/596] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:20 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1462 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:20.683564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:20.684419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d92d9b79-5682-46d6-a477-b2596e64cf87 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:20.690283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:20.694441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d92d9b79-5682-46d6-a477-b2596e64cf87 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:20.705566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.706451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.708250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.708998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.716288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d92d9b79-5682-46d6-a477-b2596e64cf87 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.717020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d92d9b79-5682-46d6-a477-b2596e64cf87 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.717839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d92d9b79-5682-46d6-a477-b2596e64cf87 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.718295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d92d9b79-5682-46d6-a477-b2596e64cf87 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.961786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:20.964962 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d92d9b79-5682-46d6-a477-b2596e64cf87 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1613 microversion: 2.1 time: 0.284522 May 14 21:13:20.966222 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 274/597] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:20 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1613 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:20.977011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4d4b5961-ca2b-4f6f-a29b-b5c19aa15de0 req-5a37a91c-cddf-48f6-8137-824b9650f7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e45e4ee-630a-46b5-81bc-8945dbcb4aa8", "tag": "dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:20.979985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4d4b5961-ca2b-4f6f-a29b-b5c19aa15de0 req-5a37a91c-cddf-48f6-8137-824b9650f7bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:20.980431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4d4b5961-ca2b-4f6f-a29b-b5c19aa15de0 req-5a37a91c-cddf-48f6-8137-824b9650f7bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:20.981336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-847b43fa-6c59-49a2-8e40-5af86dfa8f9b tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.301689 May 14 21:13:20.982080 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 324/598] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:20 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:20.997276 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4d4b5961-ca2b-4f6f-a29b-b5c19aa15de0 req-5a37a91c-cddf-48f6-8137-824b9650f7bc service nova] Creating event network-changed:dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5 for instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 on nch1-master-1 May 14 21:13:21.002791 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4d4b5961-ca2b-4f6f-a29b-b5c19aa15de0 req-5a37a91c-cddf-48f6-8137-824b9650f7bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035430 May 14 21:13:21.003387 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 275/599] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:21.143388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3485ee39-8649-4a12-970f-98c0e18fc010 tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2020851623", "id": 235619681, "os-flavor-access:is_public": "True"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:21.145054 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:21.145054 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:21.181327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e01eaaf-0be5-423b-895d-a18e053ffd32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b41008b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:21.233632 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3485ee39-8649-4a12-970f-98c0e18fc010 tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.228867 May 14 21:13:21.235043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 276/600] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:13:21 2022] POST /compute/v2.1/flavors => generated 465 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:21.239831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b80dedd-ff20-4236-a7d5-dea2913e34f9 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '.version_select at 0x7fb1a7fa3670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:21.242785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b80dedd-ff20-4236-a7d5-dea2913e34f9 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.242963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e01eaaf-0be5-423b-895d-a18e053ffd32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.243425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b80dedd-ff20-4236-a7d5-dea2913e34f9 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.244035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e01eaaf-0be5-423b-895d-a18e053ffd32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.249120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e01eaaf-0be5-423b-895d-a18e053ffd32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.249120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e01eaaf-0be5-423b-895d-a18e053ffd32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.253623 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0b80dedd-ff20-4236-a7d5-dea2913e34f9 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.017358 May 14 21:13:21.254221 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 277/601] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:13:21 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:21.259027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:21.259880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:21.267639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.268191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.269140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.269613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.361646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e01eaaf-0be5-423b-895d-a18e053ffd32 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f" status: 200 len: 240 microversion: 2.36 time: 0.378139 May 14 21:13:21.363306 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 325/602] 10.222.0.52 () {62 vars in 1302 bytes} [Sat May 14 21:13:20 2022] PUT /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f => generated 240 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:21.370503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:21.371899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:21.382373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.382847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.384148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.384646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.430677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:21.439292 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73a9a003-f213-4677-ade1-45ea47967ea0 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.184053 May 14 21:13:21.443600 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 278/603] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:21 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:21.521044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:21.528885 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97676934-d01e-4cd2-874a-afce53073757 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.163876 May 14 21:13:21.529624 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 326/604] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:21 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:21.534349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-98ea2d11-8184-4fd4-a335-4b1ee6317fd5 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Calling method '.version_select at 0x7fb1b4006b80>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:21.555274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e74f9d10-22b2-4485-9737-8170fb2f6abb tempest-FlavorsV261TestJSON-2065016996 tempest-FlavorsV261TestJSON-2065016996-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:21.565400 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e74f9d10-22b2-4485-9737-8170fb2f6abb tempest-FlavorsV261TestJSON-2065016996 tempest-FlavorsV261TestJSON-2065016996-project] 10.222.0.52 "GET /compute/v2.1/flavors/235619681" status: 200 len: 465 microversion: 2.61 time: 0.124388 May 14 21:13:21.565949 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 279/605] 10.222.0.52 () {60 vars in 1195 bytes} [Sat May 14 21:13:21 2022] GET /compute/v2.1/flavors/235619681 => generated 465 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:21.570567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1406311728", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:21.619528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:21.724258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98ea2d11-8184-4fd4-a335-4b1ee6317fd5 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.724999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98ea2d11-8184-4fd4-a335-4b1ee6317fd5 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.725762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98ea2d11-8184-4fd4-a335-4b1ee6317fd5 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.725979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98ea2d11-8184-4fd4-a335-4b1ee6317fd5 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.745070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-98ea2d11-8184-4fd4-a335-4b1ee6317fd5 tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f/detail" status: 200 len: 672 microversion: 2.36 time: 0.214205 May 14 21:13:21.753572 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 327/606] 10.222.0.52 () {60 vars in 1303 bytes} [Sat May 14 21:13:21 2022] GET /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f/detail => generated 672 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:21.765002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:21.765633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:21.775986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.776693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.777643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.778237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.861949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:21.862365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:21.862858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:21.863277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:21.863864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:21.874666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.875137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.875999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:21.876458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:21.878541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:21.894094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:21.899511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for user 5b93d6c3d03d407f8be4aa38e2fbb154 and project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:21.901657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18c2bae2-309d-46eb-a3d1-5c65bce960dd tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.154857 May 14 21:13:21.902257 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 328/607] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:21 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:21.908620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-877f823b-2b79-4d68-b0ef-0cf302a269e9 tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:21.910303 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:21.910303 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:21.913221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:13:21.915579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:13:22.063148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-877f823b-2b79-4d68-b0ef-0cf302a269e9 tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] 10.222.0.52 "PUT /compute/v2.1/flavors/235619681" status: 200 len: 466 microversion: 2.61 time: 0.159647 May 14 21:13:22.063975 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 329/608] 10.222.0.52 () {62 vars in 1215 bytes} [Sat May 14 21:13:21 2022] PUT /compute/v2.1/flavors/235619681 => generated 466 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:22.073861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7ffc310>, body: {"quota_set": {"ram": "2048"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:22.130372 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df9fe8d2-2956-410d-9e6b-102561d7b3e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563344 May 14 21:13:22.143350 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 280/609] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:13:22.148476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.155993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:22.167773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.168256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.169059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.169682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.367006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.367567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.368282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.368717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.369425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:22.379791 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8875aed4-fadc-4c4d-9012-246acca60229 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1332 microversion: 2.1 time: 0.235091 May 14 21:13:22.381098 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 281/610] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1332 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:22.393944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07fae79f-2353-4438-a82f-fda9a2422668 tempest-FlavorsV261TestJSON-2065016996 tempest-FlavorsV261TestJSON-2065016996-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.405997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.406455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.407247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.407731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.417849 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07fae79f-2353-4438-a82f-fda9a2422668 tempest-FlavorsV261TestJSON-2065016996 tempest-FlavorsV261TestJSON-2065016996-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 7156 microversion: 2.61 time: 0.036437 May 14 21:13:22.418423 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 282/611] 10.222.0.52 () {60 vars in 1186 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/flavors/detail => generated 7156 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:22.423129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec49b032-0861-4a5f-9bad-52e3fa990da2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.423768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ec49b032-0861-4a5f-9bad-52e3fa990da2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:22.477897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ec49b032-0861-4a5f-9bad-52e3fa990da2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:22.488309 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec49b032-0861-4a5f-9bad-52e3fa990da2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1213 microversion: 2.1 time: 0.066447 May 14 21:13:22.488309 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 283/612] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:22.491207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a03a1f1-c50e-45c6-a012-2d24d5866ddf tempest-FlavorsV261TestJSON-2065016996 tempest-FlavorsV261TestJSON-2065016996-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.516072 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0a03a1f1-c50e-45c6-a012-2d24d5866ddf tempest-FlavorsV261TestJSON-2065016996 tempest-FlavorsV261TestJSON-2065016996-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 3683 microversion: 2.61 time: 0.028585 May 14 21:13:22.516668 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 284/613] 10.222.0.52 () {60 vars in 1165 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/flavors => generated 3683 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:22.521267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.521881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:22.527869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.528317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.529091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.530182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.595968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-405037e9-5478-4573-8f14-b56b2b91f36f tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f?user_id=7f2e9af7c053469683f22d2a47ee2fdd" status: 200 len: 240 microversion: 2.36 time: 0.530653 May 14 21:13:22.596872 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 330/614] 10.222.0.52 () {62 vars in 1383 bytes} [Sat May 14 21:13:22 2022] PUT /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f?user_id=7f2e9af7c053469683f22d2a47ee2fdd => generated 240 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:22.601578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d848366-60de-496c-a611-4baabd71aa6c tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.602341 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:22.602341 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:22.684118 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d848366-60de-496c-a611-4baabd71aa6c tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/235619681" status: 202 len: 0 microversion: 2.61 time: 0.086014 May 14 21:13:22.685018 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 331/615] 10.222.0.52 () {60 vars in 1198 bytes} [Sat May 14 21:13:22 2022] DELETE /compute/v2.1/flavors/235619681 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:13:22.692683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.693315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:22.695375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:22.700005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.700669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.702032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.702816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.705581 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bc53d60c-8656-4af2-807a-48326476b556 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.187897 May 14 21:13:22.706445 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 285/616] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:22.711008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1f0dbd09-9c7f-4799-9ed7-b84c5b3253ff tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] Calling method '.version_select at 0x7fb1a7fd95e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.851058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:22.860325 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d0f0006b-16b0-4e8b-aacb-19cfca81f1a5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.173340 May 14 21:13:22.860915 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 332/617] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:22.876204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bd3dea09-1e31-41ba-88dc-4a2068567994 tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.901003 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bd3dea09-1e31-41ba-88dc-4a2068567994 tempest-FlavorsV261TestJSON-1204699199 tempest-FlavorsV261TestJSON-1204699199-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 6700 microversion: 2.61 time: 0.030150 May 14 21:13:22.903876 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 333/618] 10.222.0.52 () {60 vars in 1186 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/flavors/detail => generated 6700 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:22.925305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:22.926007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:22.932497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.933049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.933910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:22.934348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:22.996460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1f0dbd09-9c7f-4799-9ed7-b84c5b3253ff tempest-QuotasAdminTestV236-1715446111 tempest-QuotasAdminTestV236-1715446111-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f?user_id=7f2e9af7c053469683f22d2a47ee2fdd" status: 200 len: 282 microversion: 2.36 time: 0.289014 May 14 21:13:22.997035 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 286/619] 10.222.0.52 () {60 vars in 1363 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/os-quota-sets/a2e000a0124a45deb23d3a76ad36dc8f?user_id=7f2e9af7c053469683f22d2a47ee2fdd => generated 282 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:23.018479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:23.036977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54af9259-832c-4c9d-a433-765cf553fb4c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.115553 May 14 21:13:23.037774 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 334/620] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:22 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:23.396698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:23.397990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:23.404835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:23.405515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:23.407543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:23.407543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:23.506847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:23.509764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:23.519794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:23.519972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:23.521477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:23.521578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:23.589997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:23.606094 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c7f48f9e-2e7f-4f6d-bf8b-01ba47769a11 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1535 microversion: 2.1 time: 0.213118 May 14 21:13:23.606681 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 287/621] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:23 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1535 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:23.621132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:23.624206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b86b358-e856-4040-9e72-18b93f8d68ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'create', calling method: .version_select at 0x7fb1b40180d0>, body: {"pool": "01e3ef00-a182-4fcf-a405-9a420eb1352e"} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:23.656925 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24df36d6-c0c6-4404-b76a-249ff774223a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1217 microversion: 2.1 time: 0.155687 May 14 21:13:23.657529 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 335/622] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:23 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:23.722995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:23.723959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:23.732700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:23.733683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:23.735911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:23.736503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:24.013734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:24.026084 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec7cd642-1dda-430c-b747-089f9a910337 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.306564 May 14 21:13:24.027352 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 336/623] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:23 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:24.035270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:24.036144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:24.046986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:24.047710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:24.048638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:24.051455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:24.273339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:24.284888 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ddfd1336-be70-49ca-9be2-b275dac170eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.255572 May 14 21:13:24.286793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 337/624] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:24 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:24.300935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:24.302200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:24.308610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:24.309187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:24.314116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:24.314116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:24.413029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:24.432178 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b74e0979-eb7a-4e28-b356-9ec81f80e990 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.142920 May 14 21:13:24.432840 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 338/625] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:24 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:24.771109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1963329151", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:24.840047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:25.237587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:25.238152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:25.238737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:25.239290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:25.239837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:25.249702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.250367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.251673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.252186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.270656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Getting quotas for project e22dc54ae5e448b1ab5ebec0483c5dff. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:25.277703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Getting quotas for user d70bd5f4870740d8950b6033bdf74277 and project e22dc54ae5e448b1ab5ebec0483c5dff. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:25.299429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:13:25.301008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:13:25.464251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f080315-b00c-47e0-8c16-e40939658017 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025283 May 14 21:13:25.464990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 339/626] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:13:25.483532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:25.496165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:25.504821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.505381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.507058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.507620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.609413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:25.617159 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ef8766d-9e27-4d8b-9283-bbff3f8f9228 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1271 microversion: 2.1 time: 0.150874 May 14 21:13:25.627440 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 340/627] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:25 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:25.627440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:25.627440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:25.650534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.651005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.659428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.662528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.783209 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b86b358-e856-4040-9e72-18b93f8d68ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.163292 May 14 21:13:25.785877 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 288/628] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:13:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:25.795843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:25.796749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:25.814303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.818319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.818319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.818319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.935231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:25.952762 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-623891dd-fb3e-4b1c-b7a4-1c503959b612 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.333076 May 14 21:13:25.953745 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 341/629] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:25 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:25.960986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:25.962090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:25.978897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.979366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:25.980358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:25.980663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:26.082052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:26.114025 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9005610e-af00-4b33-a15a-300ea4af997b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.158747 May 14 21:13:26.115361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 342/630] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:25 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:26.121162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c11e2e90-fcda-4622-86f5-b1ab542b2522 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:26.123769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c11e2e90-fcda-4622-86f5-b1ab542b2522 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:26.145208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:26.176558 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e2bb399-7de6-42f8-9cfa-8f4e1d35e2a2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.389400 May 14 21:13:26.177170 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 289/631] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:25 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:26.192290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'action', calling method: .version_select at 0x7fb1b67dc790>, body: {"addFloatingIp": {"address": "172.35.4.163"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:26.193475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:26.206773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:26.207237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:26.208174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:26.218698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c11e2e90-fcda-4622-86f5-b1ab542b2522 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:26.228746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:26.232698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c11e2e90-fcda-4622-86f5-b1ab542b2522 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1214 microversion: 2.1 time: 0.115967 May 14 21:13:26.250999 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 343/632] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:26 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:26.327380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Acquired lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:13:26.636054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:26.636674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:26.647782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:26.648285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:26.649323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:26.649767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:26.962453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:26.969314 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-574e157e-017c-4e88-a0c7-5c5ee2922260 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1313 microversion: 2.1 time: 0.338614 May 14 21:13:26.974541 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 344/633] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:26 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:26.982035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:26.983157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:27.002998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:27.003918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:27.005219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:27.005895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:27.490286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:27.498986 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-323824fe-8f2d-4c8a-9a23-9519d26c72c4 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.521803 May 14 21:13:27.499591 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 345/634] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:26 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:27.504906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:27.505740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:27.514974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:27.515758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:27.516744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:27.517491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:27.959382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:27.991984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d0157383-12cd-4704-82a2-8e8e70a9b46d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.491095 May 14 21:13:28.003509 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 346/635] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:27 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:28.016355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0beeafef-0971-439d-88b1-13fb2a96f80d req-c94626b8-d7ca-497a-8cc4-56cbb32ccb38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fc3677c-c275-470e-97fc-e832134789c1", "name": "network-vif-plugged", "status": "completed", "tag": "d7b4c8ec-2c9b-4a8f-b571-ffd26783a122"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:28.027955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0beeafef-0971-439d-88b1-13fb2a96f80d req-c94626b8-d7ca-497a-8cc4-56cbb32ccb38 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.028485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0beeafef-0971-439d-88b1-13fb2a96f80d req-c94626b8-d7ca-497a-8cc4-56cbb32ccb38 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.044509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0beeafef-0971-439d-88b1-13fb2a96f80d req-c94626b8-d7ca-497a-8cc4-56cbb32ccb38 service nova] Creating event network-vif-plugged:d7b4c8ec-2c9b-4a8f-b571-ffd26783a122 for instance 2fc3677c-c275-470e-97fc-e832134789c1 on nch1-master-1 May 14 21:13:28.050282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0beeafef-0971-439d-88b1-13fb2a96f80d req-c94626b8-d7ca-497a-8cc4-56cbb32ccb38 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045520 May 14 21:13:28.051572 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 347/636] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:28.059056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:28.060445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:28.068254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.069055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.070285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.070943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.240909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Building network info cache for instance {{(pid=130638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:13:28.493903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:28.502727 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-647f26de-02fa-4923-8823-b60f0c955b4c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.449276 May 14 21:13:28.503309 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 348/637] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:28 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:28.512588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:28.513773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:28.520262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.521225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.522228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.522891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.602061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:28.615469 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44966a9a-a83f-428d-a0fc-255a09347d72 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1266 microversion: 2.1 time: 0.110754 May 14 21:13:28.633907 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 349/638] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:28 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:28.643876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-72d18617-5d33-41d7-b31f-dcd1db92d670 req-92126853-84c8-4274-8072-eece28601f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71dcc3c9-cd38-40e8-9060-8b3740681925", "tag": "b5e80fb6-d607-4cd2-bf6a-fc74ad375750"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:28.650065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-72d18617-5d33-41d7-b31f-dcd1db92d670 req-92126853-84c8-4274-8072-eece28601f1b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.650725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-72d18617-5d33-41d7-b31f-dcd1db92d670 req-92126853-84c8-4274-8072-eece28601f1b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.663144 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-72d18617-5d33-41d7-b31f-dcd1db92d670 req-92126853-84c8-4274-8072-eece28601f1b service nova] Creating event network-changed:b5e80fb6-d607-4cd2-bf6a-fc74ad375750 for instance 71dcc3c9-cd38-40e8-9060-8b3740681925 on nch2-master-1 May 14 21:13:28.669820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-72d18617-5d33-41d7-b31f-dcd1db92d670 req-92126853-84c8-4274-8072-eece28601f1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036372 May 14 21:13:28.678177 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 350/639] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:28.678439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:28.679086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:28.686802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.687260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.688089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:28.688844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:28.965255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:28.974270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d4e8e3b-e50a-4636-a1f6-375291f024de tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1313 microversion: 2.1 time: 0.301886 May 14 21:13:28.975108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 351/640] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:28 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:28.993020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-34849f39-d056-433c-8d05-948a55c39129 req-20bbbad7-acc5-4b90-a50a-64c757a846b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840d43fc-5b80-446f-8a49-9bd3739a0679", "tag": "b2de6a6b-fac3-4f46-8300-e24ecf292526"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:29.004554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-34849f39-d056-433c-8d05-948a55c39129 req-20bbbad7-acc5-4b90-a50a-64c757a846b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:29.005827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-34849f39-d056-433c-8d05-948a55c39129 req-20bbbad7-acc5-4b90-a50a-64c757a846b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:29.030659 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-34849f39-d056-433c-8d05-948a55c39129 req-20bbbad7-acc5-4b90-a50a-64c757a846b7 service nova] Creating event network-changed:b2de6a6b-fac3-4f46-8300-e24ecf292526 for instance 840d43fc-5b80-446f-8a49-9bd3739a0679 on nch2-master-1 May 14 21:13:29.040683 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-34849f39-d056-433c-8d05-948a55c39129 req-20bbbad7-acc5-4b90-a50a-64c757a846b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063899 May 14 21:13:29.043502 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 352/641] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:29.051357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:29.052394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:29.068188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:29.069056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:29.070082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:29.070867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:29.389431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:29.403314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Updating instance_info_cache with network_info: [{"id": "b2de6a6b-fac3-4f46-8300-e24ecf292526", "address": "fa:16:3e:01:ee:12", "network": {"id": "8f639cbb-5c05-497c-8ba5-726cc4b3ec5b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-108095288-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f9d24089740246829e483d7d6177125c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb2de6a6b-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:13:29.416455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-94562be0-9b0d-47eb-ba81-8a2800de3ebf tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1390 microversion: 2.1 time: 0.371341 May 14 21:13:29.429284 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 353/642] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:29 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1390 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:29.437175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:29.445302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:29.445302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:29.445302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:29.446578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:29.447167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:29.501393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Releasing lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:13:29.502684 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b4fe13f-5aae-4852-b7be-fcb1b9a9f093 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action" status: 202 len: 0 microversion: 2.1 time: 3.324565 May 14 21:13:29.503911 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 290/643] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:26 2022] POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action => generated 0 bytes in 3326 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:13:29.519036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1ac814d-2ede-4832-aace-bada24fec768 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'create', calling method: .version_select at 0x7fb1b4018d30>, body: {"pool": "01e3ef00-a182-4fcf-a405-9a420eb1352e"} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:29.648010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:29.715109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d15040fd-c4d3-4a40-95c7-43bdbb18684f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.284142 May 14 21:13:29.730651 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 354/644] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:29 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:29.730651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:29.730651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:29.743043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:29.745291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:29.747255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:29.749136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:30.140097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:30.149633 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-56db0a88-8e1e-4e56-a692-3fbc402f80f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.429090 May 14 21:13:30.150479 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 355/645] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:29 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:30.159823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:30.160911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:30.168736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:30.174097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:30.174097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:30.174097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:30.323294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:30.333847 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff48f088-0339-4908-9b9e-20387149c148 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1272 microversion: 2.1 time: 0.181366 May 14 21:13:30.334643 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 356/646] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:30 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:30.779126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34a714d8-3f24-4589-a56a-266d98688551 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Calling method '.version_select at 0x7fb1b40e5430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:30.780724 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:30.780724 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:30.782169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34a714d8-3f24-4589-a56a-266d98688551 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'dd162992e0bd406cb3f660676ddc23a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c337931c7391427c8dbda4f75806d7d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34a714d8-3f24-4589-a56a-266d98688551 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Request method failure captured: May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBt3TahrV6hL6srhivNDI6DTnMGnef8yPhm-HZa-idVNi586DFS0i51dSKT1g7dk1Vi6mJWcW48GOva5dHhfrKDUiI07vnrbSNoSzDSi1sR4brRSDRenSWyb1iSQxMsBXP26YEhCmr5PSWOYt5GxFEMhEASiSvHcNcGBhhPco5HuYeM May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:30.784075 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c337931c7391427c8dbda4f75806d7d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: dd162992e0bd406cb3f660676ddc23a5 May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:13:30.785865 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._detail(req) May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:30.786977 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 14 21:13:30.788491 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:30.790251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34a714d8-3f24-4589-a56a-266d98688551 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:30.790251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34a714d8-3f24-4589-a56a-266d98688551 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.449995 May 14 21:13:30.792572 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 357/647] 10.222.0.52 () {58 vars in 1166 bytes} [Sat May 14 21:13:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 457 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:30.808881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:30.809566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:30.824574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:30.824796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:30.826895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:30.828111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.302428 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1ac814d-2ede-4832-aace-bada24fec768 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.791134 May 14 21:13:31.303104 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 291/648] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:13:29 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:13:31.307865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-5ec6375b-db73-4004-b5d6-4e5255f45517 req-ad13ab0a-a678-4ba0-ad39-9ed6a61f066e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e45e4ee-630a-46b5-81bc-8945dbcb4aa8", "name": "network-vif-plugged", "status": "completed", "tag": "dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:31.316712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5ec6375b-db73-4004-b5d6-4e5255f45517 req-ad13ab0a-a678-4ba0-ad39-9ed6a61f066e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.317162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5ec6375b-db73-4004-b5d6-4e5255f45517 req-ad13ab0a-a678-4ba0-ad39-9ed6a61f066e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.331015 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-5ec6375b-db73-4004-b5d6-4e5255f45517 req-ad13ab0a-a678-4ba0-ad39-9ed6a61f066e service nova] Creating event network-vif-plugged:dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5 for instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 on nch1-master-1 May 14 21:13:31.336025 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-5ec6375b-db73-4004-b5d6-4e5255f45517 req-ad13ab0a-a678-4ba0-ad39-9ed6a61f066e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031475 May 14 21:13:31.336636 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 292/649] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:31.342413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:31.343117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:31.349422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.349886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.350715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.351113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.492401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:31.499167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:31.501556 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a74605b-9880-4318-9251-cd2e9fa77be9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1589 microversion: 2.1 time: 0.163727 May 14 21:13:31.509198 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d0caa0fd-1d97-4aac-a84a-5e4639d3289a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1313 microversion: 2.1 time: 0.715506 May 14 21:13:31.512792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 358/650] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:30 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:31.513172 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 293/651] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:31 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1589 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:31.518979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecefdc2c-26bf-4b52-b11c-bdf88816faad tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Calling method '.version_select at 0x7fb1a7fa3790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:31.520149 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:31.520149 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:31.521548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecefdc2c-26bf-4b52-b11c-bdf88816faad tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'dd162992e0bd406cb3f660676ddc23a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c337931c7391427c8dbda4f75806d7d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:31.521721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:31.522329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecefdc2c-26bf-4b52-b11c-bdf88816faad tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Request method failure captured: May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBt3TahrV6hL6srhivNDI6DTnMGnef8yPhm-HZa-idVNi586DFS0i51dSKT1g7dk1Vi6mJWcW48GOva5dHhfrKDUiI07vnrbSNoSzDSi1sR4brRSDRenSWyb1iSQxMsBXP26YEhCmr5PSWOYt5GxFEMhEASiSvHcNcGBhhPco5HuYeM May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:31.523276 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c337931c7391427c8dbda4f75806d7d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: dd162992e0bd406cb3f660676ddc23a5 May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: action_args: {} May 14 21:13:31.524821 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._index(req) May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:31.525750 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 14 21:13:31.527115 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:31.528478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecefdc2c-26bf-4b52-b11c-bdf88816faad tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:31.528478 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ecefdc2c-26bf-4b52-b11c-bdf88816faad tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.010123 May 14 21:13:31.528478 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 294/652] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:13:31 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:31.535975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.536629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.537520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.538034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.629980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:31.647573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-518f8f0f-1590-48e5-ac32-209fad62e7da tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7fd9e50>, body: {"quota_set": {"ram": "5120"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:31.650208 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f8bac263-14ca-46e0-b62f-ed9f1b60264f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.134619 May 14 21:13:31.650810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 359/653] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:31 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:31.655304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:31.655967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:31.662453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.662955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.663799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.664246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.712640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-518f8f0f-1590-48e5-ac32-209fad62e7da tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.713094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-518f8f0f-1590-48e5-ac32-209fad62e7da tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.713896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-518f8f0f-1590-48e5-ac32-209fad62e7da tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.714336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-518f8f0f-1590-48e5-ac32-209fad62e7da tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.794890 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-518f8f0f-1590-48e5-ac32-209fad62e7da tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7" status: 200 len: 148 microversion: 2.57 time: 0.267434 May 14 21:13:31.795880 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 295/654] 10.222.0.52 () {62 vars in 1302 bytes} [Sat May 14 21:13:31 2022] PUT /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7 => generated 148 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:31.801444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.166"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:31.802440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:31.811737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.812546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.813779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.814444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.844427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Acquired lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:13:31.871064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:31.879439 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-272f9c50-567f-4c34-93c8-8b4b668387f5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1317 microversion: 2.1 time: 0.227612 May 14 21:13:31.880268 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 360/655] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:31 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:31.884831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:31.885450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:31.892126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.892591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:31.893487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:31.893973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.114210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:32.126185 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f739b4b7-e473-4c17-96d4-f8798b41c5a8 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1314 microversion: 2.1 time: 0.243929 May 14 21:13:32.127598 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 361/656] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:31 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:32.135038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c62a146-eae6-491e-8034-991b050f6069 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:32.135918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c62a146-eae6-491e-8034-991b050f6069 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:32.143354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c62a146-eae6-491e-8034-991b050f6069 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.143928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c62a146-eae6-491e-8034-991b050f6069 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.145119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c62a146-eae6-491e-8034-991b050f6069 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.145809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c62a146-eae6-491e-8034-991b050f6069 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.268453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e.", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:13:32.269068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Releasing lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:13:32.269656 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] HTTP exception thrown: Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e. May 14 21:13:32.269656 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-338ecbc8-6a7b-4285-83f8-1e1ed98a9e7d'] May 14 21:13:32.276148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c62a146-eae6-491e-8034-991b050f6069 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147323 May 14 21:13:32.276827 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 362/657] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:13:32 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:32.283707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0bb1ef64-f198-4977-9f60-f0ca40a71a9c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Calling method '.version_select at 0x7fb1a7fab820>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:32.284727 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:32.284727 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:32.286138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0bb1ef64-f198-4977-9f60-f0ca40a71a9c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'dd162992e0bd406cb3f660676ddc23a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c337931c7391427c8dbda4f75806d7d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Request method failure captured: May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action HTTP/1.1 May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 46 May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtcPcZIUPoKZewgPgyhfhK7t-fvsC-xrq_1VQSrLrhpzXHH_1A7zjCFXke2mbC0wX9OcPOMBvjYQr3LAVEHWK_TwaXHTsLr2BLc-leD4e5v0PscfA85e2FEgSqRCFEgNJuUXg3oNLMZfpHwUjl_WjwZrWOpcmbyWLjfY7Zp4R_Iu34 May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f9d24089740246829e483d7d6177125c May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:32.286507 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9d24089740246829e483d7d6177125c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9d24089740246829e483d7d6177125c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f9d24089740246829e483d7d6177125c May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 34cd5580db494d05a9ea9cb37f714d27 May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: {"addFloatingIp": {"address": "172.35.4.166"}} May 14 21:13:32.288527 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: exception: Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e. May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-338ecbc8-6a7b-4285-83f8-1e1ed98a9e7d'] May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '840d43fc-5b80-446f-8a49-9bd3739a0679', 'body': {'addFloatingIp': {'address': '172.35.4.166'}}} May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2688, in associate_floating_ip May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:13:32.289426 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:13:32.290553 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e. May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-338ecbc8-6a7b-4285-83f8-1e1ed98a9e7d'] May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2690, in associate_floating_ip May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e. May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-338ecbc8-6a7b-4285-83f8-1e1ed98a9e7d'] May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:32.291542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e. May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-338ecbc8-6a7b-4285-83f8-1e1ed98a9e7d'] May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:32.292662 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e. May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-338ecbc8-6a7b-4285-83f8-1e1ed98a9e7d'] May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Returning 400 to user: Cannot associate floating IP 172.35.4.166 (a2faf582-c45e-445d-b6d3-cb3c52626184) with port b2de6a6b-fac3-4f46-8300-e24ecf292526 using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 01e3ef00-a182-4fcf-a405-9a420eb1352e. May 14 21:13:32.293700 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-338ecbc8-6a7b-4285-83f8-1e1ed98a9e7d'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:32.294356 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f5c1b8fb-c185-4602-a6fe-116273a607c9 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action" status: 400 len: 381 microversion: 2.1 time: 0.491500 May 14 21:13:32.294356 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 296/658] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:31 2022] POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action => generated 381 bytes in 496 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0bb1ef64-f198-4977-9f60-f0ca40a71a9c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Request method failure captured: May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBt3TahrV6hL6srhivNDI6DTnMGnef8yPhm-HZa-idVNi586DFS0i51dSKT1g7dk1Vi6mJWcW48GOva5dHhfrKDUiI07vnrbSNoSzDSi1sR4brRSDRenSWyb1iSQxMsBXP26YEhCmr5PSWOYt5GxFEMhEASiSvHcNcGBhhPco5HuYeM May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:32.297868 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c337931c7391427c8dbda4f75806d7d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: dd162992e0bd406cb3f660676ddc23a5 May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:13:32.299148 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:32.300217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 14 21:13:32.301563 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:32.302638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0bb1ef64-f198-4977-9f60-f0ca40a71a9c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:32.302638 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0bb1ef64-f198-4977-9f60-f0ca40a71a9c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.021490 May 14 21:13:32.305481 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 363/659] 10.222.0.52 () {58 vars in 1178 bytes} [Sat May 14 21:13:32 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:32.310706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afcd1ac9-475f-4294-bdc1-b2923619e955 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '.version_select at 0x7fb1b4100430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:32.313782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d80d3d9-0e5d-4dc2-ad64-6886395a2baf tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Calling method '.version_select at 0x7fb1a7fd7040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:32.385792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d80d3d9-0e5d-4dc2-ad64-6886395a2baf tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.386243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d80d3d9-0e5d-4dc2-ad64-6886395a2baf tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.387047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d80d3d9-0e5d-4dc2-ad64-6886395a2baf tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.387505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d80d3d9-0e5d-4dc2-ad64-6886395a2baf tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.415927 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d80d3d9-0e5d-4dc2-ad64-6886395a2baf tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7/detail" status: 200 len: 463 microversion: 2.57 time: 0.121532 May 14 21:13:32.417039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 297/660] 10.222.0.52 () {60 vars in 1303 bytes} [Sat May 14 21:13:32 2022] GET /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7/detail => generated 463 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:32.614105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Calling method '.version_select at 0x7fb1a7fd70d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:32.615066 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:32.615066 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:32.616435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.617389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.633183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.633992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.646149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.648083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.656455 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e290902e-b8d7-46ab-858d-ae9023d0a63a tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.238312 May 14 21:13:32.657634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 298/661] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:13:32 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:32.662664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:32.663671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:32.672714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.673546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:32.674513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:32.678974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.020538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:33.039797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b1d0c1f3-2f06-4769-9c85-c36f8457f032 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1313 microversion: 2.1 time: 0.380429 May 14 21:13:33.040760 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 299/662] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:32 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:33.045757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81c6a9b0-8f37-497e-a843-692b889d3043 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Calling method '.version_select at 0x7fb1a7fcb700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:33.046781 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:33.046781 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:33.048425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-81c6a9b0-8f37-497e-a843-692b889d3043 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'dd162992e0bd406cb3f660676ddc23a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c337931c7391427c8dbda4f75806d7d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81c6a9b0-8f37-497e-a843-692b889d3043 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Request method failure captured: May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBt3TahrV6hL6srhivNDI6DTnMGnef8yPhm-HZa-idVNi586DFS0i51dSKT1g7dk1Vi6mJWcW48GOva5dHhfrKDUiI07vnrbSNoSzDSi1sR4brRSDRenSWyb1iSQxMsBXP26YEhCmr5PSWOYt5GxFEMhEASiSvHcNcGBhhPco5HuYeM May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:33.050563 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c337931c7391427c8dbda4f75806d7d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: dd162992e0bd406cb3f660676ddc23a5 May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1'} May 14 21:13:33.052309 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:33.053237 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 14 21:13:33.054546 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:33.055761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81c6a9b0-8f37-497e-a843-692b889d3043 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:33.055761 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81c6a9b0-8f37-497e-a843-692b889d3043 tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.010081 May 14 21:13:33.057117 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 300/663] 10.222.0.52 () {58 vars in 1172 bytes} [Sat May 14 21:13:33 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:33.064152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:33.064774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:33.074674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.075197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.076909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.077252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.175796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:33.201341 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2152663-6f2e-4048-abb0-1d14ea60f80f tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.142503 May 14 21:13:33.201941 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 301/664] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:33 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:33.206889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7f64430>, body: {"quota_set": {"ram": "2048"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:33.272680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.273138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.273954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.274411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.314832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.315529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.316132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.316605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.470393 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6fe4edcb-303b-48a4-a194-f63d9a4d9038 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7?user_id=aa1f20066a404c08b847a6e03b2e8e2b" status: 200 len: 148 microversion: 2.57 time: 0.267109 May 14 21:13:33.471388 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 302/665] 10.222.0.52 () {62 vars in 1383 bytes} [Sat May 14 21:13:33 2022] PUT /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7?user_id=aa1f20066a404c08b847a6e03b2e8e2b => generated 148 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:33.480061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:33.480979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:33.489423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.490188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.491809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.492620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.596518 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afcd1ac9-475f-4294-bdc1-b2923619e955 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/a2faf582-c45e-445d-b6d3-cb3c52626184" status: 202 len: 0 microversion: 2.1 time: 1.289647 May 14 21:13:33.601025 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 364/666] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:13:32 2022] DELETE /compute/v2.1/os-floating-ips/a2faf582-c45e-445d-b6d3-cb3c52626184 => generated 0 bytes in 1295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:13:33.606170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-182cce2f-8a22-4636-b5d8-78eb08266767 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Calling method '.version_select at 0x7fb1b439e670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:33.607363 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:33.607363 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:13:33.608616 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-182cce2f-8a22-4636-b5d8-78eb08266767 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] HTTP exception thrown: Hypervisor with ID 'd857724d-a345-4f6e-a974-f2f824103815' could not be found. May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-182cce2f-8a22-4636-b5d8-78eb08266767 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Request method failure captured: May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hypervisors/d857724d-a345-4f6e-a974-f2f824103815/uptime HTTP/1.1 May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBt5hux-We62zcd-Y9R6M4et8fiIB-jfMFEfG52rMLxkm2NE6GIMGNhU6NhiDhu3xqDL5uoy2cUToIzLIJJX4LcOi90LAOraHejilv9rQpVByUJyB2YjPHwX1ve8EJHeQJAnnWKTFDZTfe4QYsCShxjw_czCg2qhcLx8ZBveqKsJkV0 May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 4282dcf3855e48dcafc787d50f0d7be8 May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1732712562 May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:13:33.616943 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4282dcf3855e48dcafc787d50f0d7be8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4282dcf3855e48dcafc787d50f0d7be8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4282dcf3855e48dcafc787d50f0d7be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4282dcf3855e48dcafc787d50f0d7be8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1732712562 May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 4282dcf3855e48dcafc787d50f0d7be8 May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1732712562 May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: a001c1a49ec347b790c55b13adbce8a2 May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: exception: Hypervisor with ID 'd857724d-a345-4f6e-a974-f2f824103815' could not be found. May 14 21:13:33.618612 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd857724d-a345-4f6e-a974-f2f824103815'} May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'd857724d-a345-4f6e-a974-f2f824103815' May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 14 21:13:33.619336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'd857724d-a345-4f6e-a974-f2f824103815' could not be found. May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:33.623843 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'd857724d-a345-4f6e-a974-f2f824103815' could not be found. May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-182cce2f-8a22-4636-b5d8-78eb08266767 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Returning 404 to user: Hypervisor with ID 'd857724d-a345-4f6e-a974-f2f824103815' could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-182cce2f-8a22-4636-b5d8-78eb08266767 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/d857724d-a345-4f6e-a974-f2f824103815/uptime" status: 404 len: 123 microversion: 2.1 time: 0.016164 May 14 21:13:33.626776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 365/667] 10.222.0.52 () {58 vars in 1277 bytes} [Sat May 14 21:13:33 2022] GET /compute/v2.1/os-hypervisors/d857724d-a345-4f6e-a974-f2f824103815/uptime => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:33.629184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:33.629810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:33.636655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.637108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.637893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.638977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.840393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:33.849074 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93d30352-9813-480b-a83e-c67e3743f38c tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1314 microversion: 2.1 time: 0.223721 May 14 21:13:33.849661 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 366/668] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:33 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:33.854986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ce9a91aa-c4f8-4852-ba74-f78b88732707 req-bd0757c6-da99-42ed-bb1d-fd7bb3a68972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e76cdc-0573-44c5-bbc5-4532124e2a3d", "tag": "b2904934-153d-424a-bb5c-c74d45510330"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:33.860868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:33.863280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ce9a91aa-c4f8-4852-ba74-f78b88732707 req-bd0757c6-da99-42ed-bb1d-fd7bb3a68972 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:33.863760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ce9a91aa-c4f8-4852-ba74-f78b88732707 req-bd0757c6-da99-42ed-bb1d-fd7bb3a68972 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:33.870826 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a50a016e-21d8-4aef-b909-2e24eca86cee tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1507 microversion: 2.1 time: 0.398199 May 14 21:13:33.871965 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 303/669] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:33 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1507 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:33.878904 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ce9a91aa-c4f8-4852-ba74-f78b88732707 req-bd0757c6-da99-42ed-bb1d-fd7bb3a68972 service nova] Creating event network-changed:b2904934-153d-424a-bb5c-c74d45510330 for instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d on nch1-master-1 May 14 21:13:33.884553 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ce9a91aa-c4f8-4852-ba74-f78b88732707 req-bd0757c6-da99-42ed-bb1d-fd7bb3a68972 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033365 May 14 21:13:33.886010 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 367/670] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:33.890220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8aea30bb-2169-4de5-b4ab-1b853ee8d756 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] Calling method '.version_select at 0x7fb1a7fcb820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:33.892963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'action', calling method: .version_select at 0x7fb1b67cf310>, body: {"removeFloatingIp": {"address": "172.35.4.163"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:34.001354 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8aea30bb-2169-4de5-b4ab-1b853ee8d756 tempest-QuotasAdminTestV257-1338515153 tempest-QuotasAdminTestV257-1338515153-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7?user_id=aa1f20066a404c08b847a6e03b2e8e2b" status: 200 len: 190 microversion: 2.57 time: 0.115859 May 14 21:13:34.003355 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 304/671] 10.222.0.52 () {60 vars in 1363 bytes} [Sat May 14 21:13:33 2022] GET /compute/v2.1/os-quota-sets/72e435aa5a414295b990584ccd3904a7?user_id=aa1f20066a404c08b847a6e03b2e8e2b => generated 190 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:13:34.006758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Calling method '.version_select at 0x7fb1b43c2670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:34.007677 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:34.007677 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:34.008979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.009561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.025133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.025665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.037935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.038477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.045137 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-34005d2f-9337-4c56-8f52-2c640510d6cd tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042011 May 14 21:13:34.046158 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 305/672] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:13:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:34.052135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:34.052135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:34.059047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.059047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.060846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.061341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.119289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:34.125944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.126399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.127202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.127670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.213779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:34.225358 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf597d59-0229-4970-a5a1-10221b0a515f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1507 microversion: 2.1 time: 0.178066 May 14 21:13:34.226398 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 306/673] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:34 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:34.241239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:34.241985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:34.248982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.249439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.250741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.251200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.443233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:34.452099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Acquired lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:13:34.453317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4d1c66f3-76e5-4259-85ef-45f4429b3c76 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1589 microversion: 2.1 time: 0.216525 May 14 21:13:34.454078 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 307/674] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:34 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1589 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:34.458955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-04b647a4-c1d4-4a82-8968-f34bdcb9e036 req-4ba0bf6c-3623-4d98-88c0-636ed31531ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fc3677c-c275-470e-97fc-e832134789c1", "tag": "d7b4c8ec-2c9b-4a8f-b571-ffd26783a122"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:34.467871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-04b647a4-c1d4-4a82-8968-f34bdcb9e036 req-4ba0bf6c-3623-4d98-88c0-636ed31531ea service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.468673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-04b647a4-c1d4-4a82-8968-f34bdcb9e036 req-4ba0bf6c-3623-4d98-88c0-636ed31531ea service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.484144 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-04b647a4-c1d4-4a82-8968-f34bdcb9e036 req-4ba0bf6c-3623-4d98-88c0-636ed31531ea service nova] Creating event network-changed:d7b4c8ec-2c9b-4a8f-b571-ffd26783a122 for instance 2fc3677c-c275-470e-97fc-e832134789c1 on nch1-master-1 May 14 21:13:34.490527 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-04b647a4-c1d4-4a82-8968-f34bdcb9e036 req-4ba0bf6c-3623-4d98-88c0-636ed31531ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034646 May 14 21:13:34.491462 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 308/675] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:34.499301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89d2545e-d38f-49ee-97fe-3a61888ccc0c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Calling method '.version_select at 0x7fb1a7f64160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:34.500745 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:34.500745 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:34.502336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-89d2545e-d38f-49ee-97fe-3a61888ccc0c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'dd162992e0bd406cb3f660676ddc23a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c337931c7391427c8dbda4f75806d7d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89d2545e-d38f-49ee-97fe-3a61888ccc0c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Request method failure captured: May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBt3TahrV6hL6srhivNDI6DTnMGnef8yPhm-HZa-idVNi586DFS0i51dSKT1g7dk1Vi6mJWcW48GOva5dHhfrKDUiI07vnrbSNoSzDSi1sR4brRSDRenSWyb1iSQxMsBXP26YEhCmr5PSWOYt5GxFEMhEASiSvHcNcGBhhPco5HuYeM May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:34.504687 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c337931c7391427c8dbda4f75806d7d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c337931c7391427c8dbda4f75806d7d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c337931c7391427c8dbda4f75806d7d2 May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372 May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: dd162992e0bd406cb3f660676ddc23a5 May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1583621372-project May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1'} May 14 21:13:34.506017 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:34.507167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 14 21:13:34.508311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:34.512316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89d2545e-d38f-49ee-97fe-3a61888ccc0c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:34.513831 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89d2545e-d38f-49ee-97fe-3a61888ccc0c tempest-HypervisorAdminNegativeTestJSON-1583621372 tempest-HypervisorAdminNegativeTestJSON-1583621372-project] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020746 May 14 21:13:34.514628 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 309/676] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:13:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:34.521911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:34.526650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:34.538001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.538904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.541236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.542382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.734329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:34.742262 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-74e87190-0645-4aa4-acc4-278b54dd452d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1313 microversion: 2.1 time: 0.226364 May 14 21:13:34.752779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 310/677] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:34 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:34.758302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:34.759117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:34.766683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.767413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.768668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.770631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.856278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:34.875073 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e01efa27-8601-41fe-8d3e-957b91eb1ab7 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.120900 May 14 21:13:34.875710 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 311/678] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:34 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:34.881004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:34.882246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:34.888939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.889432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:34.890380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:34.890827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.000195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:35.000634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:35.001122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:35.002116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:35.002116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:35.295580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:35.304690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.305608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.307114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.307977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.346757 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4308d0b7-e4f1-4657-81c4-22e257bb6b9a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "POST /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8/action" status: 202 len: 1109 microversion: 2.1 time: 0.469937 May 14 21:13:35.347921 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 312/679] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:34 2022] POST /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8/action => generated 1109 bytes in 472 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 14 21:13:35.354319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e159fab-b39c-4a85-8eaa-a85a79139481 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Calling method '.version_select at 0x7fb1a7e5f3a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:35.355801 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:13:35.355801 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:13:35.357389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0e159fab-b39c-4a85-8eaa-a85a79139481 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] HTTP exception thrown: Hypervisor with ID '734ad95b-b586-4ab3-aa82-59a782e9700c' could not be found. May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e159fab-b39c-4a85-8eaa-a85a79139481 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Request method failure captured: May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hypervisors/734ad95b-b586-4ab3-aa82-59a782e9700c HTTP/1.1 May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBt5hux-We62zcd-Y9R6M4et8fiIB-jfMFEfG52rMLxkm2NE6GIMGNhU6NhiDhu3xqDL5uoy2cUToIzLIJJX4LcOi90LAOraHejilv9rQpVByUJyB2YjPHwX1ve8EJHeQJAnnWKTFDZTfe4QYsCShxjw_czCg2qhcLx8ZBveqKsJkV0 May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 4282dcf3855e48dcafc787d50f0d7be8 May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1732712562 May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:13:35.361468 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4282dcf3855e48dcafc787d50f0d7be8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4282dcf3855e48dcafc787d50f0d7be8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4282dcf3855e48dcafc787d50f0d7be8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4282dcf3855e48dcafc787d50f0d7be8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1732712562 May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 4282dcf3855e48dcafc787d50f0d7be8 May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1732712562 May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a001c1a49ec347b790c55b13adbce8a2 May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: exception: Hypervisor with ID '734ad95b-b586-4ab3-aa82-59a782e9700c' could not be found. May 14 21:13:35.366930 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '734ad95b-b586-4ab3-aa82-59a782e9700c'} May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '734ad95b-b586-4ab3-aa82-59a782e9700c' May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 14 21:13:35.367809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:13:35.369355 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '734ad95b-b586-4ab3-aa82-59a782e9700c' could not be found. May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '734ad95b-b586-4ab3-aa82-59a782e9700c' could not be found. May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e159fab-b39c-4a85-8eaa-a85a79139481 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] Returning 404 to user: Hypervisor with ID '734ad95b-b586-4ab3-aa82-59a782e9700c' could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e159fab-b39c-4a85-8eaa-a85a79139481 tempest-HypervisorAdminNegativeTestJSON-1732712562 tempest-HypervisorAdminNegativeTestJSON-1732712562-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors/734ad95b-b586-4ab3-aa82-59a782e9700c" status: 404 len: 123 microversion: 2.1 time: 0.014039 May 14 21:13:35.370771 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 313/680] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:13:35 2022] GET /compute/v2.1/os-hypervisors/734ad95b-b586-4ab3-aa82-59a782e9700c => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:35.378227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6d55a792-da77-4e3e-b5ca-eff5808b7cd2 req-32f2c57b-3fbf-42bd-9e60-1b08730134dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dcc3c9-cd38-40e8-9060-8b3740681925", "name": "network-vif-plugged", "status": "completed", "tag": "b5e80fb6-d607-4cd2-bf6a-fc74ad375750"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:35.391452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6d55a792-da77-4e3e-b5ca-eff5808b7cd2 req-32f2c57b-3fbf-42bd-9e60-1b08730134dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.392543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6d55a792-da77-4e3e-b5ca-eff5808b7cd2 req-32f2c57b-3fbf-42bd-9e60-1b08730134dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.407590 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6d55a792-da77-4e3e-b5ca-eff5808b7cd2 req-32f2c57b-3fbf-42bd-9e60-1b08730134dc service nova] Creating event network-vif-plugged:b5e80fb6-d607-4cd2-bf6a-fc74ad375750 for instance 71dcc3c9-cd38-40e8-9060-8b3740681925 on nch2-master-1 May 14 21:13:35.414694 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6d55a792-da77-4e3e-b5ca-eff5808b7cd2 req-32f2c57b-3fbf-42bd-9e60-1b08730134dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040524 May 14 21:13:35.416338 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 314/681] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:35.422131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:35.423616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:35.430907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.431147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.432389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.432535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.595651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:35.603896 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f489524-398d-468f-92d8-150779db5dad tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1314 microversion: 2.1 time: 0.186019 May 14 21:13:35.604521 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 315/682] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:35 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:35.610420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:35.611041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:35.619862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.620319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.621293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.621739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.795669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:35.805897 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dedf9557-b154-4ca0-8645-117bf6116f33 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.200044 May 14 21:13:35.816504 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 316/683] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:35 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:35.816504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:35.816504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:35.822384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.822384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:35.822384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:35.822384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:36.012711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:36.028080 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c15855f-7e29-4f65-8fd5-126d3707f314 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1313 microversion: 2.1 time: 0.219590 May 14 21:13:36.039838 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 317/684] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:35 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:36.046662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:36.047507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:36.053938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:36.054391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:36.055178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:36.056236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:36.131831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:36.151289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f0a22e7-94e4-4b42-9733-de5754d2c947 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.109448 May 14 21:13:36.160511 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 318/685] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:36 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:36.320156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Building network info cache for instance {{(pid=130637) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:13:36.352395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4aa4fa6d-43b1-4e73-ac86-f4da24a2141f req-ba2e290d-0dae-4874-8364-89043ce61862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "840d43fc-5b80-446f-8a49-9bd3739a0679", "tag": "b2de6a6b-fac3-4f46-8300-e24ecf292526"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:36.369445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4aa4fa6d-43b1-4e73-ac86-f4da24a2141f req-ba2e290d-0dae-4874-8364-89043ce61862 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:36.370277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4aa4fa6d-43b1-4e73-ac86-f4da24a2141f req-ba2e290d-0dae-4874-8364-89043ce61862 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:36.385968 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4aa4fa6d-43b1-4e73-ac86-f4da24a2141f req-ba2e290d-0dae-4874-8364-89043ce61862 service nova] Creating event network-changed:b2de6a6b-fac3-4f46-8300-e24ecf292526 for instance 840d43fc-5b80-446f-8a49-9bd3739a0679 on nch2-master-1 May 14 21:13:36.393162 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4aa4fa6d-43b1-4e73-ac86-f4da24a2141f req-ba2e290d-0dae-4874-8364-89043ce61862 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049003 May 14 21:13:36.394377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 319/686] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:13:36.630985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:36.637515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:36.647318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:36.648189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:36.649167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:36.649722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:36.909269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:36.932878 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0d2ed19-eb74-4357-9353-4e39c6824ed2 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1314 microversion: 2.1 time: 0.313948 May 14 21:13:36.933862 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 320/687] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:36 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:36.939951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:36.940817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:36.952618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:36.954475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:36.956768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:36.958616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:37.156546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:37.167719 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1dc3c9e9-fb66-4eaa-9d8d-3b3f1a1b6cd9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.232359 May 14 21:13:37.168321 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 321/688] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:36 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:37.180471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:37.181103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:37.214568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:37.216935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:37.217950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:37.218406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:37.440114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:37.453934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b10f7758-002a-4211-8c1d-5e9ab7790e79 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1313 microversion: 2.1 time: 0.284392 May 14 21:13:37.455132 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 322/689] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:37 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:37.461054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:37.461876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:37.478593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:37.479075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:37.480625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:37.481254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:37.603426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:37.624357 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82219328-32aa-44f5-a16b-78079dd7966d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.167287 May 14 21:13:37.635659 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 323/690] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:37 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:37.677647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Updating instance_info_cache with network_info: [{"id": "b2de6a6b-fac3-4f46-8300-e24ecf292526", "address": "fa:16:3e:01:ee:12", "network": {"id": "8f639cbb-5c05-497c-8ba5-726cc4b3ec5b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-108095288-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "f9d24089740246829e483d7d6177125c", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb2de6a6b-fa", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:13:37.985864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:37.985864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:37.985864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:37.985864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:37.986974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:37.986974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:37.987133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Releasing lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:13:37.987133 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ef76c5f-0083-41c0-a0c9-2b038094e35d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action" status: 202 len: 0 microversion: 2.1 time: 4.094596 May 14 21:13:37.987133 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 368/691] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:33 2022] POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action => generated 0 bytes in 4098 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:13:37.993026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c288e275-92d9-4986-9c93-f8451653bad4 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '.version_select at 0x7fb1a7f543a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:38.178734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:38.193292 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0c7b717e-4fdc-4c0e-80c3-5ffff9a2b2df tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1314 microversion: 2.1 time: 0.246782 May 14 21:13:38.203337 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 324/692] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:37 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:38.203337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:38.203337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:38.211073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.211589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.212386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.213155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.384229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:38.392095 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d36a74c-392c-48ee-b67d-e1edce84625e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.197225 May 14 21:13:38.392764 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 325/693] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:38 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:38.474568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:38.475591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:38.495678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.496230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.498132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.499920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.728127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:38.736906 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c2d95e85-44ed-456a-ade0-d0b7515a2ac0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1463 microversion: 2.1 time: 0.269144 May 14 21:13:38.752707 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 326/694] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:38 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1463 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:38.752707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:38.752707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:38.752707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.753133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.753133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.753133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.833002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:38.855872 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee131cbf-3b93-4150-8566-b6b83bf33489 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.117296 May 14 21:13:38.856627 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 327/695] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:38 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:38.863518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:38.865102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:38.872857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.873810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.874836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:38.875538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:38.977605 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c288e275-92d9-4986-9c93-f8451653bad4 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/1d1ab5eb-88d4-4000-af0d-9587f8ed91d2" status: 202 len: 0 microversion: 2.1 time: 0.988911 May 14 21:13:38.979341 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 369/696] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:13:37 2022] DELETE /compute/v2.1/os-floating-ips/1d1ab5eb-88d4-4000-af0d-9587f8ed91d2 => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:13:38.995289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d31b6a5-435e-4185-8bb3-3ff0e3cc9dda tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'action', calling method: .version_select at 0x7fb1b67cf3a0>, body: {"addFloatingIp": {"address": ""}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:38.995411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d31b6a5-435e-4185-8bb3-3ff0e3cc9dda tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Request method failure captured: May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action HTTP/1.1 May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 34 May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtcPcZIUPoKZewgPgyhfhK7t-fvsC-xrq_1VQSrLrhpzXHH_1A7zjCFXke2mbC0wX9OcPOMBvjYQr3LAVEHWK_TwaXHTsLr2BLc-leD4e5v0PscfA85e2FEgSqRCFEgNJuUXg3oNLMZfpHwUjl_WjwZrWOpcmbyWLjfY7Zp4R_Iu34 May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f9d24089740246829e483d7d6177125c May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:38.995725 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9d24089740246829e483d7d6177125c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9d24089740246829e483d7d6177125c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f9d24089740246829e483d7d6177125c May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 34cd5580db494d05a9ea9cb37f714d27 May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: {"addFloatingIp": {"address": ""}} May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:13:38.999098 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '840d43fc-5b80-446f-8a49-9bd3739a0679', 'body': {'addFloatingIp': {'address': ''}}} May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi '' May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:39.000184 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:13:39.001524 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:13:39.002954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 14 21:13:39.002954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.002954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d31b6a5-435e-4185-8bb3-3ff0e3cc9dda tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:39.002954 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d31b6a5-435e-4185-8bb3-3ff0e3cc9dda tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action" status: 400 len: 142 microversion: 2.1 time: 0.009066 May 14 21:13:39.002954 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 370/697] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:38 2022] POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action => generated 142 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:13:39.003412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Old instance type m1.heat2, new instance type m1.heat {{(pid=130638) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 21:13:39.010315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:39.010801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:39.011303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:39.011750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:39.012161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:39.022906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:39.024192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:39.034922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.034922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.035242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.035717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.068455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Acquired lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:13:39.238292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Releasing lock "refresh_cache-840d43fc-5b80-446f-8a49-9bd3739a0679" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:13:39.238915 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] HTTP exception thrown: floating IP not found May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Request method failure captured: May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action HTTP/1.1 May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 41 May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtcPcZIUPoKZewgPgyhfhK7t-fvsC-xrq_1VQSrLrhpzXHH_1A7zjCFXke2mbC0wX9OcPOMBvjYQr3LAVEHWK_TwaXHTsLr2BLc-leD4e5v0PscfA85e2FEgSqRCFEgNJuUXg3oNLMZfpHwUjl_WjwZrWOpcmbyWLjfY7Zp4R_Iu34 May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f9d24089740246829e483d7d6177125c May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:39.242006 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9d24089740246829e483d7d6177125c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9d24089740246829e483d7d6177125c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f9d24089740246829e483d7d6177125c May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 34cd5580db494d05a9ea9cb37f714d27 May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: {"addFloatingIp": {"address": "0.0.0.0"}} May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: exception: floating IP not found May 14 21:13:39.243316 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '840d43fc-5b80-446f-8a49-9bd3739a0679', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2684, in associate_floating_ip May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:39.244305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 14 21:13:39.248581 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:39.257371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Returning 404 to user: floating IP not found {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:39.257371 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60e0639f-35ba-422e-b323-01a3d5ef7291 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action" status: 404 len: 67 microversion: 2.1 time: 0.238920 May 14 21:13:39.257371 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 371/698] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:39 2022] POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action => generated 67 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:13:39.257371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-81257b7f-d737-4ad8-a0de-724efb1beea1 req-0414a90c-4f5d-4ddf-b4e1-4b190e3de71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e76cdc-0573-44c5-bbc5-4532124e2a3d", "name": "network-vif-plugged", "status": "completed", "tag": "b2904934-153d-424a-bb5c-c74d45510330"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:39.257996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-81257b7f-d737-4ad8-a0de-724efb1beea1 req-0414a90c-4f5d-4ddf-b4e1-4b190e3de71a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.258113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-81257b7f-d737-4ad8-a0de-724efb1beea1 req-0414a90c-4f5d-4ddf-b4e1-4b190e3de71a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.269544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-81257b7f-d737-4ad8-a0de-724efb1beea1 req-0414a90c-4f5d-4ddf-b4e1-4b190e3de71a service nova] Creating event network-vif-plugged:b2904934-153d-424a-bb5c-c74d45510330 for instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d on nch1-master-1 May 14 21:13:39.274441 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-81257b7f-d737-4ad8-a0de-724efb1beea1 req-0414a90c-4f5d-4ddf-b4e1-4b190e3de71a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029352 May 14 21:13:39.277724 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 372/699] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:39.283031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:39.283756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:39.290524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.291535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.292511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.293115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.297834 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8765bf05-8455-48b7-994d-b2d56269923a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925/action" status: 202 len: 0 microversion: 2.1 time: 0.439408 May 14 21:13:39.303613 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 328/700] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:38 2022] POST /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:13:39.312027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b53f762-c1ad-4f1a-a444-678e1f70cf4a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Action: 'action', calling method: .version_select at 0x7fb1b67dcd30>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:39.385527 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0b53f762-c1ad-4f1a-a444-678e1f70cf4a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b53f762-c1ad-4f1a-a444-678e1f70cf4a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Request method failure captured: May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action HTTP/1.1 May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 44 May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtcPcZIUPoKZewgPgyhfhK7t-fvsC-xrq_1VQSrLrhpzXHH_1A7zjCFXke2mbC0wX9OcPOMBvjYQr3LAVEHWK_TwaXHTsLr2BLc-leD4e5v0PscfA85e2FEgSqRCFEgNJuUXg3oNLMZfpHwUjl_WjwZrWOpcmbyWLjfY7Zp4R_Iu34 May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f9d24089740246829e483d7d6177125c May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:39.387275 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9d24089740246829e483d7d6177125c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9d24089740246829e483d7d6177125c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f9d24089740246829e483d7d6177125c May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 34cd5580db494d05a9ea9cb37f714d27 May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:13:39.393723 ncdv-master-1 devstack@n-api.service[130638]: exception: Floating IP not found for address 0.0.0.0. May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '840d43fc-5b80-446f-8a49-9bd3739a0679', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2912, in get_instance_id_by_floating_address May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2996, in _get_floating_ip_by_address May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:39.394510 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 14 21:13:39.395834 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:39.397052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b53f762-c1ad-4f1a-a444-678e1f70cf4a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:39.397052 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0b53f762-c1ad-4f1a-a444-678e1f70cf4a tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action" status: 404 len: 88 microversion: 2.1 time: 0.084667 May 14 21:13:39.397052 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 329/701] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:13:39 2022] POST /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679/action => generated 88 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:13:39.405400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:39.407091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:39.414543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.416678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.416678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.416678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.518217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:39.526473 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-770cec98-74d6-447e-895e-0b1da0ebb421 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1314 microversion: 2.1 time: 0.247453 May 14 21:13:39.535750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 373/702] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:39 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:39.535750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:39.535750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:39.538788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.539296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.540142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.540668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.569982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:13:39.586605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:39.595910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e23f1e02-954c-46b4-8845-56e709dcbf80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1472 microversion: 2.1 time: 0.201020 May 14 21:13:39.596485 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 330/703] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:39 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1472 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:39.600877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:39.601479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:39.618655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.618655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.618655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.618655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.763162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:39.772782 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-40a3e936-7cc9-4dd4-b574-e739aca6b6e7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.175277 May 14 21:13:39.773662 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 331/704] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:39 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:39.877333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:39.878209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:39.882516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c5d0524-fcf5-41fa-a67b-6d676cf2e3ba tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "DELETE /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 204 len: 0 microversion: 2.1 time: 0.353617 May 14 21:13:39.883915 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 374/705] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:13:39 2022] DELETE /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:13:39.884675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.885330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.886144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.886726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.894270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:39.896151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:39.904803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.905942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.907107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:39.907851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:39.973711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:39.993858 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c7cec95-6a27-4303-bfac-21ec6f11285c tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.121542 May 14 21:13:39.999271 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 332/706] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:39 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:13:40.107268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:40.109066 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2ef77306-0aed-403a-b651-281a1a84a6ff tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1541 microversion: 2.1 time: 0.220566 May 14 21:13:40.109745 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 375/707] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:39 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1541 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:40.543813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:40.544949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:40.551264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:40.551761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:40.552758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:40.553205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:40.621340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:40.622435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:40.629142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:40.629601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:40.630559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:40.631036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:40.785442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:40.799809 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-261a02dd-7a5b-4fc7-b2c0-e560832b6c32 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1314 microversion: 2.1 time: 0.260192 May 14 21:13:40.800799 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 333/708] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:40 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:40.806819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:40.814163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:40.819910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:40.820674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:40.822584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:40.823335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:40.846484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:40.860659 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8874a49-ee17-4d82-a78f-1196a20c8687 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1472 microversion: 2.1 time: 0.243137 May 14 21:13:40.863632 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 376/709] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:40 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1472 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:41.014656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:41.015395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:41.022905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.023361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.024162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.030014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.066612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:41.077560 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c69b49e-c4ae-488d-99b1-faac2cf86c83 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.272989 May 14 21:13:41.078522 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 334/710] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:40 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:41.128569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:41.129340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:41.133279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:41.140210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.143620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.143620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.143620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.159012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a61f6b4-061e-40c5-86f2-b43b5aa2e13a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.148715 May 14 21:13:41.159637 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 377/711] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:41 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:41.375067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:41.381363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ba14044-e1f5-4500-90fe-312a588336c3 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Calling method '.version_select at 0x7fb1a7fabaf0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:41.384355 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b5216330-61ce-4625-946c-aac366cecae0 tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1541 microversion: 2.1 time: 0.261640 May 14 21:13:41.384920 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 335/712] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:41 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1541 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:41.471891 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ba14044-e1f5-4500-90fe-312a588336c3 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 371 microversion: 2.1 time: 0.219787 May 14 21:13:41.472568 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 378/713] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:13:41 2022] GET /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:41.483890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e8d7f0d4-b0c2-446a-a587-b5ef58e45547 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7dc6ee0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:41.557605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8d7f0d4-b0c2-446a-a587-b5ef58e45547 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.558064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8d7f0d4-b0c2-446a-a587-b5ef58e45547 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.558879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8d7f0d4-b0c2-446a-a587-b5ef58e45547 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.559383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8d7f0d4-b0c2-446a-a587-b5ef58e45547 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.738844 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e8d7f0d4-b0c2-446a-a587-b5ef58e45547 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 328 microversion: 2.1 time: 0.259502 May 14 21:13:41.755745 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 336/714] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:13:41 2022] PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 328 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:41.822852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:41.823810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:41.831144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.832749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.833739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.834335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.885974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:41.889563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:41.894485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.895023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:41.895976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:41.896497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.084631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:42.086871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:42.096140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b4f971e-ff40-4dc1-a2dc-b76037151a7b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1472 microversion: 2.1 time: 0.215592 May 14 21:13:42.099312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c2fe34ff-a8e1-4e4d-bf6c-22c848955bfb tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1464 microversion: 2.1 time: 0.282311 May 14 21:13:42.101447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 379/715] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:41 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1464 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:42.106274 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 337/716] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:41 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1472 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:42.112248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-78c981fd-0665-4983-aadf-a64f6df8bdec req-97df93c9-37dd-4de0-a73e-914f3c90f0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "840d43fc-5b80-446f-8a49-9bd3739a0679", "name": "network-vif-deleted", "tag": "b2de6a6b-fac3-4f46-8300-e24ecf292526"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:42.121281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-78c981fd-0665-4983-aadf-a64f6df8bdec req-97df93c9-37dd-4de0-a73e-914f3c90f0b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.122062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-78c981fd-0665-4983-aadf-a64f6df8bdec req-97df93c9-37dd-4de0-a73e-914f3c90f0b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.135308 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-78c981fd-0665-4983-aadf-a64f6df8bdec req-97df93c9-37dd-4de0-a73e-914f3c90f0b7 service nova] Creating event network-vif-deleted:b2de6a6b-fac3-4f46-8300-e24ecf292526 for instance 840d43fc-5b80-446f-8a49-9bd3739a0679 on nch2-master-1 May 14 21:13:42.142334 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-78c981fd-0665-4983-aadf-a64f6df8bdec req-97df93c9-37dd-4de0-a73e-914f3c90f0b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 May 14 21:13:42.143294 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 338/717] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:42.150690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:42.151933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:42.161195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.161904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.162922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.163713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.345492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-766971293", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:42.363191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:42.376381 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d032fd32-c07c-4d4b-92cf-bed5556a8073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.231634 May 14 21:13:42.383547 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 339/718] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:42 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:42.422159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:42.523007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a02b4cb8-1115-4260-a631-935d3dcc2860 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Calling method '.version_select at 0x7fb1b45000d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:42.533017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a02b4cb8-1115-4260-a631-935d3dcc2860 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.533474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a02b4cb8-1115-4260-a631-935d3dcc2860 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.554234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a02b4cb8-1115-4260-a631-935d3dcc2860 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.555080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a02b4cb8-1115-4260-a631-935d3dcc2860 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.574696 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a02b4cb8-1115-4260-a631-935d3dcc2860 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/e22dc54ae5e448b1ab5ebec0483c5dff?start=2022-05-13T21%3A13%3A42.112552&end=2022-05-15T21%3A13%3A42.112552" status: 200 len: 695 microversion: 2.1 time: 0.196291 May 14 21:13:42.576103 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 340/719] 10.222.0.52 () {58 vars in 1411 bytes} [Sat May 14 21:13:42 2022] GET /compute/v2.1/os-simple-tenant-usage/e22dc54ae5e448b1ab5ebec0483c5dff?start=2022-05-13T21%3A13%3A42.112552&end=2022-05-15T21%3A13%3A42.112552 => generated 695 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:42.585509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:42.585509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:42.592585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.593050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.593845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.594647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.670901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:42.671084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:42.671510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:42.672022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:42.673030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:42.673511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:42.683517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.684042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.684926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.685478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.689227 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2ee78c7d-aed7-4063-8c63-e7171532425a tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.111661 May 14 21:13:42.689995 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 341/720] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:42 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:42.694781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:42.695642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:42.702220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.702661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.703648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.704084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.714692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Getting quotas for project 37f9dbed24f74b7bae0335805743c94e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:42.720705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Getting quotas for user b23781a2caba4b6e9b1995a63c557c48 and project 37f9dbed24f74b7bae0335805743c94e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:42.734116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.utils [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] cores quota exceeded for 37f9dbed24f74b7bae0335805743c94e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130637) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 14 21:13:42.734962 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 14 21:13:42.735536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.736008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.736460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lazy-loading 'fault' on Instance uuid 840d43fc-5b80-446f-8a49-9bd3739a0679 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Request method failure captured: May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 144 May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBuEQ043zg61x_lAhnDFFYQ7LaXuatN2uz6LwIFgsxzDDPTosgDku1EBIXKobYpxGJIUUKOoD4_a4ttIx-NVfAiMLLL0sIXHhUvStAP_IMvkn-5lxoMXXynXsJsRaVpnWIvF58IAqidMg3a6kgzuow-NnzfQ8z9RMtR6w-PZveDz7Vk May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:42.738630 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37f9dbed24f74b7bae0335805743c94e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b23781a2caba4b6e9b1995a63c557c48 May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-766971293", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} May 14 21:13:42.740023 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-766971293', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452'}}} May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 14 21:13:42.740746 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:42.741797 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:42.742959 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d6140e65-3444-4746-a3fb-3bfb09ac83e0 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.636993 May 14 21:13:42.745289 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 380/721] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:42 2022] POST /compute/v2.1/servers => generated 111 bytes in 638 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:42.749399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4d3b7cf-4b5e-4aa6-a425-e65f77c135d5 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '.version_select at 0x7fb1a7fa6d30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:42.757917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4d3b7cf-4b5e-4aa6-a425-e65f77c135d5 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.758447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4d3b7cf-4b5e-4aa6-a425-e65f77c135d5 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.781572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4d3b7cf-4b5e-4aa6-a425-e65f77c135d5 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.782222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4d3b7cf-4b5e-4aa6-a425-e65f77c135d5 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.795109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34cd5580db494d05a9ea9cb37f714d27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9d24089740246829e483d7d6177125c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:42.799048 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-46f112fd-f28e-4d57-92d8-a03fe867ed1c tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 200 len: 1322 microversion: 2.1 time: 0.107885 May 14 21:13:42.800015 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 342/722] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:42 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 1322 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:42.802305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4d3b7cf-4b5e-4aa6-a425-e65f77c135d5 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage/e22dc54ae5e448b1ab5ebec0483c5dff?start=2022-05-13T21%3A13%3A42.112552&end=2022-05-15T21%3A13%3A42.112552" status: 200 len: 694 microversion: 2.1 time: 0.057153 May 14 21:13:42.802961 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 381/723] 10.222.0.52 () {58 vars in 1411 bytes} [Sat May 14 21:13:42 2022] GET /compute/v2.1/os-simple-tenant-usage/e22dc54ae5e448b1ab5ebec0483c5dff?start=2022-05-13T21%3A13%3A42.112552&end=2022-05-15T21%3A13%3A42.112552 => generated 694 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:42.804591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-abbe333d-c76c-4d1c-9ac1-f9fa70600c88 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7dc6ee0>, body: {"quota_set": {"cores": 20}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:42.819146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1fb9c2b5-c269-4caf-8dd1-b39d83849e22 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Calling method '.version_select at 0x7fb1b4499790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:42.828026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb9c2b5-c269-4caf-8dd1-b39d83849e22 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.828486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb9c2b5-c269-4caf-8dd1-b39d83849e22 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.844920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb9c2b5-c269-4caf-8dd1-b39d83849e22 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.845593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb9c2b5-c269-4caf-8dd1-b39d83849e22 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.889554 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1fb9c2b5-c269-4caf-8dd1-b39d83849e22 tempest-TenantUsagesTestJSON-992047621 tempest-TenantUsagesTestJSON-992047621-project-admin] 10.222.0.52 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-13T21%3A13%3A42.112552&end=2022-05-15T21%3A13%3A42.112552&detailed=1" status: 200 len: 7800 microversion: 2.1 time: 0.073934 May 14 21:13:42.890165 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 382/724] 10.222.0.52 () {58 vars in 1334 bytes} [Sat May 14 21:13:42 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-13T21%3A13%3A42.112552&end=2022-05-15T21%3A13%3A42.112552&detailed=1 => generated 7800 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:42.906340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:42.908865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:42.913118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.913575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.914353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:42.914793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:42.942116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:13:43.017271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abbe333d-c76c-4d1c-9ac1-f9fa70600c88 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.017790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abbe333d-c76c-4d1c-9ac1-f9fa70600c88 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.018773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abbe333d-c76c-4d1c-9ac1-f9fa70600c88 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.019271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abbe333d-c76c-4d1c-9ac1-f9fa70600c88 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.225699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-abbe333d-c76c-4d1c-9ac1-f9fa70600c88 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 329 microversion: 2.1 time: 0.424559 May 14 21:13:43.226389 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 343/725] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:13:42 2022] PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 329 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:43.233184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:43.233184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:43.239503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.240705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.240917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.242090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.261642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f0cbd802-43bf-4415-8dc9-0e251feaaec0 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 204 len: 0 microversion: 2.1 time: 0.358867 May 14 21:13:43.262328 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 383/726] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:13:42 2022] DELETE /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:13:43.269775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-707f045a-2c01-4cdf-bb6d-2b9223f913ac tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Calling method '.version_select at 0x7fb1b48dc700>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:43.345021 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-707f045a-2c01-4cdf-bb6d-2b9223f913ac tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 371 microversion: 2.1 time: 0.080367 May 14 21:13:43.354215 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 384/727] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:13:43 2022] GET /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 371 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:43.354215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:43.354215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:43.361575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.362656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.363641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.364525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.437813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:43.445436 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-318d0620-df2a-42bf-a719-7915a2bee1e6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1472 microversion: 2.1 time: 0.217973 May 14 21:13:43.446015 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 344/728] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:43 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:43.451156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02dc9328-83d5-4c5d-b356-df17ebe3647f tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Action: 'update', calling method: .version_select at 0x7fb1b4125820>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:43.517681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02dc9328-83d5-4c5d-b356-df17ebe3647f tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.518743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02dc9328-83d5-4c5d-b356-df17ebe3647f tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.519680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02dc9328-83d5-4c5d-b356-df17ebe3647f tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.520229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02dc9328-83d5-4c5d-b356-df17ebe3647f tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.627380 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02dc9328-83d5-4c5d-b356-df17ebe3647f tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 328 microversion: 2.1 time: 0.180289 May 14 21:13:43.638771 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 345/729] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:13:43 2022] PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:43.640010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:43.644390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:43.645030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:43.649268 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-85bc8a53-9975-4b4a-818d-944a03938427 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1470 microversion: 2.1 time: 0.302207 May 14 21:13:43.650399 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 385/730] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:43 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1470 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:43.651371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.651874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.652661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.653107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.712512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:43.713556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:43.725318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.726023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.728376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.733624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.817854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:43.825860 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5612bf47-a174-4ccd-974e-dc1311026c3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.185532 May 14 21:13:43.826540 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 346/731] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:43 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:43.831257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-408443706", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:43.857877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:43.878175 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c9e3e12-a9c2-4d25-971d-cc3ae33fbc8b tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.169515 May 14 21:13:43.879060 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 386/732] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:43 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:13:43.884404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:43.887053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:43.887053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] [instance: 840d43fc-5b80-446f-8a49-9bd3739a0679] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:43.891264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.891769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.892548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:43.892990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:43.906886 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] HTTP exception thrown: Instance 840d43fc-5b80-446f-8a49-9bd3739a0679 could not be found. May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Request method failure captured: May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 HTTP/1.1 May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtcPcZIUPoKZewgPgyhfhK7t-fvsC-xrq_1VQSrLrhpzXHH_1A7zjCFXke2mbC0wX9OcPOMBvjYQr3LAVEHWK_TwaXHTsLr2BLc-leD4e5v0PscfA85e2FEgSqRCFEgNJuUXg3oNLMZfpHwUjl_WjwZrWOpcmbyWLjfY7Zp4R_Iu34 May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f9d24089740246829e483d7d6177125c May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:43.908639 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9d24089740246829e483d7d6177125c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9d24089740246829e483d7d6177125c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9d24089740246829e483d7d6177125c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f9d24089740246829e483d7d6177125c May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209 May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 34cd5580db494d05a9ea9cb37f714d27 May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 840d43fc-5b80-446f-8a49-9bd3739a0679 could not be found. May 14 21:13:43.909847 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '840d43fc-5b80-446f-8a49-9bd3739a0679'} May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 840d43fc-5b80-446f-8a49-9bd3739a0679 could not be found. May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:43.910577 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 840d43fc-5b80-446f-8a49-9bd3739a0679 could not be found. May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 840d43fc-5b80-446f-8a49-9bd3739a0679 could not be found. May 14 21:13:43.911855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:43.913040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] Returning 404 to user: Instance 840d43fc-5b80-446f-8a49-9bd3739a0679 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:43.913040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4040f635-e671-4a49-892f-9fa0981ade6d tempest-FloatingIPsAssociationNegativeTestJSON-660343209 tempest-FloatingIPsAssociationNegativeTestJSON-660343209-project] 10.222.0.52 "GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679" status: 404 len: 111 microversion: 2.1 time: 0.029801 May 14 21:13:43.913040 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 387/733] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:43 2022] GET /compute/v2.1/servers/840d43fc-5b80-446f-8a49-9bd3739a0679 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:44.086395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:44.086962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:44.087450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:44.087901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:44.088323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:44.098675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.099135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.100053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.100499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.119056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Getting quotas for project 37f9dbed24f74b7bae0335805743c94e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:44.124419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Getting quotas for user b23781a2caba4b6e9b1995a63c557c48 and project 37f9dbed24f74b7bae0335805743c94e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:44.137108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.utils [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] instances quota exceeded for 37f9dbed24f74b7bae0335805743c94e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130638) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 14 21:13:44.138080 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Request method failure captured: May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 144 May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuEQ043zg61x_lAhnDFFYQ7LaXuatN2uz6LwIFgsxzDDPTosgDku1EBIXKobYpxGJIUUKOoD4_a4ttIx-NVfAiMLLL0sIXHhUvStAP_IMvkn-5lxoMXXynXsJsRaVpnWIvF58IAqidMg3a6kgzuow-NnzfQ8z9RMtR6w-PZveDz7Vk May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:44.141903 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37f9dbed24f74b7bae0335805743c94e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b23781a2caba4b6e9b1995a63c557c48 May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-408443706", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} May 14 21:13:44.143378 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-408443706', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452'}}} May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 14 21:13:44.144205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:44.145196 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:44.146424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33542b67-5e52-45bc-adfd-53d994ad369c tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.315805 May 14 21:13:44.149948 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 347/734] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:43 2022] POST /compute/v2.1/servers => generated 119 bytes in 317 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:44.152307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8d21d420-0200-44e8-80e8-92ac0df133b1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7f0e160>, body: {"quota_set": {"instances": 10}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:44.214535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d21d420-0200-44e8-80e8-92ac0df133b1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.214988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d21d420-0200-44e8-80e8-92ac0df133b1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.215821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d21d420-0200-44e8-80e8-92ac0df133b1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.216900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8d21d420-0200-44e8-80e8-92ac0df133b1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.453776 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8d21d420-0200-44e8-80e8-92ac0df133b1 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 329 microversion: 2.1 time: 0.305137 May 14 21:13:44.465095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 388/735] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:13:44 2022] PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 329 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:13:44.465256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:44.465256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:44.473136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aed53da0-13e3-4214-bfd1-ad6c6c5181ad tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Calling method '.version_select at 0x7fb1a7e69dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:44.473380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.473911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.474884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.475419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.578720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aed53da0-13e3-4214-bfd1-ad6c6c5181ad tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 371 microversion: 2.1 time: 0.109839 May 14 21:13:44.579416 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 389/736] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:13:44 2022] GET /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:44.595215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3cf6635a-e216-4909-8347-d04feb4e3eca tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7ffc040>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:44.685560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:44.695250 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1d32a33c-236f-41a3-a5d6-8ecdbcc7c8e2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1472 microversion: 2.1 time: 0.235096 May 14 21:13:44.705670 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 348/737] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:44 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1472 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:44.711171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cf6635a-e216-4909-8347-d04feb4e3eca tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.712531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cf6635a-e216-4909-8347-d04feb4e3eca tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.713314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cf6635a-e216-4909-8347-d04feb4e3eca tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.713770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cf6635a-e216-4909-8347-d04feb4e3eca tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.714381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:44.715741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:44.731306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.733609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.734955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.735710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.884852 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3cf6635a-e216-4909-8347-d04feb4e3eca tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 325 microversion: 2.1 time: 0.297441 May 14 21:13:44.885781 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 390/738] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:13:44 2022] PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 325 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:44.894415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:44.906526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:44.925890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:44.935368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.936258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.938943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.939844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.941438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf8b45c5-c558-48f1-be25-e03a3f6cc60e tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1470 microversion: 2.1 time: 0.233960 May 14 21:13:44.942523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 349/739] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:44 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1470 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:44.954067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:44.955190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:44.967451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.968934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:44.968934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:44.969515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.073924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:45.096487 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50eaccc0-5872-44e6-859b-4162108f358e tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.152704 May 14 21:13:45.097134 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 350/740] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:44 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:45.102397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-900038816", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:45.153926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:45.343095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:45.343572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:45.344057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:45.344468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:45.344878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:45.353344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.353785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.355229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.355716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.357827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:45.365505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5d99fdd-dbb1-49ec-92e6-ee07affa1957 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.478401 May 14 21:13:45.366446 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 391/741] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:44 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:45.385413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Getting quotas for project 37f9dbed24f74b7bae0335805743c94e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:45.391160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Getting quotas for user b23781a2caba4b6e9b1995a63c557c48 and project 37f9dbed24f74b7bae0335805743c94e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:45.404511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.utils [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] ram quota exceeded for 37f9dbed24f74b7bae0335805743c94e, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=130638) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 14 21:13:45.405028 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Request method failure captured: May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 144 May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuEQ043zg61x_lAhnDFFYQ7LaXuatN2uz6LwIFgsxzDDPTosgDku1EBIXKobYpxGJIUUKOoD4_a4ttIx-NVfAiMLLL0sIXHhUvStAP_IMvkn-5lxoMXXynXsJsRaVpnWIvF58IAqidMg3a6kgzuow-NnzfQ8z9RMtR6w-PZveDz7Vk May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:45.407086 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37f9dbed24f74b7bae0335805743c94e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b23781a2caba4b6e9b1995a63c557c48 May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-900038816", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} May 14 21:13:45.408422 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-900038816', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452'}}} May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 14 21:13:45.413052 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:45.414184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.415413 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b19c826-1a87-48cb-9f23-8907a3489135 tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.310452 May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 351/742] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:45 2022] POST /compute/v2.1/servers => generated 110 bytes in 312 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:45.420199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f8640ef-3d79-4053-b337-c1e20f3d2a30 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7e09f70>, body: {"quota_set": {"ram": 51200}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:45.426837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1127132642", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "50d8d8e6-f9b7-435c-a51a-cb3e21091d0c"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:45.492689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8640ef-3d79-4053-b337-c1e20f3d2a30 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.493353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8640ef-3d79-4053-b337-c1e20f3d2a30 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.494004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8640ef-3d79-4053-b337-c1e20f3d2a30 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.495708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8640ef-3d79-4053-b337-c1e20f3d2a30 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.502333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] validate_networks() for [('50d8d8e6-f9b7-435c-a51a-cb3e21091d0c', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:45.621285 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f8640ef-3d79-4053-b337-c1e20f3d2a30 tempest-QuotasAdminNegativeTest-659810881 tempest-QuotasAdminNegativeTest-659810881-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 200 len: 329 microversion: 2.1 time: 0.207316 May 14 21:13:45.629330 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 352/743] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:13:45 2022] PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 329 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:45.635232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0642b66-f50b-4207-877a-2ddbd11cb6cf tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Action: 'update', calling method: .version_select at 0x7fb1a7cf7550>, body: {"quota_set": {"ram": 0}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:45.639134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c0642b66-f50b-4207-877a-2ddbd11cb6cf tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b23781a2caba4b6e9b1995a63c557c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9dbed24f74b7bae0335805743c94e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0642b66-f50b-4207-877a-2ddbd11cb6cf tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Request method failure captured: May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e HTTP/1.1 May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 25 May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuEQ043zg61x_lAhnDFFYQ7LaXuatN2uz6LwIFgsxzDDPTosgDku1EBIXKobYpxGJIUUKOoD4_a4ttIx-NVfAiMLLL0sIXHhUvStAP_IMvkn-5lxoMXXynXsJsRaVpnWIvF58IAqidMg3a6kgzuow-NnzfQ8z9RMtR6w-PZveDz7Vk May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:45.641173 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37f9dbed24f74b7bae0335805743c94e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37f9dbed24f74b7bae0335805743c94e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 37f9dbed24f74b7bae0335805743c94e May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1150567896 May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b23781a2caba4b6e9b1995a63c557c48 May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-QuotasAdminNegativeTest-1150567896-project May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: {"quota_set": {"ram": 0}} May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 14 21:13:45.642648 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '37f9dbed24f74b7bae0335805743c94e', 'body': {'quota_set': {'ram': 0}}} May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:13:45.643534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.644695 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0642b66-f50b-4207-877a-2ddbd11cb6cf tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c0642b66-f50b-4207-877a-2ddbd11cb6cf tempest-QuotasAdminNegativeTest-1150567896 tempest-QuotasAdminNegativeTest-1150567896-project] 10.222.0.52 "PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e" status: 403 len: 116 microversion: 2.1 time: 0.011467 May 14 21:13:45.645995 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 353/744] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:13:45 2022] PUT /compute/v2.1/os-quota-sets/37f9dbed24f74b7bae0335805743c94e => generated 116 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:13:45.714420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:45.715338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:45.723222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.723715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.725154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.725626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.878851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:45.887586 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-39ccb601-81fc-4adc-a7c1-96006fc4a73a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.177931 May 14 21:13:45.888446 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 354/745] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:45 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:45.966759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:45.967906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:45.974796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.976572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:45.976572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:45.976572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.061596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:46.073938 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c56a708-87b3-4360-9d4e-41dd624c87a3 tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1428 microversion: 2.1 time: 0.119217 May 14 21:13:46.077306 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 355/746] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:45 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1428 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:46.109864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6cd1f051-9ffc-4402-862b-d513f562738e req-3fd00327-b0ec-4a31-ae8c-3a22223b08df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e76cdc-0573-44c5-bbc5-4532124e2a3d", "name": "network-vif-deleted", "tag": "b2904934-153d-424a-bb5c-c74d45510330"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:46.120594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6cd1f051-9ffc-4402-862b-d513f562738e req-3fd00327-b0ec-4a31-ae8c-3a22223b08df service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.121426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6cd1f051-9ffc-4402-862b-d513f562738e req-3fd00327-b0ec-4a31-ae8c-3a22223b08df service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.135619 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6cd1f051-9ffc-4402-862b-d513f562738e req-3fd00327-b0ec-4a31-ae8c-3a22223b08df service nova] Creating event network-vif-deleted:b2904934-153d-424a-bb5c-c74d45510330 for instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d on nch1-master-1 May 14 21:13:46.147529 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6cd1f051-9ffc-4402-862b-d513f562738e req-3fd00327-b0ec-4a31-ae8c-3a22223b08df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043426 May 14 21:13:46.149653 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 356/747] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:13:46.158047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:46.159237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:46.168218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.169685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.172797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.172797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.286086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:46.312642 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c47995cb-a5f9-40b8-9b57-34caeaa13097 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.160690 May 14 21:13:46.313594 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 357/748] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:46 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:46.360471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:46.361223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:46.361851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:46.369277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:46.369277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:46.377706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.378186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.379168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.379870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.386860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:46.388702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:46.396573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.403982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.403982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.403982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.404645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:46.406806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for user 038739f45c3d4ab09457d6eed20b41d4 and project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:46.422181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:13:46.425417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:13:46.588641 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e23e641-5536-47fe-b243-123a61d64e3e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.220751 May 14 21:13:46.595761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 392/749] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:13:46.601322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71fc7f0c-2254-482d-a01a-24e3a1c0fb3f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:46.603343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71fc7f0c-2254-482d-a01a-24e3a1c0fb3f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:46.617014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:46.625953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19c76c7e-0c33-49b7-a658-7ffd461d69d6 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.246742 May 14 21:13:46.627255 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 358/750] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:46 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:46.693119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71fc7f0c-2254-482d-a01a-24e3a1c0fb3f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:46.704595 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71fc7f0c-2254-482d-a01a-24e3a1c0fb3f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1211 microversion: 2.1 time: 0.107116 May 14 21:13:46.710561 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 393/751] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:46 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:46.906517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:46.907207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:46.921926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.922400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:46.923409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:46.927559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.080651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:47.089974 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4f43d4ce-0ee4-4f4e-a193-ddc718d1bd1d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.188756 May 14 21:13:47.091549 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 359/752] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:46 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:47.092204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:47.093040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:47.110128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:47.110611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.111398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:47.111899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.150132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:47.154225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.154706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lazy-loading 'fault' on Instance uuid f4e76cdc-0573-44c5-bbc5-4532124e2a3d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:47.221714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd70bd5f4870740d8950b6033bdf74277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e22dc54ae5e448b1ab5ebec0483c5dff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:47.249422 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9de4f9a1-27f5-4c6e-86ca-6b7c9da986de tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 200 len: 1304 microversion: 2.1 time: 0.158189 May 14 21:13:47.251216 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 394/753] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:47 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 1304 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:47.333283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:47.334521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:47.341410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:47.342336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.343132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:47.343576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.509394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:47.549985 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce69047b-19a1-4577-8c3b-6a5eaa351e43 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1929 microversion: 2.75 time: 0.220459 May 14 21:13:47.551052 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 360/754] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:47 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:47.646148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:47.647573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:47.654232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:47.654691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.655558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:47.656009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:47.729033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-990b15fa-ff76-4a43-9067-62d90b8705e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:47.730916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-990b15fa-ff76-4a43-9067-62d90b8705e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:47.812382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:47.821231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5927364b-97ca-4be9-a44d-cb1894a4ea3c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.180099 May 14 21:13:47.821954 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 395/755] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:47 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:47.830559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-990b15fa-ff76-4a43-9067-62d90b8705e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:47.837894 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-990b15fa-ff76-4a43-9067-62d90b8705e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1211 microversion: 2.1 time: 0.117141 May 14 21:13:47.838607 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 361/756] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:47 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1211 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:48.108882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:48.109870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:48.116933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.121478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.121478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.121478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.272128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:48.273009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] [instance: f4e76cdc-0573-44c5-bbc5-4532124e2a3d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:48.279621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.280090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.280899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.282355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.296351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:48.308930 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] HTTP exception thrown: Instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d could not be found. May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Request method failure captured: May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d HTTP/1.1 May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBty6AZwc7kX7z3OM5IMUGHD-_UB7EyayUN2JVBdQAZ7B39ayBmqzP-lWtNI0XX_T1yIZGDpJ9WG1wZ-3QnOzWlB3_zjopF2_WJSjuTFQB_RJk5sOuRG_tl-eILZdVGTIDqF6kQwn63MncceyRDBYkywkrYodAQsKIgoDpqLa7Zm3C4 May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: e22dc54ae5e448b1ab5ebec0483c5dff May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TenantUsagesTestJSON-1463131339 May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:13:48.311321 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e22dc54ae5e448b1ab5ebec0483c5dff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e22dc54ae5e448b1ab5ebec0483c5dff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e22dc54ae5e448b1ab5ebec0483c5dff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e22dc54ae5e448b1ab5ebec0483c5dff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TenantUsagesTestJSON-1463131339 May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: e22dc54ae5e448b1ab5ebec0483c5dff May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1463131339 May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TenantUsagesTestJSON-1463131339-project May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: d70bd5f4870740d8950b6033bdf74277 May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TenantUsagesTestJSON-1463131339-project May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d could not be found. May 14 21:13:48.312938 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'f4e76cdc-0573-44c5-bbc5-4532124e2a3d'} May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d could not be found. May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:48.313764 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d could not be found. May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d could not be found. May 14 21:13:48.315192 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:13:48.322495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] Returning 404 to user: Instance f4e76cdc-0573-44c5-bbc5-4532124e2a3d could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:48.322495 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d072d0ad-690b-479c-81b7-09c48d49586d tempest-TenantUsagesTestJSON-1463131339 tempest-TenantUsagesTestJSON-1463131339-project] 10.222.0.52 "GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d" status: 404 len: 111 microversion: 2.1 time: 0.045219 May 14 21:13:48.322495 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 362/757] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:48 2022] GET /compute/v2.1/servers/f4e76cdc-0573-44c5-bbc5-4532124e2a3d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:13:48.323219 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-98be1597-1373-4ee6-b653-8d6c033169b5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.211131 May 14 21:13:48.323219 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 396/758] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:48 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:48.571868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:48.572528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:48.579627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.580199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.581065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.581610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.692966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:48.713517 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81ee4b7f-acc5-4417-96b4-f0f0aaf07e9d tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1935 microversion: 2.75 time: 0.145275 May 14 21:13:48.714713 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 363/759] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:48 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1935 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:48.843279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:48.845155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:48.856397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:48.857135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:48.866532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.867183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.867428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.869041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.869727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.870343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:48.871928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:48.878911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:49.083584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:49.095816 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b03a30a-e031-4bb6-9f65-7a4689331dd8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1215 microversion: 2.1 time: 0.244118 May 14 21:13:49.096397 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 364/760] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:48 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1215 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:49.155768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:49.163524 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c4493c24-2ed6-4a9f-9c00-c3e5460fc578 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.328736 May 14 21:13:49.173669 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 397/761] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:48 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:49.337569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:49.338190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:49.359965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:49.361005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:49.361939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:49.362525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:49.617981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:49.626383 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7337fa44-f1b5-49ed-997c-fd417c721ac7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.292906 May 14 21:13:49.627228 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 365/762] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:49 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:49.737900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:49.738965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:49.748521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:49.749306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:49.750353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:49.751263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:49.862743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:49.902209 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4b9d6e85-4058-4936-843a-f9067b54ae98 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1935 microversion: 2.75 time: 0.168279 May 14 21:13:49.905036 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 398/763] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:49 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1935 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:50.113877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:50.114828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:50.121436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.121917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:50.123740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.124771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:50.180908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:50.182262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:50.195693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.198275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:50.201488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.201953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:50.236468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:50.244600 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c97c636-c25a-4c58-9c51-7acb5cb96277 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1263 microversion: 2.1 time: 0.135036 May 14 21:13:50.252159 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 366/764] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:50 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:50.645799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:50.647213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:50.654949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.656334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:50.657365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.658813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:50.706752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:50.714430 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fc6f72f7-d174-498b-ab65-38bf00302ea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.537349 May 14 21:13:50.719663 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 399/765] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:50 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:50.827414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:50.835698 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c8d792a-201f-4ed0-9d01-37864e372ff8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.194357 May 14 21:13:50.836848 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 367/766] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:50 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:50.927802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:50.929060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:50.938661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.939320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:50.940476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:50.940915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.071753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] Lazy-loading 'services' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:51.090055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11f9bc96-9727-44c5-8691-66604deb2e25 tempest-ServersAdmin275Test-2034250749 tempest-ServersAdmin275Test-2034250749-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1920 microversion: 2.75 time: 0.167868 May 14 21:13:51.099991 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 400/767] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:50 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1920 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:51.116468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:51.116980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:51.124665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.125361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.126167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.126643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.155262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:13:51.262784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:51.263626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:51.270208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.270953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.272013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.272680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.355804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:51.364315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c2037d3-e4ee-4b68-9f40-f121d0d29f82 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1269 microversion: 2.1 time: 0.105424 May 14 21:13:51.364908 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 401/768] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:51 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1269 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:51.473259 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-355d848b-03ed-460f-9c3f-4c00dd346888 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 204 len: 0 microversion: 2.75 time: 0.360270 May 14 21:13:51.474383 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 368/769] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:13:51 2022] DELETE /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:13:51.482743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:51.483624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:51.490113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.490872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.491755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.492416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.603511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:51.616107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:51.618203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:51.625068 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9cd33fb1-9ada-4ab2-b8d1-3a53996e6894 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1444 microversion: 2.75 time: 0.146408 May 14 21:13:51.626002 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 402/770] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:51 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:51.740954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:51.743005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:51.756973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.757724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.759981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.761169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.959360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:51.967973 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df90bf88-b7c2-471a-8b94-96cba2707f4f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.233778 May 14 21:13:51.968565 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 369/771] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:51 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:51.973510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:51.974131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:51.980482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.981294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:51.983075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:51.983897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.122676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1963469424", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:52.148748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:52.157008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b1bc06c-4151-4016-a945-1f21855ec65c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.187233 May 14 21:13:52.157557 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 370/772] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:51 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:52.195129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:13:52.381360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:52.382330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:52.389695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.390850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.391253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:13:52.391961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:13:52.396810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.396810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.397034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:13:52.397034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:13:52.397034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:13:52.405577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.406042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.406922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.407371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.426777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Getting quotas for project f04e1accfc534fb18e36d789a9cefde3. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:13:52.433272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Getting quotas for user 32240804909d4572880a0f419f49f61e and project f04e1accfc534fb18e36d789a9cefde3. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:13:52.451146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:13:52.453374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:13:52.541949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:52.549902 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b5e97e67-a571-4290-a1d8-ed99da6247f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.172538 May 14 21:13:52.551896 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 371/773] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:52 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:52.593221 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-757e60e9-6534-46fa-826b-f2ebfe5c0a05 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809700 May 14 21:13:52.595198 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 403/774] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:13:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:13:52.605846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ee03b00-7a1c-42a0-91d9-2e979fe1a087 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:52.607302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ee03b00-7a1c-42a0-91d9-2e979fe1a087 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:52.649252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:52.649921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:52.657364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.657858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.658971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.659418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.663763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ee03b00-7a1c-42a0-91d9-2e979fe1a087 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:52.671690 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ee03b00-7a1c-42a0-91d9-2e979fe1a087 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1222 microversion: 2.1 time: 0.069682 May 14 21:13:52.672834 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 372/775] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:52 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1222 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:52.745168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:52.755059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:52.756327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:52.764798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0458888b-9536-4420-b184-5bda165a27e5 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1444 microversion: 2.75 time: 0.119775 May 14 21:13:52.776756 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 404/776] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:52 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:13:52.986747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:52.988653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:52.997489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.998237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:52.999138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:52.999721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.158660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:53.167037 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d3709f75-b42f-47b8-98ef-d2d5ee26a891 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.186405 May 14 21:13:53.175665 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 373/777] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:52 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:53.175891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:53.176325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:53.182610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.183059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.184055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.185024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.485827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:53.492536 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-110650bc-008d-4fc8-9ea4-36f4f90dddbd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.322376 May 14 21:13:53.494403 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 405/778] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:53 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:53.567400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:53.568043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:53.574167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.574619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.576145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.576725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.690029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8fed5785-981f-4fed-862c-16815490a1cd tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:53.690797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8fed5785-981f-4fed-862c-16815490a1cd tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:53.758937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8fed5785-981f-4fed-862c-16815490a1cd tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:53.770750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:53.782056 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8fed5785-981f-4fed-862c-16815490a1cd tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1222 microversion: 2.1 time: 0.095586 May 14 21:13:53.792173 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 406/779] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:53 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:53.792376 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-51f1842b-e9be-4355-a9dc-94804f928b08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.223265 May 14 21:13:53.792376 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 374/780] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:53 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:53.792525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:53.792525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:53.799463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.799963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.800754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.801202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.841390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.841997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:53.842415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lazy-loading 'fault' on Instance uuid d5b7715f-7418-4c66-9619-21824b0e7d9d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:13:53.894576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:53.903216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:53.905860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3bff40a84e6f4a82b0c9fb0b155684c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c833726abf47f49b561df1966764d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:53.911667 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8058a9fa-2e02-486c-882b-a93785eb4fe7 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 200 len: 1449 microversion: 2.75 time: 0.127340 May 14 21:13:53.912256 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 407/781] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:53 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 1449 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:13:53.979995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-55d2b0cb-1e48-4262-ae34-4bb900a44acf req-8776781b-8604-4517-9804-5d56eaad7eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1790fe11-3d3e-47a9-ba6a-b7c026480bfe", "tag": "c79010d0-bc70-40cb-809d-4227f14fbcda"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:53.993101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55d2b0cb-1e48-4262-ae34-4bb900a44acf req-8776781b-8604-4517-9804-5d56eaad7eb2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:53.993101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55d2b0cb-1e48-4262-ae34-4bb900a44acf req-8776781b-8604-4517-9804-5d56eaad7eb2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.003650 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-55d2b0cb-1e48-4262-ae34-4bb900a44acf req-8776781b-8604-4517-9804-5d56eaad7eb2 service nova] Creating event network-changed:c79010d0-bc70-40cb-809d-4227f14fbcda for instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe on nch2-master-1 May 14 21:13:54.008569 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-55d2b0cb-1e48-4262-ae34-4bb900a44acf req-8776781b-8604-4517-9804-5d56eaad7eb2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033174 May 14 21:13:54.009390 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 375/782] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:54.186124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:54.186745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:54.192770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.193217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.194157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.194603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.395542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:54.404136 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-415d4f96-3d98-4a37-ba41-50678117294a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.222348 May 14 21:13:54.404741 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 408/783] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:54 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:54.511048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:54.512035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:54.518707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.519166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.520160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.520606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.794181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:54.810566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:54.813120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:54.854958 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04ff7d94-a029-4be7-9eff-347cf7729b60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.343413 May 14 21:13:54.857924 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 376/784] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:54 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:54.859806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.860497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.863554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.864372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.873334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:54.877518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:54.893304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.897278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:54.898170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:54.898654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:55.001264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:55.019535 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a19a0e97-9c6f-48b1-b27d-a6d4967510b2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1274 microversion: 2.1 time: 0.223133 May 14 21:13:55.020793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 409/785] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:54 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:55.025596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:55.026419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] [instance: d5b7715f-7418-4c66-9619-21824b0e7d9d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:55.033124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:55.033806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:55.034831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:55.035434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:55.052189 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] HTTP exception thrown: Instance d5b7715f-7418-4c66-9619-21824b0e7d9d could not be found. May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Request method failure captured: May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d HTTP/1.1 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtELrbOuTv3cJsjqUrcvoSWXc2EBAFc5iGt3O3sW5kKkL6MAvPIffqR6lvzfq6QnyRAGfXUxzA5_69KI80VOF3C8jMw9NzL23Etkm187306MUwLOd9onRvsxvIg2q288r2j1Eyq-ht-7SAewEDpp3ks6zLX2YqFisJ_IpYqvP9Rwy0 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.75 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f6c833726abf47f49b561df1966764d5 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersAdmin275Test-1538736458 May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:13:55.053851 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f6c833726abf47f49b561df1966764d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f6c833726abf47f49b561df1966764d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f6c833726abf47f49b561df1966764d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f6c833726abf47f49b561df1966764d5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersAdmin275Test-1538736458 May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f6c833726abf47f49b561df1966764d5 May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersAdmin275Test-1538736458 May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersAdmin275Test-1538736458-project May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 3bff40a84e6f4a82b0c9fb0b155684c4 May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersAdmin275Test-1538736458-project May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d5b7715f-7418-4c66-9619-21824b0e7d9d could not be found. May 14 21:13:55.060970 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd5b7715f-7418-4c66-9619-21824b0e7d9d'} May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b7715f-7418-4c66-9619-21824b0e7d9d could not be found. May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:13:55.061855 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b7715f-7418-4c66-9619-21824b0e7d9d could not be found. May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b7715f-7418-4c66-9619-21824b0e7d9d could not be found. May 14 21:13:55.063369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:13:55.064734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] Returning 404 to user: Instance d5b7715f-7418-4c66-9619-21824b0e7d9d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:13:55.064734 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d980229d-4c95-43fb-84e9-24c5aa0afec1 tempest-ServersAdmin275Test-1538736458 tempest-ServersAdmin275Test-1538736458-project] 10.222.0.52 "GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d" status: 404 len: 111 microversion: 2.75 time: 0.033849 May 14 21:13:55.064734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 410/786] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:13:55 2022] GET /compute/v2.1/servers/d5b7715f-7418-4c66-9619-21824b0e7d9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:13:55.255809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:55.260687 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-891a18f1-7b55-4cc8-844e-de3d74404feb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.401219 May 14 21:13:55.271349 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 377/787] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:54 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:55.425596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:55.438523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:55.449964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:55.450966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:55.452002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:55.452692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:55.627327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68409b45-041e-45f4-aa18-10063c559cff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7cf79d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:55.681910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68409b45-041e-45f4-aa18-10063c559cff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/f5eee2ef-12ac-4531-b286-1480d248c3db" status: 200 len: 662 microversion: 2.1 time: 0.063819 May 14 21:13:55.688165 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 378/788] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:55 2022] GET /compute/v2.1/images/f5eee2ef-12ac-4531-b286-1480d248c3db => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:55.688392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:55.694615 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34f82ee7-5547-46e6-aad5-79ca9a8ead94 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.276562 May 14 21:13:55.695522 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 411/789] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:55 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:55.700125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-459bb84f-beb3-4fb0-a785-2fd67a489641 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c65310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:55.742526 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-459bb84f-beb3-4fb0-a785-2fd67a489641 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/f5eee2ef-12ac-4531-b286-1480d248c3db" status: 200 len: 662 microversion: 2.1 time: 0.050867 May 14 21:13:55.744932 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 379/790] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:55 2022] GET /compute/v2.1/images/f5eee2ef-12ac-4531-b286-1480d248c3db => generated 662 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:55.874335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:55.875046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:55.890265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:55.891131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:55.895327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:55.896355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:56.044074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:56.046124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:56.054335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:56.056506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:56.057497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:56.058133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:56.173442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:56.189262 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-491b5b04-231b-4c1f-8a50-4a6099ea664c tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.318608 May 14 21:13:56.197511 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 412/791] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:55 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:56.202055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:56.214075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70840f19-cff6-4e29-aa60-8e21b52442c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1280 microversion: 2.1 time: 0.180732 May 14 21:13:56.226401 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 380/792] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:56 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:13:56.278869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:56.279693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:56.289614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:56.292892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:56.294292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:56.294804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:56.619374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:56.649404 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c8bd4a5-d8f6-4995-b27b-36d4d37f5c85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.370491 May 14 21:13:56.651530 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 413/793] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:56 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:56.713308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:56.713929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:56.722561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:56.723264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:56.724296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:56.724739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:57.047047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:57.061990 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8e6edf6f-0ce7-47c7-87c9-ea3260e4864b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.352528 May 14 21:13:57.063160 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 381/794] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:56 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:57.213138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:57.213871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:57.226162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:57.226617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:57.230117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:57.232892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:57.243947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:57.244836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:57.253098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:57.253560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:57.254357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:57.254801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:57.535710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:57.548258 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6b59da88-3a01-493b-8371-64759b54d41d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1322 microversion: 2.1 time: 0.317754 May 14 21:13:57.557685 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 382/795] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:57 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:57.672126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:57.672945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:57.679629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:57.684772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:57.684772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:57.684772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:57.742914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:57.752981 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f7be1146-3ac3-447f-afa2-dc345ea4f212 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.547192 May 14 21:13:57.753912 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 414/796] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:57 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:57.885473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:57.902012 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9732e876-d21c-42b5-809c-74c391ff3e13 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.238564 May 14 21:13:57.914572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 383/797] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:57 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:58.081531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:58.082458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:58.091226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.092225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.093465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.094096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.274463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23dd84ce-8c18-4d20-9772-14ceef4d84cf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7cf74c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:58.335781 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-23dd84ce-8c18-4d20-9772-14ceef4d84cf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/8b467e47-8342-4ff2-997c-461ff005f495" status: 200 len: 662 microversion: 2.1 time: 0.065154 May 14 21:13:58.343380 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 384/798] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:58 2022] GET /compute/v2.1/images/8b467e47-8342-4ff2-997c-461ff005f495 => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:13:58.353172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f5160c4d-fa43-4d16-8af6-ee0ab9016d9e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7fcb4c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:58.401921 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f5160c4d-fa43-4d16-8af6-ee0ab9016d9e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/8b467e47-8342-4ff2-997c-461ff005f495" status: 200 len: 662 microversion: 2.1 time: 0.051910 May 14 21:13:58.410045 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 385/799] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:13:58 2022] GET /compute/v2.1/images/8b467e47-8342-4ff2-997c-461ff005f495 => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:13:58.461482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:58.472055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f77ba1a7-ef4e-4156-975a-47cd1788c103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.395762 May 14 21:13:58.473286 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 415/800] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:58 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:58.565791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:58.566410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:58.573182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.573637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.574612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.575377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.638880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e249487a-7137-4eee-b374-a1e11202cd00 req-6008b8d3-a110-4ff3-ba20-b7f68c67de89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d60f4941-2ff2-4617-b99c-46ae90d97bce", "tag": "45254827-3761-4577-ac70-10de75efc370"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:13:58.665858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e249487a-7137-4eee-b374-a1e11202cd00 req-6008b8d3-a110-4ff3-ba20-b7f68c67de89 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.668326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e249487a-7137-4eee-b374-a1e11202cd00 req-6008b8d3-a110-4ff3-ba20-b7f68c67de89 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.705341 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e249487a-7137-4eee-b374-a1e11202cd00 req-6008b8d3-a110-4ff3-ba20-b7f68c67de89 service nova] Creating event network-changed:45254827-3761-4577-ac70-10de75efc370 for instance d60f4941-2ff2-4617-b99c-46ae90d97bce on nch1-master-1 May 14 21:13:58.718560 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e249487a-7137-4eee-b374-a1e11202cd00 req-6008b8d3-a110-4ff3-ba20-b7f68c67de89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087183 May 14 21:13:58.723577 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 416/801] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:13:58.773249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:58.774954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:58.786036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.786909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.788259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.788985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.804498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:58.816855 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd1b88e6-2abb-4fad-a2a3-c2213209639e tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1322 microversion: 2.1 time: 0.254394 May 14 21:13:58.816981 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 386/802] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:58 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:58.930308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:58.931871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:58.937838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.938457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:58.939366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:58.939965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:59.115194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:59.128211 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df3b3347-892f-4bca-9999-15c1ddc17f91 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.202296 May 14 21:13:59.129423 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 387/803] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:58 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:59.227687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:59.237045 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6aff03ee-31cc-4d9b-b9da-0d12151bfe85 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.470124 May 14 21:13:59.237654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 417/804] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:58 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:59.490306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:59.490923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:59.500039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:59.501920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:59.502723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:59.503188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:59.721209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:13:59.732923 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d3ef8a1e-aa22-45a9-b0dd-a6a66c73b8ec tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.244309 May 14 21:13:59.741014 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 388/805] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:59 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:13:59.835501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:13:59.836901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:13:59.852137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:59.860026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:13:59.860026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:13:59.860026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:00.118449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:00.134384 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21ce25b4-b64f-4a42-9564-52bc4b045ad8 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1322 microversion: 2.1 time: 0.299351 May 14 21:14:00.135043 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 418/806] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:13:59 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:00.147150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:00.151719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:00.154959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:00.155422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:00.156256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:00.156706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:00.254175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:00.254940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:00.266490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:00.266729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:00.273423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:00.274239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:00.320276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:00.328171 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-737a97b4-9be5-4c24-805e-504b814229ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.185903 May 14 21:14:00.328763 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 389/807] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:00 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:00.429576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-18de5fe2-5de3-4386-a560-e1a29628c58f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c72a60>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:00.486804 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-18de5fe2-5de3-4386-a560-e1a29628c58f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/aef3c5ec-81bc-420b-90f6-474e1c9bcd01" status: 200 len: 661 microversion: 2.1 time: 0.059771 May 14 21:14:00.488454 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 390/808] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:00 2022] GET /compute/v2.1/images/aef3c5ec-81bc-420b-90f6-474e1c9bcd01 => generated 661 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:14:00.503028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:00.505280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d61d93f5-8bbc-43ef-b944-16650942166d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c72040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:00.513125 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c71d93d-b8fa-415e-a514-98051685ec92 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.262280 May 14 21:14:00.519175 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 419/809] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:00 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:00.569956 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d61d93f5-8bbc-43ef-b944-16650942166d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/aef3c5ec-81bc-420b-90f6-474e1c9bcd01" status: 200 len: 661 microversion: 2.1 time: 0.074364 May 14 21:14:00.570616 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 391/810] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:00 2022] GET /compute/v2.1/images/aef3c5ec-81bc-420b-90f6-474e1c9bcd01 => generated 661 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:14:00.679686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1917301434", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:00.745598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:00.757852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:00.758532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:00.774761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:00.777163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:00.778519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:00.779547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.004639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:01.014867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcf4c557-1e6b-455e-bedb-4082c3cb67fe tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1514 microversion: 2.1 time: 0.271592 May 14 21:14:01.019912 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 392/811] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:00 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:01.025592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2517e1d0-77c2-4d04-bb1f-3fc5ed63a31a req-d951f9f1-bba8-4176-bc47-b0deb5c087cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1790fe11-3d3e-47a9-ba6a-b7c026480bfe", "name": "network-vif-plugged", "status": "completed", "tag": "c79010d0-bc70-40cb-809d-4227f14fbcda"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:01.041549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2517e1d0-77c2-4d04-bb1f-3fc5ed63a31a req-d951f9f1-bba8-4176-bc47-b0deb5c087cd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.043299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2517e1d0-77c2-4d04-bb1f-3fc5ed63a31a req-d951f9f1-bba8-4176-bc47-b0deb5c087cd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.065586 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2517e1d0-77c2-4d04-bb1f-3fc5ed63a31a req-d951f9f1-bba8-4176-bc47-b0deb5c087cd service nova] Creating event network-vif-plugged:c79010d0-bc70-40cb-809d-4227f14fbcda for instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe on nch2-master-1 May 14 21:14:01.077012 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2517e1d0-77c2-4d04-bb1f-3fc5ed63a31a req-d951f9f1-bba8-4176-bc47-b0deb5c087cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055593 May 14 21:14:01.080537 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 393/812] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:01.152678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:01.154125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:01.162847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.163309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.164126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.164566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.344027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:01.345111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:01.345751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:01.346343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:01.346914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:01.359189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.360309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.361145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.361582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.365783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:01.373648 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f61039ce-aeaf-4a64-b47d-25d42bace932 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1322 microversion: 2.1 time: 0.225797 May 14 21:14:01.387909 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 394/813] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:01 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:01.396439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:01.398641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:01.416604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.417069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.417858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.420377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Getting quotas for project 366727f0fe304593ae0a789b2f0eb0b2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:01.421491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.439243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Getting quotas for user dd53fb02767e4912bd762fa7d1e80a06 and project 366727f0fe304593ae0a789b2f0eb0b2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:01.460175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:01.462899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:01.580152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:01.587796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73ba936f-8bd2-44c4-b941-015328b2b143 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1311 microversion: 2.1 time: 0.198460 May 14 21:14:01.588464 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 395/814] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:01 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1311 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:01.653641 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b086c814-45b0-413f-af3c-1daba865510d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977598 May 14 21:14:01.654822 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 420/815] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:01.669129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:01.669825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:01.678105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.678896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.679968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:01.680652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:01.741741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-525571994", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:01.805647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:01.878651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:01.889372 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bdf93a7-7c3f-446c-848d-6235eb1dc1fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.232836 May 14 21:14:01.890102 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 421/816] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:01 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:01.960821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d42d011-f5cc-4cb1-808c-ca83563d55da tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Action: 'create', calling method: .version_select at 0x7fb1a7ffc310>, body: {"pool": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:02.033440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:02.034410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:02.035050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:02.036015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:02.036593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:02.046578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:02.047306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:02.048587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:02.049294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:02.070075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Getting quotas for project 873c930e94574326a2aa94a76fda4f0d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:02.076160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Getting quotas for user 3a998f4a4cc94a63ac7e939ffdb10917 and project 873c930e94574326a2aa94a76fda4f0d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:02.094573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:02.096953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:02.235261 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a1e4c57f-4a0f-49e0-86f5-106e3a014971 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645706 May 14 21:14:02.236984 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 396/817] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:02.243258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-748368856", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:02.325276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:02.750732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:02.751445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:02.752184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:02.753316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:02.754197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:02.766599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:02.767336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:02.768669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:02.769117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:02.792244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Getting quotas for project 366727f0fe304593ae0a789b2f0eb0b2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:02.801629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Getting quotas for user dd53fb02767e4912bd762fa7d1e80a06 and project 366727f0fe304593ae0a789b2f0eb0b2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:02.816814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:02.819177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:02.983752 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d815decd-205d-4408-9f17-82a1ed156735 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745416 May 14 21:14:02.987752 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 397/818] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:03.000606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:03.004035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:03.013301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:03.014734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:03.015915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:03.016586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:03.181182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:03.212016 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c91f24de-0054-4f44-a026-97f2a9bcb154 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1532 microversion: 2.1 time: 0.222265 May 14 21:14:03.213357 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 398/819] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:02 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1532 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:03.230651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1786152391", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:03.300785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:03.523928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:03.524863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:03.525215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:03.525754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:03.527839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:03.555101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:03.555853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:03.557470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:03.558088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:03.592973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Getting quotas for project 873c930e94574326a2aa94a76fda4f0d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:03.604407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Getting quotas for user 3a998f4a4cc94a63ac7e939ffdb10917 and project 873c930e94574326a2aa94a76fda4f0d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:03.645329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:03.651760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:03.865025 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a8f212b-8734-49d7-9869-01261e26aeb6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647788 May 14 21:14:03.867172 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 399/820] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:03.899386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:03.904516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:03.942349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:03.949070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:03.952064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:03.955511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:04.322795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:04.331151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-801597c4-d5d1-4879-a506-4f2eac0cc652 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1322 microversion: 2.1 time: 0.462819 May 14 21:14:04.337557 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 400/821] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:03 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:04.355573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:04.355573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:04.361101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:04.361503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:04.375297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:04.378092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:04.680159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:04.691158 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1103444c-f61a-4229-9cf5-13eb30afae81 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1493 microversion: 2.1 time: 0.352472 May 14 21:14:04.691832 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 401/822] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:04 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1493 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:04.716759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:04.717376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:04.741685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:04.742147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:04.743126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:04.744038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:04.970395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:04.980111 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5d00a96-8bb2-4df3-9352-40fbcd25d4b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.272204 May 14 21:14:04.984561 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 402/823] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:04 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:04.994874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:04.997344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:05.006087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.008085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.008892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.009500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.055181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d42d011-f5cc-4cb1-808c-ca83563d55da tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.163709 May 14 21:14:05.062828 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 422/824] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:14:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:05.070813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f41cdf57-a9de-4236-8ff1-29f646098b59 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:05.074652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f41cdf57-a9de-4236-8ff1-29f646098b59 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:05.096378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:05.104006 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-046f3550-8d13-4017-978f-3351e379340a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1213 microversion: 2.1 time: 0.117275 May 14 21:14:05.104910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 403/825] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:04 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:05.110023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:05.110879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:05.118567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.119261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.120292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.120897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.207619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f41cdf57-a9de-4236-8ff1-29f646098b59 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:05.215771 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f41cdf57-a9de-4236-8ff1-29f646098b59 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1214 microversion: 2.1 time: 0.158732 May 14 21:14:05.225813 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 423/826] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:05 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:05.344979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:05.354875 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4d2ed8cd-0cd6-4def-a140-75599b35d63a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1520 microversion: 2.1 time: 0.248729 May 14 21:14:05.355524 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 404/827] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:05 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:05.360276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-91db8bd2-be84-4f88-8653-798701775e57 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Calling method '.version_select at 0x7fb1a7e5f5e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:05.410842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-29fe9527-9fb0-4fcd-acff-4d3735ab376d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:05.411797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-29fe9527-9fb0-4fcd-acff-4d3735ab376d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:05.427743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-29fe9527-9fb0-4fcd-acff-4d3735ab376d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.428666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-29fe9527-9fb0-4fcd-acff-4d3735ab376d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.452666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-29fe9527-9fb0-4fcd-acff-4d3735ab376d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.453248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-29fe9527-9fb0-4fcd-acff-4d3735ab376d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.593722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-91db8bd2-be84-4f88-8653-798701775e57 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/63674aab-f84d-43b2-8a96-4ac1ef057a35" status: 200 len: 141 microversion: 2.1 time: 0.236982 May 14 21:14:05.604176 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 405/828] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:14:05 2022] GET /compute/v2.1/os-floating-ips/63674aab-f84d-43b2-8a96-4ac1ef057a35 => generated 141 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:05.612433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-74c666bc-dd51-41ec-8292-55aef122cf80 req-402e4013-b10c-4b74-9240-ca0dac048662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f4941-2ff2-4617-b99c-46ae90d97bce", "name": "network-vif-plugged", "status": "completed", "tag": "45254827-3761-4577-ac70-10de75efc370"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:05.623350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-74c666bc-dd51-41ec-8292-55aef122cf80 req-402e4013-b10c-4b74-9240-ca0dac048662 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.623896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-74c666bc-dd51-41ec-8292-55aef122cf80 req-402e4013-b10c-4b74-9240-ca0dac048662 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.638729 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-74c666bc-dd51-41ec-8292-55aef122cf80 req-402e4013-b10c-4b74-9240-ca0dac048662 service nova] Creating event network-vif-plugged:45254827-3761-4577-ac70-10de75efc370 for instance d60f4941-2ff2-4617-b99c-46ae90d97bce on nch1-master-1 May 14 21:14:05.654237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-74c666bc-dd51-41ec-8292-55aef122cf80 req-402e4013-b10c-4b74-9240-ca0dac048662 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058559 May 14 21:14:05.655699 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 406/829] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:05.661208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:05.663166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:05.679464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.679955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.691107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:05.691782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:05.898001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:05.905973 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e93b72e-8c29-4ee3-877b-c135032d87c5 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1322 microversion: 2.1 time: 0.248688 May 14 21:14:05.907621 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 407/830] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:05 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:05.913367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ad963aec-2ae4-4148-bc01-af6203bc892d tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Calling method '.version_select at 0x7fb1a7c659d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:06.211023 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-29fe9527-9fb0-4fcd-acff-4d3735ab376d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1644 microversion: 2.1 time: 0.983596 May 14 21:14:06.213264 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 424/831] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:05 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1644 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:06.219685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:06.220575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:06.231684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.232479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.233523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.234125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.406981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ad963aec-2ae4-4148-bc01-af6203bc892d tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.497957 May 14 21:14:06.407529 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 408/832] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:14:05 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:06.413697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:06.419396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:06.460341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.460799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.461590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.462092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.566478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:06.578429 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7936ff34-5e50-4d75-85a6-806e27877341 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1287 microversion: 2.1 time: 0.169569 May 14 21:14:06.587921 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 409/833] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:06 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1287 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:06.587921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04c80933-b1c3-4722-8c45-2603baaecc5e tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:06.587921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04c80933-b1c3-4722-8c45-2603baaecc5e tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:06.592161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04c80933-b1c3-4722-8c45-2603baaecc5e tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.592711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04c80933-b1c3-4722-8c45-2603baaecc5e tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.593589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04c80933-b1c3-4722-8c45-2603baaecc5e tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.594109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04c80933-b1c3-4722-8c45-2603baaecc5e tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.641617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:06.650753 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e36c7a07-d54e-4bf3-a96a-6699e239f580 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.436103 May 14 21:14:06.652402 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 425/834] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:06 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:06.664872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:06.666041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:06.678349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.679140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.679622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.680070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.749075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:06.758495 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c113e04b-37ac-4427-bea8-a5f80b85145f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1266 microversion: 2.1 time: 0.104648 May 14 21:14:06.768761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 426/835] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:06 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:06.768761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:06.768761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:06.774778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.775385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.776422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:06.777017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:06.822842 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04c80933-b1c3-4722-8c45-2603baaecc5e tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1644 microversion: 2.1 time: 0.241890 May 14 21:14:06.850944 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 410/836] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:06 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1644 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:06.864638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-064bd277-34e3-4348-8003-805711587bef tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Calling method '.version_select at 0x7fb1a7c72790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:07.120653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:07.130949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec99d312-7b08-4d66-9970-933e83429c9f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1520 microversion: 2.1 time: 0.369997 May 14 21:14:07.132474 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 427/837] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:06 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:07.137444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-acd0da77-47da-41eb-ac50-52569458ad96 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:07.139081 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:07.139081 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:14:07.144091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd0da77-47da-41eb-ac50-52569458ad96 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:07.144091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd0da77-47da-41eb-ac50-52569458ad96 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:07.144091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd0da77-47da-41eb-ac50-52569458ad96 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:07.144091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd0da77-47da-41eb-ac50-52569458ad96 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:07.169263 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-acd0da77-47da-41eb-ac50-52569458ad96 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.035402 May 14 21:14:07.169898 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 428/838] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:14:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:07.174962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:07.175805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:07.183180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:07.184477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:07.198934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:07.199864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:07.487012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:07.504089 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-91c685f0-3047-4c72-a07a-73ae8d3b1380 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1322 microversion: 2.1 time: 0.332959 May 14 21:14:07.520290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 429/839] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:07 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:07.531251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:07.532705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:07.540115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:07.540580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:07.545891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:07.545891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:07.587839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lazy-loading 'flavor' on Instance uuid 1790fe11-3d3e-47a9-ba6a-b7c026480bfe {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:14:07.604488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Going to try to live migrate instance to nch1-master-1 {{(pid=130637) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:14:08.267676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-064bd277-34e3-4348-8003-805711587bef tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/63674aab-f84d-43b2-8a96-4ac1ef057a35" status: 202 len: 0 microversion: 2.1 time: 1.406829 May 14 21:14:08.267676 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 411/840] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:14:06 2022] DELETE /compute/v2.1/os-floating-ips/63674aab-f84d-43b2-8a96-4ac1ef057a35 => generated 0 bytes in 1409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:08.275150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:08.276123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:08.286938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:08.287649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:08.288456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:08.288905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:08.628714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:08.637990 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-01c69640-011a-4f44-87e3-5ed852941a49 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1317 microversion: 2.1 time: 0.370072 May 14 21:14:08.639425 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 412/841] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:08 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:08.644531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:08.647799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:08.652110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:08.653506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:08.654308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:08.654785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:08.856639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:08.864665 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3bc33ca2-b69c-4de3-bfc3-2bf3b587363b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.223810 May 14 21:14:08.867812 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 413/842] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:08 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:08.875674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d2ec74b8-c47f-4e10-9992-b3c640ea4ce8 req-f293146c-f9ab-4436-bdd7-a31c8cfa0917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e45e4ee-630a-46b5-81bc-8945dbcb4aa8", "name": "network-vif-unplugged", "status": "completed", "tag": "dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:08.903301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d2ec74b8-c47f-4e10-9992-b3c640ea4ce8 req-f293146c-f9ab-4436-bdd7-a31c8cfa0917 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:08.904853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d2ec74b8-c47f-4e10-9992-b3c640ea4ce8 req-f293146c-f9ab-4436-bdd7-a31c8cfa0917 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:08.926046 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d2ec74b8-c47f-4e10-9992-b3c640ea4ce8 req-f293146c-f9ab-4436-bdd7-a31c8cfa0917 service nova] Creating event network-vif-unplugged:dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5 for instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 on nch1-master-1 May 14 21:14:08.931920 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d2ec74b8-c47f-4e10-9992-b3c640ea4ce8 req-f293146c-f9ab-4436-bdd7-a31c8cfa0917 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062493 May 14 21:14:08.933190 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 414/843] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:08.939247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:08.940178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:08.949252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:08.950330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:08.951242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:08.951937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:09.022723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:09.031653 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ebaf6203-7e16-4c80-bfe1-e459cf4322ad tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1272 microversion: 2.1 time: 0.096953 May 14 21:14:09.032745 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 415/844] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:08 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:09.038681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:09.042394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:09.046347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:09.046794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:09.047598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:09.048191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:09.099062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:14:09.460737 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5136b640-64b8-4e68-9a35-d033f7815183 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 204 len: 0 microversion: 2.1 time: 0.426394 May 14 21:14:09.467025 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 416/845] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:09 2022] DELETE /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:14:09.473056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:09.473773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:09.482034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:09.482493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:09.483280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:09.483745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:09.637788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:09.647125 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4790cff9-b4c2-4259-8cbd-282fb54c8cc0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1520 microversion: 2.1 time: 0.178389 May 14 21:14:09.649298 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 417/846] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:09 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:09.661125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f63f337a-ac83-47b4-a30b-9ce1816f5312 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Action: 'create', calling method: .version_select at 0x7fb1a7c25790>, body: {"pool": null} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:11.929956 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bbcd521d-233f-4b8b-bbfc-bbaf730d444c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe/action" status: 202 len: 0 microversion: 2.1 time: 4.408116 May 14 21:14:11.931634 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 430/847] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:07 2022] POST /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe/action => generated 0 bytes in 4410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:11.940811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:11.941899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:11.952142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:11.952609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:11.953406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:11.954023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.283790 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f63f337a-ac83-47b4-a30b-9ce1816f5312 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.634218 May 14 21:14:12.285416 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 418/848] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:14:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:12.292723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-55988b70-d57b-4232-940d-48f6986aa7d4 req-e941d111-155a-487d-a82b-62707d7d147b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b557786f-467b-4f39-b283-7c798215ba18", "tag": "cd79d740-e7bf-4fb9-a20e-1e35700ba976"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:12.304690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55988b70-d57b-4232-940d-48f6986aa7d4 req-e941d111-155a-487d-a82b-62707d7d147b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.305437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55988b70-d57b-4232-940d-48f6986aa7d4 req-e941d111-155a-487d-a82b-62707d7d147b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.321755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-55988b70-d57b-4232-940d-48f6986aa7d4 req-e941d111-155a-487d-a82b-62707d7d147b service nova] Creating event network-changed:cd79d740-e7bf-4fb9-a20e-1e35700ba976 for instance b557786f-467b-4f39-b283-7c798215ba18 on nch2-master-1 May 14 21:14:12.327985 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-55988b70-d57b-4232-940d-48f6986aa7d4 req-e941d111-155a-487d-a82b-62707d7d147b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040493 May 14 21:14:12.328842 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 419/849] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:12.334709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:12.335702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:12.343089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.343564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.344525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.345158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.352859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:12.362977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27a433d0-1f06-45b8-b76b-f63b5551e717 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1472 microversion: 2.1 time: 0.429271 May 14 21:14:12.364152 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 431/850] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:11 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1472 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:12.369167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:12.370010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:12.377442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.378249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.379244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.379946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.427623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:12.437173 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec6f9a4e-4c5a-42ef-8774-48a33b131cb9 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1647 microversion: 2.1 time: 0.106941 May 14 21:14:12.440042 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 420/851] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:12 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1647 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:12.452213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:12.453118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:12.459554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.460014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.460801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.461238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.624347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:12.635986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2494f6b6-4e08-4b90-8e9f-7439d6c3cd6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.194518 May 14 21:14:12.637183 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 421/852] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:12 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:12.642900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:12.643671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:12.649853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.650575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.651795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.653020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.656536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:12.666584 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53c4d828-0bd2-46b3-8782-c8ded35e8866 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1317 microversion: 2.1 time: 0.301266 May 14 21:14:12.667503 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 432/853] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:12 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:12.684171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:12.685148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:12.691945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.692840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.693836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.694541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.822700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:12.831235 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0a3de721-72fc-48bc-8d2f-6c5700e66587 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1314 microversion: 2.1 time: 0.192122 May 14 21:14:12.831865 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 422/854] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:12 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:12.836749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a2ad959d-4066-43f9-98a3-f52b1c67a0e8 req-9ec7146d-9acf-4421-b64c-c4c431ec7e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e45e4ee-630a-46b5-81bc-8945dbcb4aa8", "name": "network-vif-plugged", "status": "completed", "tag": "dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:12.846305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a2ad959d-4066-43f9-98a3-f52b1c67a0e8 req-9ec7146d-9acf-4421-b64c-c4c431ec7e98 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.846756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a2ad959d-4066-43f9-98a3-f52b1c67a0e8 req-9ec7146d-9acf-4421-b64c-c4c431ec7e98 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.859420 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a2ad959d-4066-43f9-98a3-f52b1c67a0e8 req-9ec7146d-9acf-4421-b64c-c4c431ec7e98 service nova] Creating event network-vif-plugged:dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5 for instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 on nch1-master-1 May 14 21:14:12.864515 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a2ad959d-4066-43f9-98a3-f52b1c67a0e8 req-9ec7146d-9acf-4421-b64c-c4c431ec7e98 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031209 May 14 21:14:12.865121 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 423/855] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:12.870325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6206c8f3-7d2d-46f7-ac34-3c80727fd94e req-f520d922-81ec-4939-8632-d6790d049d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "568afb67-d4f6-424e-82f4-150d00c3c6ee", "tag": "1ef02825-0b9d-4284-a41f-f07bc5e3e488"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:12.879683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6206c8f3-7d2d-46f7-ac34-3c80727fd94e req-f520d922-81ec-4939-8632-d6790d049d47 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.880133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6206c8f3-7d2d-46f7-ac34-3c80727fd94e req-f520d922-81ec-4939-8632-d6790d049d47 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.892954 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6206c8f3-7d2d-46f7-ac34-3c80727fd94e req-f520d922-81ec-4939-8632-d6790d049d47 service nova] Creating event network-changed:1ef02825-0b9d-4284-a41f-f07bc5e3e488 for instance 568afb67-d4f6-424e-82f4-150d00c3c6ee on nch2-master-1 May 14 21:14:12.898045 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6206c8f3-7d2d-46f7-ac34-3c80727fd94e req-f520d922-81ec-4939-8632-d6790d049d47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031507 May 14 21:14:12.898664 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 424/856] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:12.905277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:12.905982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:12.912757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.913212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:12.913987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:12.914593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:13.060091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:13.068083 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15e4772f-8bb0-4b10-929b-3ac33790a193 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.167912 May 14 21:14:13.068691 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 425/857] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:12 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:13.074690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2a620c81-70ae-41fd-b8b7-24056d1c683b tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Calling method '.version_select at 0x7fb1a7cf7b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:13.601000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:13.628837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd441a77-edab-44ee-b2b3-4ebb464efdfa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1520 microversion: 2.1 time: 0.949007 May 14 21:14:13.633372 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 433/858] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:12 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1520 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:13.836063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2fac570-5ced-47fd-a6d1-f7b2380a40ee tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:13.837454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b2fac570-5ced-47fd-a6d1-f7b2380a40ee tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] [instance: a6c7182c-4a24-4bc2-819d-7224bb490e83] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:13.845582 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b2fac570-5ced-47fd-a6d1-f7b2380a40ee tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] HTTP exception thrown: Instance a6c7182c-4a24-4bc2-819d-7224bb490e83 could not be found. May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2fac570-5ced-47fd-a6d1-f7b2380a40ee tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Request method failure captured: May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/a6c7182c-4a24-4bc2-819d-7224bb490e83/action HTTP/1.1 May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 15 May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBuPCb5GWMuUgI25NgbI6jEuveAv2TPQy5ma2TiIn6PD_rYz9y_KFQGGlxYbgnKTaNJRuu7kHd8EvtT72svo1XYwk2cvq9uA08peylLFCTV0Swq2VGxLlakqaMRSMkrn1gz7zpZOguJP0qd0Q8-GIB7sS6UZU4Nge1LOwHioF3CbgaM May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:14:13.848010 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224e7cf6cf474b02ac095458aa4add5d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: f936cc3ccd8b4fcdb55ab14c013ae684 May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: {"migrate": {}} May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:13.856562 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance a6c7182c-4a24-4bc2-819d-7224bb490e83 could not be found. May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'a6c7182c-4a24-4bc2-819d-7224bb490e83', 'body': {'migrate': {}}} May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c7182c-4a24-4bc2-819d-7224bb490e83 could not be found. May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:13.858046 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c7182c-4a24-4bc2-819d-7224bb490e83 could not be found. May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c7182c-4a24-4bc2-819d-7224bb490e83 could not be found. May 14 21:14:13.860417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:13.862496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2fac570-5ced-47fd-a6d1-f7b2380a40ee tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Returning 404 to user: Instance a6c7182c-4a24-4bc2-819d-7224bb490e83 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:13.862496 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b2fac570-5ced-47fd-a6d1-f7b2380a40ee tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/a6c7182c-4a24-4bc2-819d-7224bb490e83/action" status: 404 len: 111 microversion: 2.1 time: 0.214294 May 14 21:14:13.862496 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 434/859] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:13 2022] POST /compute/v2.1/servers/a6c7182c-4a24-4bc2-819d-7224bb490e83/action => generated 111 bytes in 216 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:13.866845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:13.867782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:13.877236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:13.878133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:13.879280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:13.879942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:14.106808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c32d3de24045bdbfce30559ea022e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97eb48c86b4d49f1b11b2b6380020f4b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:14.121760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-711afd59-02bf-4721-9339-8c24d5e3e6b5 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 200 len: 1647 microversion: 2.1 time: 0.267855 May 14 21:14:14.125396 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 435/860] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:13 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 1647 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:14.145562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:14.149290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:14.164569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:14.165898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:14.169841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:14.170506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:14.713538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:14.725791 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53837b91-1b98-4ff6-bab1-013197ca6af3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.588248 May 14 21:14:14.728416 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 436/861] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:14 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:14.743046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:14.743981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:14.757554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:14.762014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:14.762860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:14.763645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.093643 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2a620c81-70ae-41fd-b8b7-24056d1c683b tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5" status: 202 len: 0 microversion: 2.1 time: 2.023113 May 14 21:14:15.097432 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 426/862] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:14:13 2022] DELETE /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5 => generated 0 bytes in 2025 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:15.102943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:15.103905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:15.113583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.114053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.114863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.115312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.181182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:15.189960 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c5e45d1-840b-4c98-9053-b625b5679b13 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1317 microversion: 2.1 time: 0.460257 May 14 21:14:15.204275 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 437/863] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:14 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:15.209492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-901934626", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:15.266414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:15.341621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:15.350631 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-06f0c9fa-bbfd-4bc0-abe3-414596fcb3b4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1314 microversion: 2.1 time: 0.253859 May 14 21:14:15.362360 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 427/864] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:15 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:15.370045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:15.370699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:15.379088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.379790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.380768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.381374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.542240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:15.550807 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8757bf77-b491-4dd9-9579-4951cc303e08 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.187261 May 14 21:14:15.551306 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 428/865] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:15 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:15.555948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-de8fc7fc-4920-41cf-8f08-46445f8ca45f req-0ee8a146-560a-4079-90f6-f55de6b4368f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0682771c-4855-4853-9123-f03aa17b7b53", "tag": "7f69be99-9e4d-472a-a312-16dd01bfc172"}, {"name": "network-changed", "server_uuid": "6eef68d3-09e1-45d5-8cec-2e5649628310", "tag": "98713c9a-6a3b-4530-a828-26ae7e23cc8f"}, {"server_uuid": "2fc3677c-c275-470e-97fc-e832134789c1", "name": "network-vif-deleted", "tag": "d7b4c8ec-2c9b-4a8f-b571-ffd26783a122"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:15.568625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-de8fc7fc-4920-41cf-8f08-46445f8ca45f req-0ee8a146-560a-4079-90f6-f55de6b4368f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.569316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-de8fc7fc-4920-41cf-8f08-46445f8ca45f req-0ee8a146-560a-4079-90f6-f55de6b4368f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.584220 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-de8fc7fc-4920-41cf-8f08-46445f8ca45f req-0ee8a146-560a-4079-90f6-f55de6b4368f service nova] Creating event network-changed:7f69be99-9e4d-472a-a312-16dd01bfc172 for instance 0682771c-4855-4853-9123-f03aa17b7b53 on nch2-master-1 May 14 21:14:15.584767 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-de8fc7fc-4920-41cf-8f08-46445f8ca45f req-0ee8a146-560a-4079-90f6-f55de6b4368f service nova] Creating event network-changed:98713c9a-6a3b-4530-a828-26ae7e23cc8f for instance 6eef68d3-09e1-45d5-8cec-2e5649628310 on nch1-master-1 May 14 21:14:15.585265 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-de8fc7fc-4920-41cf-8f08-46445f8ca45f req-0ee8a146-560a-4079-90f6-f55de6b4368f service nova] Creating event network-vif-deleted:d7b4c8ec-2c9b-4a8f-b571-ffd26783a122 for instance 2fc3677c-c275-470e-97fc-e832134789c1 on nch1-master-1 May 14 21:14:15.598086 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-de8fc7fc-4920-41cf-8f08-46445f8ca45f req-0ee8a146-560a-4079-90f6-f55de6b4368f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.045384 May 14 21:14:15.598733 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 429/866] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:15.603877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:15.604573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:15.611929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.612460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.613245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.613681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.751972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:15.760592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bfe9ca12-feb0-41d4-b3fb-9130726c1a5d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1505 microversion: 2.1 time: 0.160170 May 14 21:14:15.761187 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 430/867] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:15 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:15.773060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d24c60e0-7d37-485c-b438-1470d192f056 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Calling method '.version_select at 0x7fb1a7cf7c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:15.811461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-d24c60e0-7d37-485c-b438-1470d192f056 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ab7a0989-7155-4013-a861-af844ba173c5 could not be found", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:14:15.812211 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d24c60e0-7d37-485c-b438-1470d192f056 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] HTTP exception thrown: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d24c60e0-7d37-485c-b438-1470d192f056 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Request method failure captured: May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5 HTTP/1.1 May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuZ1Nbeo1Wy7adebny8He0cDbY-zibCstTWYDMAnKPQtlSrcN_aJ-xTmOo-UUGZ-gFfLg9UO9ie20WyOKn90KhKcilrzq0WBsaSE9H6O92QbYzPRiRWMXKN8XNon27SNMnIpi3KHIKBviA6cUtBU1VOiZiF55KI_J5ksqc9rmsk4N8 May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c2856369dca645e88c940652f218dc3b May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPsTestJSON-1690542044 May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:15.814224 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2856369dca645e88c940652f218dc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2856369dca645e88c940652f218dc3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2856369dca645e88c940652f218dc3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2856369dca645e88c940652f218dc3b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPsTestJSON-1690542044 May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c2856369dca645e88c940652f218dc3b May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1690542044 May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPsTestJSON-1690542044-project May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 66699357d8fd4f3c95d417bafdec8e39 May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPsTestJSON-1690542044-project May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: exception: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ab7a0989-7155-4013-a861-af844ba173c5'} May 14 21:14:15.815865 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:14:15.816887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ab7a0989-7155-4013-a861-af844ba173c5 could not be found May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ebdbd01a-efbf-4068-aa8b-6897065eafdd'] May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5. May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:15.818351 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:15.819813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:15.821265 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:15.821265 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.822432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d24c60e0-7d37-485c-b438-1470d192f056 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Returning 404 to user: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:15.823326 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d24c60e0-7d37-485c-b438-1470d192f056 tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5" status: 404 len: 111 microversion: 2.1 time: 0.060438 May 14 21:14:15.823952 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 431/868] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:14:15 2022] GET /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:15.829177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:15.829805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:15.837129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.837887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.838683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.839131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.855129 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] HTTP exception thrown: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Request method failure captured: May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 HTTP/1.1 May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsO-p9NyU76WTVTUm5DyblK9MFO8OtKZpd1Y13JJWPqulRKdUbKkfpdS5U44upkzQbbK4DLEtQ2m0PXYuGC0edDehYwSYzSibW_QBZf4wOUWQRo_h407AQlr4-mN2um0Vpi36BwxPFPUcY7WaIeEl4Xgik9NIsDdfvQEMDKLs8U4Bk May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:15.856739 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97eb48c86b4d49f1b11b2b6380020f4b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 36c32d3de24045bdbfce30559ea022e7 May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:15.858413 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2fc3677c-c275-470e-97fc-e832134789c1'} May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:15.859206 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:15.860667 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:15.861859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Returning 404 to user: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:15.861859 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43a914af-c3b3-4cf3-b4cc-bea9232ebd17 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 404 len: 111 microversion: 2.1 time: 0.032739 May 14 21:14:15.861859 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 432/869] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:15 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:15.863300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:15.863933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:15.869969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.870425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.871217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.871694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.970258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:15.970734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:15.971159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:15.971605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:15.972025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:15.981305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.981877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:15.991576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:15.991576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.002135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Getting quotas for project f04e1accfc534fb18e36d789a9cefde3. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:16.007584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:16.007867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Getting quotas for user 32240804909d4572880a0f419f49f61e and project f04e1accfc534fb18e36d789a9cefde3. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:16.016464 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15be5c4a-3ecc-4be7-acb2-d7f253362431 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.156758 May 14 21:14:16.019790 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 433/870] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:15 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:16.024050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.024666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.029741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:16.031961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.032417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:16.032702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.033495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.034127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.140610 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3cd2731-8529-4f94-a1d6-e856c237a7f7 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933684 May 14 21:14:16.145834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 438/871] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:16.146485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6064c927-5f94-4ef1-ab3f-78d4251dbb9a tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Calling method '.version_select at 0x7fb1a7d823a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.171381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:16.179322 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1f94b863-caf6-4b75-98bc-f6f41a9fa5f4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 200 len: 1505 microversion: 2.1 time: 0.160958 May 14 21:14:16.188637 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 434/872] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:16 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:16.191280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-6064c927-5f94-4ef1-ab3f-78d4251dbb9a tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ab7a0989-7155-4013-a861-af844ba173c5 could not be found", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:14:16.191991 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6064c927-5f94-4ef1-ab3f-78d4251dbb9a tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] HTTP exception thrown: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6064c927-5f94-4ef1-ab3f-78d4251dbb9a tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Request method failure captured: May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5 HTTP/1.1 May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBuZ1Nbeo1Wy7adebny8He0cDbY-zibCstTWYDMAnKPQtlSrcN_aJ-xTmOo-UUGZ-gFfLg9UO9ie20WyOKn90KhKcilrzq0WBsaSE9H6O92QbYzPRiRWMXKN8XNon27SNMnIpi3KHIKBviA6cUtBU1VOiZiF55KI_J5ksqc9rmsk4N8 May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c2856369dca645e88c940652f218dc3b May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FloatingIPsTestJSON-1690542044 May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:16.194722 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2856369dca645e88c940652f218dc3b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c2856369dca645e88c940652f218dc3b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c2856369dca645e88c940652f218dc3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c2856369dca645e88c940652f218dc3b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FloatingIPsTestJSON-1690542044 May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c2856369dca645e88c940652f218dc3b May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1690542044 May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FloatingIPsTestJSON-1690542044-project May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 66699357d8fd4f3c95d417bafdec8e39 May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FloatingIPsTestJSON-1690542044-project May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: exception: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ab7a0989-7155-4013-a861-af844ba173c5'} May 14 21:14:16.196317 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:14:16.197266 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ab7a0989-7155-4013-a861-af844ba173c5 could not be found May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4bd7e7ea-d339-4374-bc9d-d2ff3d24f6e8'] May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5. May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:16.198827 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:16.200968 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:16.202340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 May 14 21:14:16.202340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.202340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6064c927-5f94-4ef1-ab3f-78d4251dbb9a tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] Returning 404 to user: Floating IP not found for ID ab7a0989-7155-4013-a861-af844ba173c5 {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:16.202340 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6064c927-5f94-4ef1-ab3f-78d4251dbb9a tempest-FloatingIPsTestJSON-1690542044 tempest-FloatingIPsTestJSON-1690542044-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5" status: 404 len: 111 microversion: 2.1 time: 0.054219 May 14 21:14:16.202340 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 439/873] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:14:16 2022] DELETE /compute/v2.1/os-floating-ips/ab7a0989-7155-4013-a861-af844ba173c5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:16.202729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.202729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.202908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-925062cc-9368-4dde-86df-0eeb24d89ea1 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.202908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-925062cc-9368-4dde-86df-0eeb24d89ea1 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.215507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.215986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.216783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.217230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.239047 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] HTTP exception thrown: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Request method failure captured: May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e HTTP/1.1 May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsO-p9NyU76WTVTUm5DyblK9MFO8OtKZpd1Y13JJWPqulRKdUbKkfpdS5U44upkzQbbK4DLEtQ2m0PXYuGC0edDehYwSYzSibW_QBZf4wOUWQRo_h407AQlr4-mN2um0Vpi36BwxPFPUcY7WaIeEl4Xgik9NIsDdfvQEMDKLs8U4Bk May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:16.240716 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97eb48c86b4d49f1b11b2b6380020f4b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 36c32d3de24045bdbfce30559ea022e7 May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.242167 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '406fb98b-cfdf-42ed-b684-bcabeee2633e'} May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:16.243054 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.244509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:16.246675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Returning 404 to user: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:16.246675 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2a6093a2-9d24-4859-bb03-b7d4ad8e918b tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 404 len: 111 microversion: 2.1 time: 0.053156 May 14 21:14:16.248450 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 435/874] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:16 2022] DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:16.253543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.254047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.268471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.268935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.269716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.270326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.276018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-925062cc-9368-4dde-86df-0eeb24d89ea1 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:16.286021 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-925062cc-9368-4dde-86df-0eeb24d89ea1 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1221 microversion: 2.1 time: 0.087756 May 14 21:14:16.287799 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 440/875] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:16 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1221 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:16.293605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.294441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.305891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:14:16.318464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.318925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.319732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.320174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.523093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:16.534735 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a2bfa79-3014-441c-9bbc-ebe432014b21 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1317 microversion: 2.1 time: 0.245071 May 14 21:14:16.535734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 441/876] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:16 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:16.546406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.547713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.556971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.559064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.560586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.561613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] HTTP exception thrown: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Request method failure captured: May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e HTTP/1.1 May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsO-p9NyU76WTVTUm5DyblK9MFO8OtKZpd1Y13JJWPqulRKdUbKkfpdS5U44upkzQbbK4DLEtQ2m0PXYuGC0edDehYwSYzSibW_QBZf4wOUWQRo_h407AQlr4-mN2um0Vpi36BwxPFPUcY7WaIeEl4Xgik9NIsDdfvQEMDKLs8U4Bk May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:16.585657 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97eb48c86b4d49f1b11b2b6380020f4b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 36c32d3de24045bdbfce30559ea022e7 May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.587039 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '406fb98b-cfdf-42ed-b684-bcabeee2633e'} May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:16.587835 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:16.591862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:16.594640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Returning 404 to user: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:16.594640 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f2fa73f8-a62e-4237-97ea-49374bb8793e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 404 len: 111 microversion: 2.1 time: 0.046371 May 14 21:14:16.594640 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 442/877] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:16 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:16.594640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.594640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.597453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.597930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.598723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.599177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.769072 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea60eba7-3cd7-44e5-b953-7396f801e008 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 204 len: 0 microversion: 2.1 time: 0.519061 May 14 21:14:16.769838 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 436/878] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:16 2022] DELETE /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:14:16.776101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:16.777178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:16.786953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.787762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:16.788795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:16.789515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.005322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:17.016347 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-860e4b6a-90e8-4cb1-b050-2b629018d4ae tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1314 microversion: 2.1 time: 0.431257 May 14 21:14:17.017001 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 443/879] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:16 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:17.021899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a1ad8fc-55c1-436d-a810-9ada372fdeb3 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '.version_select at 0x7fb1a7e2d3a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:17.111274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:17.119971 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec8aebb0-e331-494f-b947-dc65892dd0f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.348862 May 14 21:14:17.122756 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 437/880] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:16 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:17.127687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-266022148", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8f75d233-b39d-4c19-a44f-6a34a157d017"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:17.134338 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a1ad8fc-55c1-436d-a810-9ada372fdeb3 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126718949" status: 202 len: 0 microversion: 2.1 time: 0.115935 May 14 21:14:17.135450 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 444/881] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1126718949 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:17.141262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:17.142140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:17.150569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.153843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.153843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.154488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.214326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] validate_networks() for [('8f75d233-b39d-4c19-a44f-6a34a157d017', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:17.384858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:17.395906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46b7e370-a6ee-43ea-b341-39c592954683 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1477 microversion: 2.1 time: 0.259189 May 14 21:14:17.396615 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 445/882] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:17 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1477 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:17.401512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c26b2dac-b749-406d-a9bc-4f747a419568 req-f08cb6f1-e96a-4ac6-85e8-a3567e2f307b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b557786f-467b-4f39-b283-7c798215ba18", "name": "network-vif-plugged", "status": "completed", "tag": "cd79d740-e7bf-4fb9-a20e-1e35700ba976"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:17.410099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c26b2dac-b749-406d-a9bc-4f747a419568 req-f08cb6f1-e96a-4ac6-85e8-a3567e2f307b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.410548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c26b2dac-b749-406d-a9bc-4f747a419568 req-f08cb6f1-e96a-4ac6-85e8-a3567e2f307b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.422359 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c26b2dac-b749-406d-a9bc-4f747a419568 req-f08cb6f1-e96a-4ac6-85e8-a3567e2f307b service nova] Creating event network-vif-plugged:cd79d740-e7bf-4fb9-a20e-1e35700ba976 for instance b557786f-467b-4f39-b283-7c798215ba18 on nch2-master-1 May 14 21:14:17.427693 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c26b2dac-b749-406d-a9bc-4f747a419568 req-f08cb6f1-e96a-4ac6-85e8-a3567e2f307b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029677 May 14 21:14:17.428290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 446/883] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:17.433791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:17.434620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:17.440891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.441341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.455667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.455667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.516843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:17.532058 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59f09718-89d4-4e74-a8a5-5599b76e0f8f tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1225 microversion: 2.1 time: 0.101706 May 14 21:14:17.535923 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 447/884] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:17 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:17.553622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:17.554918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:17.580603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.581140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.581957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.582403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.890125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:17.890558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:17.891228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:17.891877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:17.892453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:17.904444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.905186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.906187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:17.906630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:17.949353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Getting quotas for project e4af8109ce4a4e98a2e7104125651db0. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:17.952543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Getting quotas for user 911b9cf4e9bc424bba387e2ff966cb46 and project e4af8109ce4a4e98a2e7104125651db0. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:18.047420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:18.056380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:18.192922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:18.240435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b83bfbd0-b6a7-4252-b4ee-c4af8b38e291 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1317 microversion: 2.1 time: 0.685553 May 14 21:14:18.259725 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 448/885] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:17 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1317 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:18.270027 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-12c9f708-fe0a-48b5-94b2-610c0a1b43eb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.144974 May 14 21:14:18.283339 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 438/886] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:18.291464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:18.297114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:18.308422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.310895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:18.312583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:18.313234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:18.319747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.320495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:18.321933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.322381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:18.328053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.329788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:18.720763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:18.728402 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6114b706-68be-44f3-ab0b-8d793ec5db23 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.443662 May 14 21:14:18.740224 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 439/887] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:18 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:18.745165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-733f7dc7-020e-4d04-8e28-86ddc72f10ef tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:18.750902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-733f7dc7-020e-4d04-8e28-86ddc72f10ef tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:18.845578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-733f7dc7-020e-4d04-8e28-86ddc72f10ef tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:18.854919 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-733f7dc7-020e-4d04-8e28-86ddc72f10ef tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1217 microversion: 2.1 time: 0.113502 May 14 21:14:18.856780 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 440/888] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:18 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:18.862589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:18.863824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:18.874940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.875727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:18.877422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.878090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:18.889686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:18.903555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-519474b8-0d28-4692-ae88-127b11807e8e tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1314 microversion: 2.1 time: 0.641763 May 14 21:14:18.904427 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 449/889] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:18 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:18.909104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:18.923397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:18.946776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.948116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:18.950877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:18.952615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:19.249044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:19.258425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3970a3e8-6887-4330-8d7a-1abfc40bd162 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1217 microversion: 2.1 time: 0.352853 May 14 21:14:19.262200 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 450/890] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:18 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1217 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:19.282747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:19.284199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:19.295424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:19.296312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:19.297413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:19.298945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:19.526091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:19.535436 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f7ca0ccc-a368-4b17-b38b-4826e50695af tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1476 microversion: 2.1 time: 0.677306 May 14 21:14:19.547408 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 441/891] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:18 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1476 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:19.553101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-37453b1a-6ffd-4ac9-b102-24ca32c22607 req-08774d95-741c-44e3-8847-b3c59354f1ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568afb67-d4f6-424e-82f4-150d00c3c6ee", "name": "network-vif-plugged", "status": "completed", "tag": "1ef02825-0b9d-4284-a41f-f07bc5e3e488"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:19.568197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-37453b1a-6ffd-4ac9-b102-24ca32c22607 req-08774d95-741c-44e3-8847-b3c59354f1ae service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:19.570383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-37453b1a-6ffd-4ac9-b102-24ca32c22607 req-08774d95-741c-44e3-8847-b3c59354f1ae service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:19.588266 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-37453b1a-6ffd-4ac9-b102-24ca32c22607 req-08774d95-741c-44e3-8847-b3c59354f1ae service nova] Creating event network-vif-plugged:1ef02825-0b9d-4284-a41f-f07bc5e3e488 for instance 568afb67-d4f6-424e-82f4-150d00c3c6ee on nch2-master-1 May 14 21:14:19.595824 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-37453b1a-6ffd-4ac9-b102-24ca32c22607 req-08774d95-741c-44e3-8847-b3c59354f1ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046666 May 14 21:14:19.596791 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 442/892] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:19.746950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:19.747710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:19.762135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:19.762824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:19.763801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:19.764399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.075275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:20.085903 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f4347cb0-65f2-4916-8013-234a8cc3db66 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.343796 May 14 21:14:20.098815 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 443/893] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:19 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:20.106066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:20.107563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:20.117225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.119838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.122297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.123384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.332395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:20.342538 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-01c79fa1-7e17-4b7c-99f9-12e001ff160c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1269 microversion: 2.1 time: 0.242042 May 14 21:14:20.343977 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 444/894] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:20 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1269 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:20.358403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:20.360077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:20.371290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.374101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.375700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.376709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.465914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:20.480528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9237721e-208d-4bff-b6e2-6a5a82a115f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1317 microversion: 2.1 time: 1.199901 May 14 21:14:20.481505 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 451/895] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:19 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1317 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:20.486410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:20.489980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:20.503088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.513624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.514525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.515408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.675714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:20.685802 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f26865e2-8f2f-4e3a-9c15-48b3dbca7ea3 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1281 microversion: 2.1 time: 0.201671 May 14 21:14:20.687192 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 452/896] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:20 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:20.693361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6330c0ce-d6ea-4108-9d4c-ef34caabb10d req-630f9af2-1054-41a1-8940-88312679a34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1790fe11-3d3e-47a9-ba6a-b7c026480bfe", "name": "network-vif-unplugged", "status": "completed", "tag": "c79010d0-bc70-40cb-809d-4227f14fbcda"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:20.704078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6330c0ce-d6ea-4108-9d4c-ef34caabb10d req-630f9af2-1054-41a1-8940-88312679a34f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.704857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6330c0ce-d6ea-4108-9d4c-ef34caabb10d req-630f9af2-1054-41a1-8940-88312679a34f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.717733 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6330c0ce-d6ea-4108-9d4c-ef34caabb10d req-630f9af2-1054-41a1-8940-88312679a34f service nova] Creating event network-vif-unplugged:c79010d0-bc70-40cb-809d-4227f14fbcda for instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe on nch2-master-1 May 14 21:14:20.732616 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6330c0ce-d6ea-4108-9d4c-ef34caabb10d req-630f9af2-1054-41a1-8940-88312679a34f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035605 May 14 21:14:20.734031 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 453/897] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:20.749091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:20.749826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:20.758619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.759368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.760424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:20.761064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:20.848321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:20.865887 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-85263b5b-915b-4576-87eb-ce492c4713c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1314 microversion: 2.1 time: 0.519293 May 14 21:14:20.866477 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 445/898] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:20 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:20.896283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-336e6193-fe75-4387-90a8-a27dcdc5d77c tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:20.897154 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:20.897154 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:14:21.009375 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-336e6193-fe75-4387-90a8-a27dcdc5d77c tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1595958437" status: 202 len: 0 microversion: 2.1 time: 0.116808 May 14 21:14:21.010146 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 446/899] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:14:20 2022] DELETE /compute/v2.1/flavors/1595958437 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:14:21.023865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a52b916-e708-4ae7-bf6f-1eb2b69c825c tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:21.058884 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a52b916-e708-4ae7-bf6f-1eb2b69c825c tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.042824 May 14 21:14:21.070135 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 447/900] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:14:21 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:21.076621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f6977e1-705a-4f45-a527-d97962698a57 tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:21.169722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f6977e1-705a-4f45-a527-d97962698a57 tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/1398027056" status: 202 len: 0 microversion: 2.1 time: 0.097795 May 14 21:14:21.170324 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 448/901] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:14:21 2022] DELETE /compute/v2.1/flavors/1398027056 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:14:21.177652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:21.177652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:21.185863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:21.186647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:21.187629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:21.188387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:21.592688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:21.601831 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f13d75a0-a7d5-4709-8fa5-909f11e559ea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.429897 May 14 21:14:21.603017 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 449/902] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:21 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:21.620556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61495655-6247-4e1d-b07b-ae299aa72681 tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:21.628474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:21.640710 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c54bedcb-fa33-4a43-8bb1-db61447e4dd5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1476 microversion: 2.1 time: 0.904847 May 14 21:14:21.643957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 454/903] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:20 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1476 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:21.651127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:21.658079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:21.675232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-61495655-6247-4e1d-b07b-ae299aa72681 tempest-ServersWithSpecificFlavorTestJSON-79515329 tempest-ServersWithSpecificFlavorTestJSON-79515329-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058142 May 14 21:14:21.675232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 450/904] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:14:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:21.675426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:21.675426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:21.679442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:21.679963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:21.680080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:21.680676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:21.701166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:21.701651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:21.704132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:21.706421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:21.908862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:21.923447 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d785ab8-bc30-483b-bdef-cc757e3cd498 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1275 microversion: 2.1 time: 0.278350 May 14 21:14:21.924079 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 455/905] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:21 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1275 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:21.933322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c4151547-774b-40fa-9d6d-efd00fa013c8 req-40e19acb-3bf5-453b-b679-3b3ca6575690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0682771c-4855-4853-9123-f03aa17b7b53", "name": "network-vif-plugged", "status": "completed", "tag": "7f69be99-9e4d-472a-a312-16dd01bfc172"}, {"server_uuid": "6eef68d3-09e1-45d5-8cec-2e5649628310", "name": "network-vif-plugged", "status": "completed", "tag": "98713c9a-6a3b-4530-a828-26ae7e23cc8f"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:21.945463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c4151547-774b-40fa-9d6d-efd00fa013c8 req-40e19acb-3bf5-453b-b679-3b3ca6575690 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:21.946175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c4151547-774b-40fa-9d6d-efd00fa013c8 req-40e19acb-3bf5-453b-b679-3b3ca6575690 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:21.963797 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c4151547-774b-40fa-9d6d-efd00fa013c8 req-40e19acb-3bf5-453b-b679-3b3ca6575690 service nova] Creating event network-vif-plugged:7f69be99-9e4d-472a-a312-16dd01bfc172 for instance 0682771c-4855-4853-9123-f03aa17b7b53 on nch2-master-1 May 14 21:14:21.964382 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c4151547-774b-40fa-9d6d-efd00fa013c8 req-40e19acb-3bf5-453b-b679-3b3ca6575690 service nova] Creating event network-vif-plugged:98713c9a-6a3b-4530-a828-26ae7e23cc8f for instance 6eef68d3-09e1-45d5-8cec-2e5649628310 on nch1-master-1 May 14 21:14:21.975609 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c4151547-774b-40fa-9d6d-efd00fa013c8 req-40e19acb-3bf5-453b-b679-3b3ca6575690 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048466 May 14 21:14:21.976618 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 456/906] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:21.992917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:21.998192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.018550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.018550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.018550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.018818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.046437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:22.047683 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] HTTP exception thrown: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.059068 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19522082-e54c-454f-9aba-80ecbd6fade3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1467 microversion: 2.1 time: 0.385062 May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Request method failure captured: May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 HTTP/1.1 May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsO-p9NyU76WTVTUm5DyblK9MFO8OtKZpd1Y13JJWPqulRKdUbKkfpdS5U44upkzQbbK4DLEtQ2m0PXYuGC0edDehYwSYzSibW_QBZf4wOUWQRo_h407AQlr4-mN2um0Vpi36BwxPFPUcY7WaIeEl4Xgik9NIsDdfvQEMDKLs8U4Bk May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:22.065475 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97eb48c86b4d49f1b11b2b6380020f4b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 36c32d3de24045bdbfce30559ea022e7 May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.066727 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '2fc3677c-c275-470e-97fc-e832134789c1'} May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:22.067423 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.068612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.069828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Returning 404 to user: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:22.072837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-330a6f1d-ae5d-41f2-8440-db67cb50587d tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 404 len: 111 microversion: 2.1 time: 0.092176 May 14 21:14:22.073063 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 451/907] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:21 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1467 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:22.076160 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 457/908] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:21 2022] DELETE /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:22.084898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:22.086215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:22.086868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.087651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.099517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.100549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.101340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.103051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.103195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.103602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.104005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.104462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.232269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:22.242087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-016dcd0f-0b9d-4c2f-8724-79f1a89d2bb2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1279 microversion: 2.1 time: 0.167419 May 14 21:14:22.242669 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 452/909] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:22 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1279 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:22.248323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:22.248950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.259350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.260016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.260990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.262042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.449309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:22.457440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1e25ba66-efb2-4b59-a426-79f0847d02f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1468 microversion: 2.1 time: 0.213392 May 14 21:14:22.458112 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 453/910] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:22 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1468 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:22.462708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:22.463697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 2fc3677c-c275-470e-97fc-e832134789c1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.471182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.471736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.474544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.475471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.494676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] HTTP exception thrown: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Request method failure captured: May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 HTTP/1.1 May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBsO-p9NyU76WTVTUm5DyblK9MFO8OtKZpd1Y13JJWPqulRKdUbKkfpdS5U44upkzQbbK4DLEtQ2m0PXYuGC0edDehYwSYzSibW_QBZf4wOUWQRo_h407AQlr4-mN2um0Vpi36BwxPFPUcY7WaIeEl4Xgik9NIsDdfvQEMDKLs8U4Bk May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:22.496944 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97eb48c86b4d49f1b11b2b6380020f4b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 36c32d3de24045bdbfce30559ea022e7 May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.500725 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2fc3677c-c275-470e-97fc-e832134789c1'} May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:22.501509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. May 14 21:14:22.502674 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:22.503809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Returning 404 to user: Instance 2fc3677c-c275-470e-97fc-e832134789c1 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:22.503809 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf8de889-499d-4a24-8692-a4f5626f409a tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1" status: 404 len: 111 microversion: 2.1 time: 0.039437 May 14 21:14:22.503809 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 454/911] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:22 2022] GET /compute/v2.1/servers/2fc3677c-c275-470e-97fc-e832134789c1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:22.507585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de0320d2-e4c2-40e0-b941-4003d4c1d482 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1975079483"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:22.508769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de0320d2-e4c2-40e0-b941-4003d4c1d482 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.518317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de0320d2-e4c2-40e0-b941-4003d4c1d482 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.519020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de0320d2-e4c2-40e0-b941-4003d4c1d482 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.520537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de0320d2-e4c2-40e0-b941-4003d4c1d482 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.521147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de0320d2-e4c2-40e0-b941-4003d4c1d482 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.804301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:22.814453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f685dd6-59ab-4d1a-9d10-460c4bbff2a8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1314 microversion: 2.1 time: 0.739942 May 14 21:14:22.823342 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 458/912] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:22 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:22.836886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:22.837623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.851982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.852373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.853197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.853657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.888293 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] HTTP exception thrown: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Request method failure captured: May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e HTTP/1.1 May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsO-p9NyU76WTVTUm5DyblK9MFO8OtKZpd1Y13JJWPqulRKdUbKkfpdS5U44upkzQbbK4DLEtQ2m0PXYuGC0edDehYwSYzSibW_QBZf4wOUWQRo_h407AQlr4-mN2um0Vpi36BwxPFPUcY7WaIeEl4Xgik9NIsDdfvQEMDKLs8U4Bk May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:22.891822 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97eb48c86b4d49f1b11b2b6380020f4b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 36c32d3de24045bdbfce30559ea022e7 May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:22.898508 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '406fb98b-cfdf-42ed-b684-bcabeee2633e'} May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:22.899218 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:22.900391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:22.901536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Returning 404 to user: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:22.901536 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb9ec58a-4b3c-4d2f-a611-163dc3f451e2 tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 404 len: 111 microversion: 2.1 time: 0.067626 May 14 21:14:22.907649 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 459/913] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:22 2022] DELETE /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:22.916145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:22.916918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:22.924509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.925287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:22.926296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:22.926815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.303424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:23.313168 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de0320d2-e4c2-40e0-b941-4003d4c1d482 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "POST /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18/action" status: 202 len: 0 microversion: 2.1 time: 0.809368 May 14 21:14:23.318091 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f27d3601-395f-49ae-b628-0f7c2a0ad4c3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.407694 May 14 21:14:23.318345 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 455/914] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:22 2022] POST /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18/action => generated 0 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:14:23.321491 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 460/915] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:22 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:23.333009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8ed2cad4-6ee6-4ebc-b595-23b705f2bf8c req-1bd79bc2-8073-45df-8ebe-e1b24cc22f63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e45e4ee-630a-46b5-81bc-8945dbcb4aa8", "name": "network-vif-deleted", "tag": "dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5"}, {"name": "network-changed", "server_uuid": "1790fe11-3d3e-47a9-ba6a-b7c026480bfe", "tag": "c79010d0-bc70-40cb-809d-4227f14fbcda"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:23.333609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:23.337357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:23.353685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.354433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.356927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.357921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.358997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8ed2cad4-6ee6-4ebc-b595-23b705f2bf8c req-1bd79bc2-8073-45df-8ebe-e1b24cc22f63 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.361075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8ed2cad4-6ee6-4ebc-b595-23b705f2bf8c req-1bd79bc2-8073-45df-8ebe-e1b24cc22f63 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.384891 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8ed2cad4-6ee6-4ebc-b595-23b705f2bf8c req-1bd79bc2-8073-45df-8ebe-e1b24cc22f63 service nova] Creating event network-vif-deleted:dcf886ee-cbdc-4cfd-aa6c-65655c7dc7c5 for instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 on nch1-master-1 May 14 21:14:23.387385 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8ed2cad4-6ee6-4ebc-b595-23b705f2bf8c req-1bd79bc2-8073-45df-8ebe-e1b24cc22f63 service nova] Creating event network-changed:c79010d0-bc70-40cb-809d-4227f14fbcda for instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe on nch2-master-1 May 14 21:14:23.405255 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8ed2cad4-6ee6-4ebc-b595-23b705f2bf8c req-1bd79bc2-8073-45df-8ebe-e1b24cc22f63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.081812 May 14 21:14:23.407751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 461/916] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:23.416971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:23.418397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] [instance: 406fb98b-cfdf-42ed-b684-bcabeee2633e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:23.425054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.425501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.426492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.426932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.441908 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] HTTP exception thrown: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Request method failure captured: May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e HTTP/1.1 May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBsO-p9NyU76WTVTUm5DyblK9MFO8OtKZpd1Y13JJWPqulRKdUbKkfpdS5U44upkzQbbK4DLEtQ2m0PXYuGC0edDehYwSYzSibW_QBZf4wOUWQRo_h407AQlr4-mN2um0Vpi36BwxPFPUcY7WaIeEl4Xgik9NIsDdfvQEMDKLs8U4Bk May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:23.444001 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/97eb48c86b4d49f1b11b2b6380020f4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_97eb48c86b4d49f1b11b2b6380020f4b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 97eb48c86b4d49f1b11b2b6380020f4b May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082 May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 36c32d3de24045bdbfce30559ea022e7 May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-927769082-project May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:23.445261 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '406fb98b-cfdf-42ed-b684-bcabeee2633e'} May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:23.445947 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. May 14 21:14:23.447077 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:23.450116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] Returning 404 to user: Instance 406fb98b-cfdf-42ed-b684-bcabeee2633e could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:23.451197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6acb873e-8b3b-4bdd-af29-91345f9fed4e tempest-ServersWithSpecificFlavorTestJSON-927769082 tempest-ServersWithSpecificFlavorTestJSON-927769082-project] 10.222.0.52 "GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e" status: 404 len: 111 microversion: 2.1 time: 0.040727 May 14 21:14:23.452312 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 462/917] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:23 2022] GET /compute/v2.1/servers/406fb98b-cfdf-42ed-b684-bcabeee2633e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:23.457165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:23.458077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:23.464992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.465706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.466704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.467380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.540838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:23.556828 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ab0c01a-2951-428b-9dcd-6c38f739466a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1275 microversion: 2.1 time: 0.103190 May 14 21:14:23.571519 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 463/918] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:23 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:23.578860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:23.582224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:23.586762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.587434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.588789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.590124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.715400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:23.728162 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82d5c976-4973-470a-8bb6-4d4554170fe6 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1474 microversion: 2.1 time: 0.408322 May 14 21:14:23.732411 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 456/919] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:23 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1474 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:23.739516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e6c9aa93-5fb5-4b2c-95e3-06d97a7dae6c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c655e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:23.794550 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e6c9aa93-5fb5-4b2c-95e3-06d97a7dae6c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.059933 May 14 21:14:23.795245 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 457/920] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:23 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:23.844504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:23.845487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:23.854817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.859162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:23.860504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:23.861195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.257918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:24.266032 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1fcd2fc8-e49a-484f-8970-3c3eb45cfaac tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.693386 May 14 21:14:24.267194 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 464/921] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:23 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:24.271896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-84c62803-db45-44f7-be38-f84b9ec79be7 req-5f434446-c97d-43b3-9562-e5f4e3caf67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dcc3c9-cd38-40e8-9060-8b3740681925", "name": "network-vif-unplugged", "status": "completed", "tag": "b5e80fb6-d607-4cd2-bf6a-fc74ad375750"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:24.281553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84c62803-db45-44f7-be38-f84b9ec79be7 req-5f434446-c97d-43b3-9562-e5f4e3caf67c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.282073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84c62803-db45-44f7-be38-f84b9ec79be7 req-5f434446-c97d-43b3-9562-e5f4e3caf67c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.294909 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-84c62803-db45-44f7-be38-f84b9ec79be7 req-5f434446-c97d-43b3-9562-e5f4e3caf67c service nova] Creating event network-vif-unplugged:b5e80fb6-d607-4cd2-bf6a-fc74ad375750 for instance 71dcc3c9-cd38-40e8-9060-8b3740681925 on nch2-master-1 May 14 21:14:24.302590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-84c62803-db45-44f7-be38-f84b9ec79be7 req-5f434446-c97d-43b3-9562-e5f4e3caf67c service nova] Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:14:24.311689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-84c62803-db45-44f7-be38-f84b9ec79be7 req-5f434446-c97d-43b3-9562-e5f4e3caf67c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042983 May 14 21:14:24.312736 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 465/922] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:24.341167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:24.342113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:24.351576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.351576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.351576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.351576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.478437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:24.488189 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ca9c4a5-a501-4dd2-9368-0fe680d6059a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1314 microversion: 2.1 time: 0.650183 May 14 21:14:24.488594 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 458/923] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:23 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:24.574300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:24.575314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:24.582914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.583659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.584698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.585903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.631250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:24.643319 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-39cb0ed3-7ef4-49ff-bf7a-444ea7f5d671 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.308047 May 14 21:14:24.643949 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 466/924] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:24 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:24.763051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:24.766546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:24.774607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.776347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.778420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.779244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:24.945720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:24.954527 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1b23163-bf39-4659-8e3b-bbe97a6bf9c9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.383663 May 14 21:14:24.955768 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 459/925] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:24 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:24.969350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-bd39e759-2064-43ba-8258-edf0f8eaf276 req-a172178d-30b9-426f-83d3-9b22852ea7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28ccd9ac-9784-4ddc-9814-436c67c3b385", "tag": "8c0c2d02-7d8e-43a9-a4d9-3e656eaa1a2e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:24.991692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bd39e759-2064-43ba-8258-edf0f8eaf276 req-a172178d-30b9-426f-83d3-9b22852ea7bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:24.992737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bd39e759-2064-43ba-8258-edf0f8eaf276 req-a172178d-30b9-426f-83d3-9b22852ea7bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.023012 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-bd39e759-2064-43ba-8258-edf0f8eaf276 req-a172178d-30b9-426f-83d3-9b22852ea7bc service nova] Creating event network-changed:8c0c2d02-7d8e-43a9-a4d9-3e656eaa1a2e for instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 on nch1-master-1 May 14 21:14:25.040053 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-bd39e759-2064-43ba-8258-edf0f8eaf276 req-a172178d-30b9-426f-83d3-9b22852ea7bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081314 May 14 21:14:25.041841 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 460/926] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:25.060142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a553c6c-8635-4a1c-b979-7e6a3a4048fc tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c729d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:25.114151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:25.122673 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cabf5033-3aef-48bd-a07a-db9e022038b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1474 microversion: 2.1 time: 0.364531 May 14 21:14:25.127167 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a553c6c-8635-4a1c-b979-7e6a3a4048fc tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.080225 May 14 21:14:25.127593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 461/927] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:25 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:25.137189 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 467/928] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:24 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1474 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:25.283729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:25.284737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:25.291340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.292045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.293052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.293835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.505808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:25.507413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:25.515718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.516520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.517955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.518622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.617530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:25.629020 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-25abb410-c331-4ca4-b08c-efe63b8d4dc2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.348196 May 14 21:14:25.641758 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 462/929] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:25 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:25.662112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:25.663023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:25.672035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.672486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.676436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.678109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.894516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:25.929300 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d946548b-e183-4c3e-bbf4-316fe7f582c2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1464 microversion: 2.1 time: 0.408950 May 14 21:14:25.937139 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 468/930] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:25 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1464 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:25.947320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c19a5b07-91b1-46d5-8ec2-aebbcc031b74 req-9a94df8d-137a-4b8b-a7a1-b037cfade709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe390af-35f4-4cf5-91c5-994e9c2dc488", "tag": "75e96c25-9a97-4ee1-a8c0-34cdddac4e11"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:25.957877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c19a5b07-91b1-46d5-8ec2-aebbcc031b74 req-9a94df8d-137a-4b8b-a7a1-b037cfade709 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.958847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c19a5b07-91b1-46d5-8ec2-aebbcc031b74 req-9a94df8d-137a-4b8b-a7a1-b037cfade709 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.973045 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c19a5b07-91b1-46d5-8ec2-aebbcc031b74 req-9a94df8d-137a-4b8b-a7a1-b037cfade709 service nova] Creating event network-changed:75e96c25-9a97-4ee1-a8c0-34cdddac4e11 for instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 on nch1-master-1 May 14 21:14:25.979060 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c19a5b07-91b1-46d5-8ec2-aebbcc031b74 req-9a94df8d-137a-4b8b-a7a1-b037cfade709 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039919 May 14 21:14:25.979810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 469/931] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:25.990357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:25.991378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:25.998179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:25.998783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:25.999767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.000319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.034525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:26.045401 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd969cf9-9e93-4e2b-9477-d3d282e5a6a8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.388056 May 14 21:14:26.056569 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 463/932] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:25 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:26.062790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:26.063717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:26.090210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.091007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.093541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.101356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.296173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:26.303584 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8dc987c-e87b-4622-94ee-5d01a6053e65 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1463 microversion: 2.1 time: 0.318342 May 14 21:14:26.304169 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 470/933] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:25 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:26.321120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f03a008a-e0e3-4400-bbf7-651a7512762f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7d9a040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:26.376200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f03a008a-e0e3-4400-bbf7-651a7512762f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.058766 May 14 21:14:26.377549 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 471/934] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:26 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:26.382898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:26.383730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:26.390574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.391237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.392076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.392647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.424564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:26.436128 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d4342c6e-0764-402f-8d55-19a0ae822820 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.378219 May 14 21:14:26.436998 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 464/935] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:26 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:26.445190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-653030234", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0682771c-4855-4853-9123-f03aa17b7b53"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:26.499255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:26.647187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:26.656213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96728593-024e-4d34-be3a-aaeb9bd8060a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1471 microversion: 2.1 time: 0.277357 May 14 21:14:26.657602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 472/936] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:26 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1471 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:26.662780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:26.663747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:26.671599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.672913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.674557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.675177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.878859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:26.889508 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ff8b576-a6c6-4925-8b17-cc784410ba25 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.230565 May 14 21:14:26.890340 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 473/937] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:26 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:26.900150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5d7ea8e-e8c5-4a6b-980b-e75cdeba5ca9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:26.903017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5d7ea8e-e8c5-4a6b-980b-e75cdeba5ca9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:26.919200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d7ea8e-e8c5-4a6b-980b-e75cdeba5ca9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.919937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d7ea8e-e8c5-4a6b-980b-e75cdeba5ca9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.920877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d7ea8e-e8c5-4a6b-980b-e75cdeba5ca9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:26.921518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5d7ea8e-e8c5-4a6b-980b-e75cdeba5ca9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:26.985608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:26.986608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:26.987260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:26.987820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:26.988245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:27.005670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:27.006121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:27.008977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:27.010457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:27.059991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Getting quotas for project 873c930e94574326a2aa94a76fda4f0d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:27.066554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Getting quotas for user 3a998f4a4cc94a63ac7e939ffdb10917 and project 873c930e94574326a2aa94a76fda4f0d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:27.113193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:27.115618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:27.178012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5d7ea8e-e8c5-4a6b-980b-e75cdeba5ca9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925/action" status: 204 len: 0 microversion: 2.1 time: 0.283947 May 14 21:14:27.178976 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 474/938] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:26 2022] POST /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925/action => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:14:27.192606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:27.195653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:27.227076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:27.230369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:27.232968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:27.234732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:27.275878 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8f6d859f-ebeb-4f6e-97c0-16b2262d3435 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837852 May 14 21:14:27.288402 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 465/939] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:27.294314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:27.295193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:27.306684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:27.310397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:27.317866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:27.318667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:27.525025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:27.541931 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-370140dd-e176-4755-94f8-5c144dd5970b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.361352 May 14 21:14:27.542703 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 475/940] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:27 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:27.855998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1175466118", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:27.937599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:28.126828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:28.144708 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dbc21ede-8779-44e5-88a2-a1d42a8791e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1471 microversion: 2.1 time: 0.854931 May 14 21:14:28.145682 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 466/941] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:27 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1471 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:28.150580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd3e4931-2452-46c4-9dfd-ba75e0b7d652 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:28.151383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd3e4931-2452-46c4-9dfd-ba75e0b7d652 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:28.548429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd3e4931-2452-46c4-9dfd-ba75e0b7d652 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:28.555767 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd3e4931-2452-46c4-9dfd-ba75e0b7d652 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1213 microversion: 2.1 time: 0.408810 May 14 21:14:28.556774 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 467/942] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:28 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1213 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:28.563285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bdce77d1-b027-4ccc-87d5-a1d531df5a70 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c254c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:28.619624 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bdce77d1-b027-4ccc-87d5-a1d531df5a70 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.060639 May 14 21:14:28.628143 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 468/943] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:28 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:28.633839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:28.634467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:28.641550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:28.642945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:28.644007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:28.649388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:28.655076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:28.655960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:28.656624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:28.657122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:28.657761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:28.677165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:28.681119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:28.682066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:28.684067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:28.721804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Getting quotas for project 5c422d08f9df4a1eb5f3a3476f83db55. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:28.728863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Getting quotas for user 73c669f55bbc46cdad7770a07f28d9d2 and project 5c422d08f9df4a1eb5f3a3476f83db55. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:28.753718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:28.753718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:28.823821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:28.831953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-88472d09-1cc5-414f-bb67-dc0972e4ed6c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.202457 May 14 21:14:28.832529 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 469/944] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:28 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:28.838180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a78ef107-fe02-43ea-8688-fcf45ec057f4 req-957fe658-2777-44b2-9b77-2145e32fc62f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dcc3c9-cd38-40e8-9060-8b3740681925", "name": "network-vif-plugged", "status": "completed", "tag": "b5e80fb6-d607-4cd2-bf6a-fc74ad375750"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:28.847030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a78ef107-fe02-43ea-8688-fcf45ec057f4 req-957fe658-2777-44b2-9b77-2145e32fc62f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:28.847499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a78ef107-fe02-43ea-8688-fcf45ec057f4 req-957fe658-2777-44b2-9b77-2145e32fc62f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:28.862213 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a78ef107-fe02-43ea-8688-fcf45ec057f4 req-957fe658-2777-44b2-9b77-2145e32fc62f service nova] Creating event network-vif-plugged:b5e80fb6-d607-4cd2-bf6a-fc74ad375750 for instance 71dcc3c9-cd38-40e8-9060-8b3740681925 on nch2-master-1 May 14 21:14:28.869557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-a78ef107-fe02-43ea-8688-fcf45ec057f4 req-957fe658-2777-44b2-9b77-2145e32fc62f service nova] Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:14:28.876454 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a78ef107-fe02-43ea-8688-fcf45ec057f4 req-957fe658-2777-44b2-9b77-2145e32fc62f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042539 May 14 21:14:28.881582 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 470/945] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:28.897275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:28.897275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:28.904101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:28.904750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:28.905623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:28.906594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.005298 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ea944577-4ff1-4369-a30b-7c6a6f27701e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.461233 May 14 21:14:29.010966 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 476/946] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:29.028079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:29.028774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:29.048902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.049529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.050486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.051119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.291413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:29.301880 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-788a40ec-e023-4c60-ab81-31eb5770b34e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.289250 May 14 21:14:29.303368 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 477/947] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:29 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:29.311755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:29.319077 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a23cdf2c-0caf-4754-a5c4-1ecb4b1ee14b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.435707 May 14 21:14:29.322031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91edd504-f844-48bf-9c5f-231776851e1e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:29.322660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-91edd504-f844-48bf-9c5f-231776851e1e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:29.325698 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 471/948] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:28 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:29.334348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:29.335136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:29.344500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.345750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.346709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.347314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.445277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-91edd504-f844-48bf-9c5f-231776851e1e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:29.453937 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-91edd504-f844-48bf-9c5f-231776851e1e tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1216 microversion: 2.1 time: 0.149400 May 14 21:14:29.458983 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 478/949] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:29 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:29.574675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:29.575402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:29.582412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:29.595468 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b35ec2ad-5689-4610-892b-ba59f3d8387d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1471 microversion: 2.1 time: 0.268116 May 14 21:14:29.596208 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 472/950] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:29 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:29.600291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.602001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.603968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.604427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.634351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e3e8e57c-e583-4b03-a5e5-8f2b60fc822d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c72e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:29.690964 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e3e8e57c-e583-4b03-a5e5-8f2b60fc822d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.060570 May 14 21:14:29.691920 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 473/951] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:29 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:29.780464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:29.796574 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2272a4eb-3e14-4e42-b60c-688cec843997 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1265 microversion: 2.1 time: 0.225775 May 14 21:14:29.797776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 479/952] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:29 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:29.850371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:29.851223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:29.863504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.863961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:29.864658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:29.865103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:30.009928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:30.018865 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53fc6f10-86b2-4a7b-933b-a54eb84998d5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.172479 May 14 21:14:30.020386 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 474/953] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:29 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:30.320149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:30.320776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:30.328233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:30.328698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:30.329579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:30.330063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:30.339244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:30.340004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:30.347122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:30.348348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:30.350391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:30.362629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:30.573143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:30.582675 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-951322c9-5b2e-437f-a112-e97984a08dad tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.249117 May 14 21:14:30.593906 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 475/954] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:30 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:30.599712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c344b0aa-5292-495c-9aea-909d495c32a3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:30.600486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c344b0aa-5292-495c-9aea-909d495c32a3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:30.622091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:30.640329 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-73f890e2-35d1-4ed4-a664-4ed6e919db35 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.323091 May 14 21:14:30.642204 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 480/955] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:30 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:30.661572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:30.666777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:30.685099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:30.685749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:30.688964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:30.689597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:30.854259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c344b0aa-5292-495c-9aea-909d495c32a3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:30.863522 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c344b0aa-5292-495c-9aea-909d495c32a3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1216 microversion: 2.1 time: 0.267684 May 14 21:14:30.866411 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 476/956] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:30 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1216 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:30.880758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d301cc04-74ca-4492-9a82-a1e11167c2b5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7cf7160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:30.972454 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d301cc04-74ca-4492-9a82-a1e11167c2b5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.095349 May 14 21:14:30.977640 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 477/957] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:30 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:31.009211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:31.012881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:31.021445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:31.030570 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d716af44-41f0-439b-9df5-720b240f1e53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1463 microversion: 2.1 time: 0.386274 May 14 21:14:31.037987 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 481/958] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:30 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1463 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:31.038191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.041201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.044829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.045032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.050497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-84e8a667-584e-425f-9659-c67f0c531715 req-dc0ba7ce-1451-4de1-b67b-9796485b7575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b557786f-467b-4f39-b283-7c798215ba18", "name": "network-vif-plugged", "status": "completed", "tag": "cd79d740-e7bf-4fb9-a20e-1e35700ba976"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:31.073125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84e8a667-584e-425f-9659-c67f0c531715 req-dc0ba7ce-1451-4de1-b67b-9796485b7575 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.074250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84e8a667-584e-425f-9659-c67f0c531715 req-dc0ba7ce-1451-4de1-b67b-9796485b7575 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.092688 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-84e8a667-584e-425f-9659-c67f0c531715 req-dc0ba7ce-1451-4de1-b67b-9796485b7575 service nova] Creating event network-vif-plugged:cd79d740-e7bf-4fb9-a20e-1e35700ba976 for instance b557786f-467b-4f39-b283-7c798215ba18 on nch2-master-1 May 14 21:14:31.101459 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-84e8a667-584e-425f-9659-c67f0c531715 req-dc0ba7ce-1451-4de1-b67b-9796485b7575 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060724 May 14 21:14:31.102694 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 482/959] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:31.109003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:31.124624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:31.141677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.142260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.143228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.143772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.176773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:31.191822 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43cbb481-ed6b-47cf-af4b-342fc5ca633a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1273 microversion: 2.1 time: 0.208859 May 14 21:14:31.194635 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 478/960] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:30 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1273 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:31.205399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:31.208386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:31.222888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.223263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.224810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.225328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.395018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:31.415259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbb58330-aada-4e11-888f-5f97ade5c517 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.308382 May 14 21:14:31.421567 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 483/961] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:31 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:31.459799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:31.483298 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd522780-948c-4c0f-95d6-46b002feba0e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1463 microversion: 2.1 time: 0.284609 May 14 21:14:31.484138 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 479/962] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:31 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1463 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:31.501615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3e9cc53-e144-4c8e-99d2-cba3ebc3245f tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '.version_select at 0x7fb1a7d0fc10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:31.508473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3e9cc53-e144-4c8e-99d2-cba3ebc3245f tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.509245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3e9cc53-e144-4c8e-99d2-cba3ebc3245f tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.523140 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3e9cc53-e144-4c8e-99d2-cba3ebc3245f tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1184 microversion: 2.1 time: 0.025112 May 14 21:14:31.532955 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 484/963] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:14:31 2022] GET /compute/v2.1/os-migrations => generated 1184 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:31.550802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cb45bac2-dd94-4659-8f5d-69d10d5084c7 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:31.567184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cb45bac2-dd94-4659-8f5d-69d10d5084c7 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020203 May 14 21:14:31.574013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7833cabc-d50e-456a-aa0f-313b9b820753 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1936165851", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:31.574599 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 480/964] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:31.577509 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:31.577509 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:14:31.601919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:31.603866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:31.615934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.616652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.617731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.618339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.662618 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7833cabc-d50e-456a-aa0f-313b9b820753 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.093065 May 14 21:14:31.672153 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 485/965] 10.222.0.52 () {60 vars in 1145 bytes} [Sat May 14 21:14:31 2022] POST /compute/v2.1/flavors => generated 499 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:31.685098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:31.688600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:31.707528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.708776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.709756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:31.711815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:31.946898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:31.956697 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6451179d-aaad-484c-80b5-4f6aa97c61ec tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.360805 May 14 21:14:31.957503 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 481/966] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:31 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:31.962591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50ac46fd-9621-4f32-add8-43b75123770a tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:32.006186 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50ac46fd-9621-4f32-add8-43b75123770a tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.045832 May 14 21:14:32.038212 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 482/967] 10.222.0.52 () {58 vars in 1181 bytes} [Sat May 14 21:14:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:14:32.090576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:32.094116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:32.110802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:32.123874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f236cf90-832f-44d8-868f-0e5b428c16da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.450317 May 14 21:14:32.125812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:32.125812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:32.126070 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 486/968] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:31 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:32.126170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:32.126170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:32.132193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-275bec38-b8cd-4cfe-9c97-13a35876ef83 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7d0ff70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:32.320197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-275bec38-b8cd-4cfe-9c97-13a35876ef83 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.115833 May 14 21:14:32.320197 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 487/969] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:32 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:32.320197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:32.320197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:32.320197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:32.322373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:32.322373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:32.322373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:32.380312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:32.390537 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3fe99a40-95bb-4072-9c72-e277939055b8 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1271 microversion: 2.1 time: 0.146741 May 14 21:14:32.391134 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 488/970] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:32 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:32.396554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-24941251", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "8d34442f-f499-4011-932f-fd140a82357f"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:32.414346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:32.437099 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c23bbec-51b9-4871-a122-78f0c94d5bb4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1268 microversion: 2.1 time: 0.396755 May 14 21:14:32.450701 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 483/971] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:32 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1268 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:32.461846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:32.463641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:32.467662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:32.474554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:32.475456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:32.476996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:32.478745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:32.883939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:32.900232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99362cb2-dceb-4f15-bf0a-c42390349cfb tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.444933 May 14 21:14:32.904350 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 484/972] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:32 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:32.975161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:32.977051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:32.993654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:32.998521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.001645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.003574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.262835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:33.277934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2dbd6bc4-9077-49a1-9788-c4059b9c8915 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.303758 May 14 21:14:33.280914 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 485/973] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:32 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:33.303525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:33.303982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:33.318517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.318957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.319807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.320251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.674639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:33.682216 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dffdb297-e840-4da8-a4cc-9c2f17889380 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.392208 May 14 21:14:33.684725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:33.692354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:33.692354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:33.692354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:33.692354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:33.692881 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 486/974] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:33 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:33.699030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-17d20e0c-a7ba-4ffa-8c77-d9170cffeedc req-70487660-54d4-43c7-94b2-8e5fa6f61d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ccd9ac-9784-4ddc-9814-436c67c3b385", "name": "network-vif-plugged", "status": "completed", "tag": "8c0c2d02-7d8e-43a9-a4d9-3e656eaa1a2e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:33.719014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.719462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.723676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.724481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.734279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-17d20e0c-a7ba-4ffa-8c77-d9170cffeedc req-70487660-54d4-43c7-94b2-8e5fa6f61d46 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.738041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-17d20e0c-a7ba-4ffa-8c77-d9170cffeedc req-70487660-54d4-43c7-94b2-8e5fa6f61d46 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.749175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:33.755594 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-17d20e0c-a7ba-4ffa-8c77-d9170cffeedc req-70487660-54d4-43c7-94b2-8e5fa6f61d46 service nova] Creating event network-vif-plugged:8c0c2d02-7d8e-43a9-a4d9-3e656eaa1a2e for instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 on nch1-master-1 May 14 21:14:33.760041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for user 5b93d6c3d03d407f8be4aa38e2fbb154 and project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:33.767354 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-17d20e0c-a7ba-4ffa-8c77-d9170cffeedc req-70487660-54d4-43c7-94b2-8e5fa6f61d46 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076594 May 14 21:14:33.769904 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 487/975] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:33.782044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-60b21d08-26a4-48fa-9a0f-1fb87f28c1e4 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7cf7430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:33.789791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:33.795415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:33.892081 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-60b21d08-26a4-48fa-9a0f-1fb87f28c1e4 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.121070 May 14 21:14:33.897955 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 488/976] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:33 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:33.903017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:33.908335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:33.937529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.938604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.940120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:33.941153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:33.972039 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac206667-1bfd-44eb-a5a7-6b5d7a687353 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577049 May 14 21:14:33.974034 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 489/977] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:33.989258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:33.994411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:34.021345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:34.022748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:34.024591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:34.027815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:34.370582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:34.383668 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd56575c-52d9-4245-a129-7d9f30bc34df tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1274 microversion: 2.1 time: 0.408393 May 14 21:14:34.384889 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 490/978] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:33 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1274 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:34.392515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:34.393755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:34.400874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:34.403814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:34.406390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:34.407008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:34.424072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:34.428110 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d225c9e5-64a2-4353-a5de-52ee14be0dd5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.528850 May 14 21:14:34.431891 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 489/979] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:33 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:34.447184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d901c8d4-3b03-4c7b-84a2-e19d9f6d146b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:34.447882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d901c8d4-3b03-4c7b-84a2-e19d9f6d146b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:34.867401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d901c8d4-3b03-4c7b-84a2-e19d9f6d146b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:34.877046 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d901c8d4-3b03-4c7b-84a2-e19d9f6d146b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1277 microversion: 2.1 time: 0.439945 May 14 21:14:34.877640 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 490/980] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:34 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1277 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:34.882737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:34.885338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:34.900571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:34.906254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:34.906254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:34.906254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:34.981298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:34.989901 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54596aa9-05e0-45bd-8c18-6b4e66e42d30 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.603740 May 14 21:14:34.990492 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 491/981] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:34 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:34.997122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:34.998087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:35.014139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.014775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:35.018103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.036162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:35.119259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:35.133893 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7d4fb51-c589-4ab8-b85d-fc347120bf18 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1321 microversion: 2.1 time: 0.250698 May 14 21:14:35.135108 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 491/982] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:34 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:35.144663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a96c0220-aa59-43b2-b3a3-08245f66756c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7f64160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:35.242821 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a96c0220-aa59-43b2-b3a3-08245f66756c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.106940 May 14 21:14:35.249115 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 492/983] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:35 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:35.403424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:35.404813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:35.411408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.412344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:35.413323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.413760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:35.570997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:35.584496 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7264a86d-9c6b-44e5-8616-977ba5a38054 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1274 microversion: 2.1 time: 0.186837 May 14 21:14:35.601148 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 493/984] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:35 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:35.612042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:35.612840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:35.617064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:35.624417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.625118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:35.626015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.626193 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28855de9-4fe0-4348-a43f-e23f24aa504d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.633357 May 14 21:14:35.626756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:35.646356 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 492/985] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:34 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:35.895763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:35.896396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:35.908131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:35.931743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.932991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:35.934773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:35.938131 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-402f900c-d3f7-41a0-8d1f-9cdaf85a2624 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.335729 May 14 21:14:35.938734 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 494/986] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:35 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:35.939983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.041352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:36.041352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:36.056843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.057862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.063183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.067164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.075378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:36.100608 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f9ccf73-61b9-42b9-8598-a509a50b618b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1273 microversion: 2.1 time: 0.198879 May 14 21:14:36.101995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 493/987] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:35 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:36.152173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ebbc50a4-f5bb-43d6-a76a-72693d8949a1 req-0cfee65c-0360-44a6-94b8-8ee6a7d25e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe390af-35f4-4cf5-91c5-994e9c2dc488", "name": "network-vif-plugged", "status": "completed", "tag": "75e96c25-9a97-4ee1-a8c0-34cdddac4e11"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:36.155401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ebbc50a4-f5bb-43d6-a76a-72693d8949a1 req-0cfee65c-0360-44a6-94b8-8ee6a7d25e54 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.158961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ebbc50a4-f5bb-43d6-a76a-72693d8949a1 req-0cfee65c-0360-44a6-94b8-8ee6a7d25e54 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.174472 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ebbc50a4-f5bb-43d6-a76a-72693d8949a1 req-0cfee65c-0360-44a6-94b8-8ee6a7d25e54 service nova] Creating event network-vif-plugged:75e96c25-9a97-4ee1-a8c0-34cdddac4e11 for instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 on nch1-master-1 May 14 21:14:36.180730 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ebbc50a4-f5bb-43d6-a76a-72693d8949a1 req-0cfee65c-0360-44a6-94b8-8ee6a7d25e54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077037 May 14 21:14:36.181574 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 494/988] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:36.190310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:36.191325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:36.202025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.202918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.204220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.205664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.455337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:36.462965 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9082e0c1-57ba-445e-8d4b-38c6e4da016b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 0.455965 May 14 21:14:36.463581 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 495/989] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:36 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:36.469034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c71251a1-d284-42e2-b3bd-f45bd14f144b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7bfe670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:36.497505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:36.507947 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ccbc7ccd-3f79-4b14-8936-704fcea8314d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1471 microversion: 2.1 time: 0.324102 May 14 21:14:36.509358 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 495/990] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:36 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1471 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:36.520438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c71251a1-d284-42e2-b3bd-f45bd14f144b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.055080 May 14 21:14:36.521494 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 496/991] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:36 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:36.525367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:36.533220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:36.539892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.540803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.541907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.543121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.569242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lazy-loading 'flavor' on Instance uuid 28ccd9ac-9784-4ddc-9814-436c67c3b385 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:14:36.605232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:36.606198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:36.612534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.612986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.613778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.614227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.801353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:36.813015 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c38ce814-d999-4fe3-a9d8-c3bddaad88f6 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.211364 May 14 21:14:36.817095 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 497/992] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:36 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:36.824995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:36.831061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:36.846301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.846790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.847614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.848062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.922070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7ec4db9-2549-4f28-9b3e-0fa7120e93d6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385/action" status: 202 len: 0 microversion: 2.1 time: 0.400265 May 14 21:14:36.926285 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 496/993] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:36 2022] POST /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:36.936989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31852aee-a7ca-4df2-ab3e-9f7a9451aabd tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:36.937715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31852aee-a7ca-4df2-ab3e-9f7a9451aabd tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:36.956185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31852aee-a7ca-4df2-ab3e-9f7a9451aabd tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.956639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31852aee-a7ca-4df2-ab3e-9f7a9451aabd tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:36.959926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31852aee-a7ca-4df2-ab3e-9f7a9451aabd tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:36.960587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31852aee-a7ca-4df2-ab3e-9f7a9451aabd tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.253249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:37.266187 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29d38b4c-a959-4e9a-ab19-38be6ecba13c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.444036 May 14 21:14:37.267156 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 498/994] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:36 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:37.279157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:37.280672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:37.288532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.289307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.290620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.291283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.480888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:37.492759 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2bbf6871-dd93-4e7a-b341-7f238243a511 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.220949 May 14 21:14:37.493970 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 499/995] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:37 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:37.505170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:37.505955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:37.524298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.524935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.525891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.526520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.636283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:37.638339 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-385b49bf-93e5-4ed2-ac46-8b254a9a3c23 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1337 microversion: 2.1 time: 0.142254 May 14 21:14:37.638489 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31852aee-a7ca-4df2-ab3e-9f7a9451aabd tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1630 microversion: 2.1 time: 0.710348 May 14 21:14:37.638995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 497/996] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:36 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1630 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:37.640328 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 500/997] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:37 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1337 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:37.649242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-daabcfc0-ba4a-4b13-a9c0-da7d7933c3e0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c65c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:37.654921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:37.656468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:37.666065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.666886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.669892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.669892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.700052 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-daabcfc0-ba4a-4b13-a9c0-da7d7933c3e0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.054889 May 14 21:14:37.700940 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 501/998] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:37 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:37.832045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:37.832676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:37.850941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.851423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:37.852257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:37.854254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.208192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:38.218078 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba257994-777f-46db-8e8b-68dae18c1447 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.389794 May 14 21:14:38.223454 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 502/999] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:37 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:38.284179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:38.284952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:38.293504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.294391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.296425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.297128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.617386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:38.626285 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71b43215-90b1-4d02-aac9-9711067f7e8e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1503 microversion: 2.1 time: 0.346057 May 14 21:14:38.634033 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 503/1000] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:38 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1503 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:38.639046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:38.644188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:38.655745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.660305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.661464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.662000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.809756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:38.821056 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d2f29951-1d36-4b2e-8c5b-d4995d48b612 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1317 microversion: 2.1 time: 1.169734 May 14 21:14:38.821056 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 498/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:37 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1317 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:38.834187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:38.835021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:38.850004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.853348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.856321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.860290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.953424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:38.964962 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d110345-0b61-4eb4-83fc-adfeba12aa33 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.329823 May 14 21:14:38.974655 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 504/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:38 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:38.980272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d335487b-f052-4147-8c19-bf1436b704a3 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:38.981282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d335487b-f052-4147-8c19-bf1436b704a3 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:38.988820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d335487b-f052-4147-8c19-bf1436b704a3 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.990053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d335487b-f052-4147-8c19-bf1436b704a3 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:38.991128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d335487b-f052-4147-8c19-bf1436b704a3 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:38.991888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d335487b-f052-4147-8c19-bf1436b704a3 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.034707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:39.048705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c177937-30a8-4455-9455-5fcff4347f0b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1335 microversion: 2.1 time: 0.226629 May 14 21:14:39.049699 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 499/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:38 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1335 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:39.058325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88fec907-de32-41ac-9c35-147013f827df tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7cdba60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:39.176280 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88fec907-de32-41ac-9c35-147013f827df tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.125097 May 14 21:14:39.182306 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 500/1004] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:39 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:39.232136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2f5efaa4-92ff-49e6-a581-c02c1a94a07b req-3651f12e-f993-4997-8267-97d9eeb4d9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f17f45dd-b0ff-4097-8de4-b6ffc68de7d9", "tag": "ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:39.253782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2f5efaa4-92ff-49e6-a581-c02c1a94a07b req-3651f12e-f993-4997-8267-97d9eeb4d9b5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.254332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2f5efaa4-92ff-49e6-a581-c02c1a94a07b req-3651f12e-f993-4997-8267-97d9eeb4d9b5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.282393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2f5efaa4-92ff-49e6-a581-c02c1a94a07b req-3651f12e-f993-4997-8267-97d9eeb4d9b5 service nova] Creating event network-changed:ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa for instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 on nch2-master-1 May 14 21:14:39.292826 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2f5efaa4-92ff-49e6-a581-c02c1a94a07b req-3651f12e-f993-4997-8267-97d9eeb4d9b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065899 May 14 21:14:39.293154 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d335487b-f052-4147-8c19-bf1436b704a3 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1613 microversion: 2.1 time: 0.317008 May 14 21:14:39.294722 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 505/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:38 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1613 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:39.294857 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 501/1006] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:14:39.319608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:39.320526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:39.324798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:39.327040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:39.332901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.333364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.334163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.334614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.360025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.360606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.361469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.362885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.395378 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] HTTP exception thrown: Cannot 'migrate' instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 while it is in vm_state suspended May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Request method failure captured: May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385/action HTTP/1.1 May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 15 May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuPCb5GWMuUgI25NgbI6jEuveAv2TPQy5ma2TiIn6PD_rYz9y_KFQGGlxYbgnKTaNJRuu7kHd8EvtT72svo1XYwk2cvq9uA08peylLFCTV0Swq2VGxLlakqaMRSMkrn1gz7zpZOguJP0qd0Q8-GIB7sS6UZU4Nge1LOwHioF3CbgaM May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:14:39.397667 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224e7cf6cf474b02ac095458aa4add5d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: f936cc3ccd8b4fcdb55ab14c013ae684 May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: {"migrate": {}} May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:39.399383 ncdv-master-1 devstack@n-api.service[130638]: exception: Cannot 'migrate' instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 while it is in vm_state suspended May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '28ccd9ac-9784-4ddc-9814-436c67c3b385', 'body': {'migrate': {}}} May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 in vm_state suspended. Cannot resize while the instance is in this state. May 14 21:14:39.400463 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 while it is in vm_state suspended May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.403184 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.407645 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.407645 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.407645 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:39.407645 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:39.407645 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 while it is in vm_state suspended May 14 21:14:39.407645 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.407645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Returning 409 to user: Cannot 'migrate' instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 while it is in vm_state suspended {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:39.408501 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-da955fc0-5c08-4136-9fd0-975a94959ea6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385/action" status: 409 len: 148 microversion: 2.1 time: 0.089461 May 14 21:14:39.411401 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 506/1007] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:39 2022] POST /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385/action => generated 148 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 14 21:14:39.424798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efd5e403-2e1f-4d6f-a309-1c08e89c4aa6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efd5e403-2e1f-4d6f-a309-1c08e89c4aa6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Request method failure captured: May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce/action HTTP/1.1 May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 39 May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuPCb5GWMuUgI25NgbI6jEuveAv2TPQy5ma2TiIn6PD_rYz9y_KFQGGlxYbgnKTaNJRuu7kHd8EvtT72svo1XYwk2cvq9uA08peylLFCTV0Swq2VGxLlakqaMRSMkrn1gz7zpZOguJP0qd0Q8-GIB7sS6UZU4Nge1LOwHioF3CbgaM May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:14:39.430725 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224e7cf6cf474b02ac095458aa4add5d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: f936cc3ccd8b4fcdb55ab14c013ae684 May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: {"os-resetState": {"state": "invalid"}} May 14 21:14:39.434210 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd60f4941-2ff2-4617-b99c-46ae90d97bce', 'body': {'os-resetState': {'state': 'invalid'}}} May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'invalid' May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.435871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:14:39.437492 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 14 21:14:39.438871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.438871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efd5e403-2e1f-4d6f-a309-1c08e89c4aa6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:39.440015 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-efd5e403-2e1f-4d6f-a309-1c08e89c4aa6 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce/action" status: 400 len: 144 microversion: 2.1 time: 0.019309 May 14 21:14:39.441109 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 507/1008] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:39 2022] POST /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce/action => generated 144 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:14:39.453975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b69dd4b-618d-44ed-a928-60bf31558595 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b69dd4b-618d-44ed-a928-60bf31558595 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Request method failure captured: May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce/action HTTP/1.1 May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 31 May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuPCb5GWMuUgI25NgbI6jEuveAv2TPQy5ma2TiIn6PD_rYz9y_KFQGGlxYbgnKTaNJRuu7kHd8EvtT72svo1XYwk2cvq9uA08peylLFCTV0Swq2VGxLlakqaMRSMkrn1gz7zpZOguJP0qd0Q8-GIB7sS6UZU4Nge1LOwHioF3CbgaM May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:14:39.456645 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224e7cf6cf474b02ac095458aa4add5d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: f936cc3ccd8b4fcdb55ab14c013ae684 May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: {"os-resetState": {"state": 1}} May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:39.458314 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd60f4941-2ff2-4617-b99c-46ae90d97bce', 'body': {'os-resetState': {'state': 1}}} May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 1 May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:39.459254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 14 21:14:39.460894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.462249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b69dd4b-618d-44ed-a928-60bf31558595 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:39.462249 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0b69dd4b-618d-44ed-a928-60bf31558595 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce/action" status: 400 len: 120 microversion: 2.1 time: 0.011498 May 14 21:14:39.462938 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 508/1009] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:39 2022] POST /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce/action => generated 120 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:14:39.475501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-75839357-e308-4f8d-b9f7-6bf12c295022 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:39.476509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-75839357-e308-4f8d-b9f7-6bf12c295022 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Failed to fetch instance by id 999 {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2926}} May 14 21:14:39.477099 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-75839357-e308-4f8d-b9f7-6bf12c295022 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] HTTP exception thrown: Instance 999 could not be found. May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-75839357-e308-4f8d-b9f7-6bf12c295022 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Request method failure captured: May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 37 May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuPCb5GWMuUgI25NgbI6jEuveAv2TPQy5ma2TiIn6PD_rYz9y_KFQGGlxYbgnKTaNJRuu7kHd8EvtT72svo1XYwk2cvq9uA08peylLFCTV0Swq2VGxLlakqaMRSMkrn1gz7zpZOguJP0qd0Q8-GIB7sS6UZU4Nge1LOwHioF3CbgaM May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:14:39.478944 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/224e7cf6cf474b02ac095458aa4add5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_224e7cf6cf474b02ac095458aa4add5d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 224e7cf6cf474b02ac095458aa4add5d May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-768721210 May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: f936cc3ccd8b4fcdb55ab14c013ae684 May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminNegativeTestJSON-768721210-project-admin May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: {"os-resetState": {"state": "error"}} May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:39.480667 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 999 could not be found. May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:39.481704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 14 21:14:39.483205 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:39.484755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-75839357-e308-4f8d-b9f7-6bf12c295022 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:39.486897 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-75839357-e308-4f8d-b9f7-6bf12c295022 tempest-ServersAdminNegativeTestJSON-768721210 tempest-ServersAdminNegativeTestJSON-768721210-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.016044 May 14 21:14:39.487899 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 509/1010] 10.222.0.52 () {60 vars in 1178 bytes} [Sat May 14 21:14:39 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:14:39.501681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:39.512469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:39.522440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.522923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.524618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.525139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.563750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:14:39.938245 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c7a9661d-1f1b-4e5d-9981-b599f84eb922 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "DELETE /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 204 len: 0 microversion: 2.1 time: 0.442579 May 14 21:14:39.944935 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 510/1011] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:39 2022] DELETE /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:14:39.945710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:39.946706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:39.958138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.959920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:39.960980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:39.961496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.164585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:40.189979 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b227a8c-237f-44c5-831d-6965daa0207f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1493 microversion: 2.1 time: 0.236028 May 14 21:14:40.191011 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 511/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:39 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1493 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:40.204292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:40.205311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:40.218804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.224835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.225899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.226854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.422353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:40.432366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:40.440633 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-10cc82df-b0fe-492c-90e9-ab446792e97b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 1.144108 May 14 21:14:40.443147 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b721c5be-9e34-4f10-98e3-63f10d88ee1d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1506 microversion: 2.1 time: 0.251029 May 14 21:14:40.443305 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 502/1013] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:39 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:40.444471 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 512/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:40 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1506 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:40.449966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:40.451029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:40.459136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.459855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.461202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.461817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.462532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:40.463109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:40.482944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.483434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.484296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.484746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.729741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:40.741051 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d98d504-7b54-48f4-8fd9-c3a6ec49ee22 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.295119 May 14 21:14:40.741645 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 513/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:40 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:40.756572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:40.757463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:40.764569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.765025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.765808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.766248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:40.903822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:40.913250 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4cb61e9c-f603-47b1-8132-219a52aa161a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1335 microversion: 2.1 time: 0.160848 May 14 21:14:40.914990 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 514/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:40 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1335 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:40.921794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-74824b73-2dc3-481b-8e56-4a32d812ba27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7e09f70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:40.978620 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-74824b73-2dc3-481b-8e56-4a32d812ba27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.062355 May 14 21:14:40.980437 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 515/1017] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:40 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:40.987064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07bc7cb3-f425-41f2-9320-94377ebbda0d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '.version_select at 0x7fb1a7cf7c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:40.990479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07bc7cb3-f425-41f2-9320-94377ebbda0d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:40.991090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07bc7cb3-f425-41f2-9320-94377ebbda0d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.002991 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07bc7cb3-f425-41f2-9320-94377ebbda0d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1184 microversion: 2.1 time: 0.020772 May 14 21:14:41.004371 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 516/1018] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:14:40 2022] GET /compute/v2.1/os-migrations => generated 1184 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:41.012618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:41.013424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:41.022424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.023425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.024439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.025211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.076718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:41.088200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b049b65c-3ebc-427a-a559-a5bda644874b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1468 microversion: 2.1 time: 0.633479 May 14 21:14:41.089074 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 503/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:40 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1468 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:41.093681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a0fce18-4694-4b6b-b8eb-3c6168f3359d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:41.094349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3a0fce18-4694-4b6b-b8eb-3c6168f3359d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:41.116570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a0fce18-4694-4b6b-b8eb-3c6168f3359d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.117030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a0fce18-4694-4b6b-b8eb-3c6168f3359d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.117816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a0fce18-4694-4b6b-b8eb-3c6168f3359d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.118258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a0fce18-4694-4b6b-b8eb-3c6168f3359d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.449369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:41.472464 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53c1663d-b1dd-47bc-84da-8d6169e473f2 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1506 microversion: 2.1 time: 0.466503 May 14 21:14:41.491352 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 517/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:41 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1506 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:41.514895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a6812eda-911d-45dd-9f46-563f797dceb1 req-5ae5dfd5-5b2e-42b8-9e28-2a1d5d4a82dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac73d4c4-6570-4088-84ab-55624bd26151", "tag": "697c8ba4-8a0f-466b-b7c1-d492695fc4dd"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:41.529901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a6812eda-911d-45dd-9f46-563f797dceb1 req-5ae5dfd5-5b2e-42b8-9e28-2a1d5d4a82dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.534315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a6812eda-911d-45dd-9f46-563f797dceb1 req-5ae5dfd5-5b2e-42b8-9e28-2a1d5d4a82dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.564472 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a6812eda-911d-45dd-9f46-563f797dceb1 req-5ae5dfd5-5b2e-42b8-9e28-2a1d5d4a82dc service nova] Creating event network-changed:697c8ba4-8a0f-466b-b7c1-d492695fc4dd for instance ac73d4c4-6570-4088-84ab-55624bd26151 on nch1-master-1 May 14 21:14:41.575666 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a6812eda-911d-45dd-9f46-563f797dceb1 req-5ae5dfd5-5b2e-42b8-9e28-2a1d5d4a82dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074245 May 14 21:14:41.577099 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 518/1021] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:41.589072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:41.594611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:41.627365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.628062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.629294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.629771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.724939 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a0fce18-4694-4b6b-b8eb-3c6168f3359d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1644 microversion: 2.1 time: 0.629456 May 14 21:14:41.745338 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 504/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:41 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1644 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:41.765844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a3b5d27-f346-4704-9a08-98ec3251cff8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:41.765844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a3b5d27-f346-4704-9a08-98ec3251cff8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:41.833809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a3b5d27-f346-4704-9a08-98ec3251cff8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.834292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a3b5d27-f346-4704-9a08-98ec3251cff8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:41.835119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a3b5d27-f346-4704-9a08-98ec3251cff8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:41.836358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a3b5d27-f346-4704-9a08-98ec3251cff8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:42.255025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:42.268578 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-874493d6-9c64-4b8e-b565-ac179ee1037d tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.689718 May 14 21:14:42.269606 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 519/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:41 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:42.282669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:42.284534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:42.295444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:42.296278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:42.297479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:42.298251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:42.368849 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a3b5d27-f346-4704-9a08-98ec3251cff8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "PUT /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1078 microversion: 2.1 time: 0.622038 May 14 21:14:42.369599 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 505/1024] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:14:41 2022] PUT /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1078 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:42.380511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1569272697", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "50d8d8e6-f9b7-435c-a51a-cb3e21091d0c"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:42.493105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] validate_networks() for [('50d8d8e6-f9b7-435c-a51a-cb3e21091d0c', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:14:43.126701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:43.138461 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcb61939-78cc-48fd-a937-0683dbf0ed5c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.865597 May 14 21:14:43.140324 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 520/1025] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:42 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:43.154141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:43.155697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:43.162102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:43.162570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:43.163375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:43.163866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:43.471105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:43.480170 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-772bffc5-7ff9-4f0a-a6a5-06056b90ebdd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.331196 May 14 21:14:43.480976 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 521/1026] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:43 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:43.488431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-44bd9f50-40cc-40dd-94a7-ceb07a8b9e33 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c658b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:43.583074 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-44bd9f50-40cc-40dd-94a7-ceb07a8b9e33 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.098067 May 14 21:14:43.584290 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 522/1027] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:43 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:43.590670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:43.591952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:43.600940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:43.601628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:43.603415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:43.604864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:43.901107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:43.943148 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-621fc810-bc8f-4251-90e7-a6de06346bd2 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1426 microversion: 2.1 time: 0.356390 May 14 21:14:43.958325 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 523/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:43 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1426 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:43.981645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:43.983437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:43.997355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:43.999757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:44.000715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:44.002532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:44.002652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.003143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.003580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:44.004009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.004463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.017107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.018003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.019118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.019828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.049296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:14:44.056401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for user 038739f45c3d4ab09457d6eed20b41d4 and project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:14:44.072196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:14:44.075454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:14:44.180676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:44.190536 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-643c64ab-da9b-4e26-9c3d-49fca0c3a439 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1504 microversion: 2.1 time: 0.229695 May 14 21:14:44.191642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 524/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:43 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:44.208584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:44.210381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:44.219045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.219896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.220934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.221598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.239056 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5b599c06-6730-455b-ad57-adab28c850ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.864267 May 14 21:14:44.246909 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 506/1030] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:14:44.257359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d11970d3-2eeb-46ab-81e2-2b13f7bdf35b req-ed1a121b-2bfe-449e-b67e-6d9a3a418422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28ccd9ac-9784-4ddc-9814-436c67c3b385", "name": "network-vif-deleted", "tag": "8c0c2d02-7d8e-43a9-a4d9-3e656eaa1a2e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:44.298588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d11970d3-2eeb-46ab-81e2-2b13f7bdf35b req-ed1a121b-2bfe-449e-b67e-6d9a3a418422 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.306715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d11970d3-2eeb-46ab-81e2-2b13f7bdf35b req-ed1a121b-2bfe-449e-b67e-6d9a3a418422 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.350297 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d11970d3-2eeb-46ab-81e2-2b13f7bdf35b req-ed1a121b-2bfe-449e-b67e-6d9a3a418422 service nova] Creating event network-vif-deleted:8c0c2d02-7d8e-43a9-a4d9-3e656eaa1a2e for instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 on nch1-master-1 May 14 21:14:44.377266 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d11970d3-2eeb-46ab-81e2-2b13f7bdf35b req-ed1a121b-2bfe-449e-b67e-6d9a3a418422 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117788 May 14 21:14:44.379532 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 507/1031] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:44.395191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:44.396127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:44.409075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.411835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.412666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.413124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.643330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:44.655299 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c50938a1-ed97-4520-b0ee-3e03b603a26a tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.450768 May 14 21:14:44.666450 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 525/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:44 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:44.672281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:44.673189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:44.680329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.681174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.682214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.682943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.752493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:44.761204 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-51e8f322-3a17-4f54-8b3f-f5e3eee20275 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.379678 May 14 21:14:44.770668 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 508/1033] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:44 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:44.783175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a7e6c52-5ade-44cd-aee2-a49cdcb8e462 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:44.783705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a7e6c52-5ade-44cd-aee2-a49cdcb8e462 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:44.881467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:44.887989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a7e6c52-5ade-44cd-aee2-a49cdcb8e462 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:44.892335 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0195501c-5018-4d19-b6f3-e85bd6a250b7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1504 microversion: 2.1 time: 0.221900 May 14 21:14:44.904896 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 526/1034] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:44 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1504 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:44.910974 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a7e6c52-5ade-44cd-aee2-a49cdcb8e462 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1211 microversion: 2.1 time: 0.133927 May 14 21:14:44.911132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:44.911817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:44.914105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 509/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:44 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:44.928532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97e8bbf6-fd61-498d-b11e-b07a32a508d5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7d3fee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:44.936582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.937052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:44.937855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:44.938325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.056988 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97e8bbf6-fd61-498d-b11e-b07a32a508d5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.140135 May 14 21:14:45.064535 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 510/1036] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:44 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:45.084556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:45.090968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:45.108326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.111122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.113171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.115533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.240880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:45.252221 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a58bac78-bd41-4136-9330-8f999f8ed313 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.344695 May 14 21:14:45.253028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:45.253466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:45.254596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:45.255205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:45.255885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:45.263535 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 527/1037] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:44 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:45.269197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:45.274819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:45.282086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.282810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.284311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.285497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.378603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:45.388963 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c0d58c48-5ec2-4945-b0d4-619b90c42e48 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1426 microversion: 2.1 time: 0.124266 May 14 21:14:45.390065 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 528/1038] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:45 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1426 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:45.394987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4391031b-103f-48dc-91ef-f2f543ca43e6 req-f0caa005-d04b-4a52-bd30-9f13c41b9507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:45.404049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4391031b-103f-48dc-91ef-f2f543ca43e6 req-f0caa005-d04b-4a52-bd30-9f13c41b9507 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.410609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4391031b-103f-48dc-91ef-f2f543ca43e6 req-f0caa005-d04b-4a52-bd30-9f13c41b9507 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.425381 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4391031b-103f-48dc-91ef-f2f543ca43e6 req-f0caa005-d04b-4a52-bd30-9f13c41b9507 service nova] Creating event network-changed:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch1-master-1 May 14 21:14:45.431566 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4391031b-103f-48dc-91ef-f2f543ca43e6 req-f0caa005-d04b-4a52-bd30-9f13c41b9507 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040059 May 14 21:14:45.432857 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 529/1039] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:45.509834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:45.523948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.525031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.528033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.528717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.619962 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0958a4e-ac3a-4654-9487-be7b2444ebda tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "POST /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488/action" status: 202 len: 1110 microversion: 2.1 time: 0.553699 May 14 21:14:45.623344 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 511/1040] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:45 2022] POST /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488/action => generated 1110 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 14 21:14:45.648806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:45.649624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:45.664332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.665292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.669246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.670021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.674777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:45.675528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:45.697154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.699067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.702854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.704797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.906330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:45.914475 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58844675-8638-4c8f-a9d1-056cfa5603c5 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.243651 May 14 21:14:45.943861 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 512/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:45 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:45.949363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:45.949995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:45.953040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:45.959179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.959686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.960494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:45.961160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:45.978934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bbf22b0e-f5a1-4dbf-b38a-45dba5f07f8e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.329000 May 14 21:14:45.988210 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 530/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:45 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:45.996983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:45.997994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:46.005042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.006221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.006922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.007911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.128778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:46.164235 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-955482c2-08f6-474c-bf77-55accb65a020 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1215 microversion: 2.1 time: 0.170922 May 14 21:14:46.176514 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 531/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:45 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:46.188141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9354f8ee-da0f-4b52-a1e3-43da5da63e95 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7bfe280>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:46.249356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:46.258752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1be898ae-dc86-4f04-9995-a4a1cbfc784d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.310791 May 14 21:14:46.261203 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 513/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:45 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:46.269024 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9354f8ee-da0f-4b52-a1e3-43da5da63e95 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.089238 May 14 21:14:46.270275 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 532/1045] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:46 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:46.270847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:46.276802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:46.287820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.288286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.292558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.293188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.407874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:46.409097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:46.430900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.430900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.430900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.430900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.516224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.517481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.518988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lazy-loading 'fault' on Instance uuid 28ccd9ac-9784-4ddc-9814-436c67c3b385 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:14:46.551206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:46.563647 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53269cc6-1bf0-4660-bc7b-0c6002e79939 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.296296 May 14 21:14:46.568823 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 514/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:46 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:46.576447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:46.584896 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07d11b5a-62f9-4e36-a158-9427cd43922d tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 200 len: 1311 microversion: 2.1 time: 0.181547 May 14 21:14:46.586940 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 533/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:46 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 1311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:46.951489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:46.952127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:46.960459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.961161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:46.962143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:46.962768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.008156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:47.008791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:47.018155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.018618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.019412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.020071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.208863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:47.217070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b31a40df-239b-4e6e-8296-288a1c748b8f tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.270355 May 14 21:14:47.224392 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 515/1048] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:46 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:47.237644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:47.249933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:47.262413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.264320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.265502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.266209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.287252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:47.295233 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eda5b7fa-84eb-4cdb-b753-df5171a6a1af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.292552 May 14 21:14:47.295857 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 534/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:47 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:47.309786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:47.312762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:47.325061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.325522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.328834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.329296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.485895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:47.497296 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b372acc5-2491-45a9-b2c5-82a8b625f3da tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1271 microversion: 2.1 time: 0.270185 May 14 21:14:47.497810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 516/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:47 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:47.504073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1dd3325e-cafa-4ec7-bd4a-44498584d7ff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7cda280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:47.596223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:47.607155 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43a32538-723e-4203-a9e3-f861aa320ed5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.310091 May 14 21:14:47.607804 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1dd3325e-cafa-4ec7-bd4a-44498584d7ff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.107576 May 14 21:14:47.608644 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 517/1051] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:47 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:47.623393 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 535/1052] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:47 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:47.627984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:47.629862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:47.630036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:47.630036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: 28ccd9ac-9784-4ddc-9814-436c67c3b385] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:47.639266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.639843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.640497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.641055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.641638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.642213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.642439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.643035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.683823 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] HTTP exception thrown: Instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 could not be found. May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Request method failure captured: May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 HTTP/1.1 May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuOlk6HZ9_HOk5M05dYeVQuT4Gj1ug_S-hReWQpWSUPhz2URtgA1Xu28ouukNoSiqmFJlTId7p_xgw1aUejCyxVMYE0kPH2CwCUga51IThWkkqzFrdxdjvDY3aDwFYLPoWhVfxBnFbs_u_599VbMFf7Kr7YwPzo4cEjkngZOx0V6a8 May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f04e1accfc534fb18e36d789a9cefde3 May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-659635021 May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:47.700750 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f04e1accfc534fb18e36d789a9cefde3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f04e1accfc534fb18e36d789a9cefde3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f04e1accfc534fb18e36d789a9cefde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f04e1accfc534fb18e36d789a9cefde3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminNegativeTestJSON-659635021 May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f04e1accfc534fb18e36d789a9cefde3 May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-659635021 May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminNegativeTestJSON-659635021-project May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 32240804909d4572880a0f419f49f61e May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminNegativeTestJSON-659635021-project May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 could not be found. May 14 21:14:47.702264 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '28ccd9ac-9784-4ddc-9814-436c67c3b385'} May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 could not be found. May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:47.703049 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 could not be found. May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 could not be found. May 14 21:14:47.704337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:47.705469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Returning 404 to user: Instance 28ccd9ac-9784-4ddc-9814-436c67c3b385 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:47.705469 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b925f67-8d01-48d7-9e34-410bfa638d4b tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385" status: 404 len: 111 microversion: 2.1 time: 0.062200 May 14 21:14:47.705469 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 536/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:47 2022] GET /compute/v2.1/servers/28ccd9ac-9784-4ddc-9814-436c67c3b385 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:47.711975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:47.712649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:47.731215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.731777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.732558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:47.733008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:47.768234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:14:47.961516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:47.969736 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c67c6ae-0b8d-4b52-96aa-6bd7436c10b0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.359868 May 14 21:14:47.970330 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 518/1054] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:47 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:48.246144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:48.246793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:48.264233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:48.264934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:48.265683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:48.266322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:48.529168 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-daa206ff-6f4d-46e9-8082-00ec7e5e713c tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 204 len: 0 microversion: 2.1 time: 0.820776 May 14 21:14:48.532973 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 537/1055] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:47 2022] DELETE /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 0 bytes in 823 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:14:48.554964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:48.555946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:48.581717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:48.583678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:48.585457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:48.586332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:48.881744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:48.890527 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b7bb87f-e7a0-4f59-95e7-232e2264c917 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.357651 May 14 21:14:48.902979 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 538/1056] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:48 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:48.910376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2408fbca-c5a6-4890-b2ae-6e0824d6e26a req-a821677d-28f8-494d-9477-e92fbe8db225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f45dd-b0ff-4097-8de4-b6ffc68de7d9", "name": "network-vif-plugged", "status": "completed", "tag": "ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:48.935421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2408fbca-c5a6-4890-b2ae-6e0824d6e26a req-a821677d-28f8-494d-9477-e92fbe8db225 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:48.936248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2408fbca-c5a6-4890-b2ae-6e0824d6e26a req-a821677d-28f8-494d-9477-e92fbe8db225 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:48.952537 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2408fbca-c5a6-4890-b2ae-6e0824d6e26a req-a821677d-28f8-494d-9477-e92fbe8db225 service nova] Creating event network-vif-plugged:ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa for instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 on nch2-master-1 May 14 21:14:48.958522 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2408fbca-c5a6-4890-b2ae-6e0824d6e26a req-a821677d-28f8-494d-9477-e92fbe8db225 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057197 May 14 21:14:48.959467 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 539/1057] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:48.966223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:48.966949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:48.973663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:48.974445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:48.975460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:48.975945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:48.998679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:49.008880 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9b81e02-d67f-4bbb-83c3-f5be087514be tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.771617 May 14 21:14:49.024410 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 519/1058] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:48 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:49.038443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:49.039089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:49.054242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.054764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:49.057358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.057822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:49.188918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:49.196867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9ebbd9c1-a7ca-4f25-9e3c-733579c67231 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.236104 May 14 21:14:49.203133 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 540/1059] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:48 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:49.206126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-355adf5a-1f67-40bf-adc9-94225066e349 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c72160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:49.257541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:49.261440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-355adf5a-1f67-40bf-adc9-94225066e349 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1455 microversion: 2.1 time: 0.062308 May 14 21:14:49.262033 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 541/1060] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:49 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1455 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:49.268583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:49.269207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:49.269384 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-068726e8-143b-4469-a51c-6c13ff10e47a tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1478 microversion: 2.1 time: 0.243805 May 14 21:14:49.270505 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 520/1061] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:49 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1478 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:49.275402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.276494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:49.277441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.277878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:49.283892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:49.284649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:49.291360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.306382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:49.306382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.306382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:49.415607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:49.423342 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8ea44626-3b26-402d-8ada-cb420142c0e5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.160172 May 14 21:14:49.433471 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 542/1062] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:49 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:49.434048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:49.439153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb124f94-54ce-436b-a92b-d8a9de25ef59 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.167343 May 14 21:14:49.439783 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 521/1063] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:49 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:49.910239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:49.910851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:49.917904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.918621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:49.919617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:49.920223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.070946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5de32c7c-22fb-4654-a82b-7d2d0c766e4c tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Calling method '.version_select at 0x7fb1a7cf7040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.073226 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:50.073226 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:14:50.078278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5de32c7c-22fb-4654-a82b-7d2d0c766e4c tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.078278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5de32c7c-22fb-4654-a82b-7d2d0c766e4c tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.078278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5de32c7c-22fb-4654-a82b-7d2d0c766e4c tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.078278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5de32c7c-22fb-4654-a82b-7d2d0c766e4c tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.102307 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5de32c7c-22fb-4654-a82b-7d2d0c766e4c tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.208258 May 14 21:14:50.109099 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 543/1064] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:14:49 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:50.113875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.114609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:50.121500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.121951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.127523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.127523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.127747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:50.131785 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59f5fc75-7e7d-49b1-ba1c-03d65e6ef623 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.225376 May 14 21:14:50.132639 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 522/1065] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:49 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:50.294996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c41abb2d-a6f2-4ede-b659-888d028a5c91 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Calling method '.version_select at 0x7fb1a7cdb8b0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.296393 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:50.296393 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:14:50.297507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c41abb2d-a6f2-4ede-b659-888d028a5c91 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '8888db1ad60b4d5fac18c12a1feb7dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15161169aaf4f1e89389598bdc8e710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:50.298217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c41abb2d-a6f2-4ede-b659-888d028a5c91 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Request method failure captured: May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvIKrB3iBaC-m6ukCdhqJhfRMw1MzFT-o6quAX3x1GibQTUb3Qlqz59rQe3ZgObcoJR8nGAnATix7a9kpM-nRj_v6cM44EF4xk0qSDkR4-nWgMauI-QjBvLKlDfOMJES32o5gaIobGkYlKk0kGZ2gDjuquALsR_O6w1YkxUq1-W6q4 May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:50.299722 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f15161169aaf4f1e89389598bdc8e710", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 8888db1ad60b4d5fac18c12a1feb7dea May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:14:50.301301 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:50.302336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 14 21:14:50.303631 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:50.304751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c41abb2d-a6f2-4ede-b659-888d028a5c91 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:50.304751 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c41abb2d-a6f2-4ede-b659-888d028a5c91 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] 10.222.0.52 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.167359 May 14 21:14:50.304751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 523/1066] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:50.308375 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-725fee11-cb86-4337-b8c0-c73d6442ad8b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.198147 May 14 21:14:50.309523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 544/1067] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:50.311932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.312780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:50.323129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-93e20cf0-0cc9-472b-8419-03aeeebe6566 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7bfe8b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.323861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.324319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.325140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.325707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.373416 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-93e20cf0-0cc9-472b-8419-03aeeebe6566 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1464 microversion: 2.1 time: 0.062863 May 14 21:14:50.374002 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 545/1068] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1464 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:50.379654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.380275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:50.387731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.388190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.388971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.389446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.527608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:50.535579 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43b4f334-02ca-4f6b-96b0-ebebe1f16934 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1478 microversion: 2.1 time: 0.159830 May 14 21:14:50.536161 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 546/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1478 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:50.541319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1def4ba-76ad-455c-9c5f-842fb75cb092 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Calling method '.version_select at 0x7fb1a7bfe0d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.542150 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:50.542150 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:14:50.543500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a1def4ba-76ad-455c-9c5f-842fb75cb092 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '8888db1ad60b4d5fac18c12a1feb7dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15161169aaf4f1e89389598bdc8e710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1def4ba-76ad-455c-9c5f-842fb75cb092 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Request method failure captured: May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvIKrB3iBaC-m6ukCdhqJhfRMw1MzFT-o6quAX3x1GibQTUb3Qlqz59rQe3ZgObcoJR8nGAnATix7a9kpM-nRj_v6cM44EF4xk0qSDkR4-nWgMauI-QjBvLKlDfOMJES32o5gaIobGkYlKk0kGZ2gDjuquALsR_O6w1YkxUq1-W6q4 May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:50.545470 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f15161169aaf4f1e89389598bdc8e710", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 8888db1ad60b4d5fac18c12a1feb7dea May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ncdv-master-1'} May 14 21:14:50.547042 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:50.548014 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 14 21:14:50.549328 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:50.550836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1def4ba-76ad-455c-9c5f-842fb75cb092 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:50.550836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a1def4ba-76ad-455c-9c5f-842fb75cb092 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009597 May 14 21:14:50.553215 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 547/1070] 10.222.0.52 () {58 vars in 1190 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:50.558723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47e0b3b2-f6a6-41f6-bf40-04535323b65c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c72c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.609836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-47e0b3b2-f6a6-41f6-bf40-04535323b65c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 200 len: 1464 microversion: 2.1 time: 0.055315 May 14 21:14:50.610559 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 548/1071] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 1464 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:50.616267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.616889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:50.624061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.624479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.625275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.625718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.631032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:50.640150 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0324770e-1577-41bb-92ce-9cd7f883fe1b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.336037 May 14 21:14:50.641171 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 524/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:50.655230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.656090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:50.662845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.663312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.664130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:50.664578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:50.791616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:50.800128 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f0138e25-4022-4f11-9bfa-e66ff39f7be4 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1313 microversion: 2.1 time: 0.187744 May 14 21:14:50.800827 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 549/1073] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:50.805307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5da5632-4292-462a-89ca-48b018454874 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Calling method '.version_select at 0x7fb1a7c720d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:50.806621 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:50.806621 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:14:50.818096 ncdv-master-1 devstack@n-api.service[130638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c5da5632-4292-462a-89ca-48b018454874 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] [a9d27b0e-f5bb-4194-90bb-d1d1731a0c7d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 21:14:51.195247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:51.203147 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47afcc5a-34ee-414a-ad77-a4597b0e95e9 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.552049 May 14 21:14:51.203748 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 525/1074] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:51.208457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:51.209110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:51.215789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.216373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.217163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.217604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.507653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:51.528355 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79d59df7-6b68-449f-a28a-ba681038ddcf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1468 microversion: 2.1 time: 0.322610 May 14 21:14:51.529712 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 526/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:51 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1468 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:51.536336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-4f5b2d5c-cc8a-43a5-bc29-cedf508063e8 req-b777c966-2f98-43cd-a37f-626387763c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac73d4c4-6570-4088-84ab-55624bd26151", "name": "network-vif-plugged", "status": "completed", "tag": "697c8ba4-8a0f-466b-b7c1-d492695fc4dd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:51.551649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4f5b2d5c-cc8a-43a5-bc29-cedf508063e8 req-b777c966-2f98-43cd-a37f-626387763c34 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.552096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4f5b2d5c-cc8a-43a5-bc29-cedf508063e8 req-b777c966-2f98-43cd-a37f-626387763c34 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.568035 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-4f5b2d5c-cc8a-43a5-bc29-cedf508063e8 req-b777c966-2f98-43cd-a37f-626387763c34 service nova] Creating event network-vif-plugged:697c8ba4-8a0f-466b-b7c1-d492695fc4dd for instance ac73d4c4-6570-4088-84ab-55624bd26151 on nch1-master-1 May 14 21:14:51.573608 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-4f5b2d5c-cc8a-43a5-bc29-cedf508063e8 req-b777c966-2f98-43cd-a37f-626387763c34 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042028 May 14 21:14:51.574224 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 527/1076] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:51.579135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-453bc773-d2d0-42fb-84ad-67db37656d8e req-b60059da-d375-4047-9c6b-62a6dbc164ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d79ef89-784c-4a52-803f-2961220d5f60", "tag": "32c5ed60-6069-4c0c-9bc2-bd74c3e72ece"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:51.589264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-453bc773-d2d0-42fb-84ad-67db37656d8e req-b60059da-d375-4047-9c6b-62a6dbc164ae service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.590115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-453bc773-d2d0-42fb-84ad-67db37656d8e req-b60059da-d375-4047-9c6b-62a6dbc164ae service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.603555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-453bc773-d2d0-42fb-84ad-67db37656d8e req-b60059da-d375-4047-9c6b-62a6dbc164ae service nova] Creating event network-changed:32c5ed60-6069-4c0c-9bc2-bd74c3e72ece for instance 7d79ef89-784c-4a52-803f-2961220d5f60 on nch2-master-1 May 14 21:14:51.611542 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-453bc773-d2d0-42fb-84ad-67db37656d8e req-b60059da-d375-4047-9c6b-62a6dbc164ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035605 May 14 21:14:51.612718 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 528/1077] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:51.619548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:51.620261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:51.627504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.628048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.628869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.629310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.828470 ncdv-master-1 devstack@n-api.service[130638]: INFO oslo.messaging._drivers.impl_rabbit [None req-c5da5632-4292-462a-89ca-48b018454874 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] [a9d27b0e-f5bb-4194-90bb-d1d1731a0c7d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 37150. May 14 21:14:51.835633 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c5da5632-4292-462a-89ca-48b018454874 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5da5632-4292-462a-89ca-48b018454874 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:14:51.837536 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'nonexistent_hostname'} May 14 21:14:51.839733 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:14:51.840718 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 14 21:14:51.842136 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5da5632-4292-462a-89ca-48b018454874 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:51.843740 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c5da5632-4292-462a-89ca-48b018454874 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 1.038260 May 14 21:14:51.854044 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 550/1078] 10.222.0.52 () {58 vars in 1211 bytes} [Sat May 14 21:14:50 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 1049 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:14:51.855804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:51.859823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:51.864196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:51.871859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.872501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.873432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.873885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.875604 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1353584e-eb74-4fdb-b0a8-75ba92a3d148 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.260796 May 14 21:14:51.876211 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 529/1079] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:51 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:51.882825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-07379183-5c66-4ec2-a25a-1b4ee905a12b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-235641193"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:51.884216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-07379183-5c66-4ec2-a25a-1b4ee905a12b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:51.896676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07379183-5c66-4ec2-a25a-1b4ee905a12b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.897131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07379183-5c66-4ec2-a25a-1b4ee905a12b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:51.898108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07379183-5c66-4ec2-a25a-1b4ee905a12b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:51.898548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07379183-5c66-4ec2-a25a-1b4ee905a12b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.014517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.031814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce8a4e68-74f2-49c9-b99a-fd349306864b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.170780 May 14 21:14:52.031814 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 551/1080] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:51 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:52.031814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.031814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:52.034403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.034869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.035695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.036119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.068411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.068868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.069324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lazy-loading 'fault' on Instance uuid d60f4941-2ff2-4617-b99c-46ae90d97bce {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:14:52.115116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32240804909d4572880a0f419f49f61e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f04e1accfc534fb18e36d789a9cefde3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.123413 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-32c62310-a8b2-4df0-a304-53aa0b51db78 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 200 len: 1312 microversion: 2.1 time: 0.099417 May 14 21:14:52.124027 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 552/1081] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:52.128548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.129161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:52.135011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.135687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.136470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.136930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.266996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.274430 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cbd004b7-2b91-41c8-9851-de380a19e04f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.149458 May 14 21:14:52.274993 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 553/1082] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:52.283402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.284413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:52.293590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.294040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.294821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.295259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.430830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.438861 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ddea0a6f-7dd6-4767-b335-0d41f4e9542d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1462 microversion: 2.1 time: 0.162907 May 14 21:14:52.439429 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 554/1083] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1462 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:52.443953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46ce7469-912a-40fa-a4a6-a9f92466fd72 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Calling method '.version_select at 0x7fb1a7c25af0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.444735 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:52.444735 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:14:52.445793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-46ce7469-912a-40fa-a4a6-a9f92466fd72 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '8888db1ad60b4d5fac18c12a1feb7dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15161169aaf4f1e89389598bdc8e710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46ce7469-912a-40fa-a4a6-a9f92466fd72 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Request method failure captured: May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvIKrB3iBaC-m6ukCdhqJhfRMw1MzFT-o6quAX3x1GibQTUb3Qlqz59rQe3ZgObcoJR8nGAnATix7a9kpM-nRj_v6cM44EF4xk0qSDkR4-nWgMauI-QjBvLKlDfOMJES32o5gaIobGkYlKk0kGZ2gDjuquALsR_O6w1YkxUq1-W6q4 May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:52.447321 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f15161169aaf4f1e89389598bdc8e710", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 8888db1ad60b4d5fac18c12a1feb7dea May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ncdv-master-1'} May 14 21:14:52.449462 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:52.450233 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 14 21:14:52.451704 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.452830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46ce7469-912a-40fa-a4a6-a9f92466fd72 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.452830 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-46ce7469-912a-40fa-a4a6-a9f92466fd72 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.009046 May 14 21:14:52.452830 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 555/1084] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:52.454569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.456341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:52.462042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.462493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.463814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.464259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.465093 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-07379183-5c66-4ec2-a25a-1b4ee905a12b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "POST /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee/action" status: 202 len: 0 microversion: 2.1 time: 0.586142 May 14 21:14:52.465759 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 530/1085] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:51 2022] POST /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:14:52.573770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b58ab640-15c0-45df-983d-41c22f9d10ff tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.577527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b58ab640-15c0-45df-983d-41c22f9d10ff tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Searching by: {'deleted': False, 'project_id': '95cb2bc0a93a4b919a2d65a7576e6038'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:52.584188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b58ab640-15c0-45df-983d-41c22f9d10ff tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.584646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b58ab640-15c0-45df-983d-41c22f9d10ff tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.585452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b58ab640-15c0-45df-983d-41c22f9d10ff tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.585894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b58ab640-15c0-45df-983d-41c22f9d10ff tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.598341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.607290 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0f731bbf-85c9-4874-b009-68016007907a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.156250 May 14 21:14:52.608347 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 556/1086] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:52.615142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac6403d7-3c80-41e7-916b-79c1fe6b4251 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Calling method '.version_select at 0x7fb1a7c25f70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.615971 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:52.615971 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:14:52.622279 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ac6403d7-3c80-41e7-916b-79c1fe6b4251 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac6403d7-3c80-41e7-916b-79c1fe6b4251 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,admin,member May 14 21:14:52.623836 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,admin,member May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'nonexistent_hostname'} May 14 21:14:52.625352 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.626208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.627389 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.628478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac6403d7-3c80-41e7-916b-79c1fe6b4251 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.628478 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac6403d7-3c80-41e7-916b-79c1fe6b4251 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.015776 May 14 21:14:52.628478 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 557/1087] 10.222.0.52 () {58 vars in 1190 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:14:52.633089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c50dc59c-4a41-481b-9159-404e11489c56 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c72e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.680240 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c50dc59c-4a41-481b-9159-404e11489c56 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.053396 May 14 21:14:52.680812 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 558/1088] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:52.685634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5324e606-eaca-406c-b87f-7fafa114b309 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Calling method '.version_select at 0x7fb1a7c254c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.686413 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:52.686413 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:14:52.687516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5324e606-eaca-406c-b87f-7fafa114b309 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '8888db1ad60b4d5fac18c12a1feb7dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15161169aaf4f1e89389598bdc8e710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5324e606-eaca-406c-b87f-7fafa114b309 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Request method failure captured: May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvIKrB3iBaC-m6ukCdhqJhfRMw1MzFT-o6quAX3x1GibQTUb3Qlqz59rQe3ZgObcoJR8nGAnATix7a9kpM-nRj_v6cM44EF4xk0qSDkR4-nWgMauI-QjBvLKlDfOMJES32o5gaIobGkYlKk0kGZ2gDjuquALsR_O6w1YkxUq1-W6q4 May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:52.689061 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f15161169aaf4f1e89389598bdc8e710", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 8888db1ad60b4d5fac18c12a1feb7dea May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ncdv-master-1'} May 14 21:14:52.690589 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:52.691652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 14 21:14:52.693853 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:52.695411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5324e606-eaca-406c-b87f-7fafa114b309 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.695411 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5324e606-eaca-406c-b87f-7fafa114b309 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.008693 May 14 21:14:52.695603 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b58ab640-15c0-45df-983d-41c22f9d10ff tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.226467 May 14 21:14:52.695603 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 531/1089] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:14:52.695781 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 559/1090] 10.222.0.52 () {58 vars in 1196 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:52.700108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a9302e6b-ca74-4d1d-ac63-33fbc588dcd2 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Calling method '.version_select at 0x7fb1a7c84550>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.701001 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:52.701001 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:14:52.709076 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a9302e6b-ca74-4d1d-ac63-33fbc588dcd2 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.710713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a9302e6b-ca74-4d1d-ac63-33fbc588dcd2 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:14:52.710841 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'nonexistent_hostname'} May 14 21:14:52.712388 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:14:52.714071 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 14 21:14:52.715541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a9302e6b-ca74-4d1d-ac63-33fbc588dcd2 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.716954 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a9302e6b-ca74-4d1d-ac63-33fbc588dcd2 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.015761 May 14 21:14:52.718134 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 532/1091] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:14:52.722353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-977eaa28-0ff6-4e93-81a3-2a0bc1464353 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Calling method '.version_select at 0x7fb1a7dfa4c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.722497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Searching by: {'deleted': False} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:52.723142 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:52.723142 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:14:52.724257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-977eaa28-0ff6-4e93-81a3-2a0bc1464353 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '8888db1ad60b4d5fac18c12a1feb7dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15161169aaf4f1e89389598bdc8e710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-977eaa28-0ff6-4e93-81a3-2a0bc1464353 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Request method failure captured: May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvIKrB3iBaC-m6ukCdhqJhfRMw1MzFT-o6quAX3x1GibQTUb3Qlqz59rQe3ZgObcoJR8nGAnATix7a9kpM-nRj_v6cM44EF4xk0qSDkR4-nWgMauI-QjBvLKlDfOMJES32o5gaIobGkYlKk0kGZ2gDjuquALsR_O6w1YkxUq1-W6q4 May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:52.725792 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f15161169aaf4f1e89389598bdc8e710", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 8888db1ad60b4d5fac18c12a1feb7dea May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ncdv-master-1'} May 14 21:14:52.728468 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:52.730323 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 14 21:14:52.731590 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.733115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-977eaa28-0ff6-4e93-81a3-2a0bc1464353 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.733115 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-977eaa28-0ff6-4e93-81a3-2a0bc1464353 tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] 10.222.0.52 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.008451 May 14 21:14:52.733115 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 533/1092] 10.222.0.52 () {58 vars in 1193 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:52.734318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.734769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.735593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.737499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.737977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-544549cf-f6b9-47ed-8322-c43b453480a8 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Calling method '.version_select at 0x7fb1a7d3fc10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.746660 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-544549cf-f6b9-47ed-8322-c43b453480a8 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-544549cf-f6b9-47ed-8322-c43b453480a8 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:14:52.748395 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'nonexistent_hostname'} May 14 21:14:52.749991 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:14:52.750922 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 14 21:14:52.752293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-544549cf-f6b9-47ed-8322-c43b453480a8 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.753462 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-544549cf-f6b9-47ed-8322-c43b453480a8 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.016319 May 14 21:14:52.754474 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 534/1093] 10.222.0.52 () {58 vars in 1214 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 14 21:14:52.759110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4af57cd1-cffc-41d6-89fe-ca5eb953524e tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7cd71f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4af57cd1-cffc-41d6-89fe-ca5eb953524e tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 51 May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:14:52.762033 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: {"status": "enable", "maintenance_mode": "invalid"} May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.763585 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'disable', May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'Enable', May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'Disable', May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'ENABLE', May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance: May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'invalid' May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.764555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.766402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4af57cd1-cffc-41d6-89fe-ca5eb953524e tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4af57cd1-cffc-41d6-89fe-ca5eb953524e tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.007979 May 14 21:14:52.767757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 535/1094] 10.222.0.52 () {60 vars in 1189 bytes} [Sat May 14 21:14:52 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:14:52.772853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e7158c1-ee17-4fba-a4bb-3b0d54fdfdfd tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7c84040>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e7158c1-ee17-4fba-a4bb-3b0d54fdfdfd tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 51 May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:14:52.775450 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: {"status": "invalid", "maintenance_mode": "enable"} May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.777194 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'disable', May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'Enable', May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'Disable', May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'ENABLE', May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance: May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'invalid' May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.778183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.780402 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.782401 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.782401 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:14:52.782401 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:14:52.782401 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 14 21:14:52.782401 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.782401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e7158c1-ee17-4fba-a4bb-3b0d54fdfdfd tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.782401 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9e7158c1-ee17-4fba-a4bb-3b0d54fdfdfd tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.009646 May 14 21:14:52.783802 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 536/1095] 10.222.0.52 () {60 vars in 1189 bytes} [Sat May 14 21:14:52 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:14:52.790390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bee7ea8a-3a1d-4884-8118-abcef0aa4a3a tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Action: 'update', calling method: .version_select at 0x7fb1a7cd7f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bee7ea8a-3a1d-4884-8118-abcef0aa4a3a tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '8888db1ad60b4d5fac18c12a1feb7dea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15161169aaf4f1e89389598bdc8e710', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bee7ea8a-3a1d-4884-8118-abcef0aa4a3a tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Request method failure captured: May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 50 May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvIKrB3iBaC-m6ukCdhqJhfRMw1MzFT-o6quAX3x1GibQTUb3Qlqz59rQe3ZgObcoJR8nGAnATix7a9kpM-nRj_v6cM44EF4xk0qSDkR4-nWgMauI-QjBvLKlDfOMJES32o5gaIobGkYlKk0kGZ2gDjuquALsR_O6w1YkxUq1-W6q4 May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.801135 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f15161169aaf4f1e89389598bdc8e710"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f15161169aaf4f1e89389598bdc8e710", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f15161169aaf4f1e89389598bdc8e710 May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-577760732 May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 8888db1ad60b4d5fac18c12a1feb7dea May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-577760732-project May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: {"status": "enable", "maintenance_mode": "enable"} May 14 21:14:52.802688 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:14:52.803876 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:14:52.805301 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 14 21:14:52.806836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.806836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bee7ea8a-3a1d-4884-8118-abcef0aa4a3a tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.806836 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bee7ea8a-3a1d-4884-8118-abcef0aa4a3a tempest-HostsAdminNegativeTestJSON-577760732 tempest-HostsAdminNegativeTestJSON-577760732-project] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.011124 May 14 21:14:52.806836 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 537/1096] 10.222.0.52 () {60 vars in 1189 bytes} [Sat May 14 21:14:52 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:52.806836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-409a3d25-4f49-4b1a-9e2c-8c47e73dd295 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7d0fdc0>, body: {"status": null, "maintenance_mode": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-409a3d25-4f49-4b1a-9e2c-8c47e73dd295 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 42 May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:14:52.808747 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: {"status": null, "maintenance_mode": null} May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 14 21:14:52.810300 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'disable', May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'Enable', May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'Disable', May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'ENABLE', May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance: May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi None May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.811383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.813329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.814906 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:14:52.814906 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:14:52.814906 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 14 21:14:52.814906 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.814906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-409a3d25-4f49-4b1a-9e2c-8c47e73dd295 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.814906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-409a3d25-4f49-4b1a-9e2c-8c47e73dd295 tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.008207 May 14 21:14:52.814906 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 538/1097] 10.222.0.52 () {60 vars in 1189 bytes} [Sat May 14 21:14:52 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:14:52.821780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1ba1628-cfa1-4a14-afea-6b58ac40c87d tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Action: 'update', calling method: .version_select at 0x7fb1a7fa6f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:52.824122 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.hosts [None req-a1ba1628-cfa1-4a14-afea-6b58ac40c87d tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Enabling host nonexistent_hostname. May 14 21:14:52.832172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a1ba1628-cfa1-4a14-afea-6b58ac40c87d tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1ba1628-cfa1-4a14-afea-6b58ac40c87d tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Request method failure captured: May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 50 May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvJIjCa1wzvFFljLTr-eZHBoK4pNDXM6yJMnBBPa6zKTGm17wjRD0u6Q433D8uq9c-bgr2Pyw-s3OvCevcFK-sslzAhZObnV8TrqItiyiOwrJHf2TQN9F_87Ej10H68rub2ewLsINrFsU-lyP1aNfsXSFuoPVlh4IADxSnklou-aSY May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:14:52.833896 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d6d5a5a312a04908bd46b42df3cd9245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d6d5a5a312a04908bd46b42df3cd9245", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d6d5a5a312a04908bd46b42df3cd9245 May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2063432842 May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c2419b9173474f89b32442d47ba667f2 May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2063432842-project-admin May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: {"status": "enable", "maintenance_mode": "enable"} May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.835558 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 14 21:14:52.836700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:52.837899 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:52.839403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1ba1628-cfa1-4a14-afea-6b58ac40c87d tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:52.844231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a1ba1628-cfa1-4a14-afea-6b58ac40c87d tempest-HostsAdminNegativeTestJSON-2063432842 tempest-HostsAdminNegativeTestJSON-2063432842-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.017481 May 14 21:14:52.844231 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 539/1098] 10.222.0.52 () {60 vars in 1210 bytes} [Sat May 14 21:14:52 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 14 21:14:52.858627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:14:52.897046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:52.898025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:52.905163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.905930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.906788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.907511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:52.986155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:52.986611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.062113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:53.069735 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a553d2b6-7876-4b7d-a917-204bf5943571 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.176588 May 14 21:14:53.070317 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 540/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:53.075349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:53.076041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:53.082497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.082954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.083752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.084190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.267834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:53.280269 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc6a8a20-35b1-41c9-a6b8-31abaec6c184 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1316 microversion: 2.1 time: 0.208888 May 14 21:14:53.282410 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 541/1100] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:53 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:53.294021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:53.297713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] [instance: d60f4941-2ff2-4617-b99c-46ae90d97bce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:53.305044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.305584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.306468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.307205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.328455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] HTTP exception thrown: Instance d60f4941-2ff2-4617-b99c-46ae90d97bce could not be found. May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Request method failure captured: May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce HTTP/1.1 May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBuOlk6HZ9_HOk5M05dYeVQuT4Gj1ug_S-hReWQpWSUPhz2URtgA1Xu28ouukNoSiqmFJlTId7p_xgw1aUejCyxVMYE0kPH2CwCUga51IThWkkqzFrdxdjvDY3aDwFYLPoWhVfxBnFbs_u_599VbMFf7Kr7YwPzo4cEjkngZOx0V6a8 May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f04e1accfc534fb18e36d789a9cefde3 May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-659635021 May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:53.330743 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f04e1accfc534fb18e36d789a9cefde3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f04e1accfc534fb18e36d789a9cefde3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f04e1accfc534fb18e36d789a9cefde3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f04e1accfc534fb18e36d789a9cefde3", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersAdminNegativeTestJSON-659635021 May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f04e1accfc534fb18e36d789a9cefde3 May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-659635021 May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersAdminNegativeTestJSON-659635021-project May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 32240804909d4572880a0f419f49f61e May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersAdminNegativeTestJSON-659635021-project May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d60f4941-2ff2-4617-b99c-46ae90d97bce could not be found. May 14 21:14:53.332145 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd60f4941-2ff2-4617-b99c-46ae90d97bce'} May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d60f4941-2ff2-4617-b99c-46ae90d97bce could not be found. May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:53.332917 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d60f4941-2ff2-4617-b99c-46ae90d97bce could not be found. May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d60f4941-2ff2-4617-b99c-46ae90d97bce could not be found. May 14 21:14:53.334172 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:53.340105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] Returning 404 to user: Instance d60f4941-2ff2-4617-b99c-46ae90d97bce could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:53.340105 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4360b764-c5b6-402c-9de4-e8b3fa4f0564 tempest-ServersAdminNegativeTestJSON-659635021 tempest-ServersAdminNegativeTestJSON-659635021-project] 10.222.0.52 "GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce" status: 404 len: 111 microversion: 2.1 time: 0.053697 May 14 21:14:53.340105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 542/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:53 2022] GET /compute/v2.1/servers/d60f4941-2ff2-4617-b99c-46ae90d97bce => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:53.369340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:53.370425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:53.384607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.385118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.386295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.402660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.421422 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0162f038-bb83-4118-be9e-2bb23e40917c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20439 microversion: 2.1 time: 0.715718 May 14 21:14:53.422745 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 560/1102] 10.222.0.52 () {58 vars in 1170 bytes} [Sat May 14 21:14:52 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20439 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:14:53.453968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2d7c39e-b1bf-4bc6-b9ca-bd8a3eb4b02c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:53.458444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2d7c39e-b1bf-4bc6-b9ca-bd8a3eb4b02c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Searching by: {'deleted': False, 'project_id': '95cb2bc0a93a4b919a2d65a7576e6038'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:53.465245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2d7c39e-b1bf-4bc6-b9ca-bd8a3eb4b02c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.465699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2d7c39e-b1bf-4bc6-b9ca-bd8a3eb4b02c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.466608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2d7c39e-b1bf-4bc6-b9ca-bd8a3eb4b02c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.467439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2d7c39e-b1bf-4bc6-b9ca-bd8a3eb4b02c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.595586 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2d7c39e-b1bf-4bc6-b9ca-bd8a3eb4b02c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?tenant_id=873c930e94574326a2aa94a76fda4f0d" status: 200 len: 15 microversion: 2.1 time: 0.145424 May 14 21:14:53.607631 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 561/1103] 10.222.0.52 () {58 vars in 1230 bytes} [Sat May 14 21:14:53 2022] GET /compute/v2.1/servers/detail?tenant_id=873c930e94574326a2aa94a76fda4f0d => generated 15 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:14:53.612376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0d406253-9b4c-403c-ba1b-b6c7e5095d66 req-3839cc45-a4c5-4ddf-a56b-d4ce9b9bb243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "name": "network-vif-plugged", "status": "completed", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:53.621294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0d406253-9b4c-403c-ba1b-b6c7e5095d66 req-3839cc45-a4c5-4ddf-a56b-d4ce9b9bb243 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.621982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0d406253-9b4c-403c-ba1b-b6c7e5095d66 req-3839cc45-a4c5-4ddf-a56b-d4ce9b9bb243 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.635719 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0d406253-9b4c-403c-ba1b-b6c7e5095d66 req-3839cc45-a4c5-4ddf-a56b-d4ce9b9bb243 service nova] Creating event network-vif-plugged:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch1-master-1 May 14 21:14:53.641496 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0d406253-9b4c-403c-ba1b-b6c7e5095d66 req-3839cc45-a4c5-4ddf-a56b-d4ce9b9bb243 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032678 May 14 21:14:53.642571 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 562/1104] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:53.649855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:53.656417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Searching by: {'tenant_id': '873c930e94574326a2aa94a76fda4f0d', 'deleted': False} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:53.672469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.673327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.674222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.674740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.718262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:53.727463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:14:53.731460 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ede9bc3-b38e-4003-9cba-10fc28353f93 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.389638 May 14 21:14:53.733133 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 543/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:53 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:53.738746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:53.740382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:53.749320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.750271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.751668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.752657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:53.875684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:53.877069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.098165 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3992b72f-27ec-434b-9ccd-a0a33de7c663 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=873c930e94574326a2aa94a76fda4f0d" status: 200 len: 4825 microversion: 2.1 time: 0.453893 May 14 21:14:54.098802 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 563/1106] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:14:53 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=873c930e94574326a2aa94a76fda4f0d => generated 4825 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:54.116378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a6f76d81-fe72-48eb-a98b-b3944689d14f req-d1e60b79-8642-4105-9b12-d699f8b653c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d60f4941-2ff2-4617-b99c-46ae90d97bce", "name": "network-vif-deleted", "tag": "45254827-3761-4577-ac70-10de75efc370"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:54.122756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:54.131027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a6f76d81-fe72-48eb-a98b-b3944689d14f req-d1e60b79-8642-4105-9b12-d699f8b653c5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.133637 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97b46975-2055-422d-8ce2-317a65d4ac39 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.399109 May 14 21:14:54.134747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a6f76d81-fe72-48eb-a98b-b3944689d14f req-d1e60b79-8642-4105-9b12-d699f8b653c5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.136693 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 544/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:53 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:54.142037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e0d00e0-152e-431f-a107-c7464a1d72f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7d3fd30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.155765 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a6f76d81-fe72-48eb-a98b-b3944689d14f req-d1e60b79-8642-4105-9b12-d699f8b653c5 service nova] Creating event network-vif-deleted:45254827-3761-4577-ac70-10de75efc370 for instance d60f4941-2ff2-4617-b99c-46ae90d97bce on nch1-master-1 May 14 21:14:54.163123 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a6f76d81-fe72-48eb-a98b-b3944689d14f req-d1e60b79-8642-4105-9b12-d699f8b653c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062176 May 14 21:14:54.164141 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 564/1108] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:54.170804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.171998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:54.179904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.180633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.183068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.183549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.201812 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e0d00e0-152e-431f-a107-c7464a1d72f9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.063670 May 14 21:14:54.207291 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 545/1109] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:54 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:54.207291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72bc16ce-6c5f-4cc7-8312-925c93ab49b1 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.212282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-72bc16ce-6c5f-4cc7-8312-925c93ab49b1 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Searching by: {'tenant_id': '95cb2bc0a93a4b919a2d65a7576e6038', 'deleted': False} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:54.218149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72bc16ce-6c5f-4cc7-8312-925c93ab49b1 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.218790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72bc16ce-6c5f-4cc7-8312-925c93ab49b1 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.227397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72bc16ce-6c5f-4cc7-8312-925c93ab49b1 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.227397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72bc16ce-6c5f-4cc7-8312-925c93ab49b1 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.252106 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72bc16ce-6c5f-4cc7-8312-925c93ab49b1 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=95cb2bc0a93a4b919a2d65a7576e6038" status: 200 len: 15 microversion: 2.1 time: 0.048490 May 14 21:14:54.255934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 546/1110] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:14:54 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=95cb2bc0a93a4b919a2d65a7576e6038 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:14:54.270806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac9e627d-361f-4f66-9b5e-427825acca0f tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.281101 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac9e627d-361f-4f66-9b5e-427825acca0f tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.014543 May 14 21:14:54.282280 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 547/1111] 10.222.0.52 () {58 vars in 1188 bytes} [Sat May 14 21:14:54 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:14:54.300458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b06d33ca-2c56-4709-94a8-a63e9350a08b tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:54.301768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b06d33ca-2c56-4709-94a8-a63e9350a08b tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:54.333047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b06d33ca-2c56-4709-94a8-a63e9350a08b tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.333598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b06d33ca-2c56-4709-94a8-a63e9350a08b tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.334929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b06d33ca-2c56-4709-94a8-a63e9350a08b tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.335621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b06d33ca-2c56-4709-94a8-a63e9350a08b tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.402547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:54.410410 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-813d12a0-41c9-4f5a-a8be-6fdc668db295 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.244698 May 14 21:14:54.411051 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 565/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:54 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:54.415538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.416158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:54.423609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.424073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.424863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.425313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.581617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:54.591447 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-313721fd-4059-4fb2-89b3-a30594100330 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1465 microversion: 2.1 time: 0.179330 May 14 21:14:54.593311 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 566/1113] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:54 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1465 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:54.614261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.614874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:54.621933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.622686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.623823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.624672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.668794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:14:54.688250 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b06d33ca-2c56-4709-94a8-a63e9350a08b tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action" status: 202 len: 0 microversion: 2.1 time: 0.392819 May 14 21:14:54.693035 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 548/1114] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:54 2022] POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:54.699103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.704005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:54.705343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '873c930e94574326a2aa94a76fda4f0d'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:54.716003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.716947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.717775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.718221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.808898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:14:54.910199 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64ff9840-6e43-4edb-ac1e-58b6f8d99632 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.215252 May 14 21:14:54.910707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 549/1115] 10.222.0.52 () {58 vars in 1149 bytes} [Sat May 14 21:14:54 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:54.919561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:54.919561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:54.922265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.922727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:54.923537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:54.923982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.043066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83736b01-1bbf-4f1b-8565-36500a834a61 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 204 len: 0 microversion: 2.1 time: 0.432672 May 14 21:14:55.046869 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 567/1116] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:54 2022] DELETE /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:14:55.053892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f57a656-362f-46d0-b678-5f0e30338f53 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:55.055000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0f57a656-362f-46d0-b678-5f0e30338f53 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:55.062280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f57a656-362f-46d0-b678-5f0e30338f53 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.062787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f57a656-362f-46d0-b678-5f0e30338f53 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.063638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f57a656-362f-46d0-b678-5f0e30338f53 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.064084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f57a656-362f-46d0-b678-5f0e30338f53 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.078034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:55.086454 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fa3812aa-6a38-4cce-b9e7-eb9f9734c7e1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.174415 May 14 21:14:55.087249 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 550/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:54 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:55.093135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:55.093996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:55.100881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.101336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.102141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.102606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.238243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:55.246247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a5b53a3-f41a-41a1-a52c-b46996f99ff7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1471 microversion: 2.1 time: 0.157300 May 14 21:14:55.255984 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 551/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:55 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:55.255984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:55.255984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:55.258164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.258621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.259391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.259851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.405687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:55.413562 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3fb770a3-3fc2-46fb-8ca3-a9f02bc1a7e3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.165758 May 14 21:14:55.414136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 552/1119] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:55 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:55.419451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff1a09d3-a17f-4396-8047-8d4b30dbb5f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7d64d30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:55.468761 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff1a09d3-a17f-4396-8047-8d4b30dbb5f5 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.051110 May 14 21:14:55.468761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 553/1120] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:55 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:55.471525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:55.472140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:55.478095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.478562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.479591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.480091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.487537 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0f57a656-362f-46d0-b678-5f0e30338f53 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action" status: 202 len: 0 microversion: 2.1 time: 0.438934 May 14 21:14:55.490999 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 568/1121] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:55 2022] POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:55.498081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a96474b9-1746-40aa-923b-11512425da9a tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:55.498753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a96474b9-1746-40aa-923b-11512425da9a tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:55.505318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a96474b9-1746-40aa-923b-11512425da9a tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.505768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a96474b9-1746-40aa-923b-11512425da9a tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.506729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a96474b9-1746-40aa-923b-11512425da9a tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.507434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a96474b9-1746-40aa-923b-11512425da9a tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.655199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:55.664527 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31419800-c34a-4dec-a082-a30a355983af tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.196633 May 14 21:14:55.666163 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 554/1122] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:55 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:55.671829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d15caa27-1abb-436c-b90e-55ca5af07d51 req-55e994a8-a7a5-4497-abaa-8ca20edd400f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b557786f-467b-4f39-b283-7c798215ba18", "name": "network-vif-unplugged", "status": "completed", "tag": "cd79d740-e7bf-4fb9-a20e-1e35700ba976"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:55.681189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d15caa27-1abb-436c-b90e-55ca5af07d51 req-55e994a8-a7a5-4497-abaa-8ca20edd400f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.682545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d15caa27-1abb-436c-b90e-55ca5af07d51 req-55e994a8-a7a5-4497-abaa-8ca20edd400f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.706211 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a96474b9-1746-40aa-923b-11512425da9a tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1614 microversion: 2.1 time: 0.212395 May 14 21:14:55.708068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 569/1123] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:55 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1614 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:55.709148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d15caa27-1abb-436c-b90e-55ca5af07d51 req-55e994a8-a7a5-4497-abaa-8ca20edd400f service nova] Creating event network-vif-unplugged:cd79d740-e7bf-4fb9-a20e-1e35700ba976 for instance b557786f-467b-4f39-b283-7c798215ba18 on nch2-master-1 May 14 21:14:55.722976 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d15caa27-1abb-436c-b90e-55ca5af07d51 req-55e994a8-a7a5-4497-abaa-8ca20edd400f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055274 May 14 21:14:55.724484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 555/1124] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:55.726063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71836fcb-28e2-480d-82a0-47d6df7ff06c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:55.727717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71836fcb-28e2-480d-82a0-47d6df7ff06c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:55.736982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71836fcb-28e2-480d-82a0-47d6df7ff06c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.737773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71836fcb-28e2-480d-82a0-47d6df7ff06c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.738773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71836fcb-28e2-480d-82a0-47d6df7ff06c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.739292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71836fcb-28e2-480d-82a0-47d6df7ff06c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.889924 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71836fcb-28e2-480d-82a0-47d6df7ff06c tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1614 microversion: 2.1 time: 0.167928 May 14 21:14:55.891594 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 570/1125] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:55 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1614 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:55.906687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:55.912046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:55.917578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.918037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:55.918850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:55.919293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.021714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:14:56.104726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:56.105279 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a4e7b5e-3f5b-4f4d-915c-813aed4f13f0 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 2294 microversion: 2.1 time: 0.202485 May 14 21:14:56.105567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.111960 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 556/1126] 10.222.0.52 () {58 vars in 1189 bytes} [Sat May 14 21:14:55 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 2294 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:56.112135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.112453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.113559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.113888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.117866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68277a6c-034d-438c-b885-f18fd5c09686 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:56.123545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-68277a6c-034d-438c-b885-f18fd5c09686 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:14:56.128604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68277a6c-034d-438c-b885-f18fd5c09686 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.129132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68277a6c-034d-438c-b885-f18fd5c09686 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.130156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68277a6c-034d-438c-b885-f18fd5c09686 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.130746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68277a6c-034d-438c-b885-f18fd5c09686 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.153375 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-68277a6c-034d-438c-b885-f18fd5c09686 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.039848 May 14 21:14:56.160596 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 557/1127] 10.222.0.52 () {58 vars in 1195 bytes} [Sat May 14 21:14:56 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:14:56.167095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78844cfc-add1-4e8d-9ccd-fe32741e0525 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:56.167095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78844cfc-add1-4e8d-9ccd-fe32741e0525 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.173689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78844cfc-add1-4e8d-9ccd-fe32741e0525 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.174094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78844cfc-add1-4e8d-9ccd-fe32741e0525 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.174809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78844cfc-add1-4e8d-9ccd-fe32741e0525 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.175265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78844cfc-add1-4e8d-9ccd-fe32741e0525 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.253830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:56.262308 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a16e85ad-498c-4ff6-9392-cf3d803be365 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.162148 May 14 21:14:56.262875 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 571/1128] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:56 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:56.271791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:56.271791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.275897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.276304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.277085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.277515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.437687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:56.445683 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8e987f4b-02d0-46e0-a692-6cde77bcd2e4 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1471 microversion: 2.1 time: 0.181836 May 14 21:14:56.447004 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 572/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:56 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:56.453157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:56.453940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.460649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.461414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.462187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.462605 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78844cfc-add1-4e8d-9ccd-fe32741e0525 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action" status: 202 len: 0 microversion: 2.1 time: 0.300583 May 14 21:14:56.462734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.463293 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 558/1130] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:56 2022] POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:56.475332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:56.478574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.488660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.489339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.490280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.490913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.592793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:56.593230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:56.593710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:56.594793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:56.595378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:56.655709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:56.663602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae4dd650-0109-48b5-afab-cdcd479555c3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1377 microversion: 2.1 time: 0.214626 May 14 21:14:56.664179 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 573/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:56 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1377 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:56.670112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f39c4733-3928-4b4b-97c9-a3078c043529 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a794dca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:56.730516 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f39c4733-3928-4b4b-97c9-a3078c043529 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.065070 May 14 21:14:56.731093 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 574/1132] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:56 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:56.735933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:56.736595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.743012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.743499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.744316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.744953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.889035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:56.902774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.909578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.910915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.912246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.912936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.926195 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6fec7725-d891-434c-aecb-190ff8b05768 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.191123 May 14 21:14:56.926913 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 575/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:56 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:56.956295 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b670915-ddb4-4452-a9b9-f108018248bf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action" status: 202 len: 1067 microversion: 2.1 time: 0.487955 May 14 21:14:56.957368 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 559/1134] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:56 2022] POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action => generated 1067 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 14 21:14:56.975836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:56.978468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:56.987911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.988370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:56.989175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:56.989623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.179578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:57.190052 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0333f7ae-8f99-49e0-9b42-a5aa740e92ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.220686 May 14 21:14:57.190644 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 576/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:56 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:57.253184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a48fffc6-f672-4d73-bba2-f82914bae614 req-885e794a-64b3-4335-8288-d1dc776fe5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac73d4c4-6570-4088-84ab-55624bd26151", "name": "network-vif-deleted", "tag": "697c8ba4-8a0f-466b-b7c1-d492695fc4dd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:57.266822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a48fffc6-f672-4d73-bba2-f82914bae614 req-885e794a-64b3-4335-8288-d1dc776fe5c1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.267592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a48fffc6-f672-4d73-bba2-f82914bae614 req-885e794a-64b3-4335-8288-d1dc776fe5c1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.280310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a48fffc6-f672-4d73-bba2-f82914bae614 req-885e794a-64b3-4335-8288-d1dc776fe5c1 service nova] Creating event network-vif-deleted:697c8ba4-8a0f-466b-b7c1-d492695fc4dd for instance ac73d4c4-6570-4088-84ab-55624bd26151 on nch1-master-1 May 14 21:14:57.280536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.281174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:57.291161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.293427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.295433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.296013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.309938 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a48fffc6-f672-4d73-bba2-f82914bae614 req-885e794a-64b3-4335-8288-d1dc776fe5c1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055255 May 14 21:14:57.313104 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 560/1136] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:57.488838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:57.499650 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df125ed4-9fd7-45f2-8de9-4e578a0cd4cf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.224074 May 14 21:14:57.508036 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 577/1137] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:57.513104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.513727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:57.521013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.521467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.522237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.523006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.532069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-30399a0b-0720-4fa1-8a0f-b0b6fc4c6be6 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.547119 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-30399a0b-0720-4fa1-8a0f-b0b6fc4c6be6 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.179996 May 14 21:14:57.547998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 561/1138] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:57.559547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.560160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.560627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lazy-loading 'fault' on Instance uuid ac73d4c4-6570-4088-84ab-55624bd26151 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:14:57.561424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86163ede-d45b-41b0-9375-99d0462244f4 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.580763 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86163ede-d45b-41b0-9375-99d0462244f4 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors" status: 200 len: 2912 microversion: 2.1 time: 0.024318 May 14 21:14:57.581622 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 562/1139] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors => generated 2912 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:57.594288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3a1622a-fc76-4979-aacd-73f3787565ed tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.610032 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3a1622a-fc76-4979-aacd-73f3787565ed tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019304 May 14 21:14:57.610964 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 563/1140] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:57.627405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc28f7d2-fe65-4f31-b231-ffffcad9c500 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.634623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c669f55bbc46cdad7770a07f28d9d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c422d08f9df4a1eb5f3a3476f83db55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:57.636515 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc28f7d2-fe65-4f31-b231-ffffcad9c500 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013448 May 14 21:14:57.642753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 564/1141] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:57.645516 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c680f98e-b719-422b-9fd3-c327663ee461 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 200 len: 1306 microversion: 2.1 time: 0.139197 May 14 21:14:57.646371 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 578/1142] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 1306 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:57.648325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3ddbdb3-4302-4ff5-92c7-047db75b27c4 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.674598 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3ddbdb3-4302-4ff5-92c7-047db75b27c4 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.030559 May 14 21:14:57.679275 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 565/1143] 10.222.0.52 () {58 vars in 1164 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:57.682842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.683752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:57.690700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.691275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.692176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.692293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71f1b53f-002b-41ff-85e7-4438cc6e3858 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.692915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.701139 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71f1b53f-002b-41ff-85e7-4438cc6e3858 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012465 May 14 21:14:57.707243 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 566/1144] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:14:57.711994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d716135-9533-48a1-8629-0854376caf6c tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.740719 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d716135-9533-48a1-8629-0854376caf6c tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.032274 May 14 21:14:57.752243 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 567/1145] 10.222.0.52 () {58 vars in 1168 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:57.768899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3006d7ee-c97f-41d6-b7aa-eb385c7107a0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7a67dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.823451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3006d7ee-c97f-41d6-b7aa-eb385c7107a0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.069257 May 14 21:14:57.824424 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 568/1146] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:57.829783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-216d1e34-ea66-4a4e-aae1-9afbf23f8a89 req-905667b7-ac1f-43ac-87e2-df50d4361236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d79ef89-784c-4a52-803f-2961220d5f60", "name": "network-vif-plugged", "status": "completed", "tag": "32c5ed60-6069-4c0c-9bc2-bd74c3e72ece"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:57.839558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-216d1e34-ea66-4a4e-aae1-9afbf23f8a89 req-905667b7-ac1f-43ac-87e2-df50d4361236 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.840029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-216d1e34-ea66-4a4e-aae1-9afbf23f8a89 req-905667b7-ac1f-43ac-87e2-df50d4361236 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.852439 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-216d1e34-ea66-4a4e-aae1-9afbf23f8a89 req-905667b7-ac1f-43ac-87e2-df50d4361236 service nova] Creating event network-vif-plugged:32c5ed60-6069-4c0c-9bc2-bd74c3e72ece for instance 7d79ef89-784c-4a52-803f-2961220d5f60 on nch2-master-1 May 14 21:14:57.858598 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-216d1e34-ea66-4a4e-aae1-9afbf23f8a89 req-905667b7-ac1f-43ac-87e2-df50d4361236 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 May 14 21:14:57.862188 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 569/1147] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:57.873162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-195df79e-1960-4c02-86ef-801d001e044e tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.888603 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-195df79e-1960-4c02-86ef-801d001e044e tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.027659 May 14 21:14:57.890804 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 570/1148] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:57.903606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4891953d-4074-4fab-a30a-48f33d1e4165 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.914491 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4891953d-4074-4fab-a30a-48f33d1e4165 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016970 May 14 21:14:57.916054 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 571/1149] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:57.924609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:57.936191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bbff6286-c9ae-4faf-871f-ba8c0d9fa1a7 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.952294 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8bc2cf63-49b4-4ffd-b59e-d566510a36ab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1526 microversion: 2.1 time: 0.269022 May 14 21:14:57.952294 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 579/1150] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1526 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:57.955973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:57.956596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:57.975679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.976662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:57.983715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:57.988100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.016160 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bbff6286-c9ae-4faf-871f-ba8c0d9fa1a7 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2989 microversion: 2.1 time: 0.089450 May 14 21:14:58.018060 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 572/1151] 10.222.0.52 () {58 vars in 1166 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2989 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:14:58.023263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.024371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:58.032757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.037830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.037830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.037830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.217402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:58.230941 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a8620762-4a49-4db9-ac0b-b4a5d1beed67 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.282049 May 14 21:14:58.245570 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 580/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:57 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.245570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-64dff595-4b5e-42ea-b8d9-5374564b5938 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.255388 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-64dff595-4b5e-42ea-b8d9-5374564b5938 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018604 May 14 21:14:58.267665 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 581/1153] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:58.268449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:58.277574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.278575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:58.282795 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5381ec5-aa0d-4ea2-89c5-ead323dc0df4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1526 microversion: 2.1 time: 0.263381 May 14 21:14:58.283967 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 573/1154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1526 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.285515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.286181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.287206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.287875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.296827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71eb3d09-9d95-481f-a327-38c873b2cd55 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.321072 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71eb3d09-9d95-481f-a327-38c873b2cd55 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.035568 May 14 21:14:58.322103 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 574/1155] 10.222.0.52 () {58 vars in 1143 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.332615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-762d9bfc-8792-49d7-85be-59d96bde7928 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.334833 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:14:58.334833 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:14:58.438056 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-762d9bfc-8792-49d7-85be-59d96bde7928 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/8d34442f-f499-4011-932f-fd140a82357f" status: 202 len: 0 microversion: 2.1 time: 0.112659 May 14 21:14:58.438695 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 575/1156] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:58 2022] DELETE /compute/v2.1/flavors/8d34442f-f499-4011-932f-fd140a82357f => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:58.444110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-558fbf01-2523-41b0-a572-eb8209b58f4e tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.453374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-558fbf01-2523-41b0-a572-eb8209b58f4e tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013174 May 14 21:14:58.454150 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 576/1157] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:58.459745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-229c07ec-f5f9-407c-a9c3-49780bbf1456 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.478182 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-229c07ec-f5f9-407c-a9c3-49780bbf1456 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021776 May 14 21:14:58.482516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:58.488820 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 577/1158] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.491553 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0688bf6e-2482-4239-95b6-32379ae3a442 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.220927 May 14 21:14:58.492291 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 582/1159] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.494366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-581ca24f-a672-47c6-8839-dbf91481e178 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.502503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:58.503883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:58.509377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-581ca24f-a672-47c6-8839-dbf91481e178 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.019537 May 14 21:14:58.510220 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 578/1160] 10.222.0.52 () {58 vars in 1147 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.512369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.513047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.513975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.514489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.535214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.536051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:58.546397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.546834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.547801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.549148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.550870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:58.557897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Old instance type tempest-test_resize_flavor_-1936165851, new instance type m1.heat {{(pid=130638) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 21:14:58.566991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:14:58.567553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:14:58.568166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:14:58.568661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:14:58.569230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:14:58.707489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:58.715708 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83524aef-2a8d-4aee-9792-fff5474fb4c0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.190506 May 14 21:14:58.716327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 579/1161] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.720735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb5683f7-6f21-477d-9c9f-280816ec02bf tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.737525 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb5683f7-6f21-477d-9c9f-280816ec02bf tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.020129 May 14 21:14:58.738439 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 580/1162] 10.222.0.52 () {58 vars in 1139 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:58.746642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.747365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:58.755171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.755604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.756534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.757717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.773745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] HTTP exception thrown: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Request method failure captured: May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 HTTP/1.1 May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBuy2l9_NGp2J5hOos9VyJNtkGb--YMZeTfte21iCIwg4wWnB7Lj0-rMbVX7mzsnhcwwKYAD5WMAR9VfP06A7HI74Nbt_GqpV-QfVEVkFQb2_mMXUYDLh-DqYgrkvPF-2sVvBm69CAt4sjrdrLeWCAPBats8eZgQAMsMnzGAPbXtX6A May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:58.775444 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c422d08f9df4a1eb5f3a3476f83db55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 73c669f55bbc46cdad7770a07f28d9d2 May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.777552 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ac73d4c4-6570-4088-84ab-55624bd26151'} May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:58.778417 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.781264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.783183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Returning 404 to user: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:58.783183 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3350795-cac5-4451-a499-ab50fd59273b tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 404 len: 111 microversion: 2.1 time: 0.038563 May 14 21:14:58.783183 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 581/1163] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:58.793530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d4266a3a-d4c9-420a-bbb3-89a74587a7a0 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.803012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d4266a3a-d4c9-420a-bbb3-89a74587a7a0 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018033 May 14 21:14:58.809749 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 582/1164] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:58.821163 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c57abcfa-8d30-44fd-8754-b0b9ded836c2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52/action" status: 202 len: 0 microversion: 2.1 time: 0.321231 May 14 21:14:58.825493 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 583/1165] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:14:58 2022] POST /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:14:58.827365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1950552012", "metadata": {"image_type": "test"}}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:58.830454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:58.834828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca0462e6-b7cd-453c-9260-3ef906fdcd5c tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.842982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.843779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.844917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.854520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.864462 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] HTTP exception thrown: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Request method failure captured: May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151/action HTTP/1.1 May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 112 May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBuy2l9_NGp2J5hOos9VyJNtkGb--YMZeTfte21iCIwg4wWnB7Lj0-rMbVX7mzsnhcwwKYAD5WMAR9VfP06A7HI74Nbt_GqpV-QfVEVkFQb2_mMXUYDLh-DqYgrkvPF-2sVvBm69CAt4sjrdrLeWCAPBats8eZgQAMsMnzGAPbXtX6A May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:14:58.866756 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c422d08f9df4a1eb5f3a3476f83db55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 73c669f55bbc46cdad7770a07f28d9d2 May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1950552012", "metadata": {"image_type": "test"}}} May 14 21:14:58.868166 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ac73d4c4-6570-4088-84ab-55624bd26151', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1950552012', 'metadata': {'image_type': 'test'}}}} May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:58.868982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.870697 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:58.871934 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:58.871934 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:58.871934 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:58.871934 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:58.871934 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:14:58.871934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Returning 404 to user: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:58.871934 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a31edb00-5c92-4cdf-9581-5557eca3bbb1 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "POST /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151/action" status: 404 len: 111 microversion: 2.1 time: 0.064264 May 14 21:14:58.875689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 583/1166] 10.222.0.52 () {60 vars in 1278 bytes} [Sat May 14 21:14:58 2022] POST /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:58.882474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.883307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:58.886343 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca0462e6-b7cd-453c-9260-3ef906fdcd5c tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.059402 May 14 21:14:58.887543 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 584/1167] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.892176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a613475-e623-4507-9bec-dfb79fb3006b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7ba5940>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:58.896250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.896891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.897876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:58.898509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:58.977269 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a613475-e623-4507-9bec-dfb79fb3006b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.088567 May 14 21:14:58.978186 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 585/1168] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:58.983721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d76d94c6-0855-44d5-b5d5-ccdd2707ced7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2055833022", "metadata": {"image_type": "test"}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:58.984859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d76d94c6-0855-44d5-b5d5-ccdd2707ced7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Failed to fetch instance by id tempest-invalid-774312323 {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2926}} May 14 21:14:58.985374 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d76d94c6-0855-44d5-b5d5-ccdd2707ced7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] HTTP exception thrown: Instance tempest-invalid-774312323 could not be found. May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d76d94c6-0855-44d5-b5d5-ccdd2707ced7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Request method failure captured: May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/tempest-invalid-774312323/action HTTP/1.1 May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 112 May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuy2l9_NGp2J5hOos9VyJNtkGb--YMZeTfte21iCIwg4wWnB7Lj0-rMbVX7mzsnhcwwKYAD5WMAR9VfP06A7HI74Nbt_GqpV-QfVEVkFQb2_mMXUYDLh-DqYgrkvPF-2sVvBm69CAt4sjrdrLeWCAPBats8eZgQAMsMnzGAPbXtX6A May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:58.987373 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c422d08f9df4a1eb5f3a3476f83db55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 73c669f55bbc46cdad7770a07f28d9d2 May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2055833022", "metadata": {"image_type": "test"}}} May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:58.988716 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance tempest-invalid-774312323 could not be found. May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'tempest-invalid-774312323', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2055833022', 'metadata': {'image_type': 'test'}}}} May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-774312323 could not be found. May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:58.989506 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-774312323 could not be found. May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-774312323 could not be found. May 14 21:14:58.991111 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:58.994820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d76d94c6-0855-44d5-b5d5-ccdd2707ced7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Returning 404 to user: Instance tempest-invalid-774312323 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:58.994820 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d76d94c6-0855-44d5-b5d5-ccdd2707ced7 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "POST /compute/v2.1/servers/tempest-invalid-774312323/action" status: 404 len: 100 microversion: 2.1 time: 0.009112 May 14 21:14:58.994820 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 586/1169] 10.222.0.52 () {60 vars in 1245 bytes} [Sat May 14 21:14:58 2022] POST /compute/v2.1/servers/tempest-invalid-774312323/action => generated 100 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:58.999008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0efad5c2-4a97-4fb4-98f5-b5b03e247ea8 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:59.020814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0efad5c2-4a97-4fb4-98f5-b5b03e247ea8 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025297 May 14 21:14:59.021329 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 587/1170] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:59.027310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00eb2717-c784-4634-b77a-e90e707b84ff tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-966122856"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:59.028680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-00eb2717-c784-4634-b77a-e90e707b84ff tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2926}} May 14 21:14:59.029711 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-00eb2717-c784-4634-b77a-e90e707b84ff tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00eb2717-c784-4634-b77a-e90e707b84ff tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Request method failure captured: May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 56 May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuy2l9_NGp2J5hOos9VyJNtkGb--YMZeTfte21iCIwg4wWnB7Lj0-rMbVX7mzsnhcwwKYAD5WMAR9VfP06A7HI74Nbt_GqpV-QfVEVkFQb2_mMXUYDLh-DqYgrkvPF-2sVvBm69CAt4sjrdrLeWCAPBats8eZgQAMsMnzGAPbXtX6A May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:59.033021 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c422d08f9df4a1eb5f3a3476f83db55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 73c669f55bbc46cdad7770a07f28d9d2 May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: {"createImage": {"name": "tempest-test-snap-966122856"}} May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:59.034298 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-966122856'}}} May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:59.035066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.036267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.037500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00eb2717-c784-4634-b77a-e90e707b84ff tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:59.037500 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-00eb2717-c784-4634-b77a-e90e707b84ff tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.010961 May 14 21:14:59.037500 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 588/1171] 10.222.0.52 () {60 vars in 1274 bytes} [Sat May 14 21:14:59 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:59.044020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5489e6dd-3536-4caa-b9f8-61762744b7a6 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:59.053870 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5489e6dd-3536-4caa-b9f8-61762744b7a6 tempest-FlavorsV2TestJSON-287666236 tempest-FlavorsV2TestJSON-287666236-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019032 May 14 21:14:59.055060 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 589/1172] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:14:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:14:59.062467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf9ff397-2a41-422c-92d9-deae723dfc50 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1924841071"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:14:59.065944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf9ff397-2a41-422c-92d9-deae723dfc50 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2926}} May 14 21:14:59.066647 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-cf9ff397-2a41-422c-92d9-deae723dfc50 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf9ff397-2a41-422c-92d9-deae723dfc50 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Request method failure captured: May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 57 May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuy2l9_NGp2J5hOos9VyJNtkGb--YMZeTfte21iCIwg4wWnB7Lj0-rMbVX7mzsnhcwwKYAD5WMAR9VfP06A7HI74Nbt_GqpV-QfVEVkFQb2_mMXUYDLh-DqYgrkvPF-2sVvBm69CAt4sjrdrLeWCAPBats8eZgQAMsMnzGAPbXtX6A May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:59.068394 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c422d08f9df4a1eb5f3a3476f83db55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 73c669f55bbc46cdad7770a07f28d9d2 May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: {"createImage": {"name": "tempest-test-snap-1924841071"}} May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:59.069832 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1924841071'}}} May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:59.070697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 14 21:14:59.072031 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.076113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf9ff397-2a41-422c-92d9-deae723dfc50 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:59.077291 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf9ff397-2a41-422c-92d9-deae723dfc50 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.020556 May 14 21:14:59.079628 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 590/1173] 10.222.0.52 () {60 vars in 1280 bytes} [Sat May 14 21:14:59 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:59.092353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:59.096202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:59.109045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.109507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.110368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.110817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.129216 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] HTTP exception thrown: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Request method failure captured: May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 HTTP/1.1 May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuy2l9_NGp2J5hOos9VyJNtkGb--YMZeTfte21iCIwg4wWnB7Lj0-rMbVX7mzsnhcwwKYAD5WMAR9VfP06A7HI74Nbt_GqpV-QfVEVkFQb2_mMXUYDLh-DqYgrkvPF-2sVvBm69CAt4sjrdrLeWCAPBats8eZgQAMsMnzGAPbXtX6A May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:59.130900 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c422d08f9df4a1eb5f3a3476f83db55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 73c669f55bbc46cdad7770a07f28d9d2 May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.132564 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ac73d4c4-6570-4088-84ab-55624bd26151'} May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:59.133287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.134441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.138387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Returning 404 to user: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:59.138387 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92164319-9b10-440c-9f73-524b761b0ffd tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 404 len: 111 microversion: 2.1 time: 0.049046 May 14 21:14:59.138387 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 591/1174] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:14:59 2022] DELETE /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:59.143774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:59.144401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] [instance: ac73d4c4-6570-4088-84ab-55624bd26151] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:59.154597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.155084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.156839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.157293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.172554 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] HTTP exception thrown: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Request method failure captured: May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 HTTP/1.1 May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuy2l9_NGp2J5hOos9VyJNtkGb--YMZeTfte21iCIwg4wWnB7Lj0-rMbVX7mzsnhcwwKYAD5WMAR9VfP06A7HI74Nbt_GqpV-QfVEVkFQb2_mMXUYDLh-DqYgrkvPF-2sVvBm69CAt4sjrdrLeWCAPBats8eZgQAMsMnzGAPbXtX6A May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:14:59.174132 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5c422d08f9df4a1eb5f3a3476f83db55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5c422d08f9df4a1eb5f3a3476f83db55", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5c422d08f9df4a1eb5f3a3476f83db55 May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1383248106 May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 73c669f55bbc46cdad7770a07f28d9d2 May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesNegativeTestJSON-1383248106-project May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.175434 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ac73d4c4-6570-4088-84ab-55624bd26151'} May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:14:59.176520 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. May 14 21:14:59.177848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:14:59.178893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] Returning 404 to user: Instance ac73d4c4-6570-4088-84ab-55624bd26151 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:14:59.178893 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4f4b4c3a-b363-47f0-baf7-adb994a676f3 tempest-ImagesNegativeTestJSON-1383248106 tempest-ImagesNegativeTestJSON-1383248106-project] 10.222.0.52 "GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151" status: 404 len: 111 microversion: 2.1 time: 0.038003 May 14 21:14:59.178893 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 592/1175] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:59 2022] GET /compute/v2.1/servers/ac73d4c4-6570-4088-84ab-55624bd26151 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:14:59.193758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:59.203044 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c1b2538-ae43-4e12-8b15-ac45f8a8c1a1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1535 microversion: 2.1 time: 0.325635 May 14 21:14:59.203998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 584/1176] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:58 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1535 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:59.257587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:59.257587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:59.259804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.260893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.261970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.262362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.465846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:59.479523 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1cd5b951-64c6-41a6-9543-26f005e7a33c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.230138 May 14 21:14:59.486368 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 593/1177] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:59 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:59.508934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:59.509770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:59.516881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.517551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.518324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.518923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.690014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:14:59.700427 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efe24419-5af6-4ba6-8c9c-ce27d32e1231 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.195458 May 14 21:14:59.704041 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 585/1178] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:59 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:14:59.735867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:14:59.737425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:14:59.744876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.745780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.746862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:14:59.747792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:14:59.990227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8d1fbf15-054d-44e2-8345-597a23b7fce7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79e2310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:00.044668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:00.061319 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-32d7ac63-94d5-4f85-81d4-e325b5e3b11a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1311 microversion: 2.1 time: 0.331009 May 14 21:15:00.061925 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 594/1179] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:14:59 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1311 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:00.088682 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8d1fbf15-054d-44e2-8345-597a23b7fce7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.101633 May 14 21:15:00.095012 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 586/1180] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:14:59 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:00.168321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-77c719c7-d3b3-48ec-8efc-00b704658812 req-c5961027-8d63-4502-a178-7d8ebb02950e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568afb67-d4f6-424e-82f4-150d00c3c6ee", "name": "network-vif-plugged", "status": "completed", "tag": "1ef02825-0b9d-4284-a41f-f07bc5e3e488"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:00.181606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-77c719c7-d3b3-48ec-8efc-00b704658812 req-c5961027-8d63-4502-a178-7d8ebb02950e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:00.182335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-77c719c7-d3b3-48ec-8efc-00b704658812 req-c5961027-8d63-4502-a178-7d8ebb02950e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:00.194203 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-77c719c7-d3b3-48ec-8efc-00b704658812 req-c5961027-8d63-4502-a178-7d8ebb02950e service nova] Creating event network-vif-plugged:1ef02825-0b9d-4284-a41f-f07bc5e3e488 for instance 568afb67-d4f6-424e-82f4-150d00c3c6ee on nch2-master-1 May 14 21:15:00.199722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-77c719c7-d3b3-48ec-8efc-00b704658812 req-c5961027-8d63-4502-a178-7d8ebb02950e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036331 May 14 21:15:00.205460 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 595/1181] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:00.221034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:00.221644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:00.247389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:00.248258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:00.249434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:00.250100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:00.505466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:00.507003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:00.524432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:00.526399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:00.530733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:00.532881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:00.552163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:00.565117 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f84e0701-bd90-43a6-ad79-929aad8d4e80 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1535 microversion: 2.1 time: 0.346099 May 14 21:15:00.567985 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 587/1182] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:00 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1535 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:00.722512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:00.723518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:00.742152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:00.751064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:00.752411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:00.753037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:00.796739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:00.816199 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-abe7fb8a-87ad-4650-a0a7-b2380c34bd4b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.311165 May 14 21:15:00.823496 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 596/1183] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:00 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:01.084140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:01.084983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:01.115133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.115911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.120473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.121432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.143504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:01.168238 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2dfb8961-331b-4bc1-a36b-28b1f49dc1b3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.450791 May 14 21:15:01.174161 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 588/1184] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:00 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:01.175157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b65151c1-aa4f-48db-b9c7-34046a25b5ff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7b5f160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:01.249845 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b65151c1-aa4f-48db-b9c7-34046a25b5ff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.078156 May 14 21:15:01.250858 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 589/1185] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:01 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:01.331960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:01.341094 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-463bf51b-7d74-461d-a9ff-31c7fe86af7c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1493 microversion: 2.1 time: 0.262339 May 14 21:15:01.344445 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 597/1186] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:01 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1493 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:01.361992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5cd550c5-3cb2-48da-b95b-ef054380b3d5 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:01.362624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5cd550c5-3cb2-48da-b95b-ef054380b3d5 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:01.375309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cd550c5-3cb2-48da-b95b-ef054380b3d5 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.375944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cd550c5-3cb2-48da-b95b-ef054380b3d5 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.376897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cd550c5-3cb2-48da-b95b-ef054380b3d5 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.378398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cd550c5-3cb2-48da-b95b-ef054380b3d5 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.589069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:01.590606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:01.604750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.606594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.611459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.612715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.655936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5cd550c5-3cb2-48da-b95b-ef054380b3d5 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1644 microversion: 2.1 time: 0.298676 May 14 21:15:01.658077 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 590/1187] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:01 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1644 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:01.685836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6345ea5-214b-4b8e-9f28-2bee56070b4d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:01.686917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c6345ea5-214b-4b8e-9f28-2bee56070b4d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:01.712586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6345ea5-214b-4b8e-9f28-2bee56070b4d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.721031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6345ea5-214b-4b8e-9f28-2bee56070b4d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.721031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6345ea5-214b-4b8e-9f28-2bee56070b4d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.721031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6345ea5-214b-4b8e-9f28-2bee56070b4d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.841543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:01.865123 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a94a1ac8-184d-44e9-bd21-fa95c61ce92d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1535 microversion: 2.1 time: 0.283555 May 14 21:15:01.872762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 598/1188] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:01 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1535 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:01.879407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:01.880216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:01.906237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.906696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:01.909939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:01.910445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.060248 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c6345ea5-214b-4b8e-9f28-2bee56070b4d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1644 microversion: 2.1 time: 0.384354 May 14 21:15:02.062297 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 591/1189] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:01 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1644 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:02.078707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eff64358-b142-4414-9f46-18db9880b236 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:02.080705 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:15:02.080705 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:15:02.083678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eff64358-b142-4414-9f46-18db9880b236 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.084589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eff64358-b142-4414-9f46-18db9880b236 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.087022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eff64358-b142-4414-9f46-18db9880b236 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.089670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eff64358-b142-4414-9f46-18db9880b236 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.137530 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eff64358-b142-4414-9f46-18db9880b236 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062577 May 14 21:15:02.143826 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 592/1190] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:15:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:02.149259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78d2dcc9-c9d9-4e5e-b00b-8188c2dca86c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:02.150301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78d2dcc9-c9d9-4e5e-b00b-8188c2dca86c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:02.160131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78d2dcc9-c9d9-4e5e-b00b-8188c2dca86c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.160881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78d2dcc9-c9d9-4e5e-b00b-8188c2dca86c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.161864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78d2dcc9-c9d9-4e5e-b00b-8188c2dca86c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.162529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78d2dcc9-c9d9-4e5e-b00b-8188c2dca86c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.192789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:02.203683 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6b2d185a-54df-4c66-9024-d9b8b9f113e4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.327991 May 14 21:15:02.213670 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 599/1191] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:01 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:02.213670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:02.214173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:02.238708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.240639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.241479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.241935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.469544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78d2dcc9-c9d9-4e5e-b00b-8188c2dca86c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60/action" status: 202 len: 0 microversion: 2.1 time: 0.320298 May 14 21:15:02.469544 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 593/1192] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:15:02 2022] POST /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:15:02.476861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-befce1ef-8831-4fca-a9f1-e106c8d1b372 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7990280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:02.552246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:02.565048 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5afef853-1c8e-4ec9-9f62-8622962350e3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.358991 May 14 21:15:02.565644 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 600/1193] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:02 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:02.579903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d253897-55da-43d8-bfe0-e0b3677a8401 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:02.580213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-befce1ef-8831-4fca-a9f1-e106c8d1b372 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.112563 May 14 21:15:02.581045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d253897-55da-43d8-bfe0-e0b3677a8401 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:02.581576 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 594/1194] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:02 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:02.639830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d253897-55da-43d8-bfe0-e0b3677a8401 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.640876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d253897-55da-43d8-bfe0-e0b3677a8401 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.645155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d253897-55da-43d8-bfe0-e0b3677a8401 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.645823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d253897-55da-43d8-bfe0-e0b3677a8401 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.811389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d253897-55da-43d8-bfe0-e0b3677a8401 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1649 microversion: 2.1 time: 0.244695 May 14 21:15:02.813752 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 601/1195] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:02 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1649 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:02.890744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:02.891946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:02.903935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.904727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:02.909083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:02.909083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:03.235865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:03.262453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9e89e0d-b86b-4b5e-9ae1-160e27c38899 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1535 microversion: 2.1 time: 0.373240 May 14 21:15:03.264804 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 595/1196] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:02 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1535 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:03.645500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f2c13be-6b23-48f7-9675-d30b88e5739b tempest-AbsoluteLimitsTestJSON-1104226183 tempest-AbsoluteLimitsTestJSON-1104226183-project] Calling method '.version_select at 0x7fb1a7a20b80>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:03.649421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1983496076", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:03.670108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f2c13be-6b23-48f7-9675-d30b88e5739b tempest-AbsoluteLimitsTestJSON-1104226183 tempest-AbsoluteLimitsTestJSON-1104226183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:03.670644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f2c13be-6b23-48f7-9675-d30b88e5739b tempest-AbsoluteLimitsTestJSON-1104226183 tempest-AbsoluteLimitsTestJSON-1104226183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:03.672055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f2c13be-6b23-48f7-9675-d30b88e5739b tempest-AbsoluteLimitsTestJSON-1104226183 tempest-AbsoluteLimitsTestJSON-1104226183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:03.673943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f2c13be-6b23-48f7-9675-d30b88e5739b tempest-AbsoluteLimitsTestJSON-1104226183 tempest-AbsoluteLimitsTestJSON-1104226183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:03.715093 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f2c13be-6b23-48f7-9675-d30b88e5739b tempest-AbsoluteLimitsTestJSON-1104226183 tempest-AbsoluteLimitsTestJSON-1104226183-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.446539 May 14 21:15:03.718067 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 596/1197] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:15:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:03.731568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:03.732521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:03.748116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:03.748845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:03.749800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:03.750243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:03.764469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:15:04.033212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:04.037177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:04.037970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:04.038825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:04.039321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:04.050375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.051235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.052384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.053096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.069169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:04.088633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Getting quotas for project b30891c9ccaf4e1bbdec0c910805d504. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:04.088797 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b20cc63-aea0-4f57-88ac-a880860ac79a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.358899 May 14 21:15:04.088797 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 597/1198] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:03 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:04.088965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Getting quotas for user e87dae577e6c42ba8d14094bd6cad9de and project b30891c9ccaf4e1bbdec0c910805d504. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:04.094598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:04.095449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:04.096554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:15:04.100080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:15:04.102244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.102795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.104418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.104970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.281176 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3e949b22-2942-4904-8ed3-93c40c4e8355 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.329244 May 14 21:15:04.282080 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 602/1199] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:15:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:15:04.286744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a193d2ca-5c65-48f7-bf7f-76140dcbf5e3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a796cca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:04.320938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:04.320938 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-77041842-00f2-4e8c-9ec0-b963e150fa8f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.227803 May 14 21:15:04.320938 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 598/1200] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:04 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:04.391797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a193d2ca-5c65-48f7-bf7f-76140dcbf5e3 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.107659 May 14 21:15:04.397419 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 603/1201] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:04 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:04.410993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-286f0432-84a8-405a-b04b-d7a8a66ed7e3 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:04.411903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-286f0432-84a8-405a-b04b-d7a8a66ed7e3 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:04.427776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-286f0432-84a8-405a-b04b-d7a8a66ed7e3 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.429273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-286f0432-84a8-405a-b04b-d7a8a66ed7e3 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.431034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-286f0432-84a8-405a-b04b-d7a8a66ed7e3 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.432747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-286f0432-84a8-405a-b04b-d7a8a66ed7e3 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.648247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-728804307", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "2f366748-ecde-43ad-b849-3c9dce1cc30b"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:04.692716 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-286f0432-84a8-405a-b04b-d7a8a66ed7e3 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1629 microversion: 2.1 time: 0.290876 May 14 21:15:04.693622 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 604/1202] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:04 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1629 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:04.720336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] validate_networks() for [('2f366748-ecde-43ad-b849-3c9dce1cc30b', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:15:04.720670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:04.721409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:04.733526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.734226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.735179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:04.735779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:04.906912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:04.936426 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2648a377-e4d7-41e7-af0f-b57a59c70eeb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1535 microversion: 2.1 time: 0.241444 May 14 21:15:04.939897 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 605/1203] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:04 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1535 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:04.944817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2fb01f3-b45f-4ad3-bb64-0195d30ef3af tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:04.945439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b2fb01f3-b45f-4ad3-bb64-0195d30ef3af tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:05.033118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2fb01f3-b45f-4ad3-bb64-0195d30ef3af tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:05.042440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2fb01f3-b45f-4ad3-bb64-0195d30ef3af tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1217 microversion: 2.1 time: 0.099593 May 14 21:15:05.043143 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 606/1204] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:04 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:05.051464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:05.052884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:05.060527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.063249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:05.063249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.063249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:05.188934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lazy-loading 'flavor' on Instance uuid 7d79ef89-784c-4a52-803f-2961220d5f60 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:15:05.210787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Going to try to live migrate instance to nch1-master-1 {{(pid=130638) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:15:05.281532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:05.281969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:05.282456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:05.282876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:05.283301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:05.297076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.297537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:05.298368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.298809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:05.353011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:05.362144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for user cfcb989a491440b3bf74ddc055ee14d3 and project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:05.384387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:15:05.387000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:15:05.588672 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e13233a-3899-4ea1-bb1c-7e55bc6da6cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.269491 May 14 21:15:05.589411 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 599/1205] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:15:05.599651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:05.600567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:05.607672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.608359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:05.609396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.610000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:05.767494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:05.776289 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9c3dfd06-aa95-4d2e-9f7a-dbb2bc32bf52 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.180100 May 14 21:15:05.780521 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 600/1206] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:05 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:05.795211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:05.795844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:05.802581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.803104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:05.803903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:05.804572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:06.030431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:06.039536 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e0d652fd-f91e-46ef-a80b-0df79113feb2 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.257089 May 14 21:15:06.050510 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 601/1207] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:05 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:06.056473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d93dadc7-d221-420d-b68a-f6bc84ac910e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79da4c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:06.111525 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d93dadc7-d221-420d-b68a-f6bc84ac910e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.056095 May 14 21:15:06.111525 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 602/1208] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:06 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:06.119594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8b1aa69d-29e9-4f31-acf7-ac81f989e88c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:06.120226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8b1aa69d-29e9-4f31-acf7-ac81f989e88c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:06.216960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8b1aa69d-29e9-4f31-acf7-ac81f989e88c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:06.225395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8b1aa69d-29e9-4f31-acf7-ac81f989e88c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:06.232190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8b1aa69d-29e9-4f31-acf7-ac81f989e88c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:06.232190 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8b1aa69d-29e9-4f31-acf7-ac81f989e88c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1261 microversion: 2.25 time: 0.117707 May 14 21:15:06.232190 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 603/1209] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:06 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1261 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:06.234454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:06.235273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:06.251259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:06.252134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:06.253246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:06.254048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:06.484452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:06.508006 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e0ba6e92-cba3-4927-81d7-004d63523761 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.265812 May 14 21:15:06.508851 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 604/1210] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:06 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:06.515455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:06.516134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:06.527694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:06.528381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:06.529243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:06.529773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:06.607928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:06.618509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f856f110-95b6-480e-b159-bb6adcfdedc2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1269 microversion: 2.1 time: 0.105498 May 14 21:15:06.622041 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 605/1211] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:06 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1269 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:06.796595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:06.797242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:06.803883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:06.804434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:06.805324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:06.805844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:07.004842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:07.013955 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9a2119d8-7d4c-4e93-a38f-6dba2eed6438 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.223746 May 14 21:15:07.018283 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 606/1212] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:06 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:07.069499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:07.070860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:07.089422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:07.091664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:07.095368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:07.097103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:07.518136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:07.530667 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9fc123e6-8394-4e9e-9cc8-51bc429842e9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.475892 May 14 21:15:07.531311 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 607/1213] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:07 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:07.544359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ac2ce5c-0e1f-4c65-97b3-4f78e521207b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79cc4c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:07.630262 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ac2ce5c-0e1f-4c65-97b3-4f78e521207b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.089640 May 14 21:15:07.638030 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 608/1214] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:07 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:07.645795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:07.647240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:07.655702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:07.657693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:07.657693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:07.658050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:07.794460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:07.810859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:07.813051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:07.814308 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf62410f-5047-4c8a-9c08-c5282a743e81 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1257 microversion: 2.25 time: 0.174809 May 14 21:15:07.814941 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 609/1215] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:07 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1257 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:07.834388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:07.835437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:07.841976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:07.842429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:07.843302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:07.843983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:08.069407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:08.101738 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b33abfd-f1ad-4c8a-9268-5eb3c3221bf2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.283595 May 14 21:15:08.105326 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 610/1216] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:07 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:08.123030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:08.124002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:08.137324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:08.137794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:08.143242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:08.143242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:08.350157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:08.402977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-57102223-b768-4a87-99bd-fc0e51611c32 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1275 microversion: 2.1 time: 0.293975 May 14 21:15:08.455717 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 611/1217] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:08 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:08.455717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:08.455717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:08.455717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:08.456188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:08.456188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:08.456188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:08.959372 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e3af85b-6e51-4ac0-8d3b-69d9d0af3ab9 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60/action" status: 202 len: 0 microversion: 2.1 time: 3.914390 May 14 21:15:08.963830 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 607/1218] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:15:05 2022] POST /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60/action => generated 0 bytes in 3916 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:15:08.968157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:08.968922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:08.984913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:08.987897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:08.987897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:08.987897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.027707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:09.036692 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8348d2f4-7ed4-44c1-9388-f9af7ed12b32 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.629404 May 14 21:15:09.037777 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 612/1219] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:08 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:09.042815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b7fdf69e-6840-4785-a9fc-b53c8e500765 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79cc3a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:09.102175 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b7fdf69e-6840-4785-a9fc-b53c8e500765 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.062769 May 14 21:15:09.107373 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 613/1220] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:09 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:09.124573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:09.125604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:09.142065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.143582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.145186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.147180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.207688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:09.228769 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53014a81-c6cf-44c5-92cc-3a98414cbc09 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1471 microversion: 2.1 time: 0.264429 May 14 21:15:09.230204 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 608/1221] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:08 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:09.238882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:09.246336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:09.264555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.265028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.265901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.266522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.317093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:09.331120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:09.335581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:09.337327 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb60618e-4aee-449c-b614-40014de56c15 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1321 microversion: 2.25 time: 0.227494 May 14 21:15:09.344987 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 614/1222] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:09 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:09.349950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:09.350566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:09.364716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.368965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.369897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.371060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.636730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:09.650724 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6bf71ca1-e4e1-4a71-8c4a-5feab9114c7d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.411125 May 14 21:15:09.652349 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 609/1223] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:09 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:09.672157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:09.673039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:09.702258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.708686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.709889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:09.716752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:09.826644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:09.835744 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-595ee30f-7439-417d-a52c-ed48a7a5b0ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.489539 May 14 21:15:09.847015 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 615/1224] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:09 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:10.055629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:10.056534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:10.076057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.076821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:10.077788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.078347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:10.133559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:10.159392 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1bb28782-d307-4569-b780-56b42e66b9d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.491948 May 14 21:15:10.159392 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 610/1225] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:09 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:10.171165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-883191cf-a764-4d43-a1ca-d03d5973efbf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78d7790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:10.260557 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-883191cf-a764-4d43-a1ca-d03d5973efbf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.108190 May 14 21:15:10.267970 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 611/1226] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:10 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:10.271345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:10.271703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:10.286484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.286949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:10.288150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.288588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:10.483851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:10.501978 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6580002f-2618-45b4-84ac-31fed65cebea tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.450473 May 14 21:15:10.511914 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 616/1227] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:10 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:10.511914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:10.511914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:10.531642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.532101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:10.532885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.533329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:10.879785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:10.889303 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c938b670-a686-4360-87f3-c45946b7becb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1477 microversion: 2.1 time: 0.626676 May 14 21:15:10.905852 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 612/1228] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:10 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1477 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:10.910964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:10.916213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:10.932757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.935459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:10.936524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:10.939305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:11.081017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:11.090793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:11.099032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:11.100246 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9cf890ee-916f-4ba2-85eb-31d576ab588c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1319 microversion: 2.25 time: 0.596111 May 14 21:15:11.105928 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 617/1229] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:10 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:11.110719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:11.111319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:11.132843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:11.133608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:11.135097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:11.135847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:11.465956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:11.487922 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7643c1ef-4830-4de6-a6b2-3da207068ad1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.569931 May 14 21:15:11.492202 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 613/1230] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:10 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:11.498119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:11.503457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:11.517727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:11.522510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:11.523662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:11.526973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:11.726716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:11.745002 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-256c933e-7b3d-4940-b1f6-7bc5c789366e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.637018 May 14 21:15:11.746826 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 618/1231] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:11 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:11.751796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d5eeacf-bc89-47bd-ba67-2aa2d9ed132d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79bef70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:11.820564 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d5eeacf-bc89-47bd-ba67-2aa2d9ed132d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.072271 May 14 21:15:11.823307 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 619/1232] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:11 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:11.834736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:11.836183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:11.850148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:11.852315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:11.857913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:11.858370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:12.058155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:12.068356 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f03658a6-2732-4012-96ef-0f786068eae3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.573701 May 14 21:15:12.070364 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 614/1233] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:11 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:12.083723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:12.084424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:12.100237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:12.101643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:12.104564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:12.106407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:12.345966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:12.356038 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76e8b84c-8227-4264-9aae-c8217b56ba89 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.531429 May 14 21:15:12.368340 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 620/1234] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:11 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:12.388841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:12.392411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:12.405550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:12.407516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:12.411156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:12.411871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:12.995671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:13.004734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:13.012314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:13.013756 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c8dbec9-3aac-483c-b145-3538fb5c0d93 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.643956 May 14 21:15:13.016346 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 621/1235] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:12 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:13.021074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-676533eb-3d0a-434c-a201-fb3c124357f6 req-b056d39c-cbbb-4382-a7a0-d5495bb2c168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0682771c-4855-4853-9123-f03aa17b7b53", "name": "network-vif-unplugged", "status": "completed", "tag": "7f69be99-9e4d-472a-a312-16dd01bfc172"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:13.041450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-676533eb-3d0a-434c-a201-fb3c124357f6 req-b056d39c-cbbb-4382-a7a0-d5495bb2c168 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.055614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-676533eb-3d0a-434c-a201-fb3c124357f6 req-b056d39c-cbbb-4382-a7a0-d5495bb2c168 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.069492 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-676533eb-3d0a-434c-a201-fb3c124357f6 req-b056d39c-cbbb-4382-a7a0-d5495bb2c168 service nova] Creating event network-vif-unplugged:7f69be99-9e4d-472a-a312-16dd01bfc172 for instance 0682771c-4855-4853-9123-f03aa17b7b53 on nch2-master-1 May 14 21:15:13.082619 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-676533eb-3d0a-434c-a201-fb3c124357f6 req-b056d39c-cbbb-4382-a7a0-d5495bb2c168 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064793 May 14 21:15:13.083569 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 622/1236] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:13.089186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9b400127-e892-4e41-b52f-c7672e6418f3 req-a75c88cf-7298-41e5-b6f9-ae0ff33f2c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbbb39d4-b558-43b9-a868-776517ce58e2", "tag": "229bb137-aed4-4606-843d-7799884c4e81"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:13.114500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9b400127-e892-4e41-b52f-c7672e6418f3 req-a75c88cf-7298-41e5-b6f9-ae0ff33f2c72 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.115305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9b400127-e892-4e41-b52f-c7672e6418f3 req-a75c88cf-7298-41e5-b6f9-ae0ff33f2c72 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.134919 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9b400127-e892-4e41-b52f-c7672e6418f3 req-a75c88cf-7298-41e5-b6f9-ae0ff33f2c72 service nova] Creating event network-changed:229bb137-aed4-4606-843d-7799884c4e81 for instance cbbb39d4-b558-43b9-a868-776517ce58e2 on nch1-master-1 May 14 21:15:13.156821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9b400127-e892-4e41-b52f-c7672e6418f3 req-a75c88cf-7298-41e5-b6f9-ae0ff33f2c72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071424 May 14 21:15:13.157754 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 623/1237] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:13.169151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:13.171490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:13.183923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.186752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.189230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.189860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.315781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:13.349317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9885bc5e-9c20-4d57-aec0-21567eae0cf6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1477 microversion: 2.1 time: 1.272943 May 14 21:15:13.355807 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 615/1238] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:12 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1477 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:13.375212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:13.376792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:13.390079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.390940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.392410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.393400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.710273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:13.725321 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6423f5ce-6c5a-4e27-a71f-f2045f4ef23a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.565859 May 14 21:15:13.725925 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 624/1239] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:13 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:13.739076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a1ab290-aab5-4de9-ac15-8b94450c7377 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79be310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:13.807078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:13.822734 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a1ab290-aab5-4de9-ac15-8b94450c7377 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.094995 May 14 21:15:13.824007 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 625/1240] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:13 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:13.825460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-76dce270-0066-4055-b061-103ef1860f60 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.468012 May 14 21:15:13.826082 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 616/1241] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:13 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:13.831062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:13.844409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:13.844679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:13.845496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:13.852285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.853620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.854750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.864254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.874282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.874829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:13.876307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:13.877131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:14.294589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:14.314232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-42d8dfa0-75b2-4da7-b707-0b233c4e5ea9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1515 microversion: 2.1 time: 0.483403 May 14 21:15:14.315155 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 617/1242] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:13 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1515 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:14.330464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:14.337124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:14.351326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:14.370799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:14.370799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:14.370799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:14.520692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:14.542672 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a9e34c9f-07a3-4ab4-9e19-68818265d1d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.717013 May 14 21:15:14.550315 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 626/1243] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:13 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:14.568550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:14.570845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:14.591334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:14.594471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:14.595773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:14.598490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:14.784776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:14.798607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:14.804597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:14.806440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae55b3ae-621e-4d74-8fe3-fe32f21ddaf1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.481960 May 14 21:15:14.808770 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 618/1244] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:14 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:14.817440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:14.819684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:14.833584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:14.835399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:14.837165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:14.838224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.351531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:15.369458 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c57f79d-03c6-4eec-8867-72ecc31737d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1477 microversion: 2.1 time: 0.817051 May 14 21:15:15.383115 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 627/1245] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:14 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1477 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:15.389728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88ce6416-4e08-4a19-ae82-3bb761c899f8 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7b77160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:15.459374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88ce6416-4e08-4a19-ae82-3bb761c899f8 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.074688 May 14 21:15:15.460445 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 628/1246] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:15 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:15.466875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:15.467802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:15.474639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.475596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.476628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.477325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.519782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:15.530335 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-415f455d-a616-43cc-9512-a2b32e17a968 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.720214 May 14 21:15:15.539684 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 619/1247] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:14 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:15.539684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8abcdd1e-3dba-47be-a36f-593d176050a8 req-813717b4-b0c4-4c1d-8e1e-899270104656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d79ef89-784c-4a52-803f-2961220d5f60", "name": "network-vif-unplugged", "status": "completed", "tag": "32c5ed60-6069-4c0c-9bc2-bd74c3e72ece"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:15.556003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8abcdd1e-3dba-47be-a36f-593d176050a8 req-813717b4-b0c4-4c1d-8e1e-899270104656 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.557306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8abcdd1e-3dba-47be-a36f-593d176050a8 req-813717b4-b0c4-4c1d-8e1e-899270104656 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.571287 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8abcdd1e-3dba-47be-a36f-593d176050a8 req-813717b4-b0c4-4c1d-8e1e-899270104656 service nova] Creating event network-vif-unplugged:32c5ed60-6069-4c0c-9bc2-bd74c3e72ece for instance 7d79ef89-784c-4a52-803f-2961220d5f60 on nch2-master-1 May 14 21:15:15.577573 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8abcdd1e-3dba-47be-a36f-593d176050a8 req-813717b4-b0c4-4c1d-8e1e-899270104656 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044430 May 14 21:15:15.578406 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 620/1248] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:15.583380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:15.584141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:15.591272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.591839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.592551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.592996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.774403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:15.807270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45a3b26f-b964-4397-a8db-531cd7edaebd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.341980 May 14 21:15:15.810013 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 629/1249] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:15 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:15.816310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8d5707c5-2a80-4f35-b738-f8cae0d721dc req-516aef20-765d-4f7d-a75f-6f345215fb24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43996dfa-e6da-4600-a5f7-5b9bbb2f963f", "tag": "293b2971-a322-40b2-bfb2-3a548a746cc9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:15.827006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8d5707c5-2a80-4f35-b738-f8cae0d721dc req-516aef20-765d-4f7d-a75f-6f345215fb24 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.827887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8d5707c5-2a80-4f35-b738-f8cae0d721dc req-516aef20-765d-4f7d-a75f-6f345215fb24 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.842930 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8d5707c5-2a80-4f35-b738-f8cae0d721dc req-516aef20-765d-4f7d-a75f-6f345215fb24 service nova] Creating event network-changed:293b2971-a322-40b2-bfb2-3a548a746cc9 for instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f on nch1-master-1 May 14 21:15:15.848800 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8d5707c5-2a80-4f35-b738-f8cae0d721dc req-516aef20-765d-4f7d-a75f-6f345215fb24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037225 May 14 21:15:15.850309 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 630/1250] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:15.868243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:15.870123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:15.877419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.878235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.879290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:15.880155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:15.917956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:15.934054 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-179f9dd0-17de-459c-a91c-f6d3ae4fb46c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.354570 May 14 21:15:15.946368 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 621/1251] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:15 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:15.955258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:15.956168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:16.041786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.041786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.041786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.041786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.197562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:16.220884 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2267671b-af62-4c05-8bc6-12897f297813 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.363813 May 14 21:15:16.221561 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 631/1252] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:15 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:16.236236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-49f9993d-5621-4e9b-9010-e7a14ad697ac req-58e97048-a59d-45a3-bc81-7c29c2ab20c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0682771c-4855-4853-9123-f03aa17b7b53", "name": "network-vif-plugged", "status": "completed", "tag": "7f69be99-9e4d-472a-a312-16dd01bfc172"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:16.250387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-49f9993d-5621-4e9b-9010-e7a14ad697ac req-58e97048-a59d-45a3-bc81-7c29c2ab20c3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.251189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:16.251331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-49f9993d-5621-4e9b-9010-e7a14ad697ac req-58e97048-a59d-45a3-bc81-7c29c2ab20c3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.263324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:16.265992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:16.268261 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0f98745-9e4c-4c5c-8be1-808b3f917956 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.319914 May 14 21:15:16.268850 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 622/1253] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:15 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:16.275166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-49f9993d-5621-4e9b-9010-e7a14ad697ac req-58e97048-a59d-45a3-bc81-7c29c2ab20c3 service nova] Creating event network-vif-plugged:7f69be99-9e4d-472a-a312-16dd01bfc172 for instance 0682771c-4855-4853-9123-f03aa17b7b53 on nch2-master-1 May 14 21:15:16.282245 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-49f9993d-5621-4e9b-9010-e7a14ad697ac req-58e97048-a59d-45a3-bc81-7c29c2ab20c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059255 May 14 21:15:16.283359 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 632/1254] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:16.394723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:16.395880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:16.407623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.408104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.409181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.409627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.479029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bab52bed-8016-4e1f-a046-5bb9afcaaeb2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79f20d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:16.559243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bab52bed-8016-4e1f-a046-5bb9afcaaeb2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.089923 May 14 21:15:16.559918 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 633/1255] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:16 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:16.568215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:16.568962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:16.620180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.620691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.621545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.625738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.840004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:16.848934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef7920f1-c34c-4ee7-aa41-cb050052d6d1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1477 microversion: 2.1 time: 0.462209 May 14 21:15:16.852170 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 623/1256] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:16 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1477 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:16.859221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:16.859879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:16.879295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.882655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.885423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:16.885889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:16.947806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:16.961461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-734a6176-5f61-4c26-9558-dfa4a78f48f1 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.400420 May 14 21:15:16.969871 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 634/1257] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:16 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:16.980384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:16.981015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:17.001366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.001844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.002699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.003137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.130517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:17.142397 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8fcc4d76-f4d1-4187-9283-a42d73225ca8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.289083 May 14 21:15:17.143292 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 624/1258] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:16 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:17.203216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:17.215976 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff25dc77-fdcc-4f5a-83b1-e3c92ac04e56 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.242198 May 14 21:15:17.216814 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 635/1259] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:16 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:17.238779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:17.239240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:17.257029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.257803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.258833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.259451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.286194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:17.286825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:17.296947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.300150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.300971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.301465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.609556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:17.620519 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c521fdd-1814-4da6-a965-9cf3b1cbad11 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.385981 May 14 21:15:17.622496 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 625/1260] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:17 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:17.640043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1c3751d-d92b-40ec-9d90-de135cf10c56 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78bd430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:17.669830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:17.687910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:17.687910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:17.687910 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71a46789-512b-416b-b33f-351e02c5bd20 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.404124 May 14 21:15:17.688204 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 636/1261] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:17 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:15:17.702727 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1c3751d-d92b-40ec-9d90-de135cf10c56 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1454 microversion: 2.1 time: 0.078688 May 14 21:15:17.710494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d6fbe7f8-2717-4794-9ab1-f3b8f2947317 req-a47c4dd4-f661-466f-b555-caccd9da8543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d79ef89-784c-4a52-803f-2961220d5f60", "tag": "32c5ed60-6069-4c0c-9bc2-bd74c3e72ece"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:17.710810 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 626/1262] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:17 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1454 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:17.723666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d6fbe7f8-2717-4794-9ab1-f3b8f2947317 req-a47c4dd4-f661-466f-b555-caccd9da8543 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.724412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d6fbe7f8-2717-4794-9ab1-f3b8f2947317 req-a47c4dd4-f661-466f-b555-caccd9da8543 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.739121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d6fbe7f8-2717-4794-9ab1-f3b8f2947317 req-a47c4dd4-f661-466f-b555-caccd9da8543 service nova] Creating event network-changed:32c5ed60-6069-4c0c-9bc2-bd74c3e72ece for instance 7d79ef89-784c-4a52-803f-2961220d5f60 on nch2-master-1 May 14 21:15:17.744258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d6fbe7f8-2717-4794-9ab1-f3b8f2947317 req-a47c4dd4-f661-466f-b555-caccd9da8543 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041350 May 14 21:15:17.745151 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 637/1263] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:17.874779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:17.874779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:17.885735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.887256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.888473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.889152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.979887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:17.981069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:17.992738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.994430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:17.995505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:17.996228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.244420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:18.254768 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a63bb17-9416-4687-a905-732d1e691ba3 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1477 microversion: 2.1 time: 0.391471 May 14 21:15:18.255371 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 627/1264] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:17 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1477 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:18.260709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:18.261847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:18.268709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.269388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.272136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.272652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.508182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:18.517965 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dbb1d479-4a6a-4a19-87a3-c6cb34ac56ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.260674 May 14 21:15:18.518168 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 628/1265] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:18 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:18.523130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:18.524010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:18.530820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.531388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.532298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.532966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.577866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:18.585457 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e1ffd827-0722-46d3-892e-9bc0ed2de8db tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.610958 May 14 21:15:18.596566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 638/1266] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:17 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:18.638673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:18.639598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:18.650602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.650977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.656215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.658459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.880158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:18.895903 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-94c11c45-b37a-401a-9e30-12bcd99a9d43 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.371210 May 14 21:15:18.895903 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 629/1267] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:18 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:18.899252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:18.900426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:18.909201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.909983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.910784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:18.911650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:18.949364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:18.966289 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-860ae82c-3da0-49aa-8aa7-112121ac798e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.332469 May 14 21:15:18.967696 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 639/1268] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:18 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:18.972744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-932a15ad-8e72-4ca9-8fd0-5005845cc94a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a795adc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:19.037158 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-932a15ad-8e72-4ca9-8fd0-5005845cc94a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1463 microversion: 2.1 time: 0.068000 May 14 21:15:19.038085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 640/1269] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:18 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1463 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:19.051809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0672b500-b1f2-46f3-bf52-64ae7924ab38 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79b7040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:19.122867 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0672b500-b1f2-46f3-bf52-64ae7924ab38 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 200 len: 1463 microversion: 2.1 time: 0.075234 May 14 21:15:19.131284 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 641/1270] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:19 2022] GET /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 1463 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:19.137844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:19.138584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:19.144821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.150335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.151219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.151760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.209219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:19.218432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:19.219978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:19.221385 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e63bb456-1a7f-434d-99cd-4a2f05a0a033 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.329210 May 14 21:15:19.228154 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 630/1271] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:18 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:19.272963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:19.273857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:19.281142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.281607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.282842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.283298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.316238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:19.325707 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-576f4b65-bef5-40bc-9ebc-da6837b4177c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1467 microversion: 2.1 time: 0.192892 May 14 21:15:19.327795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 642/1272] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:19 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1467 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:19.345703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-576a9a05-8f56-4319-9665-245684b0fa2b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-80487125"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:19.347138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-576a9a05-8f56-4319-9665-245684b0fa2b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:19.353664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576a9a05-8f56-4319-9665-245684b0fa2b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.354110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576a9a05-8f56-4319-9665-245684b0fa2b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.354900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576a9a05-8f56-4319-9665-245684b0fa2b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.355343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-576a9a05-8f56-4319-9665-245684b0fa2b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.519185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:19.529091 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf5c6ab5-822c-403b-81bd-dbf997bcac3f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1463 microversion: 2.1 time: 0.261158 May 14 21:15:19.539510 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 631/1273] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:19 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:19.539510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:19.539510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:19.542922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.543517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.545559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.546218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.757770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:19.766966 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83281ab7-ee84-43a2-8bcb-2b6bc6e74e0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.236117 May 14 21:15:19.767924 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 632/1274] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:19 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:19.772516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:19.773128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:19.780277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.780740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.781515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.782409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.923238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:19.930282 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-073ea3d4-04ae-4175-8f74-8202855b867d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1463 microversion: 2.1 time: 0.161412 May 14 21:15:19.931513 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 633/1275] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:19 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1463 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:19.935812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:19.936429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:19.942142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.942604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.943372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:19.943865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:19.960817 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-576a9a05-8f56-4319-9665-245684b0fa2b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "POST /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18/action" status: 202 len: 0 microversion: 2.1 time: 0.619422 May 14 21:15:19.964108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 643/1276] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:15:19 2022] POST /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:15:20.176924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:20.187307 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-af8fe9f0-667e-4a15-853b-f5334cd82934 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.255215 May 14 21:15:20.190339 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 634/1277] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:19 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:20.190769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-975d0050-8294-4641-8ef6-e026a3389dac tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Action: 'create', calling method: .version_select at 0x7fb1a79da700>, body: {"keypair": {"name": "tempest-keypair-983872793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZOpv+bxxmX6bYh5lPDJucXNagfZqNgIOCqJbXs/bkTZ+LnGXOqfj4wnMD6vcWlzCZJTxGk5CYryLYpCbaJUMJkITSZ1J2eb3FmzyDsavv1CiklF6Qtl/hPOw809/BsIA=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:20.200412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-480354e3-7755-478f-a296-345e0d867ba2 req-204b4bc8-0bf3-47e1-b1a9-2ec6add2c069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe390af-35f4-4cf5-91c5-994e9c2dc488", "name": "network-vif-unplugged", "status": "completed", "tag": "75e96c25-9a97-4ee1-a8c0-34cdddac4e11"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:20.218926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-975d0050-8294-4641-8ef6-e026a3389dac tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Getting quotas for project 611dce182666487684bf1e2a687c523a. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:20.220706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-480354e3-7755-478f-a296-345e0d867ba2 req-204b4bc8-0bf3-47e1-b1a9-2ec6add2c069 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.221165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-480354e3-7755-478f-a296-345e0d867ba2 req-204b4bc8-0bf3-47e1-b1a9-2ec6add2c069 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.234396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-975d0050-8294-4641-8ef6-e026a3389dac tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Getting quotas for user 053ae4d2abd445968a2d0a953fdbfc63 and project 611dce182666487684bf1e2a687c523a. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:20.242939 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-480354e3-7755-478f-a296-345e0d867ba2 req-204b4bc8-0bf3-47e1-b1a9-2ec6add2c069 service nova] Creating event network-vif-unplugged:75e96c25-9a97-4ee1-a8c0-34cdddac4e11 for instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 on nch1-master-1 May 14 21:15:20.248968 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-480354e3-7755-478f-a296-345e0d867ba2 req-204b4bc8-0bf3-47e1-b1a9-2ec6add2c069 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057024 May 14 21:15:20.250228 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 635/1278] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:20.260512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:20.260512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:20.264845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.265358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.267078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.267560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.369680 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-975d0050-8294-4641-8ef6-e026a3389dac tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.404031 May 14 21:15:20.370641 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 644/1279] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:15:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:20.390518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:20.392666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:20.400934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.401878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.402877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.403591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.495707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:20.496268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:20.496925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:20.497440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:20.497959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:20.577405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:20.587382 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd4ffb25-c7cb-4c34-98d2-d0b5c070dbd5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.334185 May 14 21:15:20.587382 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 636/1280] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:20 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:20.599914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa68fac2-4ffe-44ec-a820-66b72b3b5c9f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a795bdc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:20.659612 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa68fac2-4ffe-44ec-a820-66b72b3b5c9f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.071490 May 14 21:15:20.660491 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 637/1281] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:20 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:20.665160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:20.666730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:20.673134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.673586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.674378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.674922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.760122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:20.766913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.768054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.769176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.769861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.802838 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d6eee970-9576-4ce1-bb67-f1952ff1b53d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action" status: 202 len: 1067 microversion: 2.1 time: 0.431220 May 14 21:15:20.803851 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 645/1282] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:15:20 2022] POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action => generated 1067 bytes in 433 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 14 21:15:20.824657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:20.826347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:20.848655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.859151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.859151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:20.859151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:20.970682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:20.984634 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ac93f47-d0ef-4896-b712-e766a79c1d7f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.322964 May 14 21:15:20.985232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 638/1283] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:20 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:20.992943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:20.993640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:21.001148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.001404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.002392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.003002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.119057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:21.131425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:21.133777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:21.135227 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d04d308-dac7-4a7a-b04f-04cbf9d37423 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.330276 May 14 21:15:21.136402 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 646/1284] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:20 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:21.141798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:21.142590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:21.149290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.150999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.153297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.153945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.210625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:21.219632 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-805c9593-4b7b-4a99-b99f-107c49155a01 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.233034 May 14 21:15:21.221231 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 639/1285] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:20 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:21.226903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:21.227872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:21.235700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.236391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.237361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.237967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.445024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:21.454344 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f2e8a96-c13c-45dd-b90b-1bae44fb958d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.316655 May 14 21:15:21.466753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 647/1286] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:21 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:21.503893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:21.520471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53b9cbe9-0f7a-4af6-94c8-9e9194d8836d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.297846 May 14 21:15:21.521076 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 640/1287] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:21 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:21.603723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:21.603723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:21.609598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.610048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.610821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:21.611256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:21.681044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3013d831-d503-4f48-8658-4be7c26c1922 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78afd30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:21.755523 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3013d831-d503-4f48-8658-4be7c26c1922 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.084993 May 14 21:15:21.761884 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 641/1288] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:21 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:21.862808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:21.872011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a7b37a76-ade0-481e-8b95-acb5ebfa3073 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.272933 May 14 21:15:21.872608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 648/1289] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:21 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:22.002214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:22.003217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:22.012832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.013278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.014920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.015367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.153926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:22.155311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:22.163550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.164310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.176497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.177033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.274117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:22.285641 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d261f24a-d8d4-409e-9542-aa83308c2c61 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.287821 May 14 21:15:22.287127 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 642/1290] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:21 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:22.302070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:22.302696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:22.311833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.312995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.314462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.315066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.411975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:22.433091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:22.437250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:22.446048 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5b8c0239-94fe-431e-b253-67d38bfee74f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.289279 May 14 21:15:22.447368 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 649/1291] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:22 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:22.474375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:22.474999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:22.482728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.483467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.484437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.485037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.717349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:22.725674 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fa6a3843-6b67-4775-a15f-e096ab75f22d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.255149 May 14 21:15:22.726543 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 650/1292] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:22 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:22.743101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c03b58a6-1e6e-4675-ad1e-bb06efe2fdfd req-a159d738-2c76-4cae-99c1-6efcea8629d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568afb67-d4f6-424e-82f4-150d00c3c6ee", "name": "network-vif-unplugged", "status": "completed", "tag": "1ef02825-0b9d-4284-a41f-f07bc5e3e488"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:22.753193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c03b58a6-1e6e-4675-ad1e-bb06efe2fdfd req-a159d738-2c76-4cae-99c1-6efcea8629d0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.756212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c03b58a6-1e6e-4675-ad1e-bb06efe2fdfd req-a159d738-2c76-4cae-99c1-6efcea8629d0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.768186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c03b58a6-1e6e-4675-ad1e-bb06efe2fdfd req-a159d738-2c76-4cae-99c1-6efcea8629d0 service nova] Creating event network-vif-unplugged:1ef02825-0b9d-4284-a41f-f07bc5e3e488 for instance 568afb67-d4f6-424e-82f4-150d00c3c6ee on nch2-master-1 May 14 21:15:22.777880 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c03b58a6-1e6e-4675-ad1e-bb06efe2fdfd req-a159d738-2c76-4cae-99c1-6efcea8629d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038706 May 14 21:15:22.779088 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 651/1293] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:22.784689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:22.785369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:22.792640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.793358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.794306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:22.794901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:22.886876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:22.898685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d54635f0-7862-4d8d-95da-db9eb81960d0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.610059 May 14 21:15:22.899400 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 643/1294] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:22 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:22.909402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2d83ac4-01ba-4c29-b60e-bd243a216370 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a794daf0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:22.979196 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f2d83ac4-01ba-4c29-b60e-bd243a216370 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.078131 May 14 21:15:22.987071 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 644/1295] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:22 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:22.992292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:22.993221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:23.001305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.002112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.003166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.004309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.127668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:23.142320 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46311126-c08d-47c8-8475-ceb011f2c71a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1503 microversion: 2.1 time: 0.361774 May 14 21:15:23.144273 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 652/1296] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:22 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:23.302045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:23.303429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:23.306957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:23.318139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.318375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.318995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.319673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.320343 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6e6467d5-afac-47b1-84b8-c676248088e0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.331898 May 14 21:15:23.323157 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 645/1297] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:22 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:23.466732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:23.468092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:23.476047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.476693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.478975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.479741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.654840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:23.681999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:23.685054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:23.686228 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b686906-9c9e-4f89-ba7a-889dc8aa1223 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.225129 May 14 21:15:23.696397 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 646/1298] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:23 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:23.748954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:23.750047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:23.757084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.757808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.758727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.759189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.846533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:23.854802 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1a36107-e62e-4ca3-a203-6c6daf64eabf tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.556469 May 14 21:15:23.855710 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 653/1299] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:23 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:23.926331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:23.939503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:23.950674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.951896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:23.954833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:23.955470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.104984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:24.112853 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-32e8c034-e31e-4e46-b598-123863722823 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.370954 May 14 21:15:24.114149 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 647/1300] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:23 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:24.120095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-12e9bcdd-7957-454d-9c7a-203613069556 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78afdc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:24.167461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:24.168833 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-12e9bcdd-7957-454d-9c7a-203613069556 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.053397 May 14 21:15:24.169504 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 648/1301] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:24 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:24.174240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:24.174942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:24.178559 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cef52ee4-1978-4f34-a031-875a2027b174 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.265291 May 14 21:15:24.179204 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 654/1302] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:23 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:24.184663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.185266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.186583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.187275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.255682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e736fdf7-5595-4208-be2e-04f08eb744e7"}], "security_groups": [{"name": "tempest-securitygroup--773901585"}], "key_name": "tempest-keypair-983872793", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:24.426493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:24.435091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] validate_networks() for [('e736fdf7-5595-4208-be2e-04f08eb744e7', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:15:24.444303 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c1ae3ab-f56e-42b9-b0de-4529ea077fea tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1478 microversion: 2.1 time: 0.273659 May 14 21:15:24.451568 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 649/1303] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:24 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1478 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:24.451568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:24.451568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:24.460628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.461233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.462668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.462668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.639972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:24.653603 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c848e08c-47aa-4f0f-bab2-c6656fb2480a tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.202124 May 14 21:15:24.653603 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 650/1304] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:24 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:24.654663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b94e98f4-3885-4bc4-9703-ef11badd1a16 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '.version_select at 0x7fb1a787c4c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:24.657367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b94e98f4-3885-4bc4-9703-ef11badd1a16 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.658112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b94e98f4-3885-4bc4-9703-ef11badd1a16 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.668613 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b94e98f4-3885-4bc4-9703-ef11badd1a16 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 1961 microversion: 2.1 time: 0.018459 May 14 21:15:24.669597 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 651/1305] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:15:24 2022] GET /compute/v2.1/os-migrations => generated 1961 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:24.681826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-267a19d8-4acb-4dc5-9fa4-48b1af2bccde tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:24.682839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-267a19d8-4acb-4dc5-9fa4-48b1af2bccde tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:24.695375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-267a19d8-4acb-4dc5-9fa4-48b1af2bccde tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.695986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-267a19d8-4acb-4dc5-9fa4-48b1af2bccde tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.698392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-267a19d8-4acb-4dc5-9fa4-48b1af2bccde tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.700158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-267a19d8-4acb-4dc5-9fa4-48b1af2bccde tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.975025 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-267a19d8-4acb-4dc5-9fa4-48b1af2bccde tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1629 microversion: 2.1 time: 0.286184 May 14 21:15:24.975025 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 652/1306] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:24 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1629 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:24.975025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:24.975025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:24.976288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.976750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.977540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:24.978541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:24.998844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:24.999558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:25.000185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:25.000847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:25.001338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:25.011360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.012103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.013224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.013594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.048075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Getting quotas for project 611dce182666487684bf1e2a687c523a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:25.058736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Getting quotas for user 053ae4d2abd445968a2d0a953fdbfc63 and project 611dce182666487684bf1e2a687c523a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:25.068513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:15:25.070989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:15:25.224155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:25.236496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:25.238332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:25.239939 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0f9b5c77-0741-40b7-a08f-e9773bfaf958 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.274202 May 14 21:15:25.241142 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 653/1307] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:24 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:25.246799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:25.247748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:25.264894 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5b261351-eec3-4575-921c-b56bc284ef8f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.013566 May 14 21:15:25.266143 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 655/1308] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:15:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:15:25.274729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-024fc5c6-48a9-4c43-89c7-ee47e72ef894 req-d7484384-a111-4dc0-8a98-cf4ae28e1ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe390af-35f4-4cf5-91c5-994e9c2dc488", "name": "network-vif-plugged", "status": "completed", "tag": "75e96c25-9a97-4ee1-a8c0-34cdddac4e11"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:25.287702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.288644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.289592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.290740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.294402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-024fc5c6-48a9-4c43-89c7-ee47e72ef894 req-d7484384-a111-4dc0-8a98-cf4ae28e1ee5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.295067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-024fc5c6-48a9-4c43-89c7-ee47e72ef894 req-d7484384-a111-4dc0-8a98-cf4ae28e1ee5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.322862 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-024fc5c6-48a9-4c43-89c7-ee47e72ef894 req-d7484384-a111-4dc0-8a98-cf4ae28e1ee5 service nova] Creating event network-vif-plugged:75e96c25-9a97-4ee1-a8c0-34cdddac4e11 for instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 on nch1-master-1 May 14 21:15:25.328872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-024fc5c6-48a9-4c43-89c7-ee47e72ef894 req-d7484384-a111-4dc0-8a98-cf4ae28e1ee5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061222 May 14 21:15:25.330597 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 656/1309] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:25.337188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:25.338458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:25.345100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.345758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.347678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.348435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.609525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:25.621152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-321e14c4-f678-456b-91cb-2126c799f81e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.378803 May 14 21:15:25.622309 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 654/1310] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:25 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:25.636008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1476505251", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "50d8d8e6-f9b7-435c-a51a-cb3e21091d0c"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:25.669397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:25.690521 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb8d027f-dc53-4b71-9f59-2dac1fe5d5a1 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.358333 May 14 21:15:25.693347 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 657/1311] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:25 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:25.707186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-da298e23-e6c3-4dc2-8e3a-94cbf12099c9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79be670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:25.789598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] validate_networks() for [('50d8d8e6-f9b7-435c-a51a-cb3e21091d0c', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:15:25.794720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-da298e23-e6c3-4dc2-8e3a-94cbf12099c9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.099435 May 14 21:15:25.795318 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 658/1312] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:25 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:25.805479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:25.808909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:25.820305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.825025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:25.825980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:25.826587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.093272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:26.104473 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e0e06b0-e7a7-4643-954f-e2510955b33a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1540 microversion: 2.1 time: 0.307557 May 14 21:15:26.105694 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 659/1313] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:25 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1540 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:26.111127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71493db7-9175-45de-9107-3f6814b13039 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:26.112221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71493db7-9175-45de-9107-3f6814b13039 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:26.221531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71493db7-9175-45de-9107-3f6814b13039 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:26.229894 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71493db7-9175-45de-9107-3f6814b13039 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1225 microversion: 2.1 time: 0.122796 May 14 21:15:26.234474 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 660/1314] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:26 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:26.240056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:26.246678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:26.258715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.266627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.266627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.266627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.391311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:26.391828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:26.392240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:26.392637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:26.393053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:26.416937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.417396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.418219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.418706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.470456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:26.481145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for user 038739f45c3d4ab09457d6eed20b41d4 and project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:26.504946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:15:26.509232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:15:26.582538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:26.594282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ea0a7916-7eab-46f1-93cd-d4124aaf738f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.357989 May 14 21:15:26.594946 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 661/1315] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:26 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:26.624888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:26.625526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:26.654381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.654869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.655755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.656215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.703971 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-672b2968-c560-4d25-b7d5-786835692585 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076157 May 14 21:15:26.712789 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 655/1316] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:15:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:15:26.715784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:26.716425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:26.729993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.730842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.732597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:26.733522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:26.950580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:26.975574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:26.975574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:26.975574 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-886be80d-0781-4119-9dfa-21dba2467394 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.350905 May 14 21:15:26.975875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 662/1317] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:26 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:26.986278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:26.986913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:27.015898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.017949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.017949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.017949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.019998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:27.038634 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eba5a2a7-6f78-4595-a33d-6b835ff5a3c0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.321382 May 14 21:15:27.038634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 656/1318] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:26 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:27.038634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f66638a-3425-418c-b440-f65a7947d845 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:27.038634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f66638a-3425-418c-b440-f65a7947d845 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:27.129474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3f66638a-3425-418c-b440-f65a7947d845 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:27.137421 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f66638a-3425-418c-b440-f65a7947d845 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1211 microversion: 2.1 time: 0.103884 May 14 21:15:27.138284 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 657/1319] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:27 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1211 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:27.144298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1656a33-4870-452b-b1c2-24742128d1e7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78158b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:27.201292 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1656a33-4870-452b-b1c2-24742128d1e7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.061643 May 14 21:15:27.202244 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 658/1320] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:27 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:27.221910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:27.222673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:27.229848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.230254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.231072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.231518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.311127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:27.320987 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-157f215c-4acd-4a26-b7ae-c586d3468661 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.338703 May 14 21:15:27.322283 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 663/1321] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:26 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:27.327670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:27.328461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:27.335379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.336752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.339771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.340452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.433877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:27.448457 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be77d7d3-c6d6-40e6-bbb0-9dc6e51c6d0e tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1229 microversion: 2.1 time: 0.124608 May 14 21:15:27.449784 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 664/1322] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:27 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1229 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:27.454735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:27.457419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e5278038-f65b-4dba-8a32-dd9ff667dd76 req-d71c45cf-7cad-4bf2-aaec-57b6f456d527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbb39d4-b558-43b9-a868-776517ce58e2", "name": "network-vif-plugged", "status": "completed", "tag": "229bb137-aed4-4606-843d-7799884c4e81"}, {"server_uuid": "b557786f-467b-4f39-b283-7c798215ba18", "name": "network-vif-plugged", "status": "completed", "tag": "cd79d740-e7bf-4fb9-a20e-1e35700ba976"}, {"server_uuid": "43996dfa-e6da-4600-a5f7-5b9bbb2f963f", "name": "network-vif-plugged", "status": "completed", "tag": "293b2971-a322-40b2-bfb2-3a548a746cc9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:27.465576 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-23b20e7c-9831-44a4-b6c3-756dfd489892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1539 microversion: 2.1 time: 0.262201 May 14 21:15:27.466904 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 659/1323] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:27 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:27.479957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e5278038-f65b-4dba-8a32-dd9ff667dd76 req-d71c45cf-7cad-4bf2-aaec-57b6f456d527 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.480840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e5278038-f65b-4dba-8a32-dd9ff667dd76 req-d71c45cf-7cad-4bf2-aaec-57b6f456d527 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.511166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e5278038-f65b-4dba-8a32-dd9ff667dd76 req-d71c45cf-7cad-4bf2-aaec-57b6f456d527 service nova] Creating event network-vif-plugged:229bb137-aed4-4606-843d-7799884c4e81 for instance cbbb39d4-b558-43b9-a868-776517ce58e2 on nch1-master-1 May 14 21:15:27.511166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e5278038-f65b-4dba-8a32-dd9ff667dd76 req-d71c45cf-7cad-4bf2-aaec-57b6f456d527 service nova] Creating event network-vif-plugged:cd79d740-e7bf-4fb9-a20e-1e35700ba976 for instance b557786f-467b-4f39-b283-7c798215ba18 on nch2-master-1 May 14 21:15:27.511166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e5278038-f65b-4dba-8a32-dd9ff667dd76 req-d71c45cf-7cad-4bf2-aaec-57b6f456d527 service nova] Creating event network-vif-plugged:293b2971-a322-40b2-bfb2-3a548a746cc9 for instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f on nch1-master-1 May 14 21:15:27.520850 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e5278038-f65b-4dba-8a32-dd9ff667dd76 req-d71c45cf-7cad-4bf2-aaec-57b6f456d527 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.069385 May 14 21:15:27.522109 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 665/1324] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:27.612434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:27.613222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:27.628985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.633660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.634140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.634748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.959188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:27.971345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f07bcdcb-1b2c-4371-8724-b2667a9202a0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1521 microversion: 2.1 time: 0.363694 May 14 21:15:27.981013 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 660/1325] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:27 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:27.987183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:27.987913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:27.998153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.998591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:27.999396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:27.999857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.060774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:28.061464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:28.071778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.072336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.073510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.073973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.234339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:28.246269 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0cd17225-1446-4c40-b843-6663c5109ffa tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.198206 May 14 21:15:28.247286 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 661/1326] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:28 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:15:28.252206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:28.252857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:28.262701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.263205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.264003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.264634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.281278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:28.298698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:28.301910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:28.304608 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fa9ee062-40de-4c5b-b075-2ff363689bd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.326481 May 14 21:15:28.307676 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 666/1327] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:27 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:28.315259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47dfa9e4-6c7d-4379-ab87-4acde4dfb6fe tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79e2160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:28.343254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:28.356135 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b9c70649-8504-4b0c-afe3-8bbd6c6eddfd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1215 microversion: 2.1 time: 0.107604 May 14 21:15:28.366213 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 662/1328] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:28 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1215 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:28.370377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:28.372395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:28.394018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.395806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.396650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.397146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.409792 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47dfa9e4-6c7d-4379-ab87-4acde4dfb6fe tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.100157 May 14 21:15:28.410898 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 667/1329] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:28 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:28.423045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7fd80947-6d12-4c6f-ad7c-7f3fda4c6b03 req-5601a1e1-0a53-4398-9d37-ec56c56be978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "name": "network-vif-unplugged", "status": "completed", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:28.433110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7fd80947-6d12-4c6f-ad7c-7f3fda4c6b03 req-5601a1e1-0a53-4398-9d37-ec56c56be978 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.434019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7fd80947-6d12-4c6f-ad7c-7f3fda4c6b03 req-5601a1e1-0a53-4398-9d37-ec56c56be978 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.446495 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7fd80947-6d12-4c6f-ad7c-7f3fda4c6b03 req-5601a1e1-0a53-4398-9d37-ec56c56be978 service nova] Creating event network-vif-unplugged:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch2-master-1 May 14 21:15:28.453674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-7fd80947-6d12-4c6f-ad7c-7f3fda4c6b03 req-5601a1e1-0a53-4398-9d37-ec56c56be978 service nova] Instance a6444107-b523-485b-8113-41eafdabeb52 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:15:28.470372 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7fd80947-6d12-4c6f-ad7c-7f3fda4c6b03 req-5601a1e1-0a53-4398-9d37-ec56c56be978 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052315 May 14 21:15:28.477810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 668/1330] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:28.484222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:28.485782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:28.492984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.494236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.497411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.498645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.586919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:28.595213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c2de3fa-1675-4856-a6dd-a89dae793d36 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1277 microversion: 2.1 time: 0.115744 May 14 21:15:28.608432 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 669/1331] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:28 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:28.609097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:28.614419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:28.618831 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-751674a1-4e57-48ee-8447-dd89b6f7d9f9 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.260522 May 14 21:15:28.620508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:28.621269 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 663/1332] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:28 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:28.638671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.639854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:28.641808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:28.642637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.002697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:29.003327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:29.022143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.022863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.023840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.028417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.034809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:29.074962 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1914131c-8fd4-41ca-b57d-8b0161d0841f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1539 microversion: 2.1 time: 0.456679 May 14 21:15:29.076942 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 670/1333] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:28 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1539 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:29.218113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:29.234203 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-104ec188-7c05-47c6-97a1-01ea2657551b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1506 microversion: 2.1 time: 0.240139 May 14 21:15:29.235068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 664/1334] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:28 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1506 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:29.251063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:29.252032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:29.263381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:29.264564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:29.268731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.273154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.273154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.274010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.275789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.276641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.279067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.279955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.613925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:29.642086 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a3afb14e-4ff3-4172-bbcc-f45109623bf0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1317 microversion: 2.1 time: 0.377494 May 14 21:15:29.646555 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 665/1335] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:29 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:29.658134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:29.658798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:29.674380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.674875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.675751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.676210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.892785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:29.903632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:29.905771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:29.907434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2bf03b5-c567-4393-a73d-20e8599dd7a7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1361 microversion: 2.25 time: 0.259568 May 14 21:15:29.914355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:29.919557 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 666/1336] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:29 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:29.923151 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5da8a5c5-910d-4bdb-9f04-16c6d13913aa tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 200 len: 1506 microversion: 2.1 time: 0.676050 May 14 21:15:29.924594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:29.925225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:29.934822 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 671/1337] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:29 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:29.937175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.937641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.938439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:29.938890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:29.940874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a801d81-e097-4227-a38b-ec06bb82c69f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7a209d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:30.025304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a801d81-e097-4227-a38b-ec06bb82c69f tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.088003 May 14 21:15:30.026359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:30.026512 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 672/1338] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:29 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:30.035631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:30.036283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:30.041666 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fe97ea6c-7da9-4310-8366-360c776f0126 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1263 microversion: 2.1 time: 0.120667 May 14 21:15:30.042847 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 667/1339] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:29 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1263 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:30.047714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:30.048538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:30.053925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.054785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.055828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.056432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.063852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.064530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.065747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.069375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.166523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:30.186680 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-26826a2e-2bdb-41d0-ad87-1246979e19ca tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1283 microversion: 2.1 time: 0.132016 May 14 21:15:30.186680 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 668/1340] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:30 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1283 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:30.204043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:30.206744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:30.225795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.226867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.228123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.228791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.285535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:15:30.504579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:30.516265 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a1c9639-92f3-41ce-be44-d73463ac5118 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.488365 May 14 21:15:30.518726 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 673/1341] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:30 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:30.521547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:30.522155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:30.529060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.529566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.530545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.531091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.759301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:30.768247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7867ac99-427d-4900-9963-fad404523c07 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1539 microversion: 2.1 time: 0.249340 May 14 21:15:30.769145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 674/1342] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:30 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1539 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:30.781668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f5547a28-8889-4bcd-88fb-761a8a2d25f2 req-ccfa230e-05e1-431f-a464-bf47a9c8cbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:30.791964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f5547a28-8889-4bcd-88fb-761a8a2d25f2 req-ccfa230e-05e1-431f-a464-bf47a9c8cbba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.792420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f5547a28-8889-4bcd-88fb-761a8a2d25f2 req-ccfa230e-05e1-431f-a464-bf47a9c8cbba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.805404 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f5547a28-8889-4bcd-88fb-761a8a2d25f2 req-ccfa230e-05e1-431f-a464-bf47a9c8cbba service nova] Creating event network-changed:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch2-master-1 May 14 21:15:30.812180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-f5547a28-8889-4bcd-88fb-761a8a2d25f2 req-ccfa230e-05e1-431f-a464-bf47a9c8cbba service nova] Instance a6444107-b523-485b-8113-41eafdabeb52 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:15:30.824829 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f5547a28-8889-4bcd-88fb-761a8a2d25f2 req-ccfa230e-05e1-431f-a464-bf47a9c8cbba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050118 May 14 21:15:30.827024 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 675/1343] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:30.833898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:30.834605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:30.856117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.858939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:30.873246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:30.873727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:31.016146 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1117f4b5-bb03-486c-af01-029ff7ea1eb5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 204 len: 0 microversion: 2.1 time: 0.825197 May 14 21:15:31.019046 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 669/1344] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:15:30 2022] DELETE /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:15:31.028297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:31.029030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:31.063297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:31.064343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:31.064661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:31.078265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:31.377387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:31.386631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:31.391581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:31.393256 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7c5d7af-0299-474a-8f06-17f5b6bb95fc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1557 microversion: 2.25 time: 0.372976 May 14 21:15:31.394483 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 670/1345] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:31 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1557 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:31.399737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bbcffba9-caac-45d7-ba09-6994287348e6 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78bda60>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:31.448607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bbcffba9-caac-45d7-ba09-6994287348e6 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.052797 May 14 21:15:31.449817 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 671/1346] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:31 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:31.455232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:31.465256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:31.480049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:31.495411 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-56e44045-d23c-4eea-b464-2795a790ff27 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1467 microversion: 2.1 time: 0.666998 May 14 21:15:31.507219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:31.507219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:31.507219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:31.507219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:31.509899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 676/1347] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:30 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1467 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:31.515960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1218161118", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8f75d233-b39d-4c19-a44f-6a34a157d017"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:31.593115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] validate_networks() for [('8f75d233-b39d-4c19-a44f-6a34a157d017', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:15:31.628152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:31.639023 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73ae8532-7c4e-4fcf-8795-443fcd6806ac tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1269 microversion: 2.1 time: 0.187881 May 14 21:15:31.641410 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 672/1348] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:31 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:31.647545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:31.648413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:31.658442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:31.658442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:31.664667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:31.664667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:32.063136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:32.073566 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-309bb26c-8566-499b-9ba6-f8bf6b902b03 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.430246 May 14 21:15:32.074882 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 673/1349] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:31 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:32.263316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:32.264565 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:32.272301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:32.273043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:32.274838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:32.275656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:32.592056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 43996dfa-e6da-4600-a5f7-5b9bbb2f963f {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:15:32.628114 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba29ae34-78b5-4761-83dc-9c3577622ca2 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 2049 microversion: 2.25 time: 0.551682 May 14 21:15:32.628689 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 674/1350] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:32 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 2049 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:32.646305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1658936691", "metadata": {"image_type": "test"}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:32.647502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:32.654257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:32.654766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:32.654894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:32.654996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:32.655507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:32.655636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:32.656001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:32.656183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:32.656698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:32.678289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:32.683705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:32.689407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:32.695001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:32.698430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Getting quotas for project b30891c9ccaf4e1bbdec0c910805d504. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:32.706017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Getting quotas for user e87dae577e6c42ba8d14094bd6cad9de and project b30891c9ccaf4e1bbdec0c910805d504. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:32.757214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Getting quotas for project e4af8109ce4a4e98a2e7104125651db0. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:32.774025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Getting quotas for user 911b9cf4e9bc424bba387e2ff966cb46 and project e4af8109ce4a4e98a2e7104125651db0. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:32.818475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:15:32.824140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:15:33.095681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd1338ce-87d6-44ee-a7ac-f8342fd4d3cf tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584115 May 14 21:15:33.101952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 677/1351] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:15:33.117247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:33.128162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:33.143274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.143274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:33.143274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.143274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:33.395966 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c240fc48-8ba0-43ad-8596-1ab12945e2e1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "POST /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2/action" status: 202 len: 0 microversion: 2.1 time: 0.749353 May 14 21:15:33.402472 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 675/1352] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:15:32 2022] POST /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2/action => generated 0 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:15:33.414546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:33.416341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:33.432972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.436312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:33.437365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.437780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:33.725025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:33.733490 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d875c27a-2f05-4b5d-b6f9-2f006cd7b22c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.629588 May 14 21:15:33.737607 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 678/1353] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:33 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:33.746307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96ad4161-2dba-4741-ae75-b357d28fa48c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79209d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:33.827686 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96ad4161-2dba-4741-ae75-b357d28fa48c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.088748 May 14 21:15:33.828867 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 679/1354] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:33 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:33.856894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:33.860441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:33.860629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:33.872655 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2387070e-a63c-49f3-910b-cb6f2e982fca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1471 microversion: 2.1 time: 0.465306 May 14 21:15:33.877829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.887767 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 676/1355] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:33 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1471 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:33.897134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:33.897134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.897134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:33.897561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:33.897561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:33.936959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.937780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:33.943133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:33.947147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.300488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 43996dfa-e6da-4600-a5f7-5b9bbb2f963f {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:15:34.355804 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f5c786ce-a8ec-4395-b25e-8eab40d73fbd tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 2049 microversion: 2.25 time: 0.520245 May 14 21:15:34.358084 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 680/1356] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:33 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 2049 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:34.371088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:34.373425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:34.391009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.393023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.397407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.397883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.610738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:34.625265 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce17aff4-d953-4ee2-92ec-59d46b18e59d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1311 microversion: 2.1 time: 0.744958 May 14 21:15:34.626064 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 677/1357] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:33 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1311 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:34.652207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:34.652862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:34.659161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.662279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.662279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.662279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.733820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:34.753011 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6a4c5c4-c3a4-48a7-ae75-8251f41dd930 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1222 microversion: 2.1 time: 0.125605 May 14 21:15:34.756836 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 678/1358] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:34 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1222 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:34.782614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0adff7af-f1fc-4383-bb3e-1c4eabf93b68 req-6e7a6859-89d5-43bc-b92e-3bfee04c2532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe390af-35f4-4cf5-91c5-994e9c2dc488", "name": "network-vif-deleted", "tag": "75e96c25-9a97-4ee1-a8c0-34cdddac4e11"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:34.806412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0adff7af-f1fc-4383-bb3e-1c4eabf93b68 req-6e7a6859-89d5-43bc-b92e-3bfee04c2532 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.806907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0adff7af-f1fc-4383-bb3e-1c4eabf93b68 req-6e7a6859-89d5-43bc-b92e-3bfee04c2532 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.822686 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0adff7af-f1fc-4383-bb3e-1c4eabf93b68 req-6e7a6859-89d5-43bc-b92e-3bfee04c2532 service nova] Creating event network-vif-deleted:75e96c25-9a97-4ee1-a8c0-34cdddac4e11 for instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 on nch1-master-1 May 14 21:15:34.828987 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0adff7af-f1fc-4383-bb3e-1c4eabf93b68 req-6e7a6859-89d5-43bc-b92e-3bfee04c2532 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060427 May 14 21:15:34.832286 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 679/1359] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:34.836557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9cd43bd-a463-4364-8241-6cb85e1d8518 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a78d71f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:34.893845 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9cd43bd-a463-4364-8241-6cb85e1d8518 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 0.062507 May 14 21:15:34.895092 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 680/1360] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:34 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:34.905155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:34.905705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-55cc67a3-d929-4f47-943f-9a777a5b917e req-7dd2c3a7-d239-4061-973f-3e494db18a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75983071-f5ad-4c40-aa83-f61a98e5e823", "tag": "bb09673c-8ab1-484e-bf52-805d25307965"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:34.914875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55cc67a3-d929-4f47-943f-9a777a5b917e req-7dd2c3a7-d239-4061-973f-3e494db18a84 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.915099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55cc67a3-d929-4f47-943f-9a777a5b917e req-7dd2c3a7-d239-4061-973f-3e494db18a84 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.926313 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f5f8bfcb-cf26-4440-bf81-8d725fd0124a tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.564892 May 14 21:15:34.930065 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 681/1361] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:34 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:34.955817 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-55cc67a3-d929-4f47-943f-9a777a5b917e req-7dd2c3a7-d239-4061-973f-3e494db18a84 service nova] Creating event network-changed:bb09673c-8ab1-484e-bf52-805d25307965 for instance 75983071-f5ad-4c40-aa83-f61a98e5e823 on nch2-master-1 May 14 21:15:34.958866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a3c8cc5-122c-41c7-8473-dda9f0324d26 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:34.962653 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:15:34.962653 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:15:34.963355 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-55cc67a3-d929-4f47-943f-9a777a5b917e req-7dd2c3a7-d239-4061-973f-3e494db18a84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060309 May 14 21:15:34.964285 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 681/1362] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:34.970014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:34.970805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:34.973154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3c8cc5-122c-41c7-8473-dda9f0324d26 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.978553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.979029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.979914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.980433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.981661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3c8cc5-122c-41c7-8473-dda9f0324d26 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:34.982583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3c8cc5-122c-41c7-8473-dda9f0324d26 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:34.983035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3c8cc5-122c-41c7-8473-dda9f0324d26 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.072079 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a3c8cc5-122c-41c7-8473-dda9f0324d26 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.140048 May 14 21:15:35.073301 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 682/1363] 10.222.0.52 () {60 vars in 1216 bytes} [Sat May 14 21:15:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:15:35.078017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76962d47-5148-45d6-acbb-bc5326ae2470 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c83a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:35.148657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76962d47-5148-45d6-acbb-bc5326ae2470 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1453 microversion: 2.1 time: 0.074036 May 14 21:15:35.149455 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 683/1364] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:35 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:35.160241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:35.161129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:35.172268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.183134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.184307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.184906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.424225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:35.435232 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-690c7546-aba6-4de8-bffc-4188ad62da3f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1468 microversion: 2.1 time: 0.284312 May 14 21:15:35.435598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:35.437511 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 684/1365] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:35 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1468 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:35.443232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:35.444960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:35.455990 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-139a9d40-1082-497d-8940-bc6175e8a9ba tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.490314 May 14 21:15:35.456640 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 682/1366] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:34 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:35.457152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.458035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.459091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.459864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.471809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:35.472367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:35.479762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.484301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.484301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.484301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.494213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'flavor' on Instance uuid 43996dfa-e6da-4600-a5f7-5b9bbb2f963f {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:15:35.514517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Going to try to live migrate instance to nch2-master-1 {{(pid=130637) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:15:35.527979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.528450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.529399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:35.529854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:35.552524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:35.559782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for user 5b93d6c3d03d407f8be4aa38e2fbb154 and project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:36.191865 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89f3eafa-589d-4d1d-be44-a9cdb607c33e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52/action" status: 202 len: 0 microversion: 2.1 time: 0.722300 May 14 21:15:36.196621 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 683/1367] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:15:35 2022] POST /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:15:36.203554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:36.203554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:36.219023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:36.219023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:36.219023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:36.219023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:37.181885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:37.197444 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-86976995-ae5b-4aa5-8d1e-21bfa3a75783 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1311 microversion: 2.1 time: 0.998855 May 14 21:15:37.199118 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 684/1368] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:36 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1311 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:37.204909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:37.205793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:37.214003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:37.214867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:37.215961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:37.216704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:37.548469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:37.559908 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f4fb6a95-670a-4a75-ad8c-6c2ff927eff9 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1288 microversion: 2.1 time: 0.358013 May 14 21:15:37.559908 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 685/1369] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:37 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1288 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:37.579811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-913da79f-7051-4c90-bec6-ceeda0b68acd tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7ba58b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:40.934297 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f0fe5b0a-6e45-4791-9c53-7269d87c248d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f/action" status: 202 len: 0 microversion: 2.25 time: 5.495419 May 14 21:15:40.940340 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 685/1370] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:15:35 2022] POST /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f/action => generated 0 bytes in 5497 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:15:40.943204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:40.944196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:40.957600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:40.962789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:40.963851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:40.964485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:41.280859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:41.289388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-911e3ec6-ef24-492e-8d26-99dba4c0079f tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.352490 May 14 21:15:41.290642 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 686/1371] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:40 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:41.295661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-574a8320-5ac2-4312-a976-2c7036db41a0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78cfc10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:43.072319 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-913da79f-7051-4c90-bec6-ceeda0b68acd tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 5.510181 May 14 21:15:43.078841 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 686/1372] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:37 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 5519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:43.079853 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-574a8320-5ac2-4312-a976-2c7036db41a0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1462 microversion: 2.1 time: 1.787991 May 14 21:15:43.080913 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 687/1373] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:41 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1462 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:43.088841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:43.089950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:43.099976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:43.102393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.102771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:43.104950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.106073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.107984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.112568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.114933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.116308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.118988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.328634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:43.340002 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-360c4341-240d-4b42-ac27-63111459be2b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1533 microversion: 2.1 time: 0.257320 May 14 21:15:43.342451 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 687/1374] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:43 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1533 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:43.347448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-b68c2402-0b49-4515-b66e-43b6632a1088 req-d79f7940-109e-4a62-88c1-b0b8ecbbb1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2", "tag": "ec8012be-be33-462f-961b-6c852f9a37d4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:43.370578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b68c2402-0b49-4515-b66e-43b6632a1088 req-d79f7940-109e-4a62-88c1-b0b8ecbbb1e2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.372190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b68c2402-0b49-4515-b66e-43b6632a1088 req-d79f7940-109e-4a62-88c1-b0b8ecbbb1e2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.403002 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-b68c2402-0b49-4515-b66e-43b6632a1088 req-d79f7940-109e-4a62-88c1-b0b8ecbbb1e2 service nova] Creating event network-changed:ec8012be-be33-462f-961b-6c852f9a37d4 for instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 on nch2-master-1 May 14 21:15:43.412123 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-b68c2402-0b49-4515-b66e-43b6632a1088 req-d79f7940-109e-4a62-88c1-b0b8ecbbb1e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068151 May 14 21:15:43.421925 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 688/1375] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:43.428375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-df15e6ad-0761-4f51-86ec-38c6d36d56b2 req-8c83f28e-6b56-456d-9f9e-25438387eddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "name": "network-vif-plugged", "status": "completed", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:43.440392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:43.458707 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37e3ee95-76ad-44e3-9584-805678813abb tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.373966 May 14 21:15:43.458707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 688/1376] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:43 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:43.464633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-df15e6ad-0761-4f51-86ec-38c6d36d56b2 req-8c83f28e-6b56-456d-9f9e-25438387eddd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.466368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-df15e6ad-0761-4f51-86ec-38c6d36d56b2 req-8c83f28e-6b56-456d-9f9e-25438387eddd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.472735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:43.474487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:43.485680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.487534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.487534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.488351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.501430 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-df15e6ad-0761-4f51-86ec-38c6d36d56b2 req-8c83f28e-6b56-456d-9f9e-25438387eddd service nova] Creating event network-vif-plugged:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch1-master-1 May 14 21:15:43.510141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-df15e6ad-0761-4f51-86ec-38c6d36d56b2 req-8c83f28e-6b56-456d-9f9e-25438387eddd service nova] Instance a6444107-b523-485b-8113-41eafdabeb52 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:15:43.521521 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-df15e6ad-0761-4f51-86ec-38c6d36d56b2 req-8c83f28e-6b56-456d-9f9e-25438387eddd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097185 May 14 21:15:43.522596 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 689/1377] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:43.528218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:43.528939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:43.535791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.536245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.537350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.537953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.817773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:43.826034 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9e59f0a-0123-44f1-8ed7-1a0fdfb54167 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1311 microversion: 2.1 time: 0.365370 May 14 21:15:43.829519 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 689/1378] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:43 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:43.834345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:43.849845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:43.856753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.857295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.858170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:43.858742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:43.969838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:43.982854 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cc202bc5-d958-45ab-b386-60967a75081b tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1318 microversion: 2.1 time: 0.457115 May 14 21:15:43.983864 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 690/1379] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:43 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1318 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:43.990540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:43.991422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:44.003798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.009042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.012575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.013088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.070033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:44.082526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:44.084185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:44.085444 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d971b2a9-be74-4d7b-b4c9-398742ec80ed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1567 microversion: 2.25 time: 0.254897 May 14 21:15:44.086428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 690/1380] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:43 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:44.091773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b6aa8b6-c723-4394-8357-9dda62513e02 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c4280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:44.156404 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b6aa8b6-c723-4394-8357-9dda62513e02 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 200 len: 1462 microversion: 2.1 time: 0.068517 May 14 21:15:44.168300 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 691/1381] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:44 2022] GET /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 1462 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:44.182980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ad8ac19e-49e9-4139-94e8-6c6d750a7e70 req-90fe8022-16f2-4120-b40d-0c9840e44f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43996dfa-e6da-4600-a5f7-5b9bbb2f963f", "name": "network-vif-unplugged", "status": "completed", "tag": "293b2971-a322-40b2-bfb2-3a548a746cc9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:44.195690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ad8ac19e-49e9-4139-94e8-6c6d750a7e70 req-90fe8022-16f2-4120-b40d-0c9840e44f28 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.197727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ad8ac19e-49e9-4139-94e8-6c6d750a7e70 req-90fe8022-16f2-4120-b40d-0c9840e44f28 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.223655 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ad8ac19e-49e9-4139-94e8-6c6d750a7e70 req-90fe8022-16f2-4120-b40d-0c9840e44f28 service nova] Creating event network-vif-unplugged:293b2971-a322-40b2-bfb2-3a548a746cc9 for instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f on nch1-master-1 May 14 21:15:44.230994 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ad8ac19e-49e9-4139-94e8-6c6d750a7e70 req-90fe8022-16f2-4120-b40d-0c9840e44f28 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061245 May 14 21:15:44.232219 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 692/1382] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:44.237622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e4b8214-3171-46e4-adf9-0c24c038c1e5 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a78c4940>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:44.314516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8e4b8214-3171-46e4-adf9-0c24c038c1e5 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 0.080992 May 14 21:15:44.315268 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 693/1383] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:44 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:44.324599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:44.325476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:44.343577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.344135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.344932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.345387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.390688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:44.412208 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ffa79174-3969-4372-91a6-5217ffc3aab3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.426566 May 14 21:15:44.435005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 691/1384] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:43 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:44.444678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:44.447201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:44.465053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.465815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.466805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.468230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.607079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:44.625752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22071d82-a046-4adb-a825-63ee7b715350 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1468 microversion: 2.1 time: 0.309560 May 14 21:15:44.627073 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 694/1385] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:44 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1468 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:44.632197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:44.633521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:44.645644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.646437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.647247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.647721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.868699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:44.876881 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c3297beb-20e4-4458-8d10-a4688d01c91d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1533 microversion: 2.1 time: 0.440331 May 14 21:15:44.880059 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 692/1386] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:44 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1533 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:44.881713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:44.890041 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b6a8268b-78a6-47cf-a65c-eab655c7795c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.261280 May 14 21:15:44.894937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b21179f5-4ac7-4a9e-85e4-0e9ac6fe9896 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7e09670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:44.903428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 695/1387] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:44 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:44.908631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:44.909574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:44.917522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.918263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:44.919232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:44.919878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.091175 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b21179f5-4ac7-4a9e-85e4-0e9ac6fe9896 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?changes-since=2022-05-14T21%3A13%3A58Z" status: 200 len: 2373 microversion: 2.1 time: 0.208520 May 14 21:15:45.099572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 693/1388] 10.222.0.52 () {58 vars in 1198 bytes} [Sat May 14 21:15:44 2022] GET /compute/v2.1/images?changes-since=2022-05-14T21%3A13%3A58Z => generated 2373 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:45.102484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:45.103135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:45.122008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.124283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.126551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.128646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.134955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:45.145035 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f7eff0be-5823-403e-a5b8-a7b362d3c93a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1311 microversion: 2.1 time: 0.239777 May 14 21:15:45.162179 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 696/1389] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:44 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1311 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:45.171919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:45.172658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:45.190145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.190732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.191957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.192522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.449572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:45.459334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:45.461164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:45.462544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72a0c59b-15b4-4878-89e8-f7d2695229c8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1567 microversion: 2.25 time: 0.308305 May 14 21:15:45.463620 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 697/1390] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:45 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1567 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:45.469757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-56235b7a-b9ea-4a63-aa8e-adba9f0c782d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79399d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:45.494856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:45.512031 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-41ae03a2-ffc5-4663-8795-22c5899bf893 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1318 microversion: 2.1 time: 0.418640 May 14 21:15:45.512646 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 694/1391] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:45 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:45.528005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8774e053-7487-4f07-8c48-baf6de6a02d6 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a78d75e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:45.600403 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-56235b7a-b9ea-4a63-aa8e-adba9f0c782d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1171825069" status: 200 len: 485 microversion: 2.1 time: 0.134967 May 14 21:15:45.600994 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 698/1392] 10.222.0.52 () {58 vars in 1230 bytes} [Sat May 14 21:15:45 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1171825069 => generated 485 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:45.610475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:45.611116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:45.612712 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8774e053-7487-4f07-8c48-baf6de6a02d6 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 0.090312 May 14 21:15:45.613484 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 695/1393] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:45 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:45.619588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.621208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.622218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.622811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.622950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-87ded4a8-aa9c-45f3-8d79-247a6928e464 req-a3bb09e7-9e11-4e9e-b766-29f1cb7ae9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c11e4b-dada-44e6-b5f5-09279f34f6b2", "tag": "3806f5cd-d4ca-44ab-a0d0-8cb03de3c29a"}, {"server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "name": "network-vif-unplugged", "status": "completed", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:45.636530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-87ded4a8-aa9c-45f3-8d79-247a6928e464 req-a3bb09e7-9e11-4e9e-b766-29f1cb7ae9ac service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.637316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-87ded4a8-aa9c-45f3-8d79-247a6928e464 req-a3bb09e7-9e11-4e9e-b766-29f1cb7ae9ac service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.654909 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-87ded4a8-aa9c-45f3-8d79-247a6928e464 req-a3bb09e7-9e11-4e9e-b766-29f1cb7ae9ac service nova] Creating event network-changed:3806f5cd-d4ca-44ab-a0d0-8cb03de3c29a for instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 on nch1-master-1 May 14 21:15:45.656957 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-87ded4a8-aa9c-45f3-8d79-247a6928e464 req-a3bb09e7-9e11-4e9e-b766-29f1cb7ae9ac service nova] Creating event network-vif-unplugged:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch1-master-1 May 14 21:15:45.668742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-87ded4a8-aa9c-45f3-8d79-247a6928e464 req-a3bb09e7-9e11-4e9e-b766-29f1cb7ae9ac service nova] Instance a6444107-b523-485b-8113-41eafdabeb52 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:15:45.701953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-87ded4a8-aa9c-45f3-8d79-247a6928e464 req-a3bb09e7-9e11-4e9e-b766-29f1cb7ae9ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.085642 May 14 21:15:45.703241 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 696/1394] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:45.721738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a806626b-4c1e-443b-9637-267e65439805 req-d99b8eed-acad-4c1b-ade3-a4ee5d44a742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbb39d4-b558-43b9-a868-776517ce58e2", "name": "network-vif-plugged", "status": "completed", "tag": "229bb137-aed4-4606-843d-7799884c4e81"}, {"server_uuid": "75983071-f5ad-4c40-aa83-f61a98e5e823", "name": "network-vif-plugged", "status": "completed", "tag": "bb09673c-8ab1-484e-bf52-805d25307965"}, {"server_uuid": "6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2", "name": "network-vif-plugged", "status": "completed", "tag": "ec8012be-be33-462f-961b-6c852f9a37d4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:45.746198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a806626b-4c1e-443b-9637-267e65439805 req-d99b8eed-acad-4c1b-ade3-a4ee5d44a742 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:45.747580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a806626b-4c1e-443b-9637-267e65439805 req-d99b8eed-acad-4c1b-ade3-a4ee5d44a742 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:45.771437 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a806626b-4c1e-443b-9637-267e65439805 req-d99b8eed-acad-4c1b-ade3-a4ee5d44a742 service nova] Creating event network-vif-plugged:229bb137-aed4-4606-843d-7799884c4e81 for instance cbbb39d4-b558-43b9-a868-776517ce58e2 on nch1-master-1 May 14 21:15:45.772973 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a806626b-4c1e-443b-9637-267e65439805 req-d99b8eed-acad-4c1b-ade3-a4ee5d44a742 service nova] Creating event network-vif-plugged:bb09673c-8ab1-484e-bf52-805d25307965 for instance 75983071-f5ad-4c40-aa83-f61a98e5e823 on nch2-master-1 May 14 21:15:45.775435 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a806626b-4c1e-443b-9637-267e65439805 req-d99b8eed-acad-4c1b-ade3-a4ee5d44a742 service nova] Creating event network-vif-plugged:ec8012be-be33-462f-961b-6c852f9a37d4 for instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 on nch2-master-1 May 14 21:15:45.789988 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a806626b-4c1e-443b-9637-267e65439805 req-d99b8eed-acad-4c1b-ade3-a4ee5d44a742 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.081476 May 14 21:15:45.791472 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 697/1395] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:45.814030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fd905c5-dec1-4a6f-931e-7be7fff0acd9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78d7ee0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:46.089094 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9fd905c5-dec1-4a6f-931e-7be7fff0acd9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?server=b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 956 microversion: 2.1 time: 0.296175 May 14 21:15:46.091014 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 698/1396] 10.222.0.52 () {58 vars in 1208 bytes} [Sat May 14 21:15:45 2022] GET /compute/v2.1/images?server=b557786f-467b-4f39-b283-7c798215ba18 => generated 956 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:46.097010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:46.098088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:46.105955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.106759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.107793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.108419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.129115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:46.142149 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eabf99ea-d7b9-40d2-890a-b6664e2f3a59 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.539965 May 14 21:15:46.145085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 699/1397] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:45 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:46.161220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:46.161894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:46.180219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.180958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.181780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.182403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.444878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:46.456304 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3aab9558-d496-4ebe-851e-7186f7258d73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1533 microversion: 2.1 time: 0.362958 May 14 21:15:46.460050 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 699/1398] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:46 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1533 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:46.475842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9448e2aa-51ae-4382-abf5-816fbe6e37e0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7ba5820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:46.548418 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9448e2aa-51ae-4382-abf5-816fbe6e37e0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 484 microversion: 2.1 time: 0.086972 May 14 21:15:46.550123 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 700/1399] 10.222.0.52 () {58 vars in 1316 bytes} [Sat May 14 21:15:46 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 484 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:46.557081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:46.558816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:46.565606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.566401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.568054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.568606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.826498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:46.835092 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b53a562-a151-4d88-adf6-b33794ed5436 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.688830 May 14 21:15:46.845090 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 700/1400] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:46 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:46.845090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1119c770-1b28-47c2-877d-5a1ab287d208 req-a5d28ae6-66d3-403b-9726-21bca61b0a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43996dfa-e6da-4600-a5f7-5b9bbb2f963f", "tag": "293b2971-a322-40b2-bfb2-3a548a746cc9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:46.852592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1119c770-1b28-47c2-877d-5a1ab287d208 req-a5d28ae6-66d3-403b-9726-21bca61b0a50 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.853063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1119c770-1b28-47c2-877d-5a1ab287d208 req-a5d28ae6-66d3-403b-9726-21bca61b0a50 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.856682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:46.868068 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1119c770-1b28-47c2-877d-5a1ab287d208 req-a5d28ae6-66d3-403b-9726-21bca61b0a50 service nova] Creating event network-changed:293b2971-a322-40b2-bfb2-3a548a746cc9 for instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f on nch1-master-1 May 14 21:15:46.871741 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5c941fb-fc73-4b53-8cf1-852a7a3aba85 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1311 microversion: 2.1 time: 0.320207 May 14 21:15:46.884625 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 701/1401] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:46 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1311 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:46.889977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:46.890618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:46.897219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.897682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.898506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.899217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.919515 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1119c770-1b28-47c2-877d-5a1ab287d208 req-a5d28ae6-66d3-403b-9726-21bca61b0a50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078681 May 14 21:15:46.925267 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 701/1402] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:46.935631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:46.936775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:46.944917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.946524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:46.954526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:46.955617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:47.185575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:47.194442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:47.196910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:47.198171 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6f7615c3-4ec5-4cfa-b6bc-5f8b30a82537 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1567 microversion: 2.25 time: 0.312376 May 14 21:15:47.207553 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 702/1403] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:46 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:47.207553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d259e03-c541-4d7b-ad20-f29807c9f3e0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78af940>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:47.264775 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d259e03-c541-4d7b-ad20-f29807c9f3e0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 484 microversion: 2.1 time: 0.064939 May 14 21:15:47.265633 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 703/1404] 10.222.0.52 () {58 vars in 1302 bytes} [Sat May 14 21:15:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 484 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:47.270332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2ac05c8-1c7d-4984-9d00-5b3ae8921989 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a795bc10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:47.314507 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f2ac05c8-1c7d-4984-9d00-5b3ae8921989 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 0.047770 May 14 21:15:47.315158 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 704/1405] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:47 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:47.320340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:47.321173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:47.328256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:47.328719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:47.329506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:47.330013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:47.785438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:47.788932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:47.793665 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2717eede-d7ba-450e-99d6-2a0b12d81ad7 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1318 microversion: 2.1 time: 0.866460 May 14 21:15:47.794342 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 702/1406] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:46 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1318 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:47.796975 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c95461cf-ad96-4934-a442-e700224a80fc tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.480708 May 14 21:15:47.797581 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 705/1407] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:47 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:47.802329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:47.802965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:47.808722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d920817b-36a1-455c-abe8-cbc968af7a0d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c8670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:47.809194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:47.809671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:47.810492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:47.811003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:47.927183 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d920817b-36a1-455c-abe8-cbc968af7a0d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.122710 May 14 21:15:47.927818 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 703/1408] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:15:47 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:47.934153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f48f7b4d-1842-4552-bfe5-65e51ab01cd8 req-a5f67a53-29ef-4bd6-a724-cb4db03a34bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:47.944185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f48f7b4d-1842-4552-bfe5-65e51ab01cd8 req-a5f67a53-29ef-4bd6-a724-cb4db03a34bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:47.948736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f48f7b4d-1842-4552-bfe5-65e51ab01cd8 req-a5f67a53-29ef-4bd6-a724-cb4db03a34bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:47.958415 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f48f7b4d-1842-4552-bfe5-65e51ab01cd8 req-a5f67a53-29ef-4bd6-a724-cb4db03a34bc service nova] Creating event network-changed:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch1-master-1 May 14 21:15:47.964420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-f48f7b4d-1842-4552-bfe5-65e51ab01cd8 req-a5f67a53-29ef-4bd6-a724-cb4db03a34bc service nova] Instance a6444107-b523-485b-8113-41eafdabeb52 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:15:47.975042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:47.976179 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f48f7b4d-1842-4552-bfe5-65e51ab01cd8 req-a5f67a53-29ef-4bd6-a724-cb4db03a34bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046867 May 14 21:15:47.977527 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 704/1409] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:47.983290 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dedca49d-f84d-44a3-8cf1-92e9fd79be70 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1533 microversion: 2.1 time: 0.184682 May 14 21:15:47.983703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5296207b-b060-42d4-9e1b-69728e57fa9e req-fa1ae952-cd40-4673-b7bf-b8a3c0a9dddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b557786f-467b-4f39-b283-7c798215ba18", "name": "network-vif-unplugged", "status": "completed", "tag": "cd79d740-e7bf-4fb9-a20e-1e35700ba976"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:47.983976 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 706/1410] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:47 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1533 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:47.997396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:47.998953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:47.999156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5296207b-b060-42d4-9e1b-69728e57fa9e req-fa1ae952-cd40-4673-b7bf-b8a3c0a9dddd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:47.999156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5296207b-b060-42d4-9e1b-69728e57fa9e req-fa1ae952-cd40-4673-b7bf-b8a3c0a9dddd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.005712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.006567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.008129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.009137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.011195 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5296207b-b060-42d4-9e1b-69728e57fa9e req-fa1ae952-cd40-4673-b7bf-b8a3c0a9dddd service nova] Creating event network-vif-unplugged:cd79d740-e7bf-4fb9-a20e-1e35700ba976 for instance b557786f-467b-4f39-b283-7c798215ba18 on nch2-master-1 May 14 21:15:48.016420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5296207b-b060-42d4-9e1b-69728e57fa9e req-fa1ae952-cd40-4673-b7bf-b8a3c0a9dddd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037701 May 14 21:15:48.017194 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 705/1411] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:48.023344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.027094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:48.032651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.033363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.034335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.035082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.237362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:48.247779 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3f81c29-4415-4c9c-86ed-2c17f022d77d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1311 microversion: 2.1 time: 0.227930 May 14 21:15:48.252901 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 706/1412] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:48.260515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:48.262346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72a2ebf5-f991-4118-abbe-eba0fe0801c0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c8d30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.277866 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3646fb0f-80b8-4d3b-80d7-ff433e61dee0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.286354 May 14 21:15:48.288927 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 707/1413] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:47 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:48.294671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.295630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:48.301893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.302644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.303725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.304385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.346017 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72a2ebf5-f991-4118-abbe-eba0fe0801c0 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.091536 May 14 21:15:48.346604 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 707/1414] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:48.354051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2abb1415-23b6-488f-a5fb-bbc5500f6cac tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7924dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.409501 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2abb1415-23b6-488f-a5fb-bbc5500f6cac tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 0.061853 May 14 21:15:48.410157 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 708/1415] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:48.414721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f8149209-95ff-4948-98f0-459585a1b6da tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a79e2160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.500699 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f8149209-95ff-4948-98f0-459585a1b6da tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.089284 May 14 21:15:48.501498 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 709/1416] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:48.515608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d0387fb-259d-482b-a9ed-8ad48cd431ff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c80d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.613751 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d0387fb-259d-482b-a9ed-8ad48cd431ff tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/detail?changes-since=2022-05-14T21%3A13%3A53Z" status: 200 len: 6332 microversion: 2.1 time: 0.102644 May 14 21:15:48.628183 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 710/1417] 10.222.0.52 () {58 vars in 1219 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-14T21%3A13%3A53Z => generated 6332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:48.634095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7daabc9a-f706-4d28-af0d-d699c1ab9379 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c4ee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.686773 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7daabc9a-f706-4d28-af0d-d699c1ab9379 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1171825069" status: 200 len: 665 microversion: 2.1 time: 0.056624 May 14 21:15:48.687918 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 711/1418] 10.222.0.52 () {58 vars in 1251 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1171825069 => generated 665 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:15:48.702046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24426d8b-7edd-40b5-af47-02c9558c8a09 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c8310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.757342 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24426d8b-7edd-40b5-af47-02c9558c8a09 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1466 microversion: 2.1 time: 0.058959 May 14 21:15:48.766592 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 712/1419] 10.222.0.52 () {58 vars in 1337 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fv2.1%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1466 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:48.771414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-660e73f7-a677-4c28-8f6b-033496f9d799 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a795a4c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.800556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:48.809452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:48.813815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:48.815554 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b0742f1-e512-4b77-8da8-ad225e82c7f4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1567 microversion: 2.25 time: 0.525189 May 14 21:15:48.826974 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 708/1420] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1567 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:48.832041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.832901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:48.833463 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-660e73f7-a677-4c28-8f6b-033496f9d799 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1466 microversion: 2.1 time: 0.065609 May 14 21:15:48.840513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.841048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.841898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.842407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.845396 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 713/1421] 10.222.0.52 () {58 vars in 1323 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.52%2Fcompute%2Fservers%2F568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1466 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:48.850962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:48.851600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:48.859311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.859806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:48.860800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:48.861405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.094631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:49.113793 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ed4a0e6f-31cf-4648-8f43-f7bbfa20e15b tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.266441 May 14 21:15:49.114630 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 714/1422] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.126504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bba36c17-715e-48f8-8d82-9013e34ad61e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a795a4c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.151178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:49.160663 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4523ceb8-b5e5-4442-aaea-73f910c8a7d4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1318 microversion: 2.1 time: 0.332075 May 14 21:15:49.161885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 709/1423] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:48 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.189858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.190610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:49.208033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.208521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.209378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.209882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.284142 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bba36c17-715e-48f8-8d82-9013e34ad61e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.166145 May 14 21:15:49.285440 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 715/1424] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.290505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.291788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:49.299110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.300837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.304391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.305166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.397503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:49.418258 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eee74992-b114-4895-9d50-b354922304a2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1533 microversion: 2.1 time: 0.254138 May 14 21:15:49.419162 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 710/1425] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1533 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.425440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-40f41190-4c4b-4e8e-aa93-4336985ef7f7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7c255e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.533685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-40f41190-4c4b-4e8e-aa93-4336985ef7f7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.113168 May 14 21:15:49.534285 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 711/1426] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.539132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.540123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:49.547816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.548623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.549741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.550345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.651282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:49.665251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f05b620a-ec29-4a51-8599-91763da43716 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1311 microversion: 2.1 time: 0.378450 May 14 21:15:49.665860 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 716/1427] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1311 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.675223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6fe4dd50-7965-45cb-923e-088fff84bf72 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a78c4c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.752362 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6fe4dd50-7965-45cb-923e-088fff84bf72 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 0.085425 May 14 21:15:49.758985 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 717/1428] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.764679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-13ef88b4-f2a5-48af-882a-5caed8ddcfb2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c8790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.822052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:49.836557 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-03c8cb9d-db5d-48ad-8f86-08206398c140 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.300894 May 14 21:15:49.837364 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 712/1429] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.841088 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-13ef88b4-f2a5-48af-882a-5caed8ddcfb2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e" status: 200 len: 784 microversion: 2.1 time: 0.079752 May 14 21:15:49.842205 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 718/1430] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/images/b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e => generated 784 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:49.852120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.854534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:49.860624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb634e7e-8a20-45a0-b8aa-2eb1803762d1 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78cd940>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:49.872533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.873737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.874723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:49.875233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:49.963234 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb634e7e-8a20-45a0-b8aa-2eb1803762d1 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.112179 May 14 21:15:49.964477 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 719/1431] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:49.984716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9a63412-a4ea-400f-a906-2b0c8f67353d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78c4c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:50.248188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:50.259351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:50.262132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:50.263430 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8eb19c3-632a-4b4b-9b0d-db93c63164b0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1567 microversion: 2.25 time: 0.422842 May 14 21:15:50.274535 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 713/1432] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:49 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1567 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:50.274535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ae8e4bd0-1053-4833-a812-6a2b60fc8917 req-94539ad0-6f1d-47cd-a78c-d0ce6567d035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c11e4b-dada-44e6-b5f5-09279f34f6b2", "name": "network-vif-plugged", "status": "completed", "tag": "3806f5cd-d4ca-44ab-a0d0-8cb03de3c29a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:50.283373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ae8e4bd0-1053-4833-a812-6a2b60fc8917 req-94539ad0-6f1d-47cd-a78c-d0ce6567d035 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:50.288456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ae8e4bd0-1053-4833-a812-6a2b60fc8917 req-94539ad0-6f1d-47cd-a78c-d0ce6567d035 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:50.300394 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ae8e4bd0-1053-4833-a812-6a2b60fc8917 req-94539ad0-6f1d-47cd-a78c-d0ce6567d035 service nova] Creating event network-vif-plugged:3806f5cd-d4ca-44ab-a0d0-8cb03de3c29a for instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 on nch1-master-1 May 14 21:15:50.306159 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ae8e4bd0-1053-4833-a812-6a2b60fc8917 req-94539ad0-6f1d-47cd-a78c-d0ce6567d035 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040654 May 14 21:15:50.308974 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 714/1433] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:50.313629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:50.314743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:50.322842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:50.323433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:50.325975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:50.325975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:50.545469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:50.560140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-960c6c64-941e-40b8-8faf-bf6df3743cf0 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.251201 May 14 21:15:50.561291 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 715/1434] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:50 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:50.570154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:50.572544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:50.581458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:50.586517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:50.586517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:50.586517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:50.809051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:50.819338 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0a06495-511d-4218-8edd-755ed9cbc310 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1318 microversion: 2.1 time: 0.256036 May 14 21:15:50.820074 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 716/1435] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:50 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:50.825824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:50.826425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:50.833122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:50.833692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:50.834538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:50.835078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.091682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:51.100089 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b5faf70-9546-4898-a55a-48287396ee58 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1526 microversion: 2.1 time: 0.278899 May 14 21:15:51.112770 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 717/1436] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:50 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1526 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:51.131968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:51.133534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:51.142204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.142924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.145012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.145688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.324442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:51.354415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-79422ef3-2012-4666-bfcb-b6450e0bfeb3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1494 microversion: 2.1 time: 0.227815 May 14 21:15:51.355806 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 718/1437] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:51 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1494 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:51.360654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5a819cc-47b4-4fa5-8934-996de3cc6e60 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7c255e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:51.601111 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9a63412-a4ea-400f-a906-2b0c8f67353d tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37" status: 204 len: 0 microversion: 2.1 time: 1.616716 May 14 21:15:51.609971 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 720/1438] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:49 2022] DELETE /compute/v2.1/images/dc7a7de6-5368-4361-b7e8-917b3ce45a37 => generated 0 bytes in 1638 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:15:51.617094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:51.622897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:51.625098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.625906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.626803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.627322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.633668 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c5a819cc-47b4-4fa5-8934-996de3cc6e60 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1424 microversion: 2.1 time: 0.276525 May 14 21:15:51.639849 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 719/1439] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:51 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1424 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:51.646304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:51.647019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:51.654595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.655054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.655894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.656625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.914385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:51.927872 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab191b9a-a877-451c-9814-295a425da061 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1526 microversion: 2.1 time: 0.286666 May 14 21:15:51.929725 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 720/1440] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:51 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1526 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:51.950401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:51.951365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:51.958398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.959126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:51.960177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:51.960768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.015833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:52.070219 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78ea17c3-db9d-48dd-8e3e-107e424b53d7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1472 microversion: 2.1 time: 0.419095 May 14 21:15:52.070219 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 721/1441] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:51 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:52.070219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b9c4ccbb-ee1f-44e3-8b2a-aeea92f41c8c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:52.070219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b9c4ccbb-ee1f-44e3-8b2a-aeea92f41c8c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:52.070219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c4ccbb-ee1f-44e3-8b2a-aeea92f41c8c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.070795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c4ccbb-ee1f-44e3-8b2a-aeea92f41c8c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.070795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c4ccbb-ee1f-44e3-8b2a-aeea92f41c8c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.070795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c4ccbb-ee1f-44e3-8b2a-aeea92f41c8c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.143592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:52.143592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:52.144096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:52.144096 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-20f4a6a5-f5fb-4721-98b8-71efbc7c019a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1567 microversion: 2.25 time: 0.193245 May 14 21:15:52.144096 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 721/1442] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:51 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:52.145099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:52.145730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:52.152506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.153087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.153942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.154470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.310932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:52.319884 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a5d1b9f-135b-47c8-8a7f-86872c709f95 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1350 microversion: 2.1 time: 0.178670 May 14 21:15:52.320926 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 722/1443] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:52 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1350 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:52.326094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1f856ef-7f2d-4ef0-9284-fd63cc0f9cab tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1b40183a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:52.327976 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b9c4ccbb-ee1f-44e3-8b2a-aeea92f41c8c tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1645 microversion: 2.1 time: 0.295331 May 14 21:15:52.329233 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 722/1444] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:52 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1645 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:52.334313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:52.335071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:52.365402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.365402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.365402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.365402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.585009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:52.615312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53a71fa0-c97f-4764-82b6-146e7e64dea3 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1318 microversion: 2.1 time: 0.284758 May 14 21:15:52.616083 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 723/1445] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:52 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:52.626442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f171b448-35d1-4698-98d3-6a9dad59cafe tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:52.628340 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:15:52.628340 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:15:52.633907 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f171b448-35d1-4698-98d3-6a9dad59cafe tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] HTTP exception thrown: Flavor 8d34442f-f499-4011-932f-fd140a82357f could not be found. May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f171b448-35d1-4698-98d3-6a9dad59cafe tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Request method failure captured: May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/flavors/8d34442f-f499-4011-932f-fd140a82357f HTTP/1.1 May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBstuBfraGvIQvsDWH6SvjUOK0efGyWzsQvbxv6FE0WMzH0NJNoX0t5yebpQCPXdQ6j9uHuwI9sBCZ3FiqFTQbz1BbUaMeblkh6bcqgT1ie6xuTGQeyFsSOc-75zMKquImQbAX-OPFHrEgipsitZh7gSguiVUfh2nvG-BNLa7o_9JQY May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 8a4ed51cf6684302bed4497b2547ef09 May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-MigrationsAdminTest-161637913 May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:15:52.637320 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a4ed51cf6684302bed4497b2547ef09"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8a4ed51cf6684302bed4497b2547ef09"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8a4ed51cf6684302bed4497b2547ef09"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8a4ed51cf6684302bed4497b2547ef09", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-MigrationsAdminTest-161637913 May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 8a4ed51cf6684302bed4497b2547ef09 May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-MigrationsAdminTest-161637913 May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-MigrationsAdminTest-161637913-project-admin May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 9847c635058343c096bb44d95e70bc82 May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-MigrationsAdminTest-161637913-project-admin May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor 8d34442f-f499-4011-932f-fd140a82357f could not be found. May 14 21:15:52.638792 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '8d34442f-f499-4011-932f-fd140a82357f'} May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi flavor.destroy() May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8d34442f-f499-4011-932f-fd140a82357f could not be found. May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:15:52.639749 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 8d34442f-f499-4011-932f-fd140a82357f could not be found. May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8d34442f-f499-4011-932f-fd140a82357f could not be found. May 14 21:15:52.641758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:15:52.642949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f171b448-35d1-4698-98d3-6a9dad59cafe tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Returning 404 to user: Flavor 8d34442f-f499-4011-932f-fd140a82357f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:15:52.642949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f171b448-35d1-4698-98d3-6a9dad59cafe tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/8d34442f-f499-4011-932f-fd140a82357f" status: 404 len: 109 microversion: 2.1 time: 0.016657 May 14 21:15:52.644046 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 724/1446] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:15:52 2022] DELETE /compute/v2.1/flavors/8d34442f-f499-4011-932f-fd140a82357f => generated 109 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:15:52.654362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0f19d2b-04ad-4cf5-b127-5bdac987fe3f tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:52.654362 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:15:52.654362 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:15:52.654362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f19d2b-04ad-4cf5-b127-5bdac987fe3f tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.654362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f19d2b-04ad-4cf5-b127-5bdac987fe3f tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.655551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f19d2b-04ad-4cf5-b127-5bdac987fe3f tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:52.655551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f19d2b-04ad-4cf5-b127-5bdac987fe3f tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:52.686524 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0f19d2b-04ad-4cf5-b127-5bdac987fe3f tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041517 May 14 21:15:52.687413 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 725/1447] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:15:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:52.692192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1ad6e42-754a-498a-82f8-2a82598fddb1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a795a4c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:53.975021 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1ad6e42-754a-498a-82f8-2a82598fddb1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1433 microversion: 2.1 time: 1.286288 May 14 21:15:53.982376 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 726/1448] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:52 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1433 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:53.987250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1345554367", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:54.039354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:15:54.200510 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1f856ef-7f2d-4ef0-9284-fd63cc0f9cab tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698" status: 204 len: 0 microversion: 2.1 time: 1.878712 May 14 21:15:54.204162 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 723/1449] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:52 2022] DELETE /compute/v2.1/images/67fd914f-9f64-42a9-b869-48d911d41698 => generated 0 bytes in 1880 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:15:54.206234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.206851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:54.213571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.215881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.215881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.215881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.305850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:54.306380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:54.306943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:54.308374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:54.308374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:54.317033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.322072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.322072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.322072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.338461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:54.344177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Getting quotas for user 5b93d6c3d03d407f8be4aa38e2fbb154 and project 35a0e2c4a9054b4b962b9bc72c64517c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:54.359422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:15:54.361844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:15:54.462903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:54.470577 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97564974-fdbc-4b5d-b5ca-9363aba45108 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1478 microversion: 2.1 time: 0.268200 May 14 21:15:54.471157 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 724/1450] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:54 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1478 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:54.475737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.476555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:54.482463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.482922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.483739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.484172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.553125 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8e075ef5-c835-44e9-8901-f1ce698bae88 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569134 May 14 21:15:54.553374 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 727/1451] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:15:54.558153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-58e6ad7e-83bb-4e88-ae15-b8b82bd79e7f req-2a08b13f-19bb-4ab5-8787-b75ec4d28e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "name": "network-vif-plugged", "status": "completed", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:54.567314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-58e6ad7e-83bb-4e88-ae15-b8b82bd79e7f req-2a08b13f-19bb-4ab5-8787-b75ec4d28e0e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.568126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-58e6ad7e-83bb-4e88-ae15-b8b82bd79e7f req-2a08b13f-19bb-4ab5-8787-b75ec4d28e0e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.580162 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-58e6ad7e-83bb-4e88-ae15-b8b82bd79e7f req-2a08b13f-19bb-4ab5-8787-b75ec4d28e0e service nova] Creating event network-vif-plugged:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch1-master-1 May 14 21:15:54.585211 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-58e6ad7e-83bb-4e88-ae15-b8b82bd79e7f req-2a08b13f-19bb-4ab5-8787-b75ec4d28e0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030582 May 14 21:15:54.586139 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 728/1452] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:54.593064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.593901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:54.600598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.601167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.602234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.602902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.680029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:54.700234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:54.701745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:54.703123 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-da32e89a-3710-42f5-80bc-58e3859676ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1567 microversion: 2.25 time: 0.231025 May 14 21:15:54.715293 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 725/1453] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:54 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1567 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:54.724026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.724632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:54.732124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.732579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.733355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.734123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.817315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:54.828938 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc480d5e-9e21-48bc-aa6b-4333d9b8dee4 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1540 microversion: 2.1 time: 0.241353 May 14 21:15:54.831597 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 729/1454] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:54 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1540 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:54.835572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60b8d568-e1cb-4a7d-9444-0d28ff6865d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a78eaf70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.887256 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60b8d568-e1cb-4a7d-9444-0d28ff6865d2 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 200 len: 1433 microversion: 2.1 time: 0.056172 May 14 21:15:54.888057 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 730/1455] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:54 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 1433 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:54.888708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:54.894014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3284c665-a57f-454e-9055-6799daab2e01 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a78ea5e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.896902 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d925626-c9a1-4e24-b44b-9d085d82293c tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1507 microversion: 2.1 time: 0.180454 May 14 21:15:54.897572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 726/1456] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:54 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:54.902894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9318f940-6048-48cb-a84a-8b5196a1c98d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.903508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9318f940-6048-48cb-a84a-8b5196a1c98d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:54.970152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9318f940-6048-48cb-a84a-8b5196a1c98d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:54.977204 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9318f940-6048-48cb-a84a-8b5196a1c98d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1213 microversion: 2.1 time: 0.078679 May 14 21:15:54.977815 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 727/1457] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:54 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:54.983652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de39f2d8-7210-4321-8a1b-7cca56664bab tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:54.984319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de39f2d8-7210-4321-8a1b-7cca56664bab tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:54.990821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de39f2d8-7210-4321-8a1b-7cca56664bab tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.991427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de39f2d8-7210-4321-8a1b-7cca56664bab tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:54.992273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de39f2d8-7210-4321-8a1b-7cca56664bab tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:54.992729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de39f2d8-7210-4321-8a1b-7cca56664bab tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.076815 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de39f2d8-7210-4321-8a1b-7cca56664bab tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097710 May 14 21:15:55.077501 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 728/1458] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:15:54 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:55.082997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:55.083903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:55.091374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.092063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.093056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.093487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.300207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:55.307306 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1c64f75-a032-4404-af9b-9009b9f24117 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1467 microversion: 2.1 time: 0.228751 May 14 21:15:55.319749 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 729/1459] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:55 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1467 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:55.319749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:55.319749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:55.321981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.322556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.323345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.323826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.480137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:55.491787 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b619839-136b-4769-8c31-26cddda359cc tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1507 microversion: 2.1 time: 0.182391 May 14 21:15:55.492387 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 730/1460] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:55 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:55.497651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9478fb3-48bb-48e2-b248-570d64ed3720 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7e09670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:55.547238 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d9478fb3-48bb-48e2-b248-570d64ed3720 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e" status: 200 len: 784 microversion: 2.1 time: 0.053170 May 14 21:15:55.547860 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 731/1461] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:55 2022] GET /compute/v2.1/images/b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e => generated 784 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:55.552402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:55.553025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:55.559046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.559543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.560448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.560950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.704298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:55.712877 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d9f54bef-b71d-40e7-ae08-9017e8ec3bfe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1478 microversion: 2.1 time: 0.163446 May 14 21:15:55.713657 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 732/1462] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:55 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1478 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:55.719750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b82151b-bb23-4abf-b120-b6413a87f46d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:55.720976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b82151b-bb23-4abf-b120-b6413a87f46d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:55.727039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b82151b-bb23-4abf-b120-b6413a87f46d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.728419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b82151b-bb23-4abf-b120-b6413a87f46d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.729629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b82151b-bb23-4abf-b120-b6413a87f46d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.730075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b82151b-bb23-4abf-b120-b6413a87f46d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.854784 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b82151b-bb23-4abf-b120-b6413a87f46d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "PUT /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1079 microversion: 2.1 time: 0.139900 May 14 21:15:55.855456 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 733/1463] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:15:55 2022] PUT /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1079 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:55.859906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98f89bef-c1bc-4f14-9c1a-564114192a57 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:55.868332 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98f89bef-c1bc-4f14-9c1a-564114192a57 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011637 May 14 21:15:55.868629 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 734/1464] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:15:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:55.873043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:55.873651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:55.880877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.882008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:55.882208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:55.882913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.036371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:56.044955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:56.046521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:56.047745 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8a7ce95d-3319-4fb2-85c7-53f8f2196be2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1557 microversion: 2.25 time: 0.178095 May 14 21:15:56.048829 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 735/1465] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:55 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:56.053324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:56.054082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:56.060536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:56.061257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.062291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:56.062742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.209121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:56.218208 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d0474ac-a2a1-43e6-a4cd-b3820265d3b4 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1505 microversion: 2.1 time: 0.168359 May 14 21:15:56.218927 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 736/1466] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:56 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:56.224449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fdfa995c-fef1-4a18-8fa2-1ca22c5295d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a796c5e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:56.368585 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3284c665-a57f-454e-9055-6799daab2e01 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f" status: 204 len: 0 microversion: 2.1 time: 1.479073 May 14 21:15:56.370552 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 731/1467] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:54 2022] DELETE /compute/v2.1/images/89f396a8-2e1a-4b21-92a2-5c48fdd8973f => generated 0 bytes in 1482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:15:56.377606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:56.378493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:56.391603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:56.392809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.394738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:56.395390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.764099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:56.773176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4820154-5f5a-4cb1-8cc6-a7daba3adb3d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1265 microversion: 2.1 time: 0.401225 May 14 21:15:56.774035 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 732/1468] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:56 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:56.778896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b356085f-b31a-4b48-b83d-cf04dc4b44eb tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '.version_select at 0x7fb1a78cd8b0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:56.781566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b356085f-b31a-4b48-b83d-cf04dc4b44eb tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:56.782241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b356085f-b31a-4b48-b83d-cf04dc4b44eb tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.794774 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b356085f-b31a-4b48-b83d-cf04dc4b44eb tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2541 microversion: 2.25 time: 0.019530 May 14 21:15:56.795644 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 733/1469] 10.222.0.52 () {60 vars in 1183 bytes} [Sat May 14 21:15:56 2022] GET /compute/v2.1/os-migrations => generated 2541 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:56.800408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:56.801213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:56.808406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:56.808860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.809636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:56.810253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:56.987606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:56.996555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37d08583-b72c-404c-a6bc-53c7b990a955 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1505 microversion: 2.1 time: 0.199577 May 14 21:15:56.997058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 734/1470] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:56 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:57.002548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-610e705e-aeff-4fab-ac56-ebe50d32f837 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0863bd3-bff3-4125-b857-a7cf7b43cf86", "device": "/dev/xvdb"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:57.004376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-610e705e-aeff-4fab-ac56-ebe50d32f837 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:57.012364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610e705e-aeff-4fab-ac56-ebe50d32f837 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:57.013057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610e705e-aeff-4fab-ac56-ebe50d32f837 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:57.014050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610e705e-aeff-4fab-ac56-ebe50d32f837 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:57.014658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610e705e-aeff-4fab-ac56-ebe50d32f837 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:57.604301 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fdfa995c-fef1-4a18-8fa2-1ca22c5295d1 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "DELETE /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 204 len: 0 microversion: 2.1 time: 1.383985 May 14 21:15:57.609797 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 737/1471] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:56 2022] DELETE /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 0 bytes in 1385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:15:57.610786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:57.611603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:57.619677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:57.620532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:57.621970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:57.622438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:57.652394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:15:57.962542 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0402f265-cf31-4fd7-8c47-e8a1cedd6603 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 204 len: 0 microversion: 2.1 time: 0.354590 May 14 21:15:57.963573 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 738/1472] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:15:57 2022] DELETE /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:15:57.970590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-07ee90e3-9c2d-4a8e-99e9-f4549b351686 req-d7f2f5b1-9213-407a-95ac-bc63235290ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0682771c-4855-4853-9123-f03aa17b7b53", "name": "network-vif-unplugged", "status": "completed", "tag": "7f69be99-9e4d-472a-a312-16dd01bfc172"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:57.980208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-07ee90e3-9c2d-4a8e-99e9-f4549b351686 req-d7f2f5b1-9213-407a-95ac-bc63235290ab service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:57.980667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-07ee90e3-9c2d-4a8e-99e9-f4549b351686 req-d7f2f5b1-9213-407a-95ac-bc63235290ab service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:57.994607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-07ee90e3-9c2d-4a8e-99e9-f4549b351686 req-d7f2f5b1-9213-407a-95ac-bc63235290ab service nova] Creating event network-vif-unplugged:7f69be99-9e4d-472a-a312-16dd01bfc172 for instance 0682771c-4855-4853-9123-f03aa17b7b53 on nch2-master-1 May 14 21:15:58.000397 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-07ee90e3-9c2d-4a8e-99e9-f4549b351686 req-d7f2f5b1-9213-407a-95ac-bc63235290ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034883 May 14 21:15:58.001242 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 739/1473] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:58.006834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:58.008083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:58.016445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.018816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.018816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.018816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.030189 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-610e705e-aeff-4fab-ac56-ebe50d32f837 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "POST /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.031313 May 14 21:15:58.032592 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 735/1474] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:15:56 2022] POST /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments => generated 194 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:58.067659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:58.068595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:58.092796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.093407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.094642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.096684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.287795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:58.288585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 43996dfa-e6da-4600-a5f7-5b9bbb2f963f {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:15:58.297773 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-80fda63e-4265-4b14-9f9a-f36b0486fbbf tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1478 microversion: 2.1 time: 0.295073 May 14 21:15:58.298577 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 740/1475] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:58 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:58.307743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-3267f5a6-2f49-40c1-9e3b-5630364cc9a5 req-7a52421c-444d-4204-97b3-356279d4431c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75983071-f5ad-4c40-aa83-f61a98e5e823", "tag": "bb09673c-8ab1-484e-bf52-805d25307965"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:58.312661 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47f081b7-d488-421b-8b1e-b5f0161e34c4 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 2049 microversion: 2.25 time: 0.278584 May 14 21:15:58.313820 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 736/1476] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:58 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 2049 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:58.318730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8211f35-30ad-415e-9a26-e65af46a960f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:58.320171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c8211f35-30ad-415e-9a26-e65af46a960f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:58.333720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8211f35-30ad-415e-9a26-e65af46a960f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.334407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8211f35-30ad-415e-9a26-e65af46a960f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.341471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3267f5a6-2f49-40c1-9e3b-5630364cc9a5 req-7a52421c-444d-4204-97b3-356279d4431c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.341567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8211f35-30ad-415e-9a26-e65af46a960f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.341567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8211f35-30ad-415e-9a26-e65af46a960f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.342964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3267f5a6-2f49-40c1-9e3b-5630364cc9a5 req-7a52421c-444d-4204-97b3-356279d4431c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.360476 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-3267f5a6-2f49-40c1-9e3b-5630364cc9a5 req-7a52421c-444d-4204-97b3-356279d4431c service nova] Creating event network-changed:bb09673c-8ab1-484e-bf52-805d25307965 for instance 75983071-f5ad-4c40-aa83-f61a98e5e823 on nch2-master-1 May 14 21:15:58.366756 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-3267f5a6-2f49-40c1-9e3b-5630364cc9a5 req-7a52421c-444d-4204-97b3-356279d4431c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067090 May 14 21:15:58.373495 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 741/1477] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:15:58.380985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-394c4b12-8699-4a23-9c67-9c235cca64e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7d32940>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:58.417646 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-394c4b12-8699-4a23-9c67-9c235cca64e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] HTTP exception thrown: Image not found. May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-394c4b12-8699-4a23-9c67-9c235cca64e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Request method failure captured: May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 HTTP/1.1 May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvW6Ln2QIFjfCjE_L52Fw4cx-VCQ3ZywvXGeLCB8qY06oQhHhtyy3KDIvzaqp5KX5TeZtDqeOV_5d4mSCIUxcuQWFWg9QKiLLCttcYP1lS7ojDL2HnvmIXEHZ9F1pMsezYZ2RucnexFSMjl8vLA2GJHAV-At1aeGuyHfnivgJTZz7Y May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b30891c9ccaf4e1bbdec0c910805d504 May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:15:58.444412 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b30891c9ccaf4e1bbdec0c910805d504", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b30891c9ccaf4e1bbdec0c910805d504 May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerTestJSON-2124897239-project May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: e87dae577e6c42ba8d14094bd6cad9de May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerTestJSON-2124897239-project May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2d7ab310-93d4-40e3-9e8a-898ebf3356b8'} May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:15:58.446064 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2d7ab310-93d4-40e3-9e8a-898ebf3356b8 May 14 21:15:58.454021 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:15:58.455439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2d7ab310-93d4-40e3-9e8a-898ebf3356b8 could not be found. May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:15:58.456840 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-394c4b12-8699-4a23-9c67-9c235cca64e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:15:58.458226 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-394c4b12-8699-4a23-9c67-9c235cca64e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 404 len: 62 microversion: 2.1 time: 0.071216 May 14 21:15:58.459622 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 742/1478] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:58 2022] GET /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:15:58.459622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:58.459622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:58.465384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.465675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.466830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.467308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.495238 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8211f35-30ad-415e-9a26-e65af46a960f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "PUT /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1081 microversion: 2.1 time: 0.180153 May 14 21:15:58.503943 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 737/1479] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:15:58 2022] PUT /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1081 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:58.510021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:58.510678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:58.517328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.517791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.518851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.519298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.621014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:58.639083 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1bec02aa-f4b0-493d-bbf6-a58b9154c292 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.188976 May 14 21:15:58.640765 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 743/1480] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:58 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:58.654395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-76680047", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "2f366748-ecde-43ad-b849-3c9dce1cc30b"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:58.689641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:58.698070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19a0ed1e-059b-4561-9cbe-407094026b84 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1473 microversion: 2.1 time: 0.192762 May 14 21:15:58.698657 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 738/1481] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:58 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1473 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:58.708753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8af6be0b-67ec-4fb4-a8e4-e03515822103 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1357978765"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:15:58.709882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8af6be0b-67ec-4fb4-a8e4-e03515822103 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:58.717858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af6be0b-67ec-4fb4-a8e4-e03515822103 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.718050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af6be0b-67ec-4fb4-a8e4-e03515822103 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.719105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af6be0b-67ec-4fb4-a8e4-e03515822103 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:58.719787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af6be0b-67ec-4fb4-a8e4-e03515822103 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:58.731019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] validate_networks() for [('2f366748-ecde-43ad-b849-3c9dce1cc30b', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:15:59.109945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:15:59.110398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:15:59.110871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:15:59.111338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:15:59.111813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:15:59.123847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.124308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.128365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.128365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.142675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:15:59.148055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for user cfcb989a491440b3bf74ddc055ee14d3 and project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:15:59.161374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:15:59.163741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:15:59.209322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8af6be0b-67ec-4fb4-a8e4-e03515822103 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "POST /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2/action" status: 202 len: 0 microversion: 2.1 time: 0.508277 May 14 21:15:59.209971 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 739/1482] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:15:58 2022] POST /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2/action => generated 0 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:15:59.216624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:59.217327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:59.223529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.223972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.224748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.225190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.272094 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66715b9c-4f03-46c3-ac22-7ae0e24e592d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.630059 May 14 21:15:59.273027 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 744/1483] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:15:59.278270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1fc4597a-3267-4e3a-abb3-7d7e56b372ef tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7dc6160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:59.347793 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1fc4597a-3267-4e3a-abb3-7d7e56b372ef tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.073628 May 14 21:15:59.348670 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 745/1484] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:15:59 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:59.354378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b84f26c-4601-418e-8fa2-df34c3f33f68 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:59.355081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b84f26c-4601-418e-8fa2-df34c3f33f68 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:59.396548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:59.405451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3898165b-dad4-4491-8290-3380e8c77cb0 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1507 microversion: 2.1 time: 0.193604 May 14 21:15:59.406041 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 740/1485] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:59 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:59.414787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:59.414787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:59.420045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b84f26c-4601-418e-8fa2-df34c3f33f68 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:59.428154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b84f26c-4601-418e-8fa2-df34c3f33f68 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:59.429146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.429618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.429750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b84f26c-4601-418e-8fa2-df34c3f33f68 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:59.430417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.430816 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b84f26c-4601-418e-8fa2-df34c3f33f68 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1260 microversion: 2.25 time: 0.081226 May 14 21:15:59.431018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.431361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 746/1486] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:15:59 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1260 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:15:59.436092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:59.436708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:59.442656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.443114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.443955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.444401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.624269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:59.644445 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab8caa28-0eb5-46cb-9a67-cc02b30938f6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1478 microversion: 2.1 time: 0.237310 May 14 21:15:59.648210 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 741/1487] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:59 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1478 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:59.663196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:59.666079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:59.675030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.675520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.676426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.677048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.735185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:15:59.744264 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c47e65f-8a32-4585-9491-1c7c50b71f6d tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1507 microversion: 2.1 time: 0.311008 May 14 21:15:59.747279 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 747/1488] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:59 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:15:59.752076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:15:59.752694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:15:59.760250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.760627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:15:59.761692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:15:59.762327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.043432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:00.060851 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e837c9be-8502-4da1-b7e2-291b595d4174 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1473 microversion: 2.1 time: 0.312457 May 14 21:16:00.061699 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 748/1489] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:59 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1473 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:00.067210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:00.068380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:00.076539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:00.084038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.084333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.085141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.085591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.096166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6489cc3b-a5e3-444e-a773-d5f252df4e82 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.442355 May 14 21:16:00.097341 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 742/1490] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:15:59 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:00.110173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-989004ca-e938-4a09-b4c7-d8d37f852198 req-a43eb922-74cc-417f-9a2c-45a2b911ef40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbb39d4-b558-43b9-a868-776517ce58e2", "name": "network-vif-unplugged", "status": "completed", "tag": "229bb137-aed4-4606-843d-7799884c4e81"}, {"server_uuid": "0682771c-4855-4853-9123-f03aa17b7b53", "name": "network-vif-plugged", "status": "completed", "tag": "7f69be99-9e4d-472a-a312-16dd01bfc172"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:00.127450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:00.129530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-989004ca-e938-4a09-b4c7-d8d37f852198 req-a43eb922-74cc-417f-9a2c-45a2b911ef40 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.130606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-989004ca-e938-4a09-b4c7-d8d37f852198 req-a43eb922-74cc-417f-9a2c-45a2b911ef40 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.160643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-989004ca-e938-4a09-b4c7-d8d37f852198 req-a43eb922-74cc-417f-9a2c-45a2b911ef40 service nova] Creating event network-vif-unplugged:229bb137-aed4-4606-843d-7799884c4e81 for instance cbbb39d4-b558-43b9-a868-776517ce58e2 on nch1-master-1 May 14 21:16:00.161305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-989004ca-e938-4a09-b4c7-d8d37f852198 req-a43eb922-74cc-417f-9a2c-45a2b911ef40 service nova] Creating event network-vif-plugged:7f69be99-9e4d-472a-a312-16dd01bfc172 for instance 0682771c-4855-4853-9123-f03aa17b7b53 on nch2-master-1 May 14 21:16:00.176254 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-989004ca-e938-4a09-b4c7-d8d37f852198 req-a43eb922-74cc-417f-9a2c-45a2b911ef40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.077423 May 14 21:16:00.188012 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 743/1491] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:00.363117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-926b0da4-bec1-445f-9925-0aa258c482f0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7e2dee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:00.432405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-926b0da4-bec1-445f-9925-0aa258c482f0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.074102 May 14 21:16:00.433234 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 744/1492] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:00 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:00.449441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:00.450265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:00.462428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.463437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.464578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.465229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.468198 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd715ba4-bf7e-4e06-af56-cba68c6a2da8 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 204 len: 0 microversion: 2.1 time: 0.404856 May 14 21:16:00.472117 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 749/1493] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:00 2022] DELETE /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:00.488738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:00.489584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:00.514809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.515287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.516138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.516590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.609375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:00.650112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:00.664119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:00.669675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:00.672771 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cae34348-2b69-4e05-8a43-430ecab6fc95 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1264 microversion: 2.25 time: 0.226749 May 14 21:16:00.674534 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 745/1494] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:00 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:00.679940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:00.681283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:00.693873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.694642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.695693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.696960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.799504 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.compute.api [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Instance is already in deleting state, ignoring this request May 14 21:16:00.801021 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef144de4-fcf6-49e2-8d3f-2f2c36221103 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "DELETE /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 204 len: 0 microversion: 2.1 time: 0.323340 May 14 21:16:00.802370 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 750/1495] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:00 2022] DELETE /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:16:00.826407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:00.826407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:00.826407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.826407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:00.827297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:00.827297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.010145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:01.019792 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0369b56-7db6-46b9-9ea9-ef6d023294ac tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1478 microversion: 2.1 time: 0.343295 May 14 21:16:01.022041 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 746/1496] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:00 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1478 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:01.028018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d31ca0e5-2f35-4d1b-9138-c7a50e2b9ea2 req-32fc89e2-6960-459e-ac3d-0e1407ccf7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "568afb67-d4f6-424e-82f4-150d00c3c6ee", "name": "network-vif-deleted", "tag": "1ef02825-0b9d-4284-a41f-f07bc5e3e488"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:01.036818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d31ca0e5-2f35-4d1b-9138-c7a50e2b9ea2 req-32fc89e2-6960-459e-ac3d-0e1407ccf7bb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.037524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d31ca0e5-2f35-4d1b-9138-c7a50e2b9ea2 req-32fc89e2-6960-459e-ac3d-0e1407ccf7bb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.051030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:01.055121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d31ca0e5-2f35-4d1b-9138-c7a50e2b9ea2 req-32fc89e2-6960-459e-ac3d-0e1407ccf7bb service nova] Creating event network-vif-deleted:1ef02825-0b9d-4284-a41f-f07bc5e3e488 for instance 568afb67-d4f6-424e-82f4-150d00c3c6ee on nch2-master-1 May 14 21:16:01.061809 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d31ca0e5-2f35-4d1b-9138-c7a50e2b9ea2 req-32fc89e2-6960-459e-ac3d-0e1407ccf7bb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038211 May 14 21:16:01.062376 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 747/1497] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:01.078031 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-59a86ca2-4e73-490c-881c-91ec1f6d509f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1513 microversion: 2.1 time: 0.259526 May 14 21:16:01.078031 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 751/1498] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:00 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:01.078946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6f735cfe-defb-4001-8039-2eed6e7dfa76 req-9fcc6d18-f4d5-4df9-bb5d-c8d4511af59f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:01.080784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6f735cfe-defb-4001-8039-2eed6e7dfa76 req-9fcc6d18-f4d5-4df9-bb5d-c8d4511af59f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.081549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6f735cfe-defb-4001-8039-2eed6e7dfa76 req-9fcc6d18-f4d5-4df9-bb5d-c8d4511af59f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.082042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:01.082684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:01.089300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.089863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.090659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.091117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.093505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6f735cfe-defb-4001-8039-2eed6e7dfa76 req-9fcc6d18-f4d5-4df9-bb5d-c8d4511af59f service nova] Creating event network-changed:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch2-master-1 May 14 21:16:01.099012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6f735cfe-defb-4001-8039-2eed6e7dfa76 req-9fcc6d18-f4d5-4df9-bb5d-c8d4511af59f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032579 May 14 21:16:01.101415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 748/1499] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:01.115772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:01.116488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:01.124156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.124850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.131662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.131662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.159459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:01.168683 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba927c11-38b9-480f-896c-efcae3e66cad tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1302 microversion: 2.1 time: 0.094437 May 14 21:16:01.169198 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 752/1500] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:01 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:01.300066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:01.308546 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76d1fd07-df45-40f7-a716-f127314992d4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.197037 May 14 21:16:01.309149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 749/1501] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:01 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:01.445708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a29fde48-44e3-4348-a6fc-8a5a5c8dfbc3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a78af0d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:01.499462 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a29fde48-44e3-4348-a6fc-8a5a5c8dfbc3 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.057608 May 14 21:16:01.500086 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 753/1502] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:01 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:01.691849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:01.692693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:01.699712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.700116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.700955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:01.701539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:01.765189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:01.773838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:01.777248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:01.777397 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e36fbb1c-94c4-4b65-a804-4f5143b2ceb5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1264 microversion: 2.25 time: 0.089556 May 14 21:16:01.778119 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 750/1503] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:01 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1264 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:02.038351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:02.039063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:02.045890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.046355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.047237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.047723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.084029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:02.084798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:02.092292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.092808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.093632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.094108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.241107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:02.250581 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3bee1cca-4574-43b7-8bf7-c5578083aaed tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1513 microversion: 2.1 time: 0.171348 May 14 21:16:02.254122 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 751/1504] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:02 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:02.257048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:02.258166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:02.264450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.264925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.265726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.266176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.304097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.304566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.305040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lazy-loading 'fault' on Instance uuid 568afb67-d4f6-424e-82f4-150d00c3c6ee {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:02.347640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:02.356768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9d348a4-6f5e-499d-81f0-2686037ae6b2 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1307 microversion: 2.1 time: 0.103835 May 14 21:16:02.357737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 752/1505] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:02 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:02.363977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:02.364658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:02.372640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.373405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.374249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.374698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.415635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:02.426286 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a26904f5-afbc-4401-b1e2-8ca4d45c8d7f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1463 microversion: 2.1 time: 0.392558 May 14 21:16:02.427495 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 754/1506] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:02 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1463 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:02.453251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1e6cf234-8b0f-40e4-9171-47d6f95da23d tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:02.455006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1e6cf234-8b0f-40e4-9171-47d6f95da23d tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:02.465949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e6cf234-8b0f-40e4-9171-47d6f95da23d tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.465949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e6cf234-8b0f-40e4-9171-47d6f95da23d tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.465949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e6cf234-8b0f-40e4-9171-47d6f95da23d tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.465949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e6cf234-8b0f-40e4-9171-47d6f95da23d tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.546925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:02.557275 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b73320b1-3c09-417c-91f2-7a50ec7955a7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.197877 May 14 21:16:02.558340 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 753/1507] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:02 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:02.571164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a9aaa4f-d0b5-4e94-81e8-7697643f24f7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7fa6a60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:02.622324 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a9aaa4f-d0b5-4e94-81e8-7697643f24f7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.062300 May 14 21:16:02.622914 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 754/1508] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:02 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:02.797013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:02.797695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:02.810554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.811009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.812966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.812966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.833071 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1e6cf234-8b0f-40e4-9171-47d6f95da23d tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action" status: 202 len: 0 microversion: 2.1 time: 0.383851 May 14 21:16:02.838580 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 755/1509] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:16:02 2022] POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:16:02.842839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:02.843598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:02.861062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.861594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.862392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.863393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.898076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:02.899077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:02.899077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lazy-loading 'fault' on Instance uuid 0682771c-4855-4853-9123-f03aa17b7b53 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:02.916381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:02.928077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:02.929610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:02.934643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ad908fc-5912-4880-80e4-091146f44335 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1320 microversion: 2.25 time: 0.140837 May 14 21:16:02.945761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 755/1510] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:02 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1320 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:03.087068 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b279d04-98ed-4e64-8d02-867bb07e42e2 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1597 microversion: 2.1 time: 0.248039 May 14 21:16:03.089660 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 756/1511] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:02 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1597 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:03.109712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c953a4e-3c85-4ccf-8506-894390922ee3 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:03.110758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c953a4e-3c85-4ccf-8506-894390922ee3 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:03.121532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-21c34be8-dd95-4829-9163-faeadbc29ae3 req-11dc92ac-b90c-41b8-861f-1a1ec9a0d94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c11e4b-dada-44e6-b5f5-09279f34f6b2", "name": "network-vif-deleted", "tag": "3806f5cd-d4ca-44ab-a0d0-8cb03de3c29a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:03.121931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c953a4e-3c85-4ccf-8506-894390922ee3 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.122491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c953a4e-3c85-4ccf-8506-894390922ee3 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.123762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c953a4e-3c85-4ccf-8506-894390922ee3 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.124503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c953a4e-3c85-4ccf-8506-894390922ee3 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.134980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-21c34be8-dd95-4829-9163-faeadbc29ae3 req-11dc92ac-b90c-41b8-861f-1a1ec9a0d94b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.135812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-21c34be8-dd95-4829-9163-faeadbc29ae3 req-11dc92ac-b90c-41b8-861f-1a1ec9a0d94b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.149308 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-21c34be8-dd95-4829-9163-faeadbc29ae3 req-11dc92ac-b90c-41b8-861f-1a1ec9a0d94b service nova] Creating event network-vif-deleted:3806f5cd-d4ca-44ab-a0d0-8cb03de3c29a for instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 on nch1-master-1 May 14 21:16:03.154984 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-21c34be8-dd95-4829-9163-faeadbc29ae3 req-11dc92ac-b90c-41b8-861f-1a1ec9a0d94b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037333 May 14 21:16:03.155639 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 757/1512] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:16:03.269516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:03.270236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:03.276889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.277380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.278168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.278656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.360714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:03.372100 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd9398ce-b37f-495d-957e-b3972f3502b5 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1303 microversion: 2.1 time: 0.106597 May 14 21:16:03.382048 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 758/1513] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:03 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:03.388342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:03.389033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:03.394981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.395448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.396286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.396736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.435456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.435950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.436419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lazy-loading 'fault' on Instance uuid 568afb67-d4f6-424e-82f4-150d00c3c6ee {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:03.470326 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c953a4e-3c85-4ccf-8506-894390922ee3 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action" status: 202 len: 0 microversion: 2.1 time: 0.364442 May 14 21:16:03.471336 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 756/1514] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:16:03 2022] POST /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:16:03.480857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:03.485950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3bfaf0c6-9ebe-4a29-9388-e4dbc573bdc4 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:03.486591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3bfaf0c6-9ebe-4a29-9388-e4dbc573bdc4 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:03.489504 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf080405-2b2e-4765-b290-33d9e7403588 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 200 len: 1307 microversion: 2.1 time: 0.105749 May 14 21:16:03.491314 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 759/1515] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:03 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 1307 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:03.502792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bfaf0c6-9ebe-4a29-9388-e4dbc573bdc4 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.503257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bfaf0c6-9ebe-4a29-9388-e4dbc573bdc4 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.504339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bfaf0c6-9ebe-4a29-9388-e4dbc573bdc4 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.504951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bfaf0c6-9ebe-4a29-9388-e4dbc573bdc4 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.574863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:03.575497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:03.581668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.582123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.582905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.583366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.715574 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3bfaf0c6-9ebe-4a29-9388-e4dbc573bdc4 tempest-ServersAdminTestJSON-1374360741 tempest-ServersAdminTestJSON-1374360741-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1614 microversion: 2.1 time: 0.240112 May 14 21:16:03.716936 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 757/1516] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:03 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1614 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:03.722127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1dc4ed66-8dca-4940-a8ec-2729fbd7376f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7fa6f70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:03.747436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:03.755388 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d3ca18af-a861-45b5-a72f-4b436a9b23e7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.184964 May 14 21:16:03.756269 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 760/1517] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:03 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:03.761562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:03.762140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:03.768158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.768684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.769434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.769871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.770824 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1dc4ed66-8dca-4940-a8ec-2729fbd7376f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.052647 May 14 21:16:03.771439 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 758/1518] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:03 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:03.801301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:03.953927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:03.954669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:03.963434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.964020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:03.964892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:03.965407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.172398 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fb6b87ae-cbf3-4158-9413-6d58083207fe tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 204 len: 0 microversion: 2.1 time: 0.414187 May 14 21:16:04.174203 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 761/1519] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:03 2022] DELETE /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:04.183995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:04.185225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:04.187988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:04.191725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.192411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.193430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.194100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.196196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:04.198637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:04.200050 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-74a482c4-23e5-45c5-9f30-1b681ed9dd2f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1360 microversion: 2.25 time: 0.250430 May 14 21:16:04.201613 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 759/1520] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:03 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1360 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:04.349627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:04.366262 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c064c80b-70fb-40b0-9151-920cf458e39c tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1468 microversion: 2.1 time: 0.180295 May 14 21:16:04.375881 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 762/1521] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:04 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1468 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:04.389630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:04.390267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:04.396877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.397341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.398303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.398864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.436899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.437752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.438466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lazy-loading 'fault' on Instance uuid 70c11e4b-dada-44e6-b5f5-09279f34f6b2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:04.502415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '911b9cf4e9bc424bba387e2ff966cb46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4af8109ce4a4e98a2e7104125651db0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:04.508640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:04.509336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: 568afb67-d4f6-424e-82f4-150d00c3c6ee] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:04.510035 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ceb744f-21ee-40aa-be01-8b63ad9db81e tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 200 len: 1308 microversion: 2.1 time: 0.124053 May 14 21:16:04.510619 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 760/1522] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:04 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:04.523621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.524081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.525744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.526084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.543120 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] HTTP exception thrown: Instance 568afb67-d4f6-424e-82f4-150d00c3c6ee could not be found. May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Request method failure captured: May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee HTTP/1.1 May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuRlbeE5FOI1lKp-jaQMHTSczW1QzaQu7AcIt6Hsa4xjTp81xpiSP7GQn082nV9Py7fUPHiNPoz1RaneYkoAQYrIQrpLNYL0ovGus5xeQ9n-qbKv8bc9YoWBn6oYMzdcq8gNbBmMKmUzBZy59eDF_OH2n1CIGrp2R-83YICmKLZxfo May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 366727f0fe304593ae0a789b2f0eb0b2 May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListImageFiltersTestJSON-1165058219 May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:04.544844 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/366727f0fe304593ae0a789b2f0eb0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/366727f0fe304593ae0a789b2f0eb0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/366727f0fe304593ae0a789b2f0eb0b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_366727f0fe304593ae0a789b2f0eb0b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListImageFiltersTestJSON-1165058219 May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 366727f0fe304593ae0a789b2f0eb0b2 May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1165058219 May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListImageFiltersTestJSON-1165058219-project May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: dd53fb02767e4912bd762fa7d1e80a06 May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListImageFiltersTestJSON-1165058219-project May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 568afb67-d4f6-424e-82f4-150d00c3c6ee could not be found. May 14 21:16:04.546139 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '568afb67-d4f6-424e-82f4-150d00c3c6ee'} May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 568afb67-d4f6-424e-82f4-150d00c3c6ee could not be found. May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:04.547007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 568afb67-d4f6-424e-82f4-150d00c3c6ee could not be found. May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 568afb67-d4f6-424e-82f4-150d00c3c6ee could not be found. May 14 21:16:04.548530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:04.549654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Returning 404 to user: Instance 568afb67-d4f6-424e-82f4-150d00c3c6ee could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:04.549654 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-95a67a89-b2eb-4702-a017-4ef5f9132db9 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee" status: 404 len: 111 microversion: 2.1 time: 0.042128 May 14 21:16:04.549654 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 763/1523] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:04 2022] GET /compute/v2.1/servers/568afb67-d4f6-424e-82f4-150d00c3c6ee => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:16:04.555891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:04.556994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:04.563347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.564589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.564964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.565488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.594733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:04.773790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:04.774500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:04.782906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.783644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.784726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.785955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.887919 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-25e3edf4-845a-4f51-aea5-6a037d882745 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 204 len: 0 microversion: 2.1 time: 0.336179 May 14 21:16:04.891874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 761/1524] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:04 2022] DELETE /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:16:04.895168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae3d1d2f-64b1-469c-8f8d-fe35820d3414 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7e691f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:04.945317 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae3d1d2f-64b1-469c-8f8d-fe35820d3414 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.054578 May 14 21:16:04.945987 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 762/1525] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:04 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:04.955504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:04.956253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:04.959620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:04.964415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.964876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.965671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:04.966295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:04.968016 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fedfe852-46bc-40f5-a49f-36f15bd62376 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.198486 May 14 21:16:04.968590 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 764/1526] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:04 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:05.152030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-12058401-f2e2-4fc7-add6-22bcc2cfd3b8 req-a22411f8-647e-43bc-9ccc-4c52e4d7b0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1490939f-5892-4d71-8262-69f0148d55d2", "tag": "0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:05.175106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-12058401-f2e2-4fc7-add6-22bcc2cfd3b8 req-a22411f8-647e-43bc-9ccc-4c52e4d7b0b9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.175817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-12058401-f2e2-4fc7-add6-22bcc2cfd3b8 req-a22411f8-647e-43bc-9ccc-4c52e4d7b0b9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.204918 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-12058401-f2e2-4fc7-add6-22bcc2cfd3b8 req-a22411f8-647e-43bc-9ccc-4c52e4d7b0b9 service nova] Creating event network-changed:0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720 for instance 1490939f-5892-4d71-8262-69f0148d55d2 on nch1-master-1 May 14 21:16:05.210953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-12058401-f2e2-4fc7-add6-22bcc2cfd3b8 req-a22411f8-647e-43bc-9ccc-4c52e4d7b0b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062563 May 14 21:16:05.212005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 765/1527] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:16:05.214274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:05.222399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.223888 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b3d0020-3c38-4c58-b19e-30814effde9b tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1474 microversion: 2.1 time: 0.276755 May 14 21:16:05.224970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.227033 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 763/1528] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:04 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1474 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:05.240128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.240983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.242657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.243387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.336659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-035aaec8-bc7c-4b07-9a53-329840bb1f7e req-2ddf8705-20e4-4fa0-b35c-0da942f6d4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbb39d4-b558-43b9-a868-776517ce58e2", "name": "network-vif-plugged", "status": "completed", "tag": "229bb137-aed4-4606-843d-7799884c4e81"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:05.353208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-035aaec8-bc7c-4b07-9a53-329840bb1f7e req-2ddf8705-20e4-4fa0-b35c-0da942f6d4bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.354619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-035aaec8-bc7c-4b07-9a53-329840bb1f7e req-2ddf8705-20e4-4fa0-b35c-0da942f6d4bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.381740 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-035aaec8-bc7c-4b07-9a53-329840bb1f7e req-2ddf8705-20e4-4fa0-b35c-0da942f6d4bf service nova] Creating event network-vif-plugged:229bb137-aed4-4606-843d-7799884c4e81 for instance cbbb39d4-b558-43b9-a868-776517ce58e2 on nch1-master-1 May 14 21:16:05.388339 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-035aaec8-bc7c-4b07-9a53-329840bb1f7e req-2ddf8705-20e4-4fa0-b35c-0da942f6d4bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056084 May 14 21:16:05.390331 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 764/1529] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:16:05.396017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.397008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.405281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.409226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.409226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.409226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.478043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:05.490393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:05.496218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:05.497810 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c90dfdd-08ad-412c-8541-da7f98248776 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1360 microversion: 2.25 time: 0.280659 May 14 21:16:05.503763 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 766/1530] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:05 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1360 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:05.526803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.527442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 70c11e4b-dada-44e6-b5f5-09279f34f6b2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.538154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.538617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.542578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.543058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.602265 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] HTTP exception thrown: Instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 could not be found. May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Request method failure captured: May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 HTTP/1.1 May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtlKHQLokQNVdL5Ek1cMlP21Gjm3JBTA23XciYruFbw6LDOJci_0bCbE6xeuKRqz4UFHVrc2O1HvefZMm2W-azBn98r-Olxx3T2D9YitD_qbZaRamw2Ov4RJnB58JH386O43A5S7lPu0ok_s_fJgzLsnD2bF-ZFK2xhUT58J7-B4Pw May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:05.605745 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4af8109ce4a4e98a2e7104125651db0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 911b9cf4e9bc424bba387e2ff966cb46 May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 could not be found. May 14 21:16:05.618150 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '70c11e4b-dada-44e6-b5f5-09279f34f6b2'} May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 could not be found. May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:05.619285 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 could not be found. May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 could not be found. May 14 21:16:05.621239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.622671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Returning 404 to user: Instance 70c11e4b-dada-44e6-b5f5-09279f34f6b2 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:05.622671 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c5d1c90-00b1-40c0-96d3-6856e2698b16 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2" status: 404 len: 111 microversion: 2.1 time: 0.086507 May 14 21:16:05.622671 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 767/1531] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:05 2022] GET /compute/v2.1/servers/70c11e4b-dada-44e6-b5f5-09279f34f6b2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:16:05.624148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.624665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.631591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.631591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.632367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.636857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.649065 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] HTTP exception thrown: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Request method failure captured: May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 HTTP/1.1 May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtlKHQLokQNVdL5Ek1cMlP21Gjm3JBTA23XciYruFbw6LDOJci_0bCbE6xeuKRqz4UFHVrc2O1HvefZMm2W-azBn98r-Olxx3T2D9YitD_qbZaRamw2Ov4RJnB58JH386O43A5S7lPu0ok_s_fJgzLsnD2bF-ZFK2xhUT58J7-B4Pw May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:05.651641 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4af8109ce4a4e98a2e7104125651db0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 911b9cf4e9bc424bba387e2ff966cb46 May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.653084 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'dfe390af-35f4-4cf5-91c5-994e9c2dc488'} May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:05.653964 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.655557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.657297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Returning 404 to user: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:05.657297 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28f51c66-fc55-455a-88a2-8f57f41ace48 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 404 len: 111 microversion: 2.1 time: 0.032809 May 14 21:16:05.657297 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 768/1532] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:05 2022] DELETE /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:05.661815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.662447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: dfe390af-35f4-4cf5-91c5-994e9c2dc488] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.668969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.669441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.670396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.670987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.697431 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] HTTP exception thrown: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Request method failure captured: May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 HTTP/1.1 May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtlKHQLokQNVdL5Ek1cMlP21Gjm3JBTA23XciYruFbw6LDOJci_0bCbE6xeuKRqz4UFHVrc2O1HvefZMm2W-azBn98r-Olxx3T2D9YitD_qbZaRamw2Ov4RJnB58JH386O43A5S7lPu0ok_s_fJgzLsnD2bF-ZFK2xhUT58J7-B4Pw May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:05.700271 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4af8109ce4a4e98a2e7104125651db0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 911b9cf4e9bc424bba387e2ff966cb46 May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.702473 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'dfe390af-35f4-4cf5-91c5-994e9c2dc488'} May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:05.704866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. May 14 21:16:05.706374 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.707696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Returning 404 to user: Instance dfe390af-35f4-4cf5-91c5-994e9c2dc488 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:05.707696 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac9463dd-663c-445f-bb2b-79b92d0b4370 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488" status: 404 len: 111 microversion: 2.1 time: 0.049572 May 14 21:16:05.708517 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 769/1533] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:05 2022] GET /compute/v2.1/servers/dfe390af-35f4-4cf5-91c5-994e9c2dc488 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:05.719253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.720165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.733450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.733450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.733450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.733450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.743537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:05.755864 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52fc4f1e-9e5d-4296-b392-bccbd53fee38 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1468 microversion: 2.1 time: 0.362182 May 14 21:16:05.761446 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] HTTP exception thrown: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.761998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 765/1534] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:05 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1468 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Request method failure captured: May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 HTTP/1.1 May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBtlKHQLokQNVdL5Ek1cMlP21Gjm3JBTA23XciYruFbw6LDOJci_0bCbE6xeuKRqz4UFHVrc2O1HvefZMm2W-azBn98r-Olxx3T2D9YitD_qbZaRamw2Ov4RJnB58JH386O43A5S7lPu0ok_s_fJgzLsnD2bF-ZFK2xhUT58J7-B4Pw May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:05.763749 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4af8109ce4a4e98a2e7104125651db0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 911b9cf4e9bc424bba387e2ff966cb46 May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.765329 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '7e45e4ee-630a-46b5-81bc-8945dbcb4aa8'} May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:05.766214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.767879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:05.770817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Returning 404 to user: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:05.770817 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-daf03fcc-209f-495c-b6b2-63576ec8198f tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 404 len: 111 microversion: 2.1 time: 0.057274 May 14 21:16:05.770817 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 770/1535] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:05 2022] DELETE /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:05.778813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.779681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] [instance: 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.786389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.786991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.791342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:05.791342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:05.812755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] HTTP exception thrown: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Request method failure captured: May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 HTTP/1.1 May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBtlKHQLokQNVdL5Ek1cMlP21Gjm3JBTA23XciYruFbw6LDOJci_0bCbE6xeuKRqz4UFHVrc2O1HvefZMm2W-azBn98r-Olxx3T2D9YitD_qbZaRamw2Ov4RJnB58JH386O43A5S7lPu0ok_s_fJgzLsnD2bF-ZFK2xhUT58J7-B4Pw May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:16:05.814830 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e4af8109ce4a4e98a2e7104125651db0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e4af8109ce4a4e98a2e7104125651db0", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: e4af8109ce4a4e98a2e7104125651db0 May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1432404419 May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 911b9cf4e9bc424bba387e2ff966cb46 May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerDiskConfigTestJSON-1432404419-project May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.816407 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '7e45e4ee-630a-46b5-81bc-8945dbcb4aa8'} May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:05.817153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. May 14 21:16:05.818684 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:05.819780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] Returning 404 to user: Instance 7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:05.819780 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19539794-6476-4e12-b2b4-0279956d9871 tempest-ServerDiskConfigTestJSON-1432404419 tempest-ServerDiskConfigTestJSON-1432404419-project] 10.222.0.52 "GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8" status: 404 len: 111 microversion: 2.1 time: 0.041772 May 14 21:16:05.820738 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 766/1536] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:05 2022] GET /compute/v2.1/servers/7e45e4ee-630a-46b5-81bc-8945dbcb4aa8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:05.960490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a4178bbe-412b-436e-93df-979f432565c4 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7f64b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.987911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:05.988485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:05.999877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.006846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.010789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.014520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.072051 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a4178bbe-412b-436e-93df-979f432565c4 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.115917 May 14 21:16:06.079539 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 771/1537] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:05 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:06.243072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:06.244468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:06.261819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.262379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.263881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.265983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.314838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:06.324516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b74207f-4727-4e02-899f-373977c71907 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.340222 May 14 21:16:06.337031 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 767/1538] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:05 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:06.517758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:06.517758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:06.526928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.527386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.528206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.528649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.609425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:06.626978 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab96bc11-79c6-4d52-9c00-fe7bac3b2e27 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1474 microversion: 2.1 time: 0.384380 May 14 21:16:06.638209 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 772/1539] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:06 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1474 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:06.784910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:06.786648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:06.801614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.803551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.805722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:06.809448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:06.818250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:06.833668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:06.835267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:06.838860 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-698d1a7b-d991-4fb3-a980-1856080de0ac tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1360 microversion: 2.25 time: 0.326500 May 14 21:16:06.851763 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 768/1540] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:06 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1360 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:07.017297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:07.025845 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-52a53226-9928-42eb-b676-14de18125ea5 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1468 microversion: 2.1 time: 0.251505 May 14 21:16:07.027287 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 773/1541] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:06 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1468 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:07.085883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4d75db2-b80f-4e72-af73-644be8ee552f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7e691f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:07.136761 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4d75db2-b80f-4e72-af73-644be8ee552f tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.054868 May 14 21:16:07.142762 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 769/1542] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:07 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:07.346808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:07.349036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:07.356121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:07.356816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:07.357624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:07.358518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:07.413840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d53188a2-1053-4dae-b7f4-8fa5cd5117bf req-2dd54df6-5e97-4cd4-99d4-1eac8b35da9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "name": "network-vif-plugged", "status": "completed", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:07.429954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d53188a2-1053-4dae-b7f4-8fa5cd5117bf req-2dd54df6-5e97-4cd4-99d4-1eac8b35da9a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:07.430777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d53188a2-1053-4dae-b7f4-8fa5cd5117bf req-2dd54df6-5e97-4cd4-99d4-1eac8b35da9a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:07.452955 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d53188a2-1053-4dae-b7f4-8fa5cd5117bf req-2dd54df6-5e97-4cd4-99d4-1eac8b35da9a service nova] Creating event network-vif-plugged:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch2-master-1 May 14 21:16:07.459981 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d53188a2-1053-4dae-b7f4-8fa5cd5117bf req-2dd54df6-5e97-4cd4-99d4-1eac8b35da9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050655 May 14 21:16:07.461158 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 770/1543] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:16:07.530452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:07.543093 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df13063f-4aaa-4127-9239-9b8e05a82a73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.200370 May 14 21:16:07.543935 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 774/1544] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:07 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:07.646613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:07.647392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:07.657486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:07.657937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:07.658754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:07.659233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:07.823884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:07.832771 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-43407604-89f5-4635-acff-e3f6d1ebe571 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1474 microversion: 2.1 time: 0.190527 May 14 21:16:07.833719 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 771/1545] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:07 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1474 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:07.857979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:07.858724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:07.865654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:07.866439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:07.867520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:07.868835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:08.024311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:08.034107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:08.036078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:08.037796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b69eeab-ae10-4042-9bcb-9ef2bf279ad3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1360 microversion: 2.25 time: 0.184158 May 14 21:16:08.038923 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 775/1546] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:07 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:08.060858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:08.061731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:08.069444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:08.069909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:08.070770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:08.071152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:08.151182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dad113f5-32d6-4576-8e8b-3bd2d309db19 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7d32670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:08.210219 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dad113f5-32d6-4576-8e8b-3bd2d309db19 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.064117 May 14 21:16:08.211306 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 776/1547] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:08 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:08.272523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:08.285707 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad9a599c-9e04-4aab-947a-e7e49afe4003 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1468 microversion: 2.1 time: 0.231647 May 14 21:16:08.286753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 772/1548] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:08 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1468 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:08.560416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:08.561219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:08.569095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:08.569547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:08.570331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:08.570805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:08.720231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:08.727458 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0244a0f5-fbcd-4fed-8779-6e2a2071ef5d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 0.171060 May 14 21:16:08.728098 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 777/1549] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:08 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:08.850452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:08.851294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:08.860800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:08.861468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:08.862450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:08.863060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:09.038804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:09.053176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb7e166a-681e-4530-9a88-a60ddb2f3e0c tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1474 microversion: 2.1 time: 0.203840 May 14 21:16:09.053176 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 773/1550] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:08 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1474 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:09.066361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:09.066984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:09.077424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:09.085460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:09.085460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:09.085460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:09.224546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26d9e03b-a5c8-4de5-8fb1-f69b00d425e4 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7e7b8b0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:09.268476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:09.281612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:09.283426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:09.284591 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf449a2e-05f0-42df-b487-8ea89c7a0215 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1360 microversion: 2.25 time: 0.222740 May 14 21:16:09.289876 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 778/1551] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:09 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1360 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:09.306085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:09.308002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:09.316490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:09.317218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:09.318211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:09.318877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:09.328948 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26d9e03b-a5c8-4de5-8fb1-f69b00d425e4 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.106646 May 14 21:16:09.328948 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 774/1552] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:09 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:09.477642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7de91cf7-a522-4bec-b8e9-1a3e7adfda3c req-2dd0c45b-a5d3-4456-921d-6a801caefe24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f45dd-b0ff-4097-8de4-b6ffc68de7d9", "name": "network-vif-unplugged", "status": "completed", "tag": "ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:09.499401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7de91cf7-a522-4bec-b8e9-1a3e7adfda3c req-2dd0c45b-a5d3-4456-921d-6a801caefe24 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:09.499902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7de91cf7-a522-4bec-b8e9-1a3e7adfda3c req-2dd0c45b-a5d3-4456-921d-6a801caefe24 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:09.516997 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7de91cf7-a522-4bec-b8e9-1a3e7adfda3c req-2dd0c45b-a5d3-4456-921d-6a801caefe24 service nova] Creating event network-vif-unplugged:ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa for instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 on nch2-master-1 May 14 21:16:09.522821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7de91cf7-a522-4bec-b8e9-1a3e7adfda3c req-2dd0c45b-a5d3-4456-921d-6a801caefe24 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048986 May 14 21:16:09.527046 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 775/1553] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:09.536707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:09.547664 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a05fcd03-7e3e-4d9b-94f0-23d0b04f1056 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1468 microversion: 2.1 time: 0.245125 May 14 21:16:09.548624 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 779/1554] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:09 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1468 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:09.746143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:09.746869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:09.769340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:09.770712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:09.772625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:09.774178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:10.071220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:10.075665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:10.088068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:10.089095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:10.090292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:10.094613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:10.395701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:10.405417 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-79705e5d-b822-452a-8eff-59e16a693a11 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1474 microversion: 2.1 time: 0.338925 May 14 21:16:10.416041 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 780/1555] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:10 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1474 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:10.421440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:10.427571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:10.429327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:10.429972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:10.430969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:10.432141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:10.746252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:10.757646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:10.760609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:10.762021 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1bfca3e1-8eaf-4b54-b1b1-17d52718e516 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1360 microversion: 2.25 time: 0.344609 May 14 21:16:10.762835 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 781/1556] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:10 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1360 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:10.789420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46a9ec85-0304-49ef-b372-ac3d260f1038 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7d32ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:10.851456 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-46a9ec85-0304-49ef-b372-ac3d260f1038 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.087009 May 14 21:16:10.852861 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 782/1557] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:10 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:10.858261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:10.859130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:10.866030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:10.866491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:10.867516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:10.868207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.120806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:11.136583 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e1bff08e-87c7-45e2-bc7f-7affa3737cd2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1313 microversion: 2.1 time: 1.395584 May 14 21:16:11.139562 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 776/1558] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:09 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1313 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:11.156679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:11.157333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f38edadd-e360-4456-89eb-f920543ab05b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:11.159693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f38edadd-e360-4456-89eb-f920543ab05b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:11.160828 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-665bb172-e401-4f88-8806-b45f5a2e81ea tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 200 len: 1468 microversion: 2.1 time: 0.306688 May 14 21:16:11.163304 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 783/1559] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:10 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:11.176775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f38edadd-e360-4456-89eb-f920543ab05b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.177348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f38edadd-e360-4456-89eb-f920543ab05b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.178293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f38edadd-e360-4456-89eb-f920543ab05b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.178855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f38edadd-e360-4456-89eb-f920543ab05b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.424165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:11.424822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:11.435449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.436152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.438131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.438593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.452743 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f38edadd-e360-4456-89eb-f920543ab05b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1691 microversion: 2.1 time: 0.311495 May 14 21:16:11.457486 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 777/1560] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:11 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1691 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:11.474078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:11.475296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:11.482114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.482576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.483609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.484221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.514062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lazy-loading 'flavor' on Instance uuid 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:11.533972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Going to try to live migrate instance to nch1-master-1 {{(pid=130637) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:16:11.580936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd53fb02767e4912bd762fa7d1e80a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '366727f0fe304593ae0a789b2f0eb0b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:11.594156 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cc3ebbe3-aa28-4a87-a6a0-8c461ff65fdf tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 200 len: 1432 microversion: 2.1 time: 0.174316 May 14 21:16:11.608127 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 784/1561] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:11 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 1432 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:11.614625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-95f966fc-fb99-438c-b812-acb7418d6ab3 req-d1e8609f-da13-4bb3-bbbe-99040ac1d679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1490939f-5892-4d71-8262-69f0148d55d2", "name": "network-vif-plugged", "status": "completed", "tag": "0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:11.625578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-95f966fc-fb99-438c-b812-acb7418d6ab3 req-d1e8609f-da13-4bb3-bbbe-99040ac1d679 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.626089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-95f966fc-fb99-438c-b812-acb7418d6ab3 req-d1e8609f-da13-4bb3-bbbe-99040ac1d679 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.652290 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-95f966fc-fb99-438c-b812-acb7418d6ab3 req-d1e8609f-da13-4bb3-bbbe-99040ac1d679 service nova] Creating event network-vif-plugged:0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720 for instance 1490939f-5892-4d71-8262-69f0148d55d2 on nch1-master-1 May 14 21:16:11.668641 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-95f966fc-fb99-438c-b812-acb7418d6ab3 req-d1e8609f-da13-4bb3-bbbe-99040ac1d679 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058993 May 14 21:16:11.669312 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 785/1562] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:11.784817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:11.785667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:11.800007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.801830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:11.806064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:11.808739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:12.093656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:12.104241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:12.112737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:12.122050 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e3c611e0-e912-4ad1-bac4-490fe55b1c56 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1360 microversion: 2.25 time: 0.345376 May 14 21:16:12.132982 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 786/1563] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:11 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1360 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:12.143658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1f70995c-03f6-4068-9ce7-29bfa09bbc6b req-52bd29be-1fb4-4597-b75a-9bee0739b58c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b557786f-467b-4f39-b283-7c798215ba18", "name": "network-vif-deleted", "tag": "cd79d740-e7bf-4fb9-a20e-1e35700ba976"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:12.153101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1f70995c-03f6-4068-9ce7-29bfa09bbc6b req-52bd29be-1fb4-4597-b75a-9bee0739b58c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:12.153834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1f70995c-03f6-4068-9ce7-29bfa09bbc6b req-52bd29be-1fb4-4597-b75a-9bee0739b58c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:12.191180 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1f70995c-03f6-4068-9ce7-29bfa09bbc6b req-52bd29be-1fb4-4597-b75a-9bee0739b58c service nova] Creating event network-vif-deleted:cd79d740-e7bf-4fb9-a20e-1e35700ba976 for instance b557786f-467b-4f39-b283-7c798215ba18 on nch2-master-1 May 14 21:16:12.206466 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1f70995c-03f6-4068-9ce7-29bfa09bbc6b req-52bd29be-1fb4-4597-b75a-9bee0739b58c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071796 May 14 21:16:12.207015 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 787/1564] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:12.213021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41a20178-6d25-4a81-85d4-d39fb957ac5c tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7fa38b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:12.276332 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-41a20178-6d25-4a81-85d4-d39fb957ac5c tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.068017 May 14 21:16:12.277396 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 788/1565] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:12 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:12.518356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1093420348", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "728ce14a-92e3-4451-985e-e41013ccefc6"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:12.610496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] validate_networks() for [('728ce14a-92e3-4451-985e-e41013ccefc6', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:16:13.157531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:16:13.158149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:16:13.159772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:16:13.160605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:16:13.161455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:16:13.175554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.176266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.177221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.177737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.197512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Getting quotas for project ac56d68252fb4633b27be1d5f4a18d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:13.208600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Getting quotas for user 33cf6f96b2ef4a3bb222abf3ce89c2fb and project ac56d68252fb4633b27be1d5f4a18d0b. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:13.224511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:16:13.232550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:16:13.396155 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9be6302f-d0c0-49de-b75d-35565edc0bcc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.117111 May 14 21:16:13.397165 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 789/1566] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:16:13.404214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:13.412229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:13.418168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.419150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.423936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.424961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.673590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:13.686512 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-979231cd-2a1b-4406-a3c1-45512b1aac73 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1462 microversion: 2.1 time: 0.287942 May 14 21:16:13.699670 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 790/1567] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:13 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1462 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:13.706992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:13.706992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: f17f45dd-b0ff-4097-8de4-b6ffc68de7d9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:13.716693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.717414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.718964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.719606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.740391 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] HTTP exception thrown: Instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 could not be found. May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Request method failure captured: May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 HTTP/1.1 May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuYOIjdw0OQqOgu3EI9EnSDIkrtnHsDnY-wr4vmnJXE_GhIkXdd_YmtUQWXR8_juEvbkau_SYH0XBpMjvdm8SyzrDzkQHdsywyBsjqh-UrmuBDQicIXVEF76vkEcaaejK80mh5kVMp1ssC16DM6L_24bcZohOD_qGrAVZEjPdslnHY May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 873c930e94574326a2aa94a76fda4f0d May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminTestJSON-209151334 May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:13.746804 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_873c930e94574326a2aa94a76fda4f0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminTestJSON-209151334 May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 873c930e94574326a2aa94a76fda4f0d May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminTestJSON-209151334 May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminTestJSON-209151334-project May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 3a998f4a4cc94a63ac7e939ffdb10917 May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminTestJSON-209151334-project May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 could not be found. May 14 21:16:13.748749 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'f17f45dd-b0ff-4097-8de4-b6ffc68de7d9'} May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 could not be found. May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:13.749708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 could not be found. May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 could not be found. May 14 21:16:13.751326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.753186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Returning 404 to user: Instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:13.753186 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-23d01a1c-5056-4f75-bcf9-b37fe3d6c061 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9" status: 404 len: 111 microversion: 2.1 time: 0.042620 May 14 21:16:13.753186 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 791/1568] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:13 2022] GET /compute/v2.1/servers/f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:13.754034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:13.754963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] [instance: b557786f-467b-4f39-b283-7c798215ba18] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:13.769779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.769779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.769779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.769779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.784487 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] HTTP exception thrown: Instance b557786f-467b-4f39-b283-7c798215ba18 could not be found. May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Request method failure captured: May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 HTTP/1.1 May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuRlbeE5FOI1lKp-jaQMHTSczW1QzaQu7AcIt6Hsa4xjTp81xpiSP7GQn082nV9Py7fUPHiNPoz1RaneYkoAQYrIQrpLNYL0ovGus5xeQ9n-qbKv8bc9YoWBn6oYMzdcq8gNbBmMKmUzBZy59eDF_OH2n1CIGrp2R-83YICmKLZxfo May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 366727f0fe304593ae0a789b2f0eb0b2 May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListImageFiltersTestJSON-1165058219 May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:13.786070 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/366727f0fe304593ae0a789b2f0eb0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/366727f0fe304593ae0a789b2f0eb0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/366727f0fe304593ae0a789b2f0eb0b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_366727f0fe304593ae0a789b2f0eb0b2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListImageFiltersTestJSON-1165058219 May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 366727f0fe304593ae0a789b2f0eb0b2 May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1165058219 May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListImageFiltersTestJSON-1165058219-project May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: dd53fb02767e4912bd762fa7d1e80a06 May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListImageFiltersTestJSON-1165058219-project May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b557786f-467b-4f39-b283-7c798215ba18 could not be found. May 14 21:16:13.787716 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b557786f-467b-4f39-b283-7c798215ba18'} May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b557786f-467b-4f39-b283-7c798215ba18 could not be found. May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:13.788509 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b557786f-467b-4f39-b283-7c798215ba18 could not be found. May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b557786f-467b-4f39-b283-7c798215ba18 could not be found. May 14 21:16:13.791542 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:13.799851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Returning 404 to user: Instance b557786f-467b-4f39-b283-7c798215ba18 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:13.799851 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4dd1d881-0508-4bdd-ab40-1d02bd9d700a tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18" status: 404 len: 111 microversion: 2.1 time: 0.040780 May 14 21:16:13.799851 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 792/1569] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:13 2022] GET /compute/v2.1/servers/b557786f-467b-4f39-b283-7c798215ba18 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:13.799851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:13.799851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:13.801756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.802511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.803143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:13.803689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:13.975862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:13.984445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:13.985964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:13.987134 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-299a3a2e-380d-41ac-bf57-32b72431a741 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1556 microversion: 2.25 time: 0.198175 May 14 21:16:13.987742 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 793/1570] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:13 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:13.992393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5785718c-b16d-4002-8e07-be1c4555170e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a796cc10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:14.045440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5785718c-b16d-4002-8e07-be1c4555170e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.056665 May 14 21:16:14.046013 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 794/1571] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:13 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:14.050724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd35c031-5d76-4219-90f0-c373889b292d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:14.051338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd35c031-5d76-4219-90f0-c373889b292d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:14.105987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd35c031-5d76-4219-90f0-c373889b292d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:14.113412 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd35c031-5d76-4219-90f0-c373889b292d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1217 microversion: 2.1 time: 0.066386 May 14 21:16:14.113993 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 795/1572] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:14 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:14.118297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e1072ed1-a758-4499-b062-2e7cf7bfb3e2 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:14.119471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e1072ed1-a758-4499-b062-2e7cf7bfb3e2 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:14.125385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1072ed1-a758-4499-b062-2e7cf7bfb3e2 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:14.125838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1072ed1-a758-4499-b062-2e7cf7bfb3e2 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:14.126710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1072ed1-a758-4499-b062-2e7cf7bfb3e2 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:14.127132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1072ed1-a758-4499-b062-2e7cf7bfb3e2 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:14.264730 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e1072ed1-a758-4499-b062-2e7cf7bfb3e2 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1613 microversion: 2.1 time: 0.149654 May 14 21:16:14.265464 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 796/1573] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:14 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1613 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:14.270768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:14.271277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:14.278051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:14.278472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:14.279285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:14.279792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:14.312164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:14.721624 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7592d640-ee78-4db7-9604-2a1b366ec2c7 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 204 len: 0 microversion: 2.1 time: 0.454863 May 14 21:16:14.722228 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 797/1574] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:14 2022] DELETE /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:14.727690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c6e1b36-5f35-4d66-9d0f-8e014613096e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7fd7ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:15.102040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09c9a0ec-ea97-4263-84d2-50374d0a77fc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/action" status: 202 len: 0 microversion: 2.1 time: 3.632420 May 14 21:16:15.108034 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 778/1575] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:16:11 2022] POST /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/action => generated 0 bytes in 3639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:16:15.113776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:15.115240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:15.123117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:15.124476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:15.125552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:15.126375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:15.334995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 1490939f-5892-4d71-8262-69f0148d55d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:15.358665 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3bf7251-11b4-45a7-8d29-b02dca098271 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 2047 microversion: 2.25 time: 0.248986 May 14 21:16:15.359616 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 779/1576] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:15 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 2047 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:15.367393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6268525b-7deb-4738-aebe-6c49cc3fb468 req-70dce910-f615-4606-a583-af43d7a4b462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f17f45dd-b0ff-4097-8de4-b6ffc68de7d9", "name": "network-vif-deleted", "tag": "ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:15.377743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6268525b-7deb-4738-aebe-6c49cc3fb468 req-70dce910-f615-4606-a583-af43d7a4b462 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:15.378412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6268525b-7deb-4738-aebe-6c49cc3fb468 req-70dce910-f615-4606-a583-af43d7a4b462 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:15.392081 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6268525b-7deb-4738-aebe-6c49cc3fb468 req-70dce910-f615-4606-a583-af43d7a4b462 service nova] Creating event network-vif-deleted:ff34d131-6ab2-4ef5-a6c0-a47a6d4767fa for instance f17f45dd-b0ff-4097-8de4-b6ffc68de7d9 on nch2-master-1 May 14 21:16:15.399181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6268525b-7deb-4738-aebe-6c49cc3fb468 req-70dce910-f615-4606-a583-af43d7a4b462 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038115 May 14 21:16:15.400854 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 780/1577] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:15.408112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:15.408869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:15.416006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:15.418084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:15.418084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:15.418084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:15.525163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9847c635058343c096bb44d95e70bc82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a4ed51cf6684302bed4497b2547ef09', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:15.525910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] flavor_id is None. Assuming migration. {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4142}} May 14 21:16:15.526363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 21:16:15.749977 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c6e1b36-5f35-4d66-9d0f-8e014613096e tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/images/aef3c5ec-81bc-420b-90f6-474e1c9bcd01" status: 204 len: 0 microversion: 2.1 time: 1.026441 May 14 21:16:15.751933 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 798/1578] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:14 2022] DELETE /compute/v2.1/images/aef3c5ec-81bc-420b-90f6-474e1c9bcd01 => generated 0 bytes in 1029 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:15.763610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:15.769306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:15.791136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:15.791782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:15.792666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:15.793119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:15.983057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:15.994861 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c6c1ac6-e513-4dd8-bd4a-cbf312762ca0 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1470 microversion: 2.1 time: 0.241575 May 14 21:16:15.995935 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 799/1579] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:15 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1470 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:16.001156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba2bd6c5-e01f-4855-a83b-d8f0a15cd338 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a795b8b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:16.068449 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba2bd6c5-e01f-4855-a83b-d8f0a15cd338 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.071135 May 14 21:16:16.069203 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 800/1580] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:15 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:16.075974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:16.078003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:16.083901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.084690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:16.085756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.086277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:16.158072 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01c7654a-7f5e-4b7f-b8b2-7c4e2e392a19 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820/action" status: 202 len: 0 microversion: 2.1 time: 0.755319 May 14 21:16:16.159057 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 781/1581] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:16:15 2022] POST /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820/action => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:16:16.164421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:16.165897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:16.177644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.178382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:16.179405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.180052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:16.272068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:16.282628 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96b2f9c9-b2f1-46e3-8d12-05c7e87ac9f0 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1221 microversion: 2.1 time: 0.120658 May 14 21:16:16.282771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:16.291802 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 782/1582] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:16 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1221 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:16.295997 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07a81106-b03c-4b57-94dd-6f671850f940 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.225707 May 14 21:16:16.297705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:16.298510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:16.305170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.305984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:16.307601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.308015 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 801/1583] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:16 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:16.308476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:16.313740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-38c1fa73-3987-4e07-adfd-841f0024f0f7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1a7ba5ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:16.605138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 1490939f-5892-4d71-8262-69f0148d55d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:16.635251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9287e2f4-7dca-4489-9cea-0592d048f6ca tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 2047 microversion: 2.25 time: 0.341811 May 14 21:16:16.636804 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 783/1584] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:16 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 2047 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:16.641983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:16.643216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:16.652616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.653502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:16.653836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:16.654276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.037727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:17.072749 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d68cfd33-a3a3-484e-ae3d-816a1bfd7112 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1471 microversion: 2.1 time: 0.433761 May 14 21:16:17.074514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 784/1585] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:16 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:17.100676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1592d51-caf3-4f13-be97-31c081f50de8 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:17.112701 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:16:17.112701 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:16:17.112701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1592d51-caf3-4f13-be97-31c081f50de8 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.113027 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-38c1fa73-3987-4e07-adfd-841f0024f0f7 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/images/8b467e47-8342-4ff2-997c-461ff005f495" status: 204 len: 0 microversion: 2.1 time: 0.801164 May 14 21:16:17.113451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1592d51-caf3-4f13-be97-31c081f50de8 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.113550 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 802/1586] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:16 2022] DELETE /compute/v2.1/images/8b467e47-8342-4ff2-997c-461ff005f495 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:17.113666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1592d51-caf3-4f13-be97-31c081f50de8 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.113993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1592d51-caf3-4f13-be97-31c081f50de8 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.120918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:17.123097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:17.149483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.151289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.153249 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d1592d51-caf3-4f13-be97-31c081f50de8 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.076590 May 14 21:16:17.153395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.154307 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 785/1587] 10.222.0.52 () {60 vars in 1216 bytes} [Sat May 14 21:16:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:16:17.159881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6aca058f-9ed1-4d39-9b47-4d2b647d5b26 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a78f2040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:17.163283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.224463 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6aca058f-9ed1-4d39-9b47-4d2b647d5b26 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.068764 May 14 21:16:17.225133 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 786/1588] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:17 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:17.239879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb061476-9d35-4c24-9686-b191a241e092 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] Calling method '.version_select at 0x7fb1b42189d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:17.469541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:17.479608 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-588b962f-b1e0-4542-ae9b-c64365e2900a tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1470 microversion: 2.1 time: 0.366191 May 14 21:16:17.481176 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 803/1589] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:17 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1470 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:17.487261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d4aee3b5-3852-41b8-9bde-b1be12e2e30d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:17.533900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d4aee3b5-3852-41b8-9bde-b1be12e2e30d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:17.542763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4aee3b5-3852-41b8-9bde-b1be12e2e30d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.543225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4aee3b5-3852-41b8-9bde-b1be12e2e30d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.547850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4aee3b5-3852-41b8-9bde-b1be12e2e30d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.550736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4aee3b5-3852-41b8-9bde-b1be12e2e30d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.949940 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d4aee3b5-3852-41b8-9bde-b1be12e2e30d tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2/action" status: 202 len: 0 microversion: 2.25 time: 0.467255 May 14 21:16:17.951139 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 804/1590] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:16:17 2022] POST /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:17.963602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:17.964352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:17.973588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.974059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:17.976501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:17.976501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.092517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:18.120611 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bcc2c535-12fb-4064-bc27-b4366f4b339e tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1277 microversion: 2.1 time: 0.153738 May 14 21:16:18.124162 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 805/1591] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:17 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:18.129302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:18.140296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:18.163092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.163834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.164821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.166090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.326728 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb061476-9d35-4c24-9686-b191a241e092 tempest-ListImageFiltersTestJSON-1165058219 tempest-ListImageFiltersTestJSON-1165058219-project] 10.222.0.52 "DELETE /compute/v2.1/images/f5eee2ef-12ac-4531-b286-1480d248c3db" status: 204 len: 0 microversion: 2.1 time: 1.090583 May 14 21:16:18.337861 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 787/1592] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:17 2022] DELETE /compute/v2.1/images/f5eee2ef-12ac-4531-b286-1480d248c3db => generated 0 bytes in 1108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:18.350499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-39101c5e-f7de-4854-8949-52ba05e787a8 req-49c90513-cae1-4e1c-9adc-196067ac5ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eef68d3-09e1-45d5-8cec-2e5649628310", "name": "network-vif-deleted", "tag": "98713c9a-6a3b-4530-a828-26ae7e23cc8f"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:18.373057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-39101c5e-f7de-4854-8949-52ba05e787a8 req-49c90513-cae1-4e1c-9adc-196067ac5ea5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.373520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-39101c5e-f7de-4854-8949-52ba05e787a8 req-49c90513-cae1-4e1c-9adc-196067ac5ea5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.407231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-39101c5e-f7de-4854-8949-52ba05e787a8 req-49c90513-cae1-4e1c-9adc-196067ac5ea5 service nova] Creating event network-vif-deleted:98713c9a-6a3b-4530-a828-26ae7e23cc8f for instance 6eef68d3-09e1-45d5-8cec-2e5649628310 on nch1-master-1 May 14 21:16:18.415522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-39101c5e-f7de-4854-8949-52ba05e787a8 req-49c90513-cae1-4e1c-9adc-196067ac5ea5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075340 May 14 21:16:18.418265 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 788/1593] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:18.422901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:18.424135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:18.425042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:18.438714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.439872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.440959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.442017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.455471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37b58a0d-9a05-4ec0-8e4b-e5c2d130ad09 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.313818 May 14 21:16:18.470538 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 806/1594] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:18 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:18.485063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:18.487850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:18.503961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.505417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.505546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.506077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.795342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 1490939f-5892-4d71-8262-69f0148d55d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:18.814125 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8950dd8-cb1c-4840-88f4-e13b2e71ed9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 2052 microversion: 2.25 time: 0.393928 May 14 21:16:18.848200 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 789/1595] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:18 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 2052 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:18.848200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c037f3b5-5399-4c1e-8d8f-dad252f59e05 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7e69310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:18.858692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:18.869706 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a53583a-a013-4ea1-857d-544937fd1f8b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1471 microversion: 2.1 time: 0.397706 May 14 21:16:18.870784 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 807/1596] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:18 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1471 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:18.876619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:18.877252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:18.890263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.890732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.891688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.892144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.905022 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c037f3b5-5399-4c1e-8d8f-dad252f59e05 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.087950 May 14 21:16:18.913772 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 790/1597] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:18 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:18.941379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:18.941379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:18.941379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lazy-loading 'fault' on Instance uuid 6eef68d3-09e1-45d5-8cec-2e5649628310 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:19.004889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:19.014898 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-afc1970f-0506-4e59-92ab-ce5a0cf4137d tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 200 len: 1304 microversion: 2.1 time: 0.143037 May 14 21:16:19.027804 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 808/1598] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:18 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:19.170460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:19.171807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:19.184980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.197322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:19.198486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.201492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:19.468928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:19.471183 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5ba2e355-de6d-4dde-8d46-40188d4851cd tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.329701 May 14 21:16:19.471807 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 791/1599] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:19 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:19.474995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:19.475655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:19.483678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.484171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:19.484962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.485456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:19.645151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:19.655995 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-80029255-cf5d-4bda-8f58-460cd6589ff5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.185027 May 14 21:16:19.659333 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 809/1600] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:19 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:19.833857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:19.834964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:19.854004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.854975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:19.856044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.856727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:19.888365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:19.889275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:19.897626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.898371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:19.900067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:19.901404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.075382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:20.083284 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e65db3dd-670d-4afd-ad2a-c5c6b62836ad tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1471 microversion: 2.1 time: 0.200032 May 14 21:16:20.084407 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 810/1601] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:19 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:20.089461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f9a7695-71f2-4a0d-903e-acbcf8698904 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a794d040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:20.155512 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6f9a7695-71f2-4a0d-903e-acbcf8698904 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1429 microversion: 2.1 time: 0.068483 May 14 21:16:20.161232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 811/1602] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:20 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1429 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:20.168536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:20.174539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 6eef68d3-09e1-45d5-8cec-2e5649628310] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:20.190532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.195196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.199017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.201553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.232699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] HTTP exception thrown: Instance 6eef68d3-09e1-45d5-8cec-2e5649628310 could not be found. May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Request method failure captured: May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 HTTP/1.1 May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuYOIjdw0OQqOgu3EI9EnSDIkrtnHsDnY-wr4vmnJXE_GhIkXdd_YmtUQWXR8_juEvbkau_SYH0XBpMjvdm8SyzrDzkQHdsywyBsjqh-UrmuBDQicIXVEF76vkEcaaejK80mh5kVMp1ssC16DM6L_24bcZohOD_qGrAVZEjPdslnHY May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 873c930e94574326a2aa94a76fda4f0d May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminTestJSON-209151334 May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:20.236709 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_873c930e94574326a2aa94a76fda4f0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminTestJSON-209151334 May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 873c930e94574326a2aa94a76fda4f0d May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminTestJSON-209151334 May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminTestJSON-209151334-project May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 3a998f4a4cc94a63ac7e939ffdb10917 May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminTestJSON-209151334-project May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 6eef68d3-09e1-45d5-8cec-2e5649628310 could not be found. May 14 21:16:20.238220 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6eef68d3-09e1-45d5-8cec-2e5649628310'} May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eef68d3-09e1-45d5-8cec-2e5649628310 could not be found. May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:20.239037 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eef68d3-09e1-45d5-8cec-2e5649628310 could not be found. May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eef68d3-09e1-45d5-8cec-2e5649628310 could not be found. May 14 21:16:20.240482 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:20.244267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Returning 404 to user: Instance 6eef68d3-09e1-45d5-8cec-2e5649628310 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:20.246435 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-afe5c388-eab3-4c92-85a3-28819f5c9636 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310" status: 404 len: 111 microversion: 2.1 time: 0.081941 May 14 21:16:20.247892 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 812/1603] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:20 2022] GET /compute/v2.1/servers/6eef68d3-09e1-45d5-8cec-2e5649628310 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:20.256859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:20.257683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:20.265167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.266064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.267948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.268649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.302064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:20.405277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 1490939f-5892-4d71-8262-69f0148d55d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:20.420767 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e4c7c6a-9578-405c-a368-3a6d362f7060 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 2032 microversion: 2.25 time: 0.591257 May 14 21:16:20.452760 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 792/1604] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:19 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 2032 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:20.457767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:20.458960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:20.466135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.466903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.467897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.472132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.503221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'flavor' on Instance uuid 1490939f-5892-4d71-8262-69f0148d55d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:20.517947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Going to try to live migrate instance to nch2-master-1 {{(pid=130637) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:16:20.814184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c8f0871-9b8e-49af-bbfb-59bb791f1a12 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 204 len: 0 microversion: 2.1 time: 0.562169 May 14 21:16:20.816732 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 813/1605] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:20 2022] DELETE /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:20.827877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:20.828674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:20.835386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.835953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:20.836926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:20.839242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.004935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:21.014071 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f90454b-1b3e-4eff-85fb-fe8a38a8c07a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.195844 May 14 21:16:21.015012 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 814/1606] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:20 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:21.019003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:21.019655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:21.025705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.026163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.026950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.027606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.179442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:21.189341 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98048314-1efb-4ce5-ad45-96972b0aa785 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.173673 May 14 21:16:21.190041 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 815/1607] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:21 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:21.203279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:21.204258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:21.213427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.214262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.215467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.216370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.364159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:21.372839 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02abf6c6-2ea9-4317-9782-9c8c660a9e34 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1469 microversion: 2.1 time: 0.181053 May 14 21:16:21.373410 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 816/1608] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:21 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1469 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:21.380302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:21.383493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:21.395381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.395889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.396717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.397164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.546669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:21.554345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ebe8dc32-6f61-4639-bf8e-e79b87c005d7 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1471 microversion: 2.1 time: 0.178442 May 14 21:16:21.554951 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 817/1609] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:21 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1471 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:21.561425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-997bbdac-510a-4221-9702-a67586ab3d91 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7d05dc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:21.608873 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-997bbdac-510a-4221-9702-a67586ab3d91 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1438 microversion: 2.1 time: 0.052891 May 14 21:16:21.615963 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 818/1610] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:21 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1438 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:21.734034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c203ee96-5f5a-47c8-98f0-46b939b55466 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1a796c820>, body: {"keypair": {"name": "tempest-keypair-1383997293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMagN/lB9jui+Y7a91G74XTOmliRjZ0m5DNPmu+FWUSmSaXAHesEu579rTZL9QYxgjVqNB3dBM/LMngilu0DSQ5PrNnn5/kAYX+Q97WzPAkfK6TBz0WoFFRaImWXllEaaA=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:21.748540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c203ee96-5f5a-47c8-98f0-46b939b55466 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:21.760314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c203ee96-5f5a-47c8-98f0-46b939b55466 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:21.831965 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c203ee96-5f5a-47c8-98f0-46b939b55466 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.221196 May 14 21:16:21.832639 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 819/1611] 10.222.0.52 () {62 vars in 1198 bytes} [Sat May 14 21:16:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 222 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 14 21:16:21.837683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fd253bb2-3cfa-4ea8-a11b-72a9777875f4 req-dcb068ba-1999-4e78-ac81-5935460b7e0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6327b6-a740-471d-96bf-3a0dbc85214f", "tag": "a5262f93-1b5b-41b9-80c4-429291bd7755"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:21.846968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fd253bb2-3cfa-4ea8-a11b-72a9777875f4 req-dcb068ba-1999-4e78-ac81-5935460b7e0e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.847426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fd253bb2-3cfa-4ea8-a11b-72a9777875f4 req-dcb068ba-1999-4e78-ac81-5935460b7e0e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.862792 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fd253bb2-3cfa-4ea8-a11b-72a9777875f4 req-dcb068ba-1999-4e78-ac81-5935460b7e0e service nova] Creating event network-changed:a5262f93-1b5b-41b9-80c4-429291bd7755 for instance 8c6327b6-a740-471d-96bf-3a0dbc85214f on nch1-master-1 May 14 21:16:21.867879 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fd253bb2-3cfa-4ea8-a11b-72a9777875f4 req-dcb068ba-1999-4e78-ac81-5935460b7e0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034009 May 14 21:16:21.868873 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 820/1612] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:21.874239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84b6e111-3738-4895-92ea-ab09a8945c4c tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7fcb3a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:21.920428 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84b6e111-3738-4895-92ea-ab09a8945c4c tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 200 len: 1438 microversion: 2.1 time: 0.050144 May 14 21:16:21.921267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 821/1613] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:21 2022] GET /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 1438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:21.926059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-454d69a4-1c33-491d-9cd8-ffb957426535 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a78af0d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:21.945693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-454d69a4-1c33-491d-9cd8-ffb957426535 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1383997293" status: 200 len: 512 microversion: 2.2 time: 0.023030 May 14 21:16:21.946913 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 822/1614] 10.222.0.52 () {60 vars in 1257 bytes} [Sat May 14 21:16:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1383997293 => generated 512 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:21.951658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:21.952406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:21.959417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.964077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:21.964077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:21.964077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:22.105893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:22.108776 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b0e61ba-9c1f-45c3-a555-99d581142f62 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1467 microversion: 2.1 time: 0.161391 May 14 21:16:22.109348 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 823/1615] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:21 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1467 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:22.116809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3689bdcb-32dd-4312-a6dd-dbb29be82ac8 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1b434fee0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:22.200137 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3689bdcb-32dd-4312-a6dd-dbb29be82ac8 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383997293" status: 204 len: 0 microversion: 2.2 time: 0.087330 May 14 21:16:22.205355 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 824/1616] 10.222.0.52 () {60 vars in 1260 bytes} [Sat May 14 21:16:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383997293 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:22.210042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:22.210680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:22.217919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:22.220392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:22.220392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:22.220392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:22.358329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:22.365966 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd835a79-bbcf-4c44-b22c-dfab6f593126 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.164227 May 14 21:16:22.366873 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 825/1617] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:22 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:22.373120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-557c2265-f303-422b-886e-0f2d8c644f46 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1b539f820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:23.610622 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-557c2265-f303-422b-886e-0f2d8c644f46 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "DELETE /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e" status: 204 len: 0 microversion: 2.1 time: 1.237680 May 14 21:16:23.610622 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 826/1618] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:22 2022] DELETE /compute/v2.1/images/2f9a6053-8593-4689-8643-c167b00e2d6e => generated 0 bytes in 1239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:23.611432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:23.612079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:23.619215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:23.619703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:23.620536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:23.620982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:23.771384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:23.780515 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b090f5ad-bb00-4bf2-ac5d-c480e6e63c92 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.172835 May 14 21:16:23.781110 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 827/1619] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:23 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:23.795171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aec769dc-6076-41fc-b0f3-d923d23eb682 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1b539fb80>, body: {"keypair": {"name": "tempest-keypair-1225051796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNE+Mq0ZbgPfbB4e8npqgBsgFVkuAU9fbWmi/g+l8pXY7eh43Spfm4UdNgt0k6aIyYOEc+/zUGvOi53JIzbJI1ftJl7moDQQuQ/E+pSCjM95tEjw+nMi+lvRsKRtXUFiGA=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:23.811050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-aec769dc-6076-41fc-b0f3-d923d23eb682 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:23.816545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-aec769dc-6076-41fc-b0f3-d923d23eb682 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:23.914418 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aec769dc-6076-41fc-b0f3-d923d23eb682 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.123112 May 14 21:16:23.916546 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 828/1620] 10.222.0.52 () {62 vars in 1198 bytes} [Sat May 14 21:16:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 14 21:16:23.921104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:23.922070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:23.930037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:23.930037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:23.930037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:23.930382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:23.963705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:23.964164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:23.964619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lazy-loading 'fault' on Instance uuid 0682771c-4855-4853-9123-f03aa17b7b53 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:24.006923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a998f4a4cc94a63ac7e939ffdb10917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873c930e94574326a2aa94a76fda4f0d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:24.015043 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9eec1563-7419-481e-bfbc-1c9764c6856f tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 200 len: 1303 microversion: 2.1 time: 0.097719 May 14 21:16:24.015641 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 829/1621] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:23 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:24.020651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.021255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:24.027621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.028077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.028842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.029278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.169079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:24.177551 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f2fe53e-f94c-475c-a24f-3f64bfa4245d tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.160329 May 14 21:16:24.184089 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 830/1622] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:24 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:24.187076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.187843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:24.194088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.194628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.197869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.197869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.334613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:24.344271 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a6b67e9-2824-48ee-b3cb-a6466deccacb tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.165109 May 14 21:16:24.345062 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 831/1623] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:24 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:24.349443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d86a63e0-e599-4c67-a5b5-abaf9ac295f0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '.version_select at 0x7fb1a7fa31f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.397415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d86a63e0-e599-4c67-a5b5-abaf9ac295f0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] HTTP exception thrown: Image not found. May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d86a63e0-e599-4c67-a5b5-abaf9ac295f0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Request method failure captured: May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 HTTP/1.1 May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvW6Ln2QIFjfCjE_L52Fw4cx-VCQ3ZywvXGeLCB8qY06oQhHhtyy3KDIvzaqp5KX5TeZtDqeOV_5d4mSCIUxcuQWFWg9QKiLLCttcYP1lS7ojDL2HnvmIXEHZ9F1pMsezYZ2RucnexFSMjl8vLA2GJHAV-At1aeGuyHfnivgJTZz7Y May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b30891c9ccaf4e1bbdec0c910805d504 May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:24.398624 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b30891c9ccaf4e1bbdec0c910805d504", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b30891c9ccaf4e1bbdec0c910805d504 May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerTestJSON-2124897239-project May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: e87dae577e6c42ba8d14094bd6cad9de May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerTestJSON-2124897239-project May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2d7ab310-93d4-40e3-9e8a-898ebf3356b8'} May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:24.400967 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2d7ab310-93d4-40e3-9e8a-898ebf3356b8 to delete May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:24.401914 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2d7ab310-93d4-40e3-9e8a-898ebf3356b8 could not be found. May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:24.403142 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d86a63e0-e599-4c67-a5b5-abaf9ac295f0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d86a63e0-e599-4c67-a5b5-abaf9ac295f0 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "DELETE /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8" status: 404 len: 62 microversion: 2.1 time: 0.054806 May 14 21:16:24.404666 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 832/1624] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:24 2022] DELETE /compute/v2.1/images/2d7ab310-93d4-40e3-9e8a-898ebf3356b8 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:16:24.405872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-bcb220cc-a5ae-4859-9a66-93c1c606ecdf req-5d33b9a5-6ed4-4c3c-98e9-6bd3da9db79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0682771c-4855-4853-9123-f03aa17b7b53", "name": "network-vif-deleted", "tag": "7f69be99-9e4d-472a-a312-16dd01bfc172"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:24.414749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bcb220cc-a5ae-4859-9a66-93c1c606ecdf req-5d33b9a5-6ed4-4c3c-98e9-6bd3da9db79a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.415224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bcb220cc-a5ae-4859-9a66-93c1c606ecdf req-5d33b9a5-6ed4-4c3c-98e9-6bd3da9db79a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.425510 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-bcb220cc-a5ae-4859-9a66-93c1c606ecdf req-5d33b9a5-6ed4-4c3c-98e9-6bd3da9db79a service nova] Creating event network-vif-deleted:7f69be99-9e4d-472a-a312-16dd01bfc172 for instance 0682771c-4855-4853-9123-f03aa17b7b53 on nch2-master-1 May 14 21:16:24.430232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-bcb220cc-a5ae-4859-9a66-93c1c606ecdf req-5d33b9a5-6ed4-4c3c-98e9-6bd3da9db79a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027904 May 14 21:16:24.430874 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 833/1625] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:24.436032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d029e9b4-abb2-464e-8801-c81e0923d6e7 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a786a1f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.545232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d029e9b4-abb2-464e-8801-c81e0923d6e7 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225051796" status: 204 len: 0 microversion: 2.2 time: 0.113043 May 14 21:16:24.545823 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 834/1626] 10.222.0.52 () {60 vars in 1260 bytes} [Sat May 14 21:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225051796 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:24.550412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.551078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:24.557459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.557918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.558708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.559153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.584748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:24.643061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00e5e5d7-918f-45de-af0f-b1dc0af0d4b6 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2/action" status: 202 len: 0 microversion: 2.25 time: 4.189078 May 14 21:16:24.643747 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 793/1627] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:16:20 2022] POST /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2/action => generated 0 bytes in 4190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:24.648636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8d9cc5c3-1307-4686-972b-996275a21eb3 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1a79b7b80>, body: {"keypair": {"name": "tempest-keypair-1970777310", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:24.664128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8d9cc5c3-1307-4686-972b-996275a21eb3 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:24.669358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8d9cc5c3-1307-4686-972b-996275a21eb3 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:24.768446 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8d9cc5c3-1307-4686-972b-996275a21eb3 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.123645 May 14 21:16:24.769093 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 794/1628] 10.222.0.52 () {62 vars in 1198 bytes} [Sat May 14 21:16:24 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 14 21:16:24.773899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.775062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:24.780779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.781243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.782032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.782479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.887092 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d37230ce-ebf1-410b-bd63-ba7633371347 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 204 len: 0 microversion: 2.1 time: 0.340012 May 14 21:16:24.887732 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 835/1629] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:24 2022] DELETE /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:24.892884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4841ca36-0747-419d-b74c-f7828b5c0ec7 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a7e09af0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.919331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:24.927581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:24.929122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:24.933040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b4dc033-c8b8-4089-8d5d-4a097d9811e4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.160279 May 14 21:16:24.933040 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 795/1630] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:24 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:24.936151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.936761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:24.942689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.943140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.943928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:24.944364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:24.991009 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4841ca36-0747-419d-b74c-f7828b5c0ec7 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970777310" status: 204 len: 0 microversion: 2.2 time: 0.102046 May 14 21:16:24.991633 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 836/1631] 10.222.0.52 () {60 vars in 1260 bytes} [Sat May 14 21:16:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1970777310 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:24.997085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:24.997946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:25.005334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.005848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.006587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.007030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.080268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:25.089048 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9117f3cd-bdca-4b3c-8d60-722caa1fece8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.156357 May 14 21:16:25.095516 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 796/1632] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:24 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:25.095516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-770bc7e7-1871-4b5c-b38e-e1732a699ae6 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1a7dfaaf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1163285687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErT1S57X/fWucOuwe6YrlVyLVMdHFQyS6Zz/O/1jldJf5iBlUv3Ht4Yyyd+MBNY3aqypI4W+xtQsoK31mFhEgotCABrW8VKtK7huHzTT9i8iH/rUaZ6Nc+eKQv4iEM3SA=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:25.110999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-770bc7e7-1871-4b5c-b38e-e1732a699ae6 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:25.116822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-770bc7e7-1871-4b5c-b38e-e1732a699ae6 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:25.147605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:25.155976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4139268b-6035-41f7-9bce-a5e762ba4bce tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1473 microversion: 2.1 time: 0.163209 May 14 21:16:25.156592 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 837/1633] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:24 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1473 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:25.162791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.163413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] [instance: 0682771c-4855-4853-9123-f03aa17b7b53] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:25.170781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.171160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.171973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.172411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.187289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] HTTP exception thrown: Instance 0682771c-4855-4853-9123-f03aa17b7b53 could not be found. May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Request method failure captured: May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 HTTP/1.1 May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuYOIjdw0OQqOgu3EI9EnSDIkrtnHsDnY-wr4vmnJXE_GhIkXdd_YmtUQWXR8_juEvbkau_SYH0XBpMjvdm8SyzrDzkQHdsywyBsjqh-UrmuBDQicIXVEF76vkEcaaejK80mh5kVMp1ssC16DM6L_24bcZohOD_qGrAVZEjPdslnHY May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 873c930e94574326a2aa94a76fda4f0d May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAdminTestJSON-209151334 May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:25.189155 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/873c930e94574326a2aa94a76fda4f0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_873c930e94574326a2aa94a76fda4f0d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAdminTestJSON-209151334 May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 873c930e94574326a2aa94a76fda4f0d May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAdminTestJSON-209151334 May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAdminTestJSON-209151334-project May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 3a998f4a4cc94a63ac7e939ffdb10917 May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAdminTestJSON-209151334-project May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 0682771c-4855-4853-9123-f03aa17b7b53 could not be found. May 14 21:16:25.190944 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '0682771c-4855-4853-9123-f03aa17b7b53'} May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0682771c-4855-4853-9123-f03aa17b7b53 could not be found. May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:25.191891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0682771c-4855-4853-9123-f03aa17b7b53 could not be found. May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0682771c-4855-4853-9123-f03aa17b7b53 could not be found. May 14 21:16:25.193408 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:25.195717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] Returning 404 to user: Instance 0682771c-4855-4853-9123-f03aa17b7b53 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:25.195717 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e151afa8-672a-4b6f-b7a4-ed359f3c52a6 tempest-ServersAdminTestJSON-209151334 tempest-ServersAdminTestJSON-209151334-project] 10.222.0.52 "GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53" status: 404 len: 111 microversion: 2.1 time: 0.034751 May 14 21:16:25.195717 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 838/1634] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:25 2022] GET /compute/v2.1/servers/0682771c-4855-4853-9123-f03aa17b7b53 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:25.200640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.201330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:25.208473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.208968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.213230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.213230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.237750 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-770bc7e7-1871-4b5c-b38e-e1732a699ae6 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.146262 May 14 21:16:25.238778 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 797/1635] 10.222.0.52 () {62 vars in 1198 bytes} [Sat May 14 21:16:25 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 14 21:16:25.256614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3fc33ea0-7110-4800-9304-cca509a54097 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1a7990ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-378116426", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZ4hajQrMU3hiHKAyf+OiPQWHR8yWGexwcZ7sXCN+eu7S+Cx05v+WOE8xIJ+NPMOTGozXOetUSDDIVVdf2KuPoa3Zf73vVBZseQ96468BPrg0mmfSPxSk2uIHeN2ldA+w=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:25.277865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3fc33ea0-7110-4800-9304-cca509a54097 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:25.284754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3fc33ea0-7110-4800-9304-cca509a54097 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:25.380001 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3fc33ea0-7110-4800-9304-cca509a54097 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.132506 May 14 21:16:25.381008 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 798/1636] 10.222.0.52 () {62 vars in 1198 bytes} [Sat May 14 21:16:25 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) May 14 21:16:25.386641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cec3cc10-1076-46ec-aaaf-d4dfc38fe032 req-3e45e6e2-70ef-49f8-91b8-91ab943ca807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbb39d4-b558-43b9-a868-776517ce58e2", "name": "network-vif-unplugged", "status": "completed", "tag": "229bb137-aed4-4606-843d-7799884c4e81"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:25.390579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:25.397746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cec3cc10-1076-46ec-aaaf-d4dfc38fe032 req-3e45e6e2-70ef-49f8-91b8-91ab943ca807 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.398634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cec3cc10-1076-46ec-aaaf-d4dfc38fe032 req-3e45e6e2-70ef-49f8-91b8-91ab943ca807 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.405011 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-12ae271e-ff8c-4a4d-b0d8-b36f53ed7b05 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.209151 May 14 21:16:25.405769 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 839/1637] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:25 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:25.411107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.411759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:25.413127 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cec3cc10-1076-46ec-aaaf-d4dfc38fe032 req-3e45e6e2-70ef-49f8-91b8-91ab943ca807 service nova] Creating event network-vif-unplugged:229bb137-aed4-4606-843d-7799884c4e81 for instance cbbb39d4-b558-43b9-a868-776517ce58e2 on nch1-master-1 May 14 21:16:25.420069 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cec3cc10-1076-46ec-aaaf-d4dfc38fe032 req-3e45e6e2-70ef-49f8-91b8-91ab943ca807 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037287 May 14 21:16:25.420196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.420573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.421216 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 799/1638] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:25.421435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.422012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.427302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-025446e9-ec99-45c8-9dce-8d8ba7a11115 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1a7990550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-55539451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0DRqMDlGJPRZRYtHlXFUYLWgZhjZvY7iDx7ijeMli4UW+wBdGvX9NYS5a/jkx/GaEE96Cii/6sx3A3G8RfgTn7/bTaQ985sp6C2OrNtTm6bcI/VfGZ6ZHG138uqJ5Cfw=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:25.445827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-025446e9-ec99-45c8-9dce-8d8ba7a11115 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:25.452683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-025446e9-ec99-45c8-9dce-8d8ba7a11115 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:25.546471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-025446e9-ec99-45c8-9dce-8d8ba7a11115 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.123908 May 14 21:16:25.547501 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 800/1639] 10.222.0.52 () {62 vars in 1198 bytes} [Sat May 14 21:16:25 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 14 21:16:25.558350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d027d27-70e1-4d11-bdda-9168c0ea4a3a tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a79904c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.561196 ncdv-master-1 devstack@n-api.service[130637]: WARNING oslo_db.sqlalchemy.utils [None req-9d027d27-70e1-4d11-bdda-9168c0ea4a3a tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Unique keys not in sort_keys. The sorting order may be unstable. May 14 21:16:25.567204 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d027d27-70e1-4d11-bdda-9168c0ea4a3a tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.013677 May 14 21:16:25.568077 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 801/1640] 10.222.0.52 () {60 vars in 1176 bytes} [Sat May 14 21:16:25 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:25.574617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:25.578363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-10c12e3c-284d-46d7-a65a-3ccc3ca44e61 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a7dfa670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.582768 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9253755c-fcc3-4174-925f-30f95ca456f7 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.175824 May 14 21:16:25.583551 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 840/1641] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:25 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:25.652148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-10c12e3c-284d-46d7-a65a-3ccc3ca44e61 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-55539451" status: 204 len: 0 microversion: 2.2 time: 0.077786 May 14 21:16:25.652920 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 802/1642] 10.222.0.52 () {60 vars in 1314 bytes} [Sat May 14 21:16:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-55539451 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:16:25.661784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b99d046a-6294-4a09-883e-0a858beef8e4 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a786a1f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.737150 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b99d046a-6294-4a09-883e-0a858beef8e4 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-378116426" status: 204 len: 0 microversion: 2.2 time: 0.079804 May 14 21:16:25.737762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 841/1643] 10.222.0.52 () {60 vars in 1317 bytes} [Sat May 14 21:16:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-378116426 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:25.747902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99aec2a5-566b-4959-b85c-4c5b3886e164 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a79b7280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.825596 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99aec2a5-566b-4959-b85c-4c5b3886e164 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1163285687" status: 204 len: 0 microversion: 2.2 time: 0.075073 May 14 21:16:25.825596 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 803/1644] 10.222.0.52 () {60 vars in 1320 bytes} [Sat May 14 21:16:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1163285687 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:25.830760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65f1eabc-5658-4d26-8477-31c5656fd22b tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1a781cf70>, body: {"keypair": {"name": "tempest-keypair-1407742788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBt39BzL4d85kBdkxkB6MLKff28vz3tSeyUfjIdIUvAKoBCiRQihsJdWSLreZpEijn3p9Ox0JhPo3IHnymYtkhc+a2UbT3abfLGuzjI13Unii61bGU3AxtDOZzaUlIatwA=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:25.846349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-65f1eabc-5658-4d26-8477-31c5656fd22b tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:25.853098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-65f1eabc-5658-4d26-8477-31c5656fd22b tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:25.950408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.951206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:25.957908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.958643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.959504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:25.959991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:25.962864 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65f1eabc-5658-4d26-8477-31c5656fd22b tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.135468 May 14 21:16:25.974097 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 842/1645] 10.222.0.52 () {62 vars in 1198 bytes} [Sat May 14 21:16:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 14 21:16:25.975078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-870dcec7-a7e7-4b07-b24d-3f2f14dc61d5 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a7823af0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:25.983042 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-870dcec7-a7e7-4b07-b24d-3f2f14dc61d5 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1407742788" status: 200 len: 513 microversion: 2.2 time: 0.013551 May 14 21:16:25.985300 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 843/1646] 10.222.0.52 () {60 vars in 1257 bytes} [Sat May 14 21:16:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1407742788 => generated 513 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:25.996245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-135897ae-3560-4f19-bcb0-7d478392a9b8 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a781cd30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:26.000916 ncdv-master-1 devstack@n-api.service[130638]: WARNING oslo_db.sqlalchemy.utils [None req-135897ae-3560-4f19-bcb0-7d478392a9b8 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Unique keys not in sort_keys. The sorting order may be unstable. May 14 21:16:26.019028 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-135897ae-3560-4f19-bcb0-7d478392a9b8 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.026999 May 14 21:16:26.023523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 844/1647] 10.222.0.52 () {60 vars in 1176 bytes} [Sat May 14 21:16:25 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:26.030875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-05e2aa83-4734-448d-8b78-ce3df45d25cc tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a796cd30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:26.128911 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-05e2aa83-4734-448d-8b78-ce3df45d25cc tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407742788" status: 204 len: 0 microversion: 2.2 time: 0.101823 May 14 21:16:26.129747 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 845/1648] 10.222.0.52 () {60 vars in 1260 bytes} [Sat May 14 21:16:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1407742788 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:26.138227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:26.138638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:26.145685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.146193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.147051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.147655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.188689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:26.195404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:26.197837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:26.199261 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d07cfd7-06df-4ba8-8cb8-980d2d27f00a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.253774 May 14 21:16:26.199856 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 804/1649] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:25 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:26.205051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Action: 'create', calling method: .version_select at 0x7fb1a7b5f310>, body: {"keypair": {"name": "tempest-keypair-1586363161", "type": "x509"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:26.220418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:26.225735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:26.245460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.processutils [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp8t1ewvvh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp8t1ewvvh/temp.key -subj /CN=0df8b006c5314616a9d91bd2975b5eba -extensions v3_req_client {{(pid=130637) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 14 21:16:26.290056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:26.298749 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3263890b-2078-49c1-b594-236222a09582 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.167920 May 14 21:16:26.299790 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 846/1650] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:26 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:26.304588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:26.305280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:26.312046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.312649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.313553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.314060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.464078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:26.472008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-be5b7d55-c066-41e0-95d3-28e04c6739e7 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1473 microversion: 2.1 time: 0.171055 May 14 21:16:26.485176 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 847/1651] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:26 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1473 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:26.487928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:26.488553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:26.495393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.495886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.496670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.497122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.643421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:26.652141 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f213c1d6-866a-4746-88a4-5d9ef1efa2cf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.168107 May 14 21:16:26.653043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 848/1652] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:26 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:26.658034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-93763bc1-b310-4338-8733-a33be10d1364 req-1425b59e-b489-495b-91b0-d0e63321d10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2", "name": "network-vif-unplugged", "status": "completed", "tag": "ec8012be-be33-462f-961b-6c852f9a37d4"}, {"name": "network-changed", "server_uuid": "6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2", "tag": "ec8012be-be33-462f-961b-6c852f9a37d4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:26.668189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-93763bc1-b310-4338-8733-a33be10d1364 req-1425b59e-b489-495b-91b0-d0e63321d10a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.674043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-93763bc1-b310-4338-8733-a33be10d1364 req-1425b59e-b489-495b-91b0-d0e63321d10a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.683442 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-93763bc1-b310-4338-8733-a33be10d1364 req-1425b59e-b489-495b-91b0-d0e63321d10a service nova] Creating event network-vif-unplugged:ec8012be-be33-462f-961b-6c852f9a37d4 for instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 on nch2-master-1 May 14 21:16:26.684180 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-93763bc1-b310-4338-8733-a33be10d1364 req-1425b59e-b489-495b-91b0-d0e63321d10a service nova] Creating event network-changed:ec8012be-be33-462f-961b-6c852f9a37d4 for instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 on nch2-master-1 May 14 21:16:26.690514 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-93763bc1-b310-4338-8733-a33be10d1364 req-1425b59e-b489-495b-91b0-d0e63321d10a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.036132 May 14 21:16:26.692846 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 849/1653] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:26.701357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:26.702699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:26.710269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.711080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.712899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:26.713799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:26.834407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.processutils [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp8t1ewvvh/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp8t1ewvvh/temp.key -subj /CN=0df8b006c5314616a9d91bd2975b5eba -extensions v3_req_client" returned: 0 in 0.588s {{(pid=130637) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 14 21:16:26.836829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.processutils [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp8t1ewvvh/temp.key -password pass: {{(pid=130637) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 14 21:16:26.865122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.processutils [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp8t1ewvvh/temp.key -password pass:" returned: 0 in 0.027s {{(pid=130637) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 14 21:16:26.896735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:26.905553 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8812f229-d1e6-453b-8848-9dc7dbf7488f tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.211260 May 14 21:16:26.912791 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 850/1654] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:26 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:26.985333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:26.992469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Getting quotas for user 0df8b006c5314616a9d91bd2975b5eba and project 9cd3efb132bd4c4da3730331e5b15792. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:27.009446 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-094abf11-5e37-4c10-9c2a-7f43f2ca4695 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.808379 May 14 21:16:27.014829 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 805/1655] 10.222.0.52 () {62 vars in 1197 bytes} [Sat May 14 21:16:26 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 810 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:27.019986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6c22e92-467c-4b43-a71e-bbed3a728962 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a781c160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.027931 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6c22e92-467c-4b43-a71e-bbed3a728962 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1586363161" status: 200 len: 1534 microversion: 2.2 time: 0.011736 May 14 21:16:27.028885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 851/1656] 10.222.0.52 () {60 vars in 1257 bytes} [Sat May 14 21:16:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1586363161 => generated 1534 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:27.040523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-537a457b-0099-4497-80a6-0a04651fc302 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a7e699d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.043559 ncdv-master-1 devstack@n-api.service[130637]: WARNING oslo_db.sqlalchemy.utils [None req-537a457b-0099-4497-80a6-0a04651fc302 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Unique keys not in sort_keys. The sorting order may be unstable. May 14 21:16:27.049886 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-537a457b-0099-4497-80a6-0a04651fc302 tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.014808 May 14 21:16:27.050877 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 806/1657] 10.222.0.52 () {60 vars in 1176 bytes} [Sat May 14 21:16:27 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:27.061421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78f4895e-6ac6-445c-9423-6e61bee0c37c tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] Calling method '.version_select at 0x7fb1a7823670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.189201 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-78f4895e-6ac6-445c-9423-6e61bee0c37c tempest-KeyPairsV22TestJSON-160832476 tempest-KeyPairsV22TestJSON-160832476-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586363161" status: 204 len: 0 microversion: 2.2 time: 0.131660 May 14 21:16:27.189973 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 852/1658] 10.222.0.52 () {60 vars in 1260 bytes} [Sat May 14 21:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586363161 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:27.218011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.219032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:27.226002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.226915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.229175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.231957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.318756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.331634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:27.341020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.344273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.345419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.346130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.587501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:27.600343 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd38b8df-dc71-40a7-b1f6-0412792b838d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.287555 May 14 21:16:27.602167 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 853/1659] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:27 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:27.612644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.617544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:27.626616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.627216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.628988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.629541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.822833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:27.832762 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-453af435-a454-44b1-af8c-fc4500abc514 tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1473 microversion: 2.1 time: 0.226757 May 14 21:16:27.840703 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 854/1660] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:27 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:27.849683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.850888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:27.864564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.864564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.864564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.864926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:27.865400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.880977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:27.886801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:27.888528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d660959-d275-41b6-8994-b2f3c511cd08 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.674237 May 14 21:16:27.889153 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 807/1661] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:27 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:27.929778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:27.931441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:27.945838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.947972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:27.949467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:27.950103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.040819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:28.050936 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd4c63b1-d523-4657-bdf0-b12b6262e365 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.208757 May 14 21:16:28.063651 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 855/1662] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:27 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:28.291046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:28.300290 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5f8c7cb1-a486-4926-a814-2e0c833b080a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.380036 May 14 21:16:28.310445 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 808/1663] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:27 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:28.621299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:28.621920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:28.632579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:28.632579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.632579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:28.632579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.778352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:28.786523 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d868945-7665-47e2-a821-f91ce46b644a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.169274 May 14 21:16:28.787112 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 856/1664] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:28 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:28.825432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-4579cd0c-4bf1-4f26-b526-3f3bcfa1a01a req-a5f846b0-19f8-47ee-85d1-f5302626923f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbb39d4-b558-43b9-a868-776517ce58e2", "name": "network-vif-deleted", "tag": "229bb137-aed4-4606-843d-7799884c4e81"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:28.834955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4579cd0c-4bf1-4f26-b526-3f3bcfa1a01a req-a5f846b0-19f8-47ee-85d1-f5302626923f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:28.835599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4579cd0c-4bf1-4f26-b526-3f3bcfa1a01a req-a5f846b0-19f8-47ee-85d1-f5302626923f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.858564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:28.860712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:28.861399 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-4579cd0c-4bf1-4f26-b526-3f3bcfa1a01a req-a5f846b0-19f8-47ee-85d1-f5302626923f service nova] Creating event network-vif-deleted:229bb137-aed4-4606-843d-7799884c4e81 for instance cbbb39d4-b558-43b9-a868-776517ce58e2 on nch1-master-1 May 14 21:16:28.869564 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-4579cd0c-4bf1-4f26-b526-3f3bcfa1a01a req-a5f846b0-19f8-47ee-85d1-f5302626923f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051190 May 14 21:16:28.870917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:28.871271 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 809/1665] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:28.871418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.872228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:28.872745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.907051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:28.912103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:28.924659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:28.925710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.927412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:28.928236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:28.974861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e87dae577e6c42ba8d14094bd6cad9de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30891c9ccaf4e1bbdec0c910805d504', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:28.989309 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b3312f74-a5b8-4dd4-8c11-1223d8bb122e tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 200 len: 1431 microversion: 2.1 time: 0.140903 May 14 21:16:28.990277 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 857/1666] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:28 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 1431 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:29.069549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:29.070227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:29.084874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:29.085865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:29.086766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:29.087382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:29.174940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:29.201568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:29.203951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:29.205705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e62ca6cd-6a1f-4892-84e6-b54c6790a0d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.302974 May 14 21:16:29.216593 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 810/1667] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:28 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:29.293953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:29.304714 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8488b83-eaaf-4424-b677-7ddd7f8dd53f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.239326 May 14 21:16:29.314570 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 858/1668] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:29 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:29.319997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:29.320630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:29.328697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:29.329588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:29.332507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:29.333691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:29.545351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:29.554606 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31e8749d-f510-4235-ab9b-2e69785bd20d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.239872 May 14 21:16:29.559430 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 811/1669] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:29 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:29.613614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-55c9fba1-7198-4d31-a3fa-5293dae64c6e req-599a9923-f1c1-4584-b947-32ce61b136bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6327b6-a740-471d-96bf-3a0dbc85214f", "name": "network-vif-plugged", "status": "completed", "tag": "a5262f93-1b5b-41b9-80c4-429291bd7755"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:29.622525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55c9fba1-7198-4d31-a3fa-5293dae64c6e req-599a9923-f1c1-4584-b947-32ce61b136bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:29.622923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-55c9fba1-7198-4d31-a3fa-5293dae64c6e req-599a9923-f1c1-4584-b947-32ce61b136bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:29.635446 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-55c9fba1-7198-4d31-a3fa-5293dae64c6e req-599a9923-f1c1-4584-b947-32ce61b136bd service nova] Creating event network-vif-plugged:a5262f93-1b5b-41b9-80c4-429291bd7755 for instance 8c6327b6-a740-471d-96bf-3a0dbc85214f on nch1-master-1 May 14 21:16:29.640304 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-55c9fba1-7198-4d31-a3fa-5293dae64c6e req-599a9923-f1c1-4584-b947-32ce61b136bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030845 May 14 21:16:29.640944 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 859/1670] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:16:29.815053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:29.816017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:29.836081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:29.837372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:29.838751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:29.840023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.007695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:30.009378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] [instance: cbbb39d4-b558-43b9-a868-776517ce58e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:30.018085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.021933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.022957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.023726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.074342 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] HTTP exception thrown: Instance cbbb39d4-b558-43b9-a868-776517ce58e2 could not be found. May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Request method failure captured: May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 HTTP/1.1 May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvW6Ln2QIFjfCjE_L52Fw4cx-VCQ3ZywvXGeLCB8qY06oQhHhtyy3KDIvzaqp5KX5TeZtDqeOV_5d4mSCIUxcuQWFWg9QKiLLCttcYP1lS7ojDL2HnvmIXEHZ9F1pMsezYZ2RucnexFSMjl8vLA2GJHAV-At1aeGuyHfnivgJTZz7Y May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b30891c9ccaf4e1bbdec0c910805d504 May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:30.077985 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b30891c9ccaf4e1bbdec0c910805d504"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b30891c9ccaf4e1bbdec0c910805d504", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b30891c9ccaf4e1bbdec0c910805d504 May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-2124897239 May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerTestJSON-2124897239-project May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: e87dae577e6c42ba8d14094bd6cad9de May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerTestJSON-2124897239-project May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance cbbb39d4-b558-43b9-a868-776517ce58e2 could not be found. May 14 21:16:30.079824 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'cbbb39d4-b558-43b9-a868-776517ce58e2'} May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbb39d4-b558-43b9-a868-776517ce58e2 could not be found. May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:30.080734 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbb39d4-b558-43b9-a868-776517ce58e2 could not be found. May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbb39d4-b558-43b9-a868-776517ce58e2 could not be found. May 14 21:16:30.082454 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:30.087184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] Returning 404 to user: Instance cbbb39d4-b558-43b9-a868-776517ce58e2 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:30.090084 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65f5d0d8-3d06-4e58-bbb0-55f64665d23d tempest-ImagesOneServerTestJSON-2124897239 tempest-ImagesOneServerTestJSON-2124897239-project] 10.222.0.52 "GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2" status: 404 len: 111 microversion: 2.1 time: 0.086493 May 14 21:16:30.098618 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 860/1671] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:30 2022] GET /compute/v2.1/servers/cbbb39d4-b558-43b9-a868-776517ce58e2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:30.225611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:30.226413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:30.234278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.234809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.241740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.241740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.349790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:30.361037 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27b301a3-7f0a-4acc-9b3e-b33b9c8ed674 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.558974 May 14 21:16:30.362226 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 812/1672] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:29 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:30.390265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:30.398722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:30.400887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:30.406125 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7780736d-a255-460d-8768-41b1a49b718f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.183751 May 14 21:16:30.411193 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 861/1673] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:30 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:30.411830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:30.412465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:30.418622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.419085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.419911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.420362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.558737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:30.568840 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-513f091e-c5c5-4a4f-bc93-da5bc7d03565 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.160708 May 14 21:16:30.582798 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 862/1674] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:30 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:30.591051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:30.592014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:30.598349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.599238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.600522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:30.601127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:30.638464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2119936112", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:30.714026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:16:31.030315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:16:31.030850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:16:31.031662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:16:31.032354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:16:31.032861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:16:31.043645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.044211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.045242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.045760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.058360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:31.069470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:31.071438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8def480-8ebe-4eb8-8c51-9cc8e077739c tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.487204 May 14 21:16:31.072231 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 863/1675] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:30 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:31.076958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8b1d9e84-0952-4099-a64c-dab1bc828982 req-a962fa9f-3ce0-41d2-9e85-76bfb1730d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1490939f-5892-4d71-8262-69f0148d55d2", "name": "network-vif-unplugged", "status": "completed", "tag": "0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720"}, {"name": "network-changed", "server_uuid": "1490939f-5892-4d71-8262-69f0148d55d2", "tag": "0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:31.086455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8b1d9e84-0952-4099-a64c-dab1bc828982 req-a962fa9f-3ce0-41d2-9e85-76bfb1730d85 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.087685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8b1d9e84-0952-4099-a64c-dab1bc828982 req-a962fa9f-3ce0-41d2-9e85-76bfb1730d85 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.089816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:31.103396 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8b1d9e84-0952-4099-a64c-dab1bc828982 req-a962fa9f-3ce0-41d2-9e85-76bfb1730d85 service nova] Creating event network-vif-unplugged:0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720 for instance 1490939f-5892-4d71-8262-69f0148d55d2 on nch1-master-1 May 14 21:16:31.104214 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8b1d9e84-0952-4099-a64c-dab1bc828982 req-a962fa9f-3ce0-41d2-9e85-76bfb1730d85 service nova] Creating event network-changed:0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720 for instance 1490939f-5892-4d71-8262-69f0148d55d2 on nch1-master-1 May 14 21:16:31.106707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:16:31.109738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:16:31.109950 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8b1d9e84-0952-4099-a64c-dab1bc828982 req-a962fa9f-3ce0-41d2-9e85-76bfb1730d85 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.036404 May 14 21:16:31.110762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 864/1676] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:31.219158 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a9bc3973-4dfc-4f96-a9e0-e9721ded44d8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855799 May 14 21:16:31.219864 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 813/1677] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:16:31.231065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9add90a9-dba3-435c-bd66-a09cbf274fe0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:31.231812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9add90a9-dba3-435c-bd66-a09cbf274fe0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:31.288363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9add90a9-dba3-435c-bd66-a09cbf274fe0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:31.296492 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9add90a9-dba3-435c-bd66-a09cbf274fe0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1217 microversion: 2.1 time: 0.070179 May 14 21:16:31.297089 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 865/1678] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:31 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:31.378775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:31.379407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:31.390716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.391564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.392445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.392812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.431859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:31.431859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:31.437076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.437683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.438561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.439020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.561903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:31.578006 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fea1b510-aaad-4da4-a953-43ef6ff1a6cb tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.203594 May 14 21:16:31.578737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 814/1679] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:31 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:31.585828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:31.593331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:31.595090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:31.597444 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2b6e957-d7c6-484f-a279-82aecbcbeb35 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.176793 May 14 21:16:31.598848 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 866/1680] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:31 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:31.603741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:31.604832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:31.611393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.612079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.612896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:31.613337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:31.861956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:31.871757 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f07fee39-a3d8-4930-9d5f-92e75e6fe80e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.284258 May 14 21:16:31.872484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 815/1681] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:31 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:32.089272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:32.090165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:32.096910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:32.097369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:32.098159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:32.098601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:32.314158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4dc02cf-ee22-4e1d-a3de-288b58e06661 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:32.314931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4dc02cf-ee22-4e1d-a3de-288b58e06661 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:32.328367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:32.337951 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0edf0534-9e10-4238-a566-48e87958c486 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1317 microversion: 2.1 time: 0.253018 May 14 21:16:32.339012 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 867/1682] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:32 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:32.376017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4dc02cf-ee22-4e1d-a3de-288b58e06661 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:32.385144 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4dc02cf-ee22-4e1d-a3de-288b58e06661 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1217 microversion: 2.1 time: 0.075111 May 14 21:16:32.385869 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 816/1683] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:32 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:32.603625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:32.603810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:32.613176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:32.615952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:32.621207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:32.622032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:32.629320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:32.630300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:32.633906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:32.634396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:32.635414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:32.636100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:32.843720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:32.853013 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c2db836-59be-41dd-a149-ac63ab90c1e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.253642 May 14 21:16:32.853598 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 868/1684] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:32 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:32.946950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:32.959128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:32.961382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:32.962659 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0fe6d3b0-be4c-41bd-b223-7fbc64378b2c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.346366 May 14 21:16:32.963234 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 817/1685] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:32 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:32.999360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41336f4d-333d-4dfd-8745-deeccbdd7843 tempest-ListImageFiltersNegativeTestJSON-486376566 tempest-ListImageFiltersNegativeTestJSON-486376566-project] Calling method '.version_select at 0x7fb1a7823dc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.024453 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-41336f4d-333d-4dfd-8745-deeccbdd7843 tempest-ListImageFiltersNegativeTestJSON-486376566 tempest-ListImageFiltersNegativeTestJSON-486376566-project] HTTP exception thrown: Image not found. May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41336f4d-333d-4dfd-8745-deeccbdd7843 tempest-ListImageFiltersNegativeTestJSON-486376566 tempest-ListImageFiltersNegativeTestJSON-486376566-project] Request method failure captured: May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/images/9858d517-8cdc-46c8-bab8-f08e97cfc54e HTTP/1.1 May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBwwB0IGpp2uj8EWGmHRwvMlHH-w9shdnUVY3EFGjS0JC4AjCkd93c6oX9SSlqDzSBZTuiMfXMhzfe3BP-H9srEZkr8HHd4UdCU6YT9B9z4xsxSgccRDYCvtVBE9Nkk5HRDC5ZxZcFH2nHxwJ0ybZ49WS2F3jqu0FMM-czbomOIwh7Y May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: dfdcd319144a4bfc900bc852e5af53a5 May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-486376566 May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:33.026652 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dfdcd319144a4bfc900bc852e5af53a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/dfdcd319144a4bfc900bc852e5af53a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/dfdcd319144a4bfc900bc852e5af53a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_dfdcd319144a4bfc900bc852e5af53a5", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-486376566 May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: dfdcd319144a4bfc900bc852e5af53a5 May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-486376566 May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListImageFiltersNegativeTestJSON-486376566-project May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b4a4535d476449dcb26b5aad77ec636d May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-486376566-project May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '9858d517-8cdc-46c8-bab8-f08e97cfc54e'} May 14 21:16:33.029741 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:16:33.030733 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9858d517-8cdc-46c8-bab8-f08e97cfc54e May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:16:33.039349 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9858d517-8cdc-46c8-bab8-f08e97cfc54e could not be found. May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:16:33.040813 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.042255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41336f4d-333d-4dfd-8745-deeccbdd7843 tempest-ListImageFiltersNegativeTestJSON-486376566 tempest-ListImageFiltersNegativeTestJSON-486376566-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:33.043587 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-41336f4d-333d-4dfd-8745-deeccbdd7843 tempest-ListImageFiltersNegativeTestJSON-486376566 tempest-ListImageFiltersNegativeTestJSON-486376566-project] 10.222.0.52 "GET /compute/v2.1/images/9858d517-8cdc-46c8-bab8-f08e97cfc54e" status: 404 len: 62 microversion: 2.1 time: 0.173781 May 14 21:16:33.043587 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 869/1686] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:32 2022] GET /compute/v2.1/images/9858d517-8cdc-46c8-bab8-f08e97cfc54e => generated 62 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:16:33.043587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.043587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:33.051219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.051730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.052526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.052976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.054030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52fac714-9f7d-4452-a569-9ee0ef3b47aa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Calling method '.version_select at 0x7fb1a7b5f5e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.116915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-52fac714-9f7d-4452-a569-9ee0ef3b47aa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:16:33.119303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-52fac714-9f7d-4452-a569-9ee0ef3b47aa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Neutron security group 16baff38-03e1-422d-b8a8-849740dddc22 not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:16:33.120425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-52fac714-9f7d-4452-a569-9ee0ef3b47aa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] HTTP exception thrown: Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist May 14 21:16:33.120425 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-b91defaa-8a76-4a06-94f8-2c850f12a95a'] May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52fac714-9f7d-4452-a569-9ee0ef3b47aa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Request method failure captured: May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-security-groups/16baff38-03e1-422d-b8a8-849740dddc22 HTTP/1.1 May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwwebGgqAYtN-084dYL_1l-dYnLIA8CoMOIrDZsdd5NiMqhalr71jQxoPkvF4iYCrz9jI1w8iaeFqRby0e3pAqMmCMAoqh4kS-mxXvBbRjRrnje7W71lzUl6rHssxbeMb1qYEzcJTIHJ-IA0IT6dwXTYwXLL-0lPUI94G7RhepIu78 May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:16:33.124553 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/87efca1c13a8404896728ea606abde39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_87efca1c13a8404896728ea606abde39", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ef788d4f59b2492db17db14f497b74c4 May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-b91defaa-8a76-4a06-94f8-2c850f12a95a'] May 14 21:16:33.127263 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '16baff38-03e1-422d-b8a8-849740dddc22'} May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.128978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b91defaa-8a76-4a06-94f8-2c850f12a95a'] May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:16:33.130907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b91defaa-8a76-4a06-94f8-2c850f12a95a'] May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b91defaa-8a76-4a06-94f8-2c850f12a95a'] May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.136533 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b91defaa-8a76-4a06-94f8-2c850f12a95a'] May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52fac714-9f7d-4452-a569-9ee0ef3b47aa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Returning 404 to user: Security group 16baff38-03e1-422d-b8a8-849740dddc22 does not exist May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-b91defaa-8a76-4a06-94f8-2c850f12a95a'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:33.138217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52fac714-9f7d-4452-a569-9ee0ef3b47aa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/16baff38-03e1-422d-b8a8-849740dddc22" status: 404 len: 194 microversion: 2.1 time: 0.170260 May 14 21:16:33.139695 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 818/1687] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:16:32 2022] DELETE /compute/v2.1/os-security-groups/16baff38-03e1-422d-b8a8-849740dddc22 => generated 194 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:33.148654 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6e5d8200-4f54-44cc-ad2c-35fc33e630fa tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004031 May 14 21:16:33.149841 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 819/1688] 10.222.0.52 () {58 vars in 1163 bytes} [Sat May 14 21:16:33 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 14 21:16:33.158915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4712bbde-1184-412b-a634-cc485c7f2996 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Calling method '.version_select at 0x7fb1a7990790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.222524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:33.231005 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0d23c93-ca75-43ec-8157-df3c5431bcd0 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.200136 May 14 21:16:33.231834 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 870/1689] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:33.338745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4712bbde-1184-412b-a634-cc485c7f2996 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.183738 May 14 21:16:33.339342 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 820/1690] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:33.350844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a82b38bb-24fd-4793-ad37-5f01aae81d0a tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Calling method '.version_select at 0x7fb1a7fa33a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.355077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.355806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:33.363157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.363747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.364611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.365252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.468297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-a82b38bb-24fd-4793-ad37-5f01aae81d0a tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:16:33.469099 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a82b38bb-24fd-4793-ad37-5f01aae81d0a tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] HTTP exception thrown: Insufficient rights for removing default security group. May 14 21:16:33.469099 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-59256785-8a3d-4d3c-853e-16f2800e60e2'] May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a82b38bb-24fd-4793-ad37-5f01aae81d0a tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Request method failure captured: May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-groups/8ed43897-42e0-44cb-bc89-faf2006180aa HTTP/1.1 May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBwwebGgqAYtN-084dYL_1l-dYnLIA8CoMOIrDZsdd5NiMqhalr71jQxoPkvF4iYCrz9jI1w8iaeFqRby0e3pAqMmCMAoqh4kS-mxXvBbRjRrnje7W71lzUl6rHssxbeMb1qYEzcJTIHJ-IA0IT6dwXTYwXLL-0lPUI94G7RhepIu78 May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:33.472129 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/87efca1c13a8404896728ea606abde39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_87efca1c13a8404896728ea606abde39", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ef788d4f59b2492db17db14f497b74c4 May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: exception: Insufficient rights for removing default security group. May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-59256785-8a3d-4d3c-853e-16f2800e60e2'] May 14 21:16:33.473578 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '8ed43897-42e0-44cb-bc89-faf2006180aa'} May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.474373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59256785-8a3d-4d3c-853e-16f2800e60e2'] May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 14 21:16:33.476496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59256785-8a3d-4d3c-853e-16f2800e60e2'] May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59256785-8a3d-4d3c-853e-16f2800e60e2'] May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.479989 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-59256785-8a3d-4d3c-853e-16f2800e60e2'] May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a82b38bb-24fd-4793-ad37-5f01aae81d0a tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Returning 400 to user: Insufficient rights for removing default security group. May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-59256785-8a3d-4d3c-853e-16f2800e60e2'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a82b38bb-24fd-4793-ad37-5f01aae81d0a tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8ed43897-42e0-44cb-bc89-faf2006180aa" status: 400 len: 182 microversion: 2.1 time: 0.126651 May 14 21:16:33.483391 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 871/1691] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:16:33 2022] DELETE /compute/v2.1/os-security-groups/8ed43897-42e0-44cb-bc89-faf2006180aa => generated 182 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:16:33.486363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.486363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:33.488604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.489060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.489850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.490289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.525701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:33.533857 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7925c39c-30fe-4f4f-8143-08c7993d6edc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1506 microversion: 2.1 time: 0.183547 May 14 21:16:33.535156 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 821/1692] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:33.541081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-743c1140-cb52-4981-8ea1-01cd86072818 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Calling method '.version_select at 0x7fb1a79b7280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.561781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:33.567144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-743c1140-cb52-4981-8ea1-01cd86072818 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:16:33.567864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-743c1140-cb52-4981-8ea1-01cd86072818 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Neutron security group 6341fd3f-f176-4a78-9388-743132d9bad4 not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:16:33.568458 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-743c1140-cb52-4981-8ea1-01cd86072818 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] HTTP exception thrown: Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist May 14 21:16:33.568458 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a5246367-077f-4a66-b779-d1ca5b08766d'] May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-743c1140-cb52-4981-8ea1-01cd86072818 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Request method failure captured: May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-security-groups/6341fd3f-f176-4a78-9388-743132d9bad4 HTTP/1.1 May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwwebGgqAYtN-084dYL_1l-dYnLIA8CoMOIrDZsdd5NiMqhalr71jQxoPkvF4iYCrz9jI1w8iaeFqRby0e3pAqMmCMAoqh4kS-mxXvBbRjRrnje7W71lzUl6rHssxbeMb1qYEzcJTIHJ-IA0IT6dwXTYwXLL-0lPUI94G7RhepIu78 May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:16:33.570368 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/87efca1c13a8404896728ea606abde39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_87efca1c13a8404896728ea606abde39", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ef788d4f59b2492db17db14f497b74c4 May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a5246367-077f-4a66-b779-d1ca5b08766d'] May 14 21:16:33.572166 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '6341fd3f-f176-4a78-9388-743132d9bad4'} May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.573064 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5246367-077f-4a66-b779-d1ca5b08766d'] May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:16:33.574479 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5246367-077f-4a66-b779-d1ca5b08766d'] May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5246367-077f-4a66-b779-d1ca5b08766d'] May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.575807 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5246367-077f-4a66-b779-d1ca5b08766d'] May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-743c1140-cb52-4981-8ea1-01cd86072818 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Returning 404 to user: Security group 6341fd3f-f176-4a78-9388-743132d9bad4 does not exist May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a5246367-077f-4a66-b779-d1ca5b08766d'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:33.577412 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-743c1140-cb52-4981-8ea1-01cd86072818 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/6341fd3f-f176-4a78-9388-743132d9bad4" status: 404 len: 194 microversion: 2.1 time: 0.038717 May 14 21:16:33.584294 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c0cb749-55c4-4140-9d9e-50aa644ed437 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1269 microversion: 2.1 time: 0.101487 May 14 21:16:33.584294 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 872/1693] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1269 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:33.584484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 822/1694] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/os-security-groups/6341fd3f-f176-4a78-9388-743132d9bad4 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:33.586016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.586302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:33.591348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1d2bf78-338d-4a42-9734-96fc0d40ddc0 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Action: 'update', calling method: .version_select at 0x7fb1a7d9adc0>, body: {"security_group": {"name": "tempest-sg-1028870821", "description": "tempest-description-2049584508"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:33.593990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.594813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.596271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.596919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.629022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-e1d2bf78-338d-4a42-9734-96fc0d40ddc0 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:16:33.629022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-e1d2bf78-338d-4a42-9734-96fc0d40ddc0 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Neutron security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:16:33.631929 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-e1d2bf78-338d-4a42-9734-96fc0d40ddc0 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] HTTP exception thrown: Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist May 14 21:16:33.631929 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-c48e5bbc-42a1-416f-8b35-51e8c7148c51'] May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1d2bf78-338d-4a42-9734-96fc0d40ddc0 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Request method failure captured: May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/os-security-groups/5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 HTTP/1.1 May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 102 May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwwebGgqAYtN-084dYL_1l-dYnLIA8CoMOIrDZsdd5NiMqhalr71jQxoPkvF4iYCrz9jI1w8iaeFqRby0e3pAqMmCMAoqh4kS-mxXvBbRjRrnje7W71lzUl6rHssxbeMb1qYEzcJTIHJ-IA0IT6dwXTYwXLL-0lPUI94G7RhepIu78 May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:16:33.634318 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/87efca1c13a8404896728ea606abde39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/87efca1c13a8404896728ea606abde39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_87efca1c13a8404896728ea606abde39", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 87efca1c13a8404896728ea606abde39 May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258 May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ef788d4f59b2492db17db14f497b74c4 May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1566321258-project May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: {"security_group": {"name": "tempest-sg-1028870821", "description": "tempest-description-2049584508"}} May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:16:33.635732 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-c48e5bbc-42a1-416f-8b35-51e8c7148c51'] May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6', 'body': {'security_group': {'name': 'tempest-sg-1028870821', 'description': 'tempest-description-2049584508'}}} May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:16:33.636654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48e5bbc-42a1-416f-8b35-51e8c7148c51'] May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:16:33.641028 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48e5bbc-42a1-416f-8b35-51e8c7148c51'] May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48e5bbc-42a1-416f-8b35-51e8c7148c51'] May 14 21:16:33.642192 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c48e5bbc-42a1-416f-8b35-51e8c7148c51'] May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1d2bf78-338d-4a42-9734-96fc0d40ddc0 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] Returning 404 to user: Security group 5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 does not exist May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-c48e5bbc-42a1-416f-8b35-51e8c7148c51'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:33.643389 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e1d2bf78-338d-4a42-9734-96fc0d40ddc0 tempest-SecurityGroupsNegativeTestJSON-1566321258 tempest-SecurityGroupsNegativeTestJSON-1566321258-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6" status: 404 len: 194 microversion: 2.1 time: 0.050521 May 14 21:16:33.644673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:33.644780 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 823/1695] 10.222.0.52 () {60 vars in 1289 bytes} [Sat May 14 21:16:33 2022] PUT /compute/v2.1/os-security-groups/5dbb44b8-c897-4baa-8c2b-29b8cd5cc5b6 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:33.644869 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0fdc64d-3c0e-429f-a02e-c53144cf13a8 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f/os-instance-actions/req-9be6302f-d0c0-49de-b75d-35565edc0bcc" status: 200 len: 313 microversion: 2.1 time: 0.058688 May 14 21:16:33.644869 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 873/1696] 10.222.0.52 () {58 vars in 1418 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f/os-instance-actions/req-9be6302f-d0c0-49de-b75d-35565edc0bcc => generated 313 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:33.650898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c5bf030-4749-4247-8469-8738290730da tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:33.651976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c5bf030-4749-4247-8469-8738290730da tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:33.658551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c5bf030-4749-4247-8469-8738290730da tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.659015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c5bf030-4749-4247-8469-8738290730da tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.659834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c5bf030-4749-4247-8469-8738290730da tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.660285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c5bf030-4749-4247-8469-8738290730da tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.870987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.871628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:33.877712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.878234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.879008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:33.879442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:33.967871 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c5bf030-4749-4247-8469-8738290730da tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "POST /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f/action" status: 202 len: 0 microversion: 2.1 time: 0.321064 May 14 21:16:33.969075 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 824/1697] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:16:33 2022] POST /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:16:33.990046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:33.994163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:34.002696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.003425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.004462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.005086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.112890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:34.123842 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bfdf97bf-c3a1-46df-a441-6bbb44597045 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.257476 May 14 21:16:34.124679 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 874/1698] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:34.129654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:34.130496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:34.138980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.143012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.143012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.143012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.251754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:34.267098 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-edc73e5e-3656-491c-90ea-fe382d063688 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1508 microversion: 2.1 time: 0.293412 May 14 21:16:34.271720 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 825/1699] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:33 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:34.299430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:34.300108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:34.306437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.306910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.307729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.308365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.410053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:34.422453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:34.424032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:34.425252 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aae99fe8-2770-4ca8-b665-5b3d15b09670 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.299462 May 14 21:16:34.426171 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 875/1700] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:34 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:34.594483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:34.595412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:34.602203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.602878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.604032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:34.604641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:34.678924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:34.687362 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0ca9c1c-6d72-4578-8c46-e09d20d2366e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1287 microversion: 2.1 time: 0.097107 May 14 21:16:34.688024 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 876/1701] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:34 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:34.705745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:34.713339 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-803a6cf9-c836-4f2d-912d-3334f5d5afdb tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.436788 May 14 21:16:34.713930 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 826/1702] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:34 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:35.142114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:35.142744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:35.150037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.150803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.151616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.152063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.291091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:35.292579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:35.306680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:35.316208 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e84bca5f-0d01-48f3-8c85-6cd1468c9d4d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.178035 May 14 21:16:35.316795 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 877/1703] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:35 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:35.324518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.325285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.326403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.327436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.445820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:35.447089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:35.456298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.456852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.457727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.458269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.585392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:35.605234 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dc604bca-36c1-4265-83e4-8033ad98f805 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1508 microversion: 2.1 time: 0.315439 May 14 21:16:35.608871 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 827/1704] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:35 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:35.651329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:35.661405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:35.663456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:35.665091 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-912a3fac-7bd3-42be-af76-4749eebd03b6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.224627 May 14 21:16:35.665885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 878/1705] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:35 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:35.706768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:35.707699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:35.714413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.714912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.716523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.717052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.732112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:35.732744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:35.742383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.743228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.744591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:35.745196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:35.807690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:35.815590 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8487c5f3-a2df-40ad-b9e9-012e888478f9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1275 microversion: 2.1 time: 0.114134 May 14 21:16:35.816505 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 828/1706] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:35 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1275 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:35.957980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:35.966871 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53e476ab-f43a-420f-a8c7-540519534274 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.240513 May 14 21:16:35.976407 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 879/1707] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:35 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:36.340061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:36.340061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:36.345145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:36.345972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:36.346914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:36.347537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:36.649942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8cffd1d9-73f4-4913-9b9f-83508c5660a4 tempest-ListImagesTestJSON-903303569 tempest-ListImagesTestJSON-903303569-project] Calling method '.version_select at 0x7fb1a781c790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:36.697980 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8cffd1d9-73f4-4913-9b9f-83508c5660a4 tempest-ListImagesTestJSON-903303569 tempest-ListImagesTestJSON-903303569-project] 10.222.0.52 "GET /compute/v2.1/images/b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e" status: 200 len: 784 microversion: 2.1 time: 0.203090 May 14 21:16:36.698827 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 880/1708] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:16:36 2022] GET /compute/v2.1/images/b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e => generated 784 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:36.710946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:36.711672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:36.717813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:36.718515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:36.719292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:36.719943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:36.733584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:36.763554 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8bcec71-dbe8-4046-83e7-486f47d52e58 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.433243 May 14 21:16:36.766208 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 829/1709] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:36 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:36.771863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:36.772682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:36.785356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:36.786057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:36.789002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:36.789569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:36.929309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:36.939450 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8cadd0d4-5cb5-4708-976c-8d6251392b8a tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1506 microversion: 2.1 time: 0.234333 May 14 21:16:36.949092 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 881/1710] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:36 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1506 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:36.957243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-801dcb56-ac57-46c0-8160-9544c2ba669e tempest-ListImagesTestJSON-903303569 tempest-ListImagesTestJSON-903303569-project] Calling method '.version_select at 0x7fb1a783d160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:37.046666 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-801dcb56-ac57-46c0-8160-9544c2ba669e tempest-ListImagesTestJSON-903303569 tempest-ListImagesTestJSON-903303569-project] 10.222.0.52 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.095788 May 14 21:16:37.047415 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 882/1711] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:36 2022] GET /compute/v2.1/images => generated 445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:37.054287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:37.054933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:37.065304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.065304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.065304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.065304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.143543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:37.153137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:37.154956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:37.156600 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f67df173-62c9-467a-9e04-98ebdd160df8 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.388507 May 14 21:16:37.157520 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 830/1712] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:36 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:37.162918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c970503c-d523-4404-bb13-2092219d5aa2 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '.version_select at 0x7fb1b40e5670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:37.163825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c970503c-d523-4404-bb13-2092219d5aa2 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:37.171046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c970503c-d523-4404-bb13-2092219d5aa2 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.171826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c970503c-d523-4404-bb13-2092219d5aa2 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.172846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c970503c-d523-4404-bb13-2092219d5aa2 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.173431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c970503c-d523-4404-bb13-2092219d5aa2 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.213687 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c970503c-d523-4404-bb13-2092219d5aa2 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.054882 May 14 21:16:37.214990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 831/1713] 10.222.0.52 () {58 vars in 1295 bytes} [Sat May 14 21:16:37 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f/os-instance-actions => generated 611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:37.220994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:37.221815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:37.228947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.229413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.230373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.230850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.284923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:37.299927 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fcaff704-cabb-49f7-a638-4351f3637c62 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1317 microversion: 2.1 time: 0.251229 May 14 21:16:37.300516 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 883/1714] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:37 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:37.307185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71a4fe6c-2eaf-4075-be0f-f45827d8a5a4 tempest-ListImagesTestJSON-903303569 tempest-ListImagesTestJSON-903303569-project] Calling method '.version_select at 0x7fb1a7823430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:37.552840 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71a4fe6c-2eaf-4075-be0f-f45827d8a5a4 tempest-ListImagesTestJSON-903303569 tempest-ListImagesTestJSON-903303569-project] 10.222.0.52 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.250720 May 14 21:16:37.553442 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 884/1715] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:16:37 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:37.559542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:37.560296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:37.568280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.568921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.569728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.570346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.603741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:37.970053 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89b531ad-3043-42a1-ae83-f361feee6553 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 204 len: 0 microversion: 2.1 time: 0.414783 May 14 21:16:37.974539 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 885/1716] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:37 2022] DELETE /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:37.978209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:37.979034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:37.980941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:37.991293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.993621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.996154 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ef58bcf5-0732-4254-b547-9ed76ea9b87e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.779521 May 14 21:16:37.996321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:37.996775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:37.997795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 832/1717] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:37 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:38.013573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:38.014472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:38.023035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:38.023256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:38.025451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:38.025914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:38.264794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:38.265902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:38.275713 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eaf4b880-c654-4a41-bf56-c212faef3f00 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.302786 May 14 21:16:38.276662 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 886/1718] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:37 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:38.277082 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-81179ebe-5ae0-4ca9-8a6b-47811b746169 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1512 microversion: 2.1 time: 0.269374 May 14 21:16:38.288962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 833/1719] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:37 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:38.291739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:38.292376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:38.299108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:38.299699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:38.300712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:38.301223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:38.316599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:38.317327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:38.327283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:38.328530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:38.331768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:38.332246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:38.489473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:38.497605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:38.499139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:38.500368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cbfbd6af-156c-4c3d-888e-90d251f53af1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.222451 May 14 21:16:38.501268 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 887/1720] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:38 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:38.606361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:38.616225 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c1aa140-812e-4244-b428-3045d4d94fba tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1317 microversion: 2.1 time: 0.303933 May 14 21:16:38.625899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 834/1721] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:38 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:38.840233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-981c135c-50a1-4cb8-a4bb-5ae15836babe req-582360a3-6c5b-4987-90ab-e8b8e8d7bcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebd3dc2-1a09-4160-9276-8df5efb2fa05", "tag": "93c7b375-0812-49e1-b96d-0fc14fa1a724"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:38.855382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-981c135c-50a1-4cb8-a4bb-5ae15836babe req-582360a3-6c5b-4987-90ab-e8b8e8d7bcba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:38.861307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-981c135c-50a1-4cb8-a4bb-5ae15836babe req-582360a3-6c5b-4987-90ab-e8b8e8d7bcba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:38.869700 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-981c135c-50a1-4cb8-a4bb-5ae15836babe req-582360a3-6c5b-4987-90ab-e8b8e8d7bcba service nova] Creating event network-changed:93c7b375-0812-49e1-b96d-0fc14fa1a724 for instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 on nch2-master-1 May 14 21:16:38.877990 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-981c135c-50a1-4cb8-a4bb-5ae15836babe req-582360a3-6c5b-4987-90ab-e8b8e8d7bcba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042894 May 14 21:16:38.879395 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 888/1722] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:39.015246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:39.016557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:39.023882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.028591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:39.029830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.032360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:39.295522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:39.297317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:39.304338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.304800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:39.306499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.307345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:39.372275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:39.380120 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34a21f88-53b1-4a26-bae0-6debeddfd2fd tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.368557 May 14 21:16:39.392369 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 835/1723] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:39 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:39.399133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:39.399982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:39.407048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.407369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:39.408394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.409005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:39.759216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:39.771522 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-90629c2b-0711-4d5c-aaf9-3b86fb1c32dc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1550 microversion: 2.1 time: 0.480860 May 14 21:16:39.776174 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 889/1724] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:39 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1550 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:39.778567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:39.779348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:39.786112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.786796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:39.789031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:39.790652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.040121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:40.049228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:40.051044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:40.052516 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcddf45b-7248-40b5-b877-cbf4d24da0e2 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.278861 May 14 21:16:40.053272 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 890/1725] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:39 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:40.058667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:40.065091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:40.072579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.074147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.075718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.076407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.326674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:40.337786 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ff8ac5cb-47da-4ac8-88ab-07047cb66b41 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1317 microversion: 2.1 time: 0.283231 May 14 21:16:40.338433 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 891/1726] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:40 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:40.398275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:40.399229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:40.407021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.407886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.417259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.418227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.448198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:40.460604 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9aa61e90-88d5-4f66-90cf-2676b4ddbacc tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1512 microversion: 2.1 time: 1.065470 May 14 21:16:40.465598 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 836/1727] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:39 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1512 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:40.732228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:40.733107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-610c2e2a-3a71-4a69-b399-7ba4e614fb06 tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Calling method '.version_select at 0x7fb1a784cb80>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:40.745346 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd78587b-e4fa-4ece-99f5-e45a78e6a892 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.350885 May 14 21:16:40.745963 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 892/1728] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:40 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:40.757492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610c2e2a-3a71-4a69-b399-7ba4e614fb06 tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.759924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610c2e2a-3a71-4a69-b399-7ba4e614fb06 tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.761224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610c2e2a-3a71-4a69-b399-7ba4e614fb06 tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.761683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-610c2e2a-3a71-4a69-b399-7ba4e614fb06 tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.785295 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-610c2e2a-3a71-4a69-b399-7ba4e614fb06 tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] 10.222.0.52 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.202442 May 14 21:16:40.786207 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 837/1729] 10.222.0.52 () {58 vars in 1121 bytes} [Sat May 14 21:16:40 2022] GET /compute/v2.1/limits => generated 511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:40.790256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:40.791217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:40.799289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.800205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.801373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:40.802041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:40.873726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1284867437", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:40.956911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:16:41.114769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:41.125734 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66da0a2b-91e3-41da-bb82-c5abf88477fa tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1540 microversion: 2.1 time: 0.340049 May 14 21:16:41.137145 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 893/1730] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:40 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1540 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:41.143383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:41.144103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:41.151156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.155103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.155103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.155103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.411445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Getting quotas for project f9acbb04d9b6439bb94b5f602dceb932. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:41.418238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Getting quotas for user 5a7c8b811af04d7f90b0a68849ac7957 and project f9acbb04d9b6439bb94b5f602dceb932. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:41.439117 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Request method failure captured: May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 1752 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBw4ZfUQiQxCJ2TlthZb-mTx1NEmzuzPROaW37SkGVTJkstPfAfJ1uAQajSiTLnYTGUOc7fZ4jMN657Wue-c562_riTkQlT5iT-rZFjhjH9MXaJl6CpGV5fEM-EQO_cXCHSbE4PV4TytpJwFNyD4G1-cUqm4XaWsYpLf22KXeWISD54 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f9acbb04d9b6439bb94b5f602dceb932 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1437822268 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9acbb04d9b6439bb94b5f602dceb932"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f9acbb04d9b6439bb94b5f602dceb932"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f9acbb04d9b6439bb94b5f602dceb932"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f9acbb04d9b6439bb94b5f602dceb932", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1437822268 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f9acbb04d9b6439bb94b5f602dceb932 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1437822268 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 5a7c8b811af04d7f90b0a68849ac7957 May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1284867437", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:16:41.442054 ncdv-master-1 devstack@n-api.service[130637]: exception: Maximum number of metadata items exceeds 128 May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1284867437', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:16:41.444351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 14 21:16:41.450317 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:41.456443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:41.457396 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7aa716ce-a1f5-4355-ac99-553cebf67dfe tempest-AbsoluteLimitsNegativeTestJSON-1437822268 tempest-AbsoluteLimitsNegativeTestJSON-1437822268-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.588064 May 14 21:16:41.458386 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 838/1731] 10.222.0.52 () {60 vars in 1147 bytes} [Sat May 14 21:16:40 2022] POST /compute/v2.1/servers => generated 87 bytes in 590 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 14 21:16:41.473971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1c06f1a-e305-4db4-89f3-33b9fcdb37c0 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '.version_select at 0x7fb1b4a064c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:41.490244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1c06f1a-e305-4db4-89f3-33b9fcdb37c0 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.499734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1c06f1a-e305-4db4-89f3-33b9fcdb37c0 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.519645 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d1c06f1a-e305-4db4-89f3-33b9fcdb37c0 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3503 microversion: 2.1 time: 0.058978 May 14 21:16:41.520733 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 839/1732] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:16:41 2022] GET /compute/v2.1/os-migrations => generated 3503 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:41.547514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:41.549148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:41.569383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.570319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.571256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.571900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.625601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:16:41.791658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:41.800533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:41.802163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:41.803440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef3ca00a-801a-4d47-a158-7fcd9ded3edc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.673279 May 14 21:16:41.804189 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 894/1733] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:41 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:41.810246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-7393b1b8-72d7-41cb-b8fa-bbbe63f72787 req-6b8dc1a9-b0c7-4079-9c70-e892eaa0211c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6327b6-a740-471d-96bf-3a0dbc85214f", "name": "network-vif-deleted", "tag": "a5262f93-1b5b-41b9-80c4-429291bd7755"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:41.818864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7393b1b8-72d7-41cb-b8fa-bbbe63f72787 req-6b8dc1a9-b0c7-4079-9c70-e892eaa0211c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.819402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7393b1b8-72d7-41cb-b8fa-bbbe63f72787 req-6b8dc1a9-b0c7-4079-9c70-e892eaa0211c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.840699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-7393b1b8-72d7-41cb-b8fa-bbbe63f72787 req-6b8dc1a9-b0c7-4079-9c70-e892eaa0211c service nova] Creating event network-vif-deleted:a5262f93-1b5b-41b9-80c4-429291bd7755 for instance 8c6327b6-a740-471d-96bf-3a0dbc85214f on nch1-master-1 May 14 21:16:41.845708 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-7393b1b8-72d7-41cb-b8fa-bbbe63f72787 req-6b8dc1a9-b0c7-4079-9c70-e892eaa0211c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040005 May 14 21:16:41.846409 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 895/1734] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:41.852626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:41.853609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:41.860800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.861327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.862335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.862981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.935440 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-80012351-0796-4da7-b526-df8dec25d525 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 204 len: 0 microversion: 2.1 time: 0.412168 May 14 21:16:41.939856 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 840/1735] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:16:41 2022] DELETE /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:16:41.942131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:41.942840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:41.949968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.950427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:41.951243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:41.951705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.004080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.004535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.005008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lazy-loading 'fault' on Instance uuid 8c6327b6-a740-471d-96bf-3a0dbc85214f {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:42.036771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:42.045538 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee4c913f-0cbd-4de0-a578-66ec86ab4d05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1317 microversion: 2.1 time: 0.197696 May 14 21:16:42.046345 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 896/1736] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:41 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:42.052682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eab223f9-01f5-4d11-9794-dc48415012ee tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:42.053578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eab223f9-01f5-4d11-9794-dc48415012ee tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:42.060894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33cf6f96b2ef4a3bb222abf3ce89c2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac56d68252fb4633b27be1d5f4a18d0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:42.064128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab223f9-01f5-4d11-9794-dc48415012ee tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.064669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab223f9-01f5-4d11-9794-dc48415012ee tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.065619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab223f9-01f5-4d11-9794-dc48415012ee tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.067069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab223f9-01f5-4d11-9794-dc48415012ee tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.069914 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d2729503-0f91-40da-aeb9-854e1735a62d tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 200 len: 1307 microversion: 2.1 time: 0.131962 May 14 21:16:42.076980 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 841/1737] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:41 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:42.088230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:42.089204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:42.096158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.096978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.097935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.098853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.311217 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eab223f9-01f5-4d11-9794-dc48415012ee tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1691 microversion: 2.1 time: 0.262826 May 14 21:16:42.311949 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 897/1738] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:42 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1691 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:42.318550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:42.319884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:42.344676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:42.353368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.354437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.356409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.356926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.358424 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7694ff2a-6226-418f-97cd-81172893eba1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.283103 May 14 21:16:42.371198 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 842/1739] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:42 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:42.404024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a4aed3a-6497-43df-8afd-92d392fd8767 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:42.411357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a4aed3a-6497-43df-8afd-92d392fd8767 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:42.427551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a4aed3a-6497-43df-8afd-92d392fd8767 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.432126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a4aed3a-6497-43df-8afd-92d392fd8767 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.436205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a4aed3a-6497-43df-8afd-92d392fd8767 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.436938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a4aed3a-6497-43df-8afd-92d392fd8767 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.615371 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a4aed3a-6497-43df-8afd-92d392fd8767 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1691 microversion: 2.1 time: 0.242669 May 14 21:16:42.635208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:42.638639 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 843/1740] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:42 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:42.646854 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dfc47980-94bb-4480-97ba-f3ef4c9beb07 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1664 microversion: 2.1 time: 0.333644 May 14 21:16:42.647928 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 898/1741] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:42 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1664 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:42.729759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:42.730318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:42.741732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.742213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.747982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.749598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.822606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:42.823139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:42.836715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.839603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.843807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:42.844613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:42.998357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lazy-loading 'services' on Instance uuid 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:43.134084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:43.147726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:43.152977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:43.155756 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97ac20d6-0377-4f1d-992b-17bf2187c77b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1566 microversion: 2.25 time: 0.338146 May 14 21:16:43.158600 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 899/1742] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:42 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1566 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:16:43.175341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:43.176514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:43.183718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.184664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.185842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.186290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.395197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a487d452-5b78-49a5-957b-879a54d739f2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments/e0863bd3-bff3-4125-b857-a7cf7b43cf86" status: 202 len: 0 microversion: 2.1 time: 0.670687 May 14 21:16:43.401909 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 844/1743] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:16:42 2022] DELETE /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments/e0863bd3-bff3-4125-b857-a7cf7b43cf86 => generated 0 bytes in 678 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:16:43.412735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:43.414068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] [instance: 8c6327b6-a740-471d-96bf-3a0dbc85214f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:43.436662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.437109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.437953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.438395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.447915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:43.462253 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-55a70fff-2bb3-46bb-8786-56d80b1e8789 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1317 microversion: 2.1 time: 0.300909 May 14 21:16:43.463282 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 900/1744] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:43 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:43.471658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:43.473799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:43.483889 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] HTTP exception thrown: Instance 8c6327b6-a740-471d-96bf-3a0dbc85214f could not be found. May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Request method failure captured: May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f HTTP/1.1 May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwbBhcFV0SpLaIpd2fZXcVivn82arvl8OLfro-O-Zp_M2G2vX9kslRqz_obpxrI6UyAz3cTDUcUKX4P8MlNDmsjM-gk50YHTBdyR74QMHpJvwHLzD_0Ki5SD1rxWA4J8-MkinKEDZhivlkpFi5biurad8EBGA2DhZ-GlFC8C-KDv9Q May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: ac56d68252fb4633b27be1d5f4a18d0b May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-InstanceActionsTestJSON-428253615 May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac56d68252fb4633b27be1d5f4a18d0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ac56d68252fb4633b27be1d5f4a18d0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ac56d68252fb4633b27be1d5f4a18d0b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ac56d68252fb4633b27be1d5f4a18d0b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-InstanceActionsTestJSON-428253615 May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: ac56d68252fb4633b27be1d5f4a18d0b May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-InstanceActionsTestJSON-428253615 May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-InstanceActionsTestJSON-428253615-project May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 33cf6f96b2ef4a3bb222abf3ce89c2fb May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-InstanceActionsTestJSON-428253615-project May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 8c6327b6-a740-471d-96bf-3a0dbc85214f could not be found. May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '8c6327b6-a740-471d-96bf-3a0dbc85214f'} May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6327b6-a740-471d-96bf-3a0dbc85214f could not be found. May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6327b6-a740-471d-96bf-3a0dbc85214f could not be found. May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:43.486108 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:43.491013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:43.491013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:43.491013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:43.491013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:43.491013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:43.491013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6327b6-a740-471d-96bf-3a0dbc85214f could not be found. May 14 21:16:43.491013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:16:43.494159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] Returning 404 to user: Instance 8c6327b6-a740-471d-96bf-3a0dbc85214f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:43.494309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.495196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.496018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.496723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.498026 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6931f79b-8a64-491e-be02-45f4522435f5 tempest-InstanceActionsTestJSON-428253615 tempest-InstanceActionsTestJSON-428253615-project] 10.222.0.52 "GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f" status: 404 len: 111 microversion: 2.1 time: 0.094604 May 14 21:16:43.505207 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 845/1745] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:43 2022] GET /compute/v2.1/servers/8c6327b6-a740-471d-96bf-3a0dbc85214f => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:43.514860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5db3d914-9f21-4538-8741-6436fcc87cbd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:43.517003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5db3d914-9f21-4538-8741-6436fcc87cbd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:43.543034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db3d914-9f21-4538-8741-6436fcc87cbd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.543034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db3d914-9f21-4538-8741-6436fcc87cbd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.543034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db3d914-9f21-4538-8741-6436fcc87cbd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.566329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db3d914-9f21-4538-8741-6436fcc87cbd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.612616 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5db3d914-9f21-4538-8741-6436fcc87cbd tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103214 May 14 21:16:43.621166 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 846/1746] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:16:43 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:43.676955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:43.681725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:43.693908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.695384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.700398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:43.703160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:43.727353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:43.735246 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70cddc1d-60b7-4760-a90f-ebaf9b1b5f53 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.270562 May 14 21:16:43.739245 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 901/1747] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:43 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:43.925689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:43.939294 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a6624f3-ba5e-4d11-8652-1e73d081da4c tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1664 microversion: 2.1 time: 0.266584 May 14 21:16:43.940514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 847/1748] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:43 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1664 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:44.176234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:44.176946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:44.185294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.185844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.186977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.187449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.470266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:44.490347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:44.492355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:44.497000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:44.497230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:44.498836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b69c4a55-3040-4a1b-a819-2715d5d92e1c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1541 microversion: 2.25 time: 0.326944 May 14 21:16:44.503433 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 902/1749] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:44 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1541 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:44.520876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.522172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.522584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-519744f3-da6b-4fc0-9d57-36d24992e571 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '.version_select at 0x7fb1a77d2b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:44.526580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.526580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.526962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-519744f3-da6b-4fc0-9d57-36d24992e571 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.526962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-519744f3-da6b-4fc0-9d57-36d24992e571 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.564659 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-519744f3-da6b-4fc0-9d57-36d24992e571 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 4049 microversion: 2.25 time: 0.046926 May 14 21:16:44.565939 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 903/1750] 10.222.0.52 () {60 vars in 1183 bytes} [Sat May 14 21:16:44 2022] GET /compute/v2.1/os-migrations => generated 4049 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:44.593463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:44.594355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:44.619669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.619669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.621330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.621789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.898857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 1490939f-5892-4d71-8262-69f0148d55d2 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:16:44.918959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:44.935492 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dfdf4067-69b3-4f90-8a43-d0b40d648c05 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1317 microversion: 2.1 time: 0.454316 May 14 21:16:44.935699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14cdf297-8ad3-4540-9f2d-3de07da8ec4a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 2032 microversion: 2.25 time: 0.359614 May 14 21:16:44.936852 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 904/1751] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:44 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 2032 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:44.943090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1f15c424-e127-4de0-800f-802415313016 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:44.944102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1f15c424-e127-4de0-800f-802415313016 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:44.953566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 848/1752] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:44 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1317 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:44.956113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f15c424-e127-4de0-800f-802415313016 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.956626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f15c424-e127-4de0-800f-802415313016 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.961282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f15c424-e127-4de0-800f-802415313016 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.961282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f15c424-e127-4de0-800f-802415313016 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:44.971761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:44.973371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:44.999196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:44.999690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:45.004752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:45.005452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:45.011051 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1f15c424-e127-4de0-800f-802415313016 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073117 May 14 21:16:45.012102 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 905/1753] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:16:44 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:16:45.029659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-5b134b79-3cfd-4485-9409-b8afaa4e000e req-2b53ff01-e078-41c1-bea2-a727ec74aacc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebd3dc2-1a09-4160-9276-8df5efb2fa05", "name": "network-vif-plugged", "status": "completed", "tag": "93c7b375-0812-49e1-b96d-0fc14fa1a724"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:45.050498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5b134b79-3cfd-4485-9409-b8afaa4e000e req-2b53ff01-e078-41c1-bea2-a727ec74aacc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:45.051913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5b134b79-3cfd-4485-9409-b8afaa4e000e req-2b53ff01-e078-41c1-bea2-a727ec74aacc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:45.074254 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-5b134b79-3cfd-4485-9409-b8afaa4e000e req-2b53ff01-e078-41c1-bea2-a727ec74aacc service nova] Creating event network-vif-plugged:93c7b375-0812-49e1-b96d-0fc14fa1a724 for instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 on nch2-master-1 May 14 21:16:45.083503 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-5b134b79-3cfd-4485-9409-b8afaa4e000e req-2b53ff01-e078-41c1-bea2-a727ec74aacc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070048 May 14 21:16:45.084445 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 906/1754] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:45.090268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:45.090987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:45.098049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:45.098605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:45.103810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:45.103810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:45.538440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:45.559803 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcefe989-f169-4697-bdf1-ce9ab43f5dbf tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1664 microversion: 2.1 time: 0.470467 May 14 21:16:45.560478 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 907/1755] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:45 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1664 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:45.566405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-106633041", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "2f366748-ecde-43ad-b849-3c9dce1cc30b"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:45.655837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] validate_networks() for [('2f366748-ecde-43ad-b849-3c9dce1cc30b', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:16:45.711815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:45.724745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-615aa5fe-4cf1-44cd-8d2d-1edb0778ed95 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1476 microversion: 2.1 time: 0.763478 May 14 21:16:45.728214 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 849/1756] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:44 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1476 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:45.983210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:45.984094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:45.990837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:45.991992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:45.993687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:45.994446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:46.651630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:46.663388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9a18622-d46a-43ea-b4a6-7f8c090d78d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1317 microversion: 2.1 time: 0.683985 May 14 21:16:46.668567 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 850/1757] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:45 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:46.677790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:46.678827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:46.693455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:46.694980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:46.696791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:46.699856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:47.004723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:16:47.005308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:16:47.005886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:16:47.006316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:16:47.008611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:16:47.021359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:47.021359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:47.022127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:47.022956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:47.068228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:47.084043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for user cfcb989a491440b3bf74ddc055ee14d3 and project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:47.113512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:16:47.127523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:16:47.405643 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcfe6b77-4c2e-4f92-b690-499586297c3f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.843699 May 14 21:16:47.407286 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 908/1758] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:16:47.413792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:47.417987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:47.428160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:47.428941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:47.430160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:47.431357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:47.631584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:47.652352 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-374fc815-820c-4169-b120-3f83ea5652af tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1664 microversion: 2.1 time: 0.977153 May 14 21:16:47.665843 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 851/1759] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:46 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1664 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:47.680766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-865b3413-a592-4fad-ac86-b31b64cc4482 req-4637053b-574e-4c25-875a-a1bdb40730e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75983071-f5ad-4c40-aa83-f61a98e5e823", "name": "network-vif-unplugged", "status": "completed", "tag": "bb09673c-8ab1-484e-bf52-805d25307965"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:47.701085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-865b3413-a592-4fad-ac86-b31b64cc4482 req-4637053b-574e-4c25-875a-a1bdb40730e7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:47.704075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-865b3413-a592-4fad-ac86-b31b64cc4482 req-4637053b-574e-4c25-875a-a1bdb40730e7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:47.731349 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-865b3413-a592-4fad-ac86-b31b64cc4482 req-4637053b-574e-4c25-875a-a1bdb40730e7 service nova] Creating event network-vif-unplugged:bb09673c-8ab1-484e-bf52-805d25307965 for instance 75983071-f5ad-4c40-aa83-f61a98e5e823 on nch2-master-1 May 14 21:16:47.737781 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-865b3413-a592-4fad-ac86-b31b64cc4482 req-4637053b-574e-4c25-875a-a1bdb40730e7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070462 May 14 21:16:47.738943 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 852/1760] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:47.745474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8298e025-5cec-415a-b4b7-fea059ca327f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:47.746557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8298e025-5cec-415a-b4b7-fea059ca327f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:47.923238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8298e025-5cec-415a-b4b7-fea059ca327f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:47.923238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8298e025-5cec-415a-b4b7-fea059ca327f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:47.923238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8298e025-5cec-415a-b4b7-fea059ca327f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:47.923238 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8298e025-5cec-415a-b4b7-fea059ca327f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1261 microversion: 2.25 time: 0.165788 May 14 21:16:47.923238 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 853/1761] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:47 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:47.923893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:47.924903 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-687b39e8-49fb-41c7-b963-0c7980217a00 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1475 microversion: 2.1 time: 0.516268 May 14 21:16:47.930152 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 909/1762] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:47 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1475 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:47.932334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:47.933449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:47.962974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:47.963786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:47.964842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:47.965950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:48.512049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:48.523027 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab53b9bd-332a-47cd-90b3-6fce54c60942 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1467 microversion: 2.1 time: 0.596612 May 14 21:16:48.525649 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 854/1763] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:47 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1467 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:48.686569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:48.686569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:48.686569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:48.686569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:48.688629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:48.688857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:48.838576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58e3e29b-98b1-44f5-8ecb-48e065e41cca tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:48.839223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-58e3e29b-98b1-44f5-8ecb-48e065e41cca tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:48.854350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58e3e29b-98b1-44f5-8ecb-48e065e41cca tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:48.858638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58e3e29b-98b1-44f5-8ecb-48e065e41cca tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:48.859504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58e3e29b-98b1-44f5-8ecb-48e065e41cca tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:48.859988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58e3e29b-98b1-44f5-8ecb-48e065e41cca tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:48.899754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:48.910156 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-480548a9-cbfe-4199-a394-13e5af002470 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1597 microversion: 2.1 time: 0.242624 May 14 21:16:48.910749 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 855/1764] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:48 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1597 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:48.950388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1acec163-97cc-4d7b-9258-20c1247eb00d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:48.951031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1acec163-97cc-4d7b-9258-20c1247eb00d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:49.194571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1acec163-97cc-4d7b-9258-20c1247eb00d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:49.209205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1acec163-97cc-4d7b-9258-20c1247eb00d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:49.211695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1acec163-97cc-4d7b-9258-20c1247eb00d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:49.220919 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1acec163-97cc-4d7b-9258-20c1247eb00d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1261 microversion: 2.25 time: 0.277841 May 14 21:16:49.222181 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 856/1765] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:48 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1261 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:49.243000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:49.243000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:49.251064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:49.254222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:49.255174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:49.256719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:49.626519 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58e3e29b-98b1-44f5-8ecb-48e065e41cca tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1618 microversion: 2.1 time: 1.085654 May 14 21:16:49.627924 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 910/1766] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:48 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1618 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:49.639790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-304d7dc8-4529-437e-911e-6726e8d904cf req-57fcaf4b-541f-47e7-9c70-20ce1ea68350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "name": "network-vif-unplugged", "status": "completed", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:49.656645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-304d7dc8-4529-437e-911e-6726e8d904cf req-57fcaf4b-541f-47e7-9c70-20ce1ea68350 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:49.657580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-304d7dc8-4529-437e-911e-6726e8d904cf req-57fcaf4b-541f-47e7-9c70-20ce1ea68350 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:49.688096 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-304d7dc8-4529-437e-911e-6726e8d904cf req-57fcaf4b-541f-47e7-9c70-20ce1ea68350 service nova] Creating event network-vif-unplugged:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch1-master-1 May 14 21:16:49.697667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-304d7dc8-4529-437e-911e-6726e8d904cf req-57fcaf4b-541f-47e7-9c70-20ce1ea68350 service nova] Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:16:49.717636 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-304d7dc8-4529-437e-911e-6726e8d904cf req-57fcaf4b-541f-47e7-9c70-20ce1ea68350 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087516 May 14 21:16:49.718819 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 911/1767] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:49.729198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fe903388-8852-43cb-a487-08d4222c5015 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: .version_select at 0x7fb1a78a4d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2071474482", "policies": ["affinity"]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:49.756682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-fe903388-8852-43cb-a487-08d4222c5015 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:49.758980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-fe903388-8852-43cb-a487-08d4222c5015 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:50.049724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:50.051990 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0518a81d-2fa3-4e63-9ea1-fc3fa1cf1721 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1475 microversion: 2.1 time: 0.825733 May 14 21:16:50.051990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 857/1768] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:49 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1475 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:50.065104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:50.066118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:50.073784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:50.074491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:50.075558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:50.076171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:50.194221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-fe903388-8852-43cb-a487-08d4222c5015 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:50.204439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-fe903388-8852-43cb-a487-08d4222c5015 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:50.240720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '053ae4d2abd445968a2d0a953fdbfc63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611dce182666487684bf1e2a687c523a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:50.249578 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fe903388-8852-43cb-a487-08d4222c5015 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.529037 May 14 21:16:50.252199 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 912/1769] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:16:49 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:50.255322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09300b41-008d-465e-968a-1273003a77b1 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 200 len: 1597 microversion: 2.1 time: 0.191479 May 14 21:16:50.256378 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 858/1770] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:50 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 1597 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:50.261553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:50.262301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:50.303862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:50.306607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:50.308308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:50.311086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:50.457053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:50.461829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2117175128", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "11f18c89-031b-470c-8f91-81f3a040bd15"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:50.468375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:50.475635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:50.478199 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-86105c55-2d18-41ae-b024-deaa30445abd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1257 microversion: 2.25 time: 0.224687 May 14 21:16:50.481777 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 913/1771] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:50 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1257 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:50.610067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:16:51.067764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:51.068929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:51.085843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:51.086614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:51.087683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:51.088516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:51.708537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:16:51.713598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:16:51.714470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:16:51.715297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:16:51.715975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:16:51.790773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:51.791241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:51.792094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:51.792550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:51.834066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:51.856086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:51.896638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:51.909393 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6b51a123-5683-4c5e-a43e-87c4e80634e1 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1475 microversion: 2.1 time: 0.844957 May 14 21:16:51.911110 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 914/1772] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:51 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1475 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:16:51.917836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:51.918455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Going to run 2 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:16:51.918888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] [instance: 75983071-f5ad-4c40-aa83-f61a98e5e823] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:51.926971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:51.930622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:51.930622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:51.930622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:51.933942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:16:51.953616 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] HTTP exception thrown: Instance 75983071-f5ad-4c40-aa83-f61a98e5e823 could not be found. May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Request method failure captured: May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 HTTP/1.1 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvnH0b95VTfE8AyclpajtV9IQrhXiVou1BBLWcNCSHfdVgdjGVOs1mnsAIJL48jLH436yBr-HwyLkubwohI4D-NV7hFEOXWopsvr_bsPoUPLG0ZFKuWj32e55uNMvLxLUAkcRlQTY7J9-z5cYbn-JpzeJoDu0Aj8O4SlzLFlYMWILA May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 611dce182666487684bf1e2a687c523a May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestFqdnHostnames-741043621 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/611dce182666487684bf1e2a687c523a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/611dce182666487684bf1e2a687c523a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/611dce182666487684bf1e2a687c523a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_611dce182666487684bf1e2a687c523a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestFqdnHostnames-741043621 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 611dce182666487684bf1e2a687c523a May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-741043621 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestFqdnHostnames-741043621-project May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 053ae4d2abd445968a2d0a953fdbfc63 May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestFqdnHostnames-741043621-project May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 75983071-f5ad-4c40-aa83-f61a98e5e823 could not be found. May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '75983071-f5ad-4c40-aa83-f61a98e5e823'} May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75983071-f5ad-4c40-aa83-f61a98e5e823 could not be found. May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75983071-f5ad-4c40-aa83-f61a98e5e823 could not be found. May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:16:51.956092 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75983071-f5ad-4c40-aa83-f61a98e5e823 could not be found. May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Returning 404 to user: Instance 75983071-f5ad-4c40-aa83-f61a98e5e823 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d09842a-2d89-4173-b68e-22c8dbabe3a3 tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823" status: 404 len: 111 microversion: 2.1 time: 0.045126 May 14 21:16:51.964004 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 915/1773] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:51 2022] GET /compute/v2.1/servers/75983071-f5ad-4c40-aa83-f61a98e5e823 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:16:51.995514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:51.997319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:52.020185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:52.029010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:52.032374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:52.033440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:52.072499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=130637) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 14 21:16:52.113766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:52.125673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:52.328768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:52.332133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:52.356483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:52.358216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:52.359640 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d037464-5132-41b2-9aa1-69f5c8c8a2bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1319 microversion: 2.25 time: 0.393243 May 14 21:16:52.361494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:52.362231 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 916/1774] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:51 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:52.414047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=b9f6c282-322e-4eac-b6d0-959de031b52a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:16:52.656481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:52.690704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:52.750133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-826d43cd-7d27-41b6-9e71-9cdef793f412 req-10f46d53-25d5-45a3-81e2-d883971e4dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75983071-f5ad-4c40-aa83-f61a98e5e823", "name": "network-vif-deleted", "tag": "bb09673c-8ab1-484e-bf52-805d25307965"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:52.750646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-826d43cd-7d27-41b6-9e71-9cdef793f412 req-10f46d53-25d5-45a3-81e2-d883971e4dcf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:52.751364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-826d43cd-7d27-41b6-9e71-9cdef793f412 req-10f46d53-25d5-45a3-81e2-d883971e4dcf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:52.778331 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-826d43cd-7d27-41b6-9e71-9cdef793f412 req-10f46d53-25d5-45a3-81e2-d883971e4dcf service nova] Creating event network-vif-deleted:bb09673c-8ab1-484e-bf52-805d25307965 for instance 75983071-f5ad-4c40-aa83-f61a98e5e823 on nch2-master-1 May 14 21:16:52.788054 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-826d43cd-7d27-41b6-9e71-9cdef793f412 req-10f46d53-25d5-45a3-81e2-d883971e4dcf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.420675 May 14 21:16:52.789094 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 917/1775] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:52.795281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ada97cb2-c8d6-47e5-ad37-b76c4b95173d tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] Calling method '.version_select at 0x7fb1a77d2160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:52.887676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:52.920315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:52.941485 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ada97cb2-c8d6-47e5-ad37-b76c4b95173d tempest-ServersTestFqdnHostnames-741043621 tempest-ServersTestFqdnHostnames-741043621-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-983872793" status: 202 len: 0 microversion: 2.1 time: 0.150942 May 14 21:16:52.942995 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 918/1776] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:16:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-983872793 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:16:52.949856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:52.950954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:52.969514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:52.970351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:52.971412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:52.972104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:52.998381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18ef8b85-2d45-4fc0-9093-9c951bb20e0e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.534609 May 14 21:16:52.998381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 859/1777] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:16:50 2022] POST /compute/v2.1/servers => generated 32 bytes in 2536 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) May 14 21:16:53.008406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:53.021518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:53.025786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Searching by: {'deleted': False, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:16:53.078138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:53.080043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:53.084286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:53.085206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:53.258760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:16:53.355963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-004bebce-3d14-48a4-b361-4bb8bd5aadee tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.351688 May 14 21:16:53.362653 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 860/1778] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:16:53 2022] GET /compute/v2.1/servers => generated 1004 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:53.377276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad8aa6c5-38fe-455d-8448-0df57a5f1e90 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:53.380829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad8aa6c5-38fe-455d-8448-0df57a5f1e90 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:53.514211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:53.522174 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c37942b4-3f9c-4911-a0b8-4bfd88622095 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1475 microversion: 2.1 time: 0.577765 May 14 21:16:53.524641 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 919/1779] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:52 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1475 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:53.532451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:53.533377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:53.539876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:53.540453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:53.541389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:53.541939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:53.768579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:53.788371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:53.790623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:53.803161 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1961a663-6314-4824-a612-c828483b10f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1319 microversion: 2.25 time: 0.269899 May 14 21:16:53.804163 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 920/1780] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:53 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:53.884688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1369352006", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3532d5d6-e949-4efd-bf19-71c3a4c24862"}, {"uuid": "851d4d49-a0cc-40d8-8232-23236598d69b"}, {"uuid": "3532d5d6-e949-4efd-bf19-71c3a4c24862"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:54.008702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] validate_networks() for [('3532d5d6-e949-4efd-bf19-71c3a4c24862', None, None, None, None, None), ('851d4d49-a0cc-40d8-8232-23236598d69b', None, None, None, None, None), ('3532d5d6-e949-4efd-bf19-71c3a4c24862', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:16:54.302133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad8aa6c5-38fe-455d-8448-0df57a5f1e90 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:54.313923 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad8aa6c5-38fe-455d-8448-0df57a5f1e90 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1219 microversion: 2.1 time: 0.950078 May 14 21:16:54.314776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 861/1781] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:53 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1219 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:54.541952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:54.542839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:54.551344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:54.552033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:54.569700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:54.570630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:55.369080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:55.377680 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ec251a0-db63-42b5-8169-fc5aa8236ed4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1475 microversion: 2.1 time: 0.840005 May 14 21:16:55.397316 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 862/1782] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:54 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1475 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:55.397316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0b708747-cb92-4cc7-bffe-52fe8d71538f req-3e3026a4-742f-422d-8c4a-b8480124bfbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:16:55.415160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0b708747-cb92-4cc7-bffe-52fe8d71538f req-3e3026a4-742f-422d-8c4a-b8480124bfbf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:55.415768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0b708747-cb92-4cc7-bffe-52fe8d71538f req-3e3026a4-742f-422d-8c4a-b8480124bfbf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:55.448748 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0b708747-cb92-4cc7-bffe-52fe8d71538f req-3e3026a4-742f-422d-8c4a-b8480124bfbf service nova] Creating event network-changed:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch1-master-1 May 14 21:16:55.460520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-0b708747-cb92-4cc7-bffe-52fe8d71538f req-3e3026a4-742f-422d-8c4a-b8480124bfbf service nova] Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:16:55.510753 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0b708747-cb92-4cc7-bffe-52fe8d71538f req-3e3026a4-742f-422d-8c4a-b8480124bfbf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115106 May 14 21:16:55.518218 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 863/1783] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:16:55.538028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:55.543395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:55.582147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:55.583324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:55.584269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:55.596056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:56.578289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:56.591042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:56.592803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:56.600854 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-42b00fe6-79dc-4ffa-802f-266f367ba6f0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 1.077859 May 14 21:16:56.601747 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 864/1784] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:55 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:16:56.608940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:56.620500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:56.629438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:56.629438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:56.629438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:56.629438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:56.969353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:56.980935 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7dfe7b70-e1a9-4864-a521-a57e79c60bd9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1215 microversion: 2.1 time: 0.377727 May 14 21:16:56.984742 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 865/1785] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:56 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1215 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:57.005440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:57.006231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:57.025878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:57.033053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:57.043713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:57.049245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:58.569766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:16:58.571772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:16:58.573212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:16:58.573867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:16:58.574524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:16:58.603078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:58.607743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:58.609200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:58.609887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:58.646669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Getting quotas for project 9197ea49e7544e7c96dd2d4b1a55fa29. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:16:58.654687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Getting quotas for user 6ae75ac4b3ed44eda1e8717ff641cd0c and project 9197ea49e7544e7c96dd2d4b1a55fa29. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:16:58.670168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:16:58.673231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:16:58.888468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:58.920935 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1152ed3-d1d5-4f61-953f-727eb4d4d26c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.041085 May 14 21:16:58.927756 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 921/1786] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 5048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:16:58.949389 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f02d01e5-a8f4-45d4-8b53-e5a27ab92e28 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1473 microversion: 2.1 time: 1.961493 May 14 21:16:58.950023 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 866/1787] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:56 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1473 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:58.959830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:58.959830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:58.990391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:58.992909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:58.994276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:58.997224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:59.016906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:59.020455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:16:59.051728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:59.052459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:59.054131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:16:59.054806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:16:59.727509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:16:59.727509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a7f610d-668b-4c0b-b20b-9597e694481b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1279 microversion: 2.1 time: 0.748761 May 14 21:16:59.738209 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 867/1788] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:58 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1279 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:16:59.754855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59bee9a9-8ead-4866-b3f7-d71db8e6ca0f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:16:59.755898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-59bee9a9-8ead-4866-b3f7-d71db8e6ca0f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:00.084227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-59bee9a9-8ead-4866-b3f7-d71db8e6ca0f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:00.102565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59bee9a9-8ead-4866-b3f7-d71db8e6ca0f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1213 microversion: 2.1 time: 0.361558 May 14 21:17:00.108821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 868/1789] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:16:59 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1213 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:00.131587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:00.133439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:00.154043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:00.169857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:00.176831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:00.184489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:00.975587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:01.001280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:01.005751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:01.010538 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9cdaad99-27f1-4fa3-af80-22bf37a16357 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 2.079448 May 14 21:17:01.013104 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 922/1790] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:16:58 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 2084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:01.025508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:01.029886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:01.044251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:01.045069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:01.046665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:01.050002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:01.651592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:01.681351 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0279d309-e238-4902-8108-3a1ce3200361 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1277 microversion: 2.1 time: 0.665087 May 14 21:17:01.691213 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 923/1791] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:01 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1277 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:01.709017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:01.710205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:01.741544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:01.743392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:01.744518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:01.745115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:01.845896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:01.855969 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa6a4985-ffbc-4165-b865-fa47f67718b3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1470 microversion: 2.1 time: 1.744788 May 14 21:17:01.860178 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 869/1792] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:00 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1470 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:01.877082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5278db53-2be9-4cba-8880-511db6867060 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:01.877629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5278db53-2be9-4cba-8880-511db6867060 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:01.907855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5278db53-2be9-4cba-8880-511db6867060 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:01.908606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5278db53-2be9-4cba-8880-511db6867060 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:01.909590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5278db53-2be9-4cba-8880-511db6867060 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:01.932202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5278db53-2be9-4cba-8880-511db6867060 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:02.075516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:02.088731 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-857dab1f-a699-4da4-990c-50341d96849f tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1265 microversion: 2.1 time: 0.392879 May 14 21:17:02.090765 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 924/1793] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:01 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:02.115303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:02.119209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:02.165980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:02.166444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:02.172950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:02.177268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:02.876440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:02.893029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:02.896228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:02.897720 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba8f1467-6da2-4f7d-b369-bd505d18f6b7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.805990 May 14 21:17:02.908703 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 925/1794] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:02 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:02.915823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:02.921297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:02.925031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:02.925587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:02.926446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:02.927117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:03.048790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:03.059799 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-85c6592d-a9d3-4771-9219-d1f911605b07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1277 microversion: 2.1 time: 0.149491 May 14 21:17:03.073547 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 926/1795] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:02 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:03.117545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:03.122649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:03.134970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:03.148212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:03.148212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:03.148212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:03.281947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:03.298040 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02f4e716-6a71-4fd5-99b6-cd7b40e0a817 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1283 microversion: 2.1 time: 0.190077 May 14 21:17:03.300065 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 927/1796] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:03 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1283 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:03.365808 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5278db53-2be9-4cba-8880-511db6867060 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "POST /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820/action" status: 202 len: 0 microversion: 2.1 time: 1.492256 May 14 21:17:03.370511 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 870/1797] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:17:01 2022] POST /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820/action => generated 0 bytes in 1494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:17:03.379275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:03.380708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:03.393642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:03.395068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:03.401094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:03.406279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:03.919097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:03.920074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:03.946072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:03.946072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:03.946072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:03.946072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:04.003157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:04.013612 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-10353eaa-48ff-4f46-b503-54007942ce9a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.640915 May 14 21:17:04.023379 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 928/1798] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:03 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:04.036561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ab4d085f-2625-4a9d-a4ff-2eb5d5246a77 req-e06e8d0e-4c44-4a6a-ae27-1e12530bd72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "name": "network-vif-plugged", "status": "completed", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:04.048635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ab4d085f-2625-4a9d-a4ff-2eb5d5246a77 req-e06e8d0e-4c44-4a6a-ae27-1e12530bd72c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:04.049520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ab4d085f-2625-4a9d-a4ff-2eb5d5246a77 req-e06e8d0e-4c44-4a6a-ae27-1e12530bd72c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:04.079425 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ab4d085f-2625-4a9d-a4ff-2eb5d5246a77 req-e06e8d0e-4c44-4a6a-ae27-1e12530bd72c service nova] Creating event network-vif-plugged:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch1-master-1 May 14 21:17:04.089108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-ab4d085f-2625-4a9d-a4ff-2eb5d5246a77 req-e06e8d0e-4c44-4a6a-ae27-1e12530bd72c service nova] Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:17:04.132735 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ab4d085f-2625-4a9d-a4ff-2eb5d5246a77 req-e06e8d0e-4c44-4a6a-ae27-1e12530bd72c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103614 May 14 21:17:04.132735 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 929/1799] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:04.151517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:04.155423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:04.168561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:04.173341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:04.178437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:04.178437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:04.312199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:04.328113 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ad6dd874-176c-4886-a5d5-dce9356a0b5f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1277 microversion: 2.1 time: 0.199400 May 14 21:17:04.339131 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 930/1800] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:04 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:04.349335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:04.351075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:04.370084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:04.370831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:04.374222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:04.375583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:04.538073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:04.550735 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa2ffc12-8a1d-4e8d-a4eb-e38e9f6d1a93 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1271 microversion: 2.1 time: 0.206755 May 14 21:17:04.551550 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 931/1801] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:04 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1271 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:05.038076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:05.038076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:05.043702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:05.044671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:05.046027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:05.046704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:05.478193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:05.494291 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-95501837-10cc-4bcf-8d9b-a9f6e6221397 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.462156 May 14 21:17:05.496070 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 932/1802] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:05 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:05.504589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:05.509226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:05.521139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:05.522277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:05.524271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:05.524449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:05.681013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:05.696950 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-67c2a2dd-7f9a-4615-9895-8940777ee231 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1277 microversion: 2.1 time: 0.199820 May 14 21:17:05.708035 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 933/1803] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:05 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:05.716530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:05.717729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:05.730795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:05.733016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:05.733016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:05.734762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:05.836704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:05.864056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:05.866275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:05.875630 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-647c0c44-b89f-47b0-a30a-1713cc9d7302 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 1.962947 May 14 21:17:05.880666 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 871/1804] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:03 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:05.884128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:05.892247 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fe907def-49d0-4f22-99c8-29e1c3b17a02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1271 microversion: 2.1 time: 0.182238 May 14 21:17:05.899169 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 934/1805] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:05 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:05.906190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a40d6651-8b57-49d8-82f6-86bee51a226e req-0d865fea-1985-4807-a896-78b6a20854ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd12aad-4b1b-4433-a46d-66a5d3fa7862", "tag": "1aef7905-067e-45bd-9e0e-044b18eaa72b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:05.959371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a40d6651-8b57-49d8-82f6-86bee51a226e req-0d865fea-1985-4807-a896-78b6a20854ce service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:05.959878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a40d6651-8b57-49d8-82f6-86bee51a226e req-0d865fea-1985-4807-a896-78b6a20854ce service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:06.001365 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a40d6651-8b57-49d8-82f6-86bee51a226e req-0d865fea-1985-4807-a896-78b6a20854ce service nova] Creating event network-changed:1aef7905-067e-45bd-9e0e-044b18eaa72b for instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 on nch1-master-1 May 14 21:17:06.018168 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a40d6651-8b57-49d8-82f6-86bee51a226e req-0d865fea-1985-4807-a896-78b6a20854ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135145 May 14 21:17:06.020546 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 872/1806] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:06.516309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:06.517380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:06.542680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:06.545607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:06.558757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:06.563063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:06.726496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:06.727756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:06.739090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:06.740064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:06.741066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:06.742024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:06.838928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:06.853019 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58546092-f121-4838-8f7b-5d3d385d6c0f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.341978 May 14 21:17:06.856942 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 935/1807] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:06 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:06.906182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:06.906817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:06.930987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:06.934994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:06.936888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:06.944239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:07.014595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:07.026763 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9168862-f767-46d5-a2e3-785fddcdb4a1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1277 microversion: 2.1 time: 0.305437 May 14 21:17:07.040753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 873/1808] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:06 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1277 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:07.040753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:07.040753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:07.072148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:07.078606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:07.078606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:07.078606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:07.532785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:07.548948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:07.551353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:07.553475 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14e039ec-65b9-47be-a894-74e43ac08719 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.654056 May 14 21:17:07.555215 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 936/1809] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:06 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:07.873168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:07.874165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:07.906965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:07.908321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:07.910131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:07.912618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:08.263512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:08.274349 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1061950b-ea10-40e8-b9ce-7deaa8066546 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.407807 May 14 21:17:08.274963 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 937/1810] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:07 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:08.283608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:08.290176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:08.304576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:08.309567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:08.309567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:08.309567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:08.823319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:08.843545 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eee8ab92-b159-4e15-87b1-05b5f1263cf6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 0.555588 May 14 21:17:08.857848 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 938/1811] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:08 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:08.869990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:08.870900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:08.886796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:08.888122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:08.889130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:08.890336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:09.249131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:09.264758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:09.266692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:09.271616 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a966e32d-6e29-4c23-8653-9f0b07a776f3 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.412262 May 14 21:17:09.275290 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 939/1812] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:08 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:09.291829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:09.292613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:09.305477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:09.306716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:09.307708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:09.309413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:09.349820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:09.359467 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5148130f-7192-4f45-8334-c081c8f2a8fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1313 microversion: 2.1 time: 2.326030 May 14 21:17:09.363610 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 874/1813] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:07 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1313 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:09.637519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-163da574-91ae-43f9-bded-70799207acfd req-bc24c103-d9bc-492e-9715-6fecb1cecb37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f6c282-322e-4eac-b6d0-959de031b52a", "tag": "577c7de2-4e7f-4990-ace6-4e5aa42e5998"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:09.652258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-163da574-91ae-43f9-bded-70799207acfd req-bc24c103-d9bc-492e-9715-6fecb1cecb37 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:09.655007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-163da574-91ae-43f9-bded-70799207acfd req-bc24c103-d9bc-492e-9715-6fecb1cecb37 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:09.681522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-163da574-91ae-43f9-bded-70799207acfd req-bc24c103-d9bc-492e-9715-6fecb1cecb37 service nova] Creating event network-changed:577c7de2-4e7f-4990-ace6-4e5aa42e5998 for instance b9f6c282-322e-4eac-b6d0-959de031b52a on nch1-master-1 May 14 21:17:09.697451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-163da574-91ae-43f9-bded-70799207acfd req-bc24c103-d9bc-492e-9715-6fecb1cecb37 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063609 May 14 21:17:09.698785 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 875/1814] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:17:09.740073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:09.760859 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e3bc315-ac80-4d66-ad18-258d5ca1cf2a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.474212 May 14 21:17:09.761501 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 940/1815] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:09 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:09.863863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:09.864685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:09.890356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:09.891070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:09.892244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:09.894137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:10.298808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:10.298808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:10.309650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:10.329657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:10.331233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:10.331983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:10.650751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:10.673115 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0834bfc3-ee52-496f-9d3a-5a8c51973df9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 0.813461 May 14 21:17:10.680705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 876/1816] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:09 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:10.688567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:10.693998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:10.707942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:10.714177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:10.714177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:10.714177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:10.778100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:10.798575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:10.805041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:10.811820 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d2ce504-1a18-421c-bbf0-6be7e45f7d4d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.521652 May 14 21:17:10.813238 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 941/1817] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:10 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:10.822731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:10.823423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:10.829723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:10.830178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:10.831135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:10.831607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:11.070953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:11.087726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:11.088985 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dea1d0bb-0ead-45a7-bb74-ae446439fedc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.274448 May 14 21:17:11.098692 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 942/1818] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:10 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:11.100548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-41a47f03-b13a-4ae2-95fc-9e10fc4847c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1313 microversion: 2.1 time: 0.418752 May 14 21:17:11.103078 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 877/1819] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:10 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:11.568889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d7dd2db2-8561-4d48-8f4b-34a59ed4c4e3 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Action: 'create', calling method: .version_select at 0x7fb1a77d2310>, body: {"keypair": {"name": "tempest-keypair-1727142335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK70j3LPBr1EpU5qLKE3lxKlGAJ7nuDWJVZfCceSzxjoQEVGC6JJWxjkkFFZLTPKhy+Z3STTAWIcW68IoUvUq33iCZCIpbqVOM7DZEbSUD4v5yb7KQ0BoKSu26zdsbgdiw=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:11.599918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d7dd2db2-8561-4d48-8f4b-34a59ed4c4e3 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Getting quotas for project ef1f3155d52e42bb9c54f43a8360a74e. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:11.611599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d7dd2db2-8561-4d48-8f4b-34a59ed4c4e3 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Getting quotas for user 4e87a5a5713748b6a0d73984a279009b and project ef1f3155d52e42bb9c54f43a8360a74e. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:11.693284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:11.693895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:11.703045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:11.711681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:11.712825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:11.713434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:11.774434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d7dd2db2-8561-4d48-8f4b-34a59ed4c4e3 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.304075 May 14 21:17:11.780661 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 943/1820] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:17:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:11.832105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:11.832807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:11.844269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:11.848806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:11.848806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:11.848806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:12.269195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:12.283425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:12.287584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:12.304798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5fd88776-9254-4ecd-a0da-9755a59e7b8a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.465304 May 14 21:17:12.304798 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 944/1821] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:11 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:12.318304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:12.319441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:12.336593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:12.339294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:12.340427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:12.341135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:13.153342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:13.164643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffe087a2-e9d9-479a-9747-a8ef7673365b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 1.475027 May 14 21:17:13.166371 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 878/1822] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:11 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:13.172520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:13.178118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:13.198118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:13.200503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:13.202529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:13.205064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:13.406663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:13.420815 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e18002a-504d-418c-8d6d-17df106c5b69 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 1.112536 May 14 21:17:13.431593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 945/1823] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:12 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:13.438685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:13.439353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:13.449290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:13.449290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:13.449290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:13.449290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:13.671581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:13.685174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:13.686703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:13.691677 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1fd9dc13-51c7-4890-80cc-344c9f870d14 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.258613 May 14 21:17:13.692762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 946/1824] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:13 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:13.891178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:13.899198 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8088c8ec-1a28-4dbc-b96b-e9ce2f6cc39e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1334 microversion: 2.1 time: 0.731586 May 14 21:17:13.904680 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 879/1825] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:13 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1334 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:14.186908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:14.187947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:14.234958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:14.237905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:14.238772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:14.247895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:14.308242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b4f86eeb-fcf6-4269-8aa2-a6706fc1962f req-12146722-93a8-4bb3-929f-1c113fa7a338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62fa985e-ce99-4aa4-b8f4-7eea574ff735", "tag": "8d9e55ad-f15d-4d89-82b6-1590b8ae3515"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:14.330553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4f86eeb-fcf6-4269-8aa2-a6706fc1962f req-12146722-93a8-4bb3-929f-1c113fa7a338 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:14.333520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4f86eeb-fcf6-4269-8aa2-a6706fc1962f req-12146722-93a8-4bb3-929f-1c113fa7a338 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:14.384809 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b4f86eeb-fcf6-4269-8aa2-a6706fc1962f req-12146722-93a8-4bb3-929f-1c113fa7a338 service nova] Creating event network-changed:8d9e55ad-f15d-4d89-82b6-1590b8ae3515 for instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 on nch1-master-1 May 14 21:17:14.416631 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b4f86eeb-fcf6-4269-8aa2-a6706fc1962f req-12146722-93a8-4bb3-929f-1c113fa7a338 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112804 May 14 21:17:14.420003 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 880/1826] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:14.440172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:14.440883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:14.467772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:14.469239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:14.474877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:14.475352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:14.637235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:14.649698 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9d7e8759-dca5-4f50-b8a0-1ba26b13c307 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 0.470913 May 14 21:17:14.660810 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 947/1827] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:14 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:14.712232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:14.714581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:14.730425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:14.734926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:14.737269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:14.739123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:15.024152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:15.034457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:15.041062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:15.053311 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50c9018d-a40b-4586-a030-f3923ec75709 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.336114 May 14 21:17:15.053311 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 948/1828] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:14 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:15.058046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:15.058845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:15.081787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:15.083956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:15.086478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:15.087076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:15.674848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:15.683355 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e60fa9d5-2b0a-4f25-bdcd-9ce9cf25d58e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1334 microversion: 2.1 time: 0.635789 May 14 21:17:15.684003 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 949/1829] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:15 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1334 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:15.688555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:15.689354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:15.702048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:15.702521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:15.703319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:15.703990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:15.709512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:15.724169 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-247be893-5417-4b58-ab70-83c62e7fbd0a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 1.289180 May 14 21:17:15.726392 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 881/1830] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:14 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:16.061401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:16.062024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:16.075847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:16.076322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:16.077139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:16.077580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:16.133505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:16.145006 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9fea6ab4-aedf-4ece-8222-0cc8036e3625 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 0.459877 May 14 21:17:16.158636 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 950/1831] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:15 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:16.682354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2d252922-dccf-4884-b4ee-9e178be09a03 req-79ba290b-f386-4ef2-a6fa-06afa64278b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd12aad-4b1b-4433-a46d-66a5d3fa7862", "name": "network-vif-plugged", "status": "completed", "tag": "1aef7905-067e-45bd-9e0e-044b18eaa72b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:16.726933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2d252922-dccf-4884-b4ee-9e178be09a03 req-79ba290b-f386-4ef2-a6fa-06afa64278b4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:16.727797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2d252922-dccf-4884-b4ee-9e178be09a03 req-79ba290b-f386-4ef2-a6fa-06afa64278b4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:16.760404 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2d252922-dccf-4884-b4ee-9e178be09a03 req-79ba290b-f386-4ef2-a6fa-06afa64278b4 service nova] Creating event network-vif-plugged:1aef7905-067e-45bd-9e0e-044b18eaa72b for instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 on nch1-master-1 May 14 21:17:16.782295 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2d252922-dccf-4884-b4ee-9e178be09a03 req-79ba290b-f386-4ef2-a6fa-06afa64278b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415833 May 14 21:17:16.802578 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 951/1832] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:16.841634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:16.857112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:16.883877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:16.888436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:16.890054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:16.893834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:17.607596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:17.618154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:17.620108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:17.623232 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e2984d8-f569-44eb-ac7b-996b6c9b67bd tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 1.564799 May 14 21:17:17.624770 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 882/1833] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:16 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:17.634702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:17.635575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:17.643039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:17.646128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:17.646128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:17.646128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:17.742487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:17.776561 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5c66669b-9da2-439c-94b9-2c5d93da8f11 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.956710 May 14 21:17:17.777515 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 952/1834] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:16 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:17.782859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:17.783851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:17.797000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:17.798087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:17.802864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:17.804576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:18.195825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:18.204260 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a1d889b-de79-4190-a724-103d06ca126e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 0.425405 May 14 21:17:18.205344 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 953/1835] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:17 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:18.273339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:18.287277 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-232cf7db-8463-4b50-9877-dbf41642cb25 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.659673 May 14 21:17:18.297775 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 883/1836] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:17 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:18.304962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0d7864e5-605d-4c4d-887a-be4ef6dac2d1 req-4219c70d-1f2a-4071-b267-64b730f77062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "name": "network-vif-unplugged", "status": "completed", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:18.317173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14ec3c1c-6a47-4b01-a0b8-006a49fdd58a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'create', calling method: .version_select at 0x7fb1a77e3790>, body: {"keypair": {"name": "tempest-keypair-1240623792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDVOqv4fQ669PvYaKp3yzI1kj+hvl6XkUsmD8sfxDliShWEOQ7bypubIR/c8/UM323Yk9VVpXAX1JeNh/OX2GQzF+Snj75xr2KPZP+mnhnzkv2VFhWCvr3+eF77BcT6Ew=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:18.320645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0d7864e5-605d-4c4d-887a-be4ef6dac2d1 req-4219c70d-1f2a-4071-b267-64b730f77062 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:18.320645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0d7864e5-605d-4c4d-887a-be4ef6dac2d1 req-4219c70d-1f2a-4071-b267-64b730f77062 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:18.343054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-14ec3c1c-6a47-4b01-a0b8-006a49fdd58a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for project a924ca59a9ac44cf96e53be012a43af1. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:18.354820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0d7864e5-605d-4c4d-887a-be4ef6dac2d1 req-4219c70d-1f2a-4071-b267-64b730f77062 service nova] Creating event network-vif-unplugged:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch2-master-1 May 14 21:17:18.371471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-0d7864e5-605d-4c4d-887a-be4ef6dac2d1 req-4219c70d-1f2a-4071-b267-64b730f77062 service nova] Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:17:18.385704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-14ec3c1c-6a47-4b01-a0b8-006a49fdd58a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for user a42e0caa0878447f98544e74f767c7ca and project a924ca59a9ac44cf96e53be012a43af1. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:18.400873 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0d7864e5-605d-4c4d-887a-be4ef6dac2d1 req-4219c70d-1f2a-4071-b267-64b730f77062 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098132 May 14 21:17:18.401791 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 884/1837] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:18.502943 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14ec3c1c-6a47-4b01-a0b8-006a49fdd58a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.296210 May 14 21:17:18.505048 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 954/1838] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:17:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:18.643372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:18.644980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:18.659128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:18.662668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:18.665467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:18.667093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:18.804511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:18.811175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:18.841470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:18.841690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:18.842542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:18.863425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:19.451541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:19.469651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:19.471287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:19.472713 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d4a4309e-2022-4bb3-a156-a8bf5f06ed60 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1361 microversion: 2.25 time: 0.834195 May 14 21:17:19.473472 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 885/1839] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:18 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1361 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:19.489782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:19.496352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:19.502966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:19.503429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:19.504251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:19.504698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:19.562592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:19.571885 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-975936f2-9d9d-4170-a49d-480d47f422dd tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.781768 May 14 21:17:19.575787 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 955/1840] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:18 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:19.581610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:19.591963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:19.594520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:19.595215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:19.596361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:19.597035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:20.538455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:20.549118 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fa391ea4-6b7b-4845-ae40-02178a8befe5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.971813 May 14 21:17:20.555408 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 956/1841] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:19 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:20.562388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:20.568484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:20.584456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:20.587313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:20.590834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:20.591514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:20.634118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:20.646171 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c64e52fa-4440-4a11-a317-9286838f19c3 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 1.167602 May 14 21:17:20.647752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 886/1842] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:19 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:20.659024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e3c6e46c-ec67-4b3e-ae09-1deaa8745c11 req-7797bbbe-7608-4ea6-b475-1a90adab4281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f6c282-322e-4eac-b6d0-959de031b52a", "name": "network-vif-plugged", "status": "completed", "tag": "577c7de2-4e7f-4990-ace6-4e5aa42e5998"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:20.679120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e3c6e46c-ec67-4b3e-ae09-1deaa8745c11 req-7797bbbe-7608-4ea6-b475-1a90adab4281 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:20.679663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e3c6e46c-ec67-4b3e-ae09-1deaa8745c11 req-7797bbbe-7608-4ea6-b475-1a90adab4281 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:20.701566 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e3c6e46c-ec67-4b3e-ae09-1deaa8745c11 req-7797bbbe-7608-4ea6-b475-1a90adab4281 service nova] Creating event network-vif-plugged:577c7de2-4e7f-4990-ace6-4e5aa42e5998 for instance b9f6c282-322e-4eac-b6d0-959de031b52a on nch1-master-1 May 14 21:17:20.714433 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e3c6e46c-ec67-4b3e-ae09-1deaa8745c11 req-7797bbbe-7608-4ea6-b475-1a90adab4281 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061864 May 14 21:17:20.717204 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 887/1843] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:20.743975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:20.744690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:20.781084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:20.782211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:20.783092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:20.799507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:21.459051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:21.467194 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-819f75b3-0c0c-41a5-a56c-f3ef17fe6a6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.748547 May 14 21:17:21.476979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 888/1844] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:20 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:21.482941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:21.489731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-3b77a3cf-9578-4e68-ad89-f0f2160898c7 req-fdd35705-46d3-4299-b701-e3d1c7d656f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}, {"name": "network-changed", "server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "tag": "71f13a97-5bd0-4446-9085-0270aee83186"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:21.490520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:21.493080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:21.494525 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-90944c1c-1153-4419-a03b-5b821ae42701 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1558 microversion: 2.25 time: 0.936098 May 14 21:17:21.495655 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 957/1845] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:20 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1558 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:21.512248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:21.513165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:21.513923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3b77a3cf-9578-4e68-ad89-f0f2160898c7 req-fdd35705-46d3-4299-b701-e3d1c7d656f4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:21.517382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3b77a3cf-9578-4e68-ad89-f0f2160898c7 req-fdd35705-46d3-4299-b701-e3d1c7d656f4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:21.528502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:21.529215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:21.530206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:21.530841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:21.586237 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-3b77a3cf-9578-4e68-ad89-f0f2160898c7 req-fdd35705-46d3-4299-b701-e3d1c7d656f4 service nova] Creating event network-changed:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch2-master-1 May 14 21:17:21.586762 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-3b77a3cf-9578-4e68-ad89-f0f2160898c7 req-fdd35705-46d3-4299-b701-e3d1c7d656f4 service nova] Creating event network-changed:71f13a97-5bd0-4446-9085-0270aee83186 for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:21.598299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-3b77a3cf-9578-4e68-ad89-f0f2160898c7 req-fdd35705-46d3-4299-b701-e3d1c7d656f4 service nova] Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:17:21.620989 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-3b77a3cf-9578-4e68-ad89-f0f2160898c7 req-fdd35705-46d3-4299-b701-e3d1c7d656f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.143057 May 14 21:17:21.622252 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 889/1846] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:21.629935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:21.630722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:21.640546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:21.641196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:21.644293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:21.644821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:22.256190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:22.267276 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d0252b9c-0fc2-4d5f-85b1-ed597a570644 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.643730 May 14 21:17:22.270734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 890/1847] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:21 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:22.270869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:22.277078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:22.277861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:22.292476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:22.293430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:22.294898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:22.296690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:22.304383 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-91951070-408e-4883-bcd6-8636fcabd77e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 2050 microversion: 2.25 time: 0.795627 May 14 21:17:22.307514 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 958/1848] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:21 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 2050 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:17:22.329017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b1e49c1b-db50-4466-b584-d16aa7a5f4ea tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:22.333699 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:17:22.333699 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:17:22.345957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e49c1b-db50-4466-b584-d16aa7a5f4ea tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:22.350656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e49c1b-db50-4466-b584-d16aa7a5f4ea tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:22.352473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e49c1b-db50-4466-b584-d16aa7a5f4ea tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:22.353011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e49c1b-db50-4466-b584-d16aa7a5f4ea tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:22.438218 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b1e49c1b-db50-4466-b584-d16aa7a5f4ea tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.109913 May 14 21:17:22.439290 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 959/1849] 10.222.0.52 () {60 vars in 1216 bytes} [Sat May 14 21:17:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 21:17:22.487185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:22.487947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:22.513671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:22.522089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:22.524801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:22.526026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:22.936961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:22.948172 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-582afc68-62f6-49a5-9087-ab5b3cfec9ee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.468377 May 14 21:17:22.964771 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 960/1850] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:22 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:22.973050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-75ce1ff4-0b88-4f16-bcfd-b5f3b2f5dd2c req-034ca44a-f11e-4b1f-8627-a401f5468c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fa985e-ce99-4aa4-b8f4-7eea574ff735", "name": "network-vif-plugged", "status": "completed", "tag": "8d9e55ad-f15d-4d89-82b6-1590b8ae3515"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:22.992795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-75ce1ff4-0b88-4f16-bcfd-b5f3b2f5dd2c req-034ca44a-f11e-4b1f-8627-a401f5468c9f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:22.992795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-75ce1ff4-0b88-4f16-bcfd-b5f3b2f5dd2c req-034ca44a-f11e-4b1f-8627-a401f5468c9f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:23.001443 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-75ce1ff4-0b88-4f16-bcfd-b5f3b2f5dd2c req-034ca44a-f11e-4b1f-8627-a401f5468c9f service nova] Creating event network-vif-plugged:8d9e55ad-f15d-4d89-82b6-1590b8ae3515 for instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 on nch1-master-1 May 14 21:17:23.008605 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-75ce1ff4-0b88-4f16-bcfd-b5f3b2f5dd2c req-034ca44a-f11e-4b1f-8627-a401f5468c9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040955 May 14 21:17:23.009658 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 961/1851] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:23.292430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:23.295065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:23.307753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:23.309679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:23.311165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:23.311929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:23.470375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:23.504481 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2fe1a71f-917e-412e-9508-c1ba22c1d946 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 1.234475 May 14 21:17:23.511465 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 891/1852] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:22 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:23.695706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:23.721823 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de539bb2-d9af-481f-aa32-61e897fd51b8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.431188 May 14 21:17:23.721823 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 962/1853] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:23 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:23.980233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:23.980794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:24.000974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:24.004761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:24.007381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:24.009016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:24.539976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:24.541501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:24.553377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:24.554195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:24.555981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:24.556639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:24.760385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:24.777125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:24.777883 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a7e28736-ec84-45b2-8caa-eed1ae28910b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1319 microversion: 2.1 time: 0.242611 May 14 21:17:24.777883 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 963/1854] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:24 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:24.779306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:24.780071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:24.787780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:24.789218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:24.789883 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c27b496e-229e-4c07-8c4a-2cd47c07a8c4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.824463 May 14 21:17:24.790929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:24.791721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:24.801602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 892/1855] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:23 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:24.945673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:24.953944 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1f7e493-cb05-4f70-bebd-8bc4fd0e8d3a tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1469 microversion: 2.1 time: 0.179386 May 14 21:17:24.954665 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 964/1856] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:24 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:25.299126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d0e49e99-cfa4-404e-a87f-421dc60629e4 req-c31f27f8-face-4dfe-903a-fce9174b2e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "tag": "e3119c30-cd1d-44fb-bf9c-dd51415d53ae"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:25.317500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d0e49e99-cfa4-404e-a87f-421dc60629e4 req-c31f27f8-face-4dfe-903a-fce9174b2e68 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:25.322108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d0e49e99-cfa4-404e-a87f-421dc60629e4 req-c31f27f8-face-4dfe-903a-fce9174b2e68 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:25.350543 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d0e49e99-cfa4-404e-a87f-421dc60629e4 req-c31f27f8-face-4dfe-903a-fce9174b2e68 service nova] Creating event network-changed:e3119c30-cd1d-44fb-bf9c-dd51415d53ae for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:25.358289 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d0e49e99-cfa4-404e-a87f-421dc60629e4 req-c31f27f8-face-4dfe-903a-fce9174b2e68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069071 May 14 21:17:25.359687 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 893/1857] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:25.791986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:25.792735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:25.800657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:25.801396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:25.802948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:25.802948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:25.810087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:25.810930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:25.827337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:25.828455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:25.830575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:25.832096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:26.048871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:26.063641 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a875ec0-c390-4da8-afa6-91f4002f938d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1469 microversion: 2.1 time: 0.278293 May 14 21:17:26.069437 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 965/1858] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:25 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:26.079114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1818655953", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5fb69a44-68f6-44d7-9bcb-ee9798387585"}], "security_groups": [{"name": "tempest-securitygroup--226020611"}], "key_name": "tempest-keypair-1240623792", "user_data": "}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:26.220362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] validate_networks() for [('5fb69a44-68f6-44d7-9bcb-ee9798387585', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:17:26.308135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:26.316917 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00f15b99-69bf-4217-9b5f-67a4239d58e3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.510794 May 14 21:17:26.317519 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 894/1859] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:25 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:26.324337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:26.324966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:26.331352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:26.331855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:26.332655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:26.333435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:26.705375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:17:26.706241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:17:26.707433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:17:26.708258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:17:26.708947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:17:26.721307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:26.722076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:26.722907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:26.723371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:26.743704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:26.750329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for user a42e0caa0878447f98544e74f767c7ca and project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:26.765015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:17:26.767849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:17:26.974911 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd991043-dbc5-432a-b4aa-d917b33ceeb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.903828 May 14 21:17:26.977204 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 966/1860] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:17:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:17:26.987424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:26.989864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:27.009747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.010216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.011249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.019116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.122016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:27.138765 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c86bce3b-aec4-4157-8cb4-152491f63f27 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1462 microversion: 2.1 time: 0.815789 May 14 21:17:27.139415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 895/1861] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:26 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1462 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:27.159806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b363af3-3b5b-4d67-bbfa-6d857475ae5d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a72aa90-a850-47be-bc0c-572dbc34980a", "device": "/dev/xvdb"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:27.165976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b363af3-3b5b-4d67-bbfa-6d857475ae5d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:27.184690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b363af3-3b5b-4d67-bbfa-6d857475ae5d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.185422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b363af3-3b5b-4d67-bbfa-6d857475ae5d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.189979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b363af3-3b5b-4d67-bbfa-6d857475ae5d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.190455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b363af3-3b5b-4d67-bbfa-6d857475ae5d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.258318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:27.266826 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c27c564-4fbc-4fae-815c-fc3cfec7c1f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1468 microversion: 2.1 time: 0.288087 May 14 21:17:27.277973 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 967/1862] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:26 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1468 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:27.285366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cca56585-0f1b-4f43-aa99-33ce81e071c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:27.286001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cca56585-0f1b-4f43-aa99-33ce81e071c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:27.383915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cca56585-0f1b-4f43-aa99-33ce81e071c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:27.393571 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cca56585-0f1b-4f43-aa99-33ce81e071c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1239 microversion: 2.1 time: 0.114451 May 14 21:17:27.396435 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 968/1863] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:27 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1239 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:27.404288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0cff7881-94c1-4f47-87dc-de547f172a60 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:27.405505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0cff7881-94c1-4f47-87dc-de547f172a60 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:27.415770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cff7881-94c1-4f47-87dc-de547f172a60 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.417022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cff7881-94c1-4f47-87dc-de547f172a60 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.418031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cff7881-94c1-4f47-87dc-de547f172a60 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.418661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cff7881-94c1-4f47-87dc-de547f172a60 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.604775 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0cff7881-94c1-4f47-87dc-de547f172a60 tempest-MigrationsAdminTest-161637913 tempest-MigrationsAdminTest-161637913-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1613 microversion: 2.1 time: 0.205680 May 14 21:17:27.610889 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 969/1864] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:27 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1613 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:27.624964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:27.628723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:27.630025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Searching by: {'reservation_id': 'r-sqgc0e7s', 'deleted': False, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:17:27.647877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.648625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.649637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.650620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:27.831328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:17:27.949066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:27.958169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:27.958912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.128711 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-08e30a3d-43fc-4a5f-a9f7-69c0a9098b7a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-sqgc0e7s" status: 200 len: 2930 microversion: 2.1 time: 0.520692 May 14 21:17:28.134447 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 970/1865] 10.222.0.52 () {58 vars in 1196 bytes} [Sat May 14 21:17:27 2022] GET /compute/v2.1/servers/detail?reservation_id=r-sqgc0e7s => generated 2930 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:28.139152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:28.139794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:28.147576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.159405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.159405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.159405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.316610 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b363af3-3b5b-4d67-bbfa-6d857475ae5d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "POST /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.172863 May 14 21:17:28.327239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 896/1866] 10.222.0.52 () {62 vars in 1363 bytes} [Sat May 14 21:17:27 2022] POST /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:17:28.342656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:28.343591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:28.357548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.359068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.360149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.360849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.395393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:28.415913 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0c7d6cd2-c96e-45ea-afdd-0bdbc1d2545e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.271351 May 14 21:17:28.415913 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 971/1867] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:28 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:28.421451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:17:28.425716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e43a16b-0835-432d-b31a-4f9439bea4ef tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:28.465955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.server_groups [None req-5e43a16b-0835-432d-b31a-4f9439bea4ef tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Querying cell eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) for 2 instances {{(pid=130638) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 14 21:17:28.466897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e43a16b-0835-432d-b31a-4f9439bea4ef tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.467441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e43a16b-0835-432d-b31a-4f9439bea4ef tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.515949 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e43a16b-0835-432d-b31a-4f9439bea4ef tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/11f18c89-031b-470c-8f91-81f3a040bd15" status: 200 len: 266 microversion: 2.1 time: 0.107298 May 14 21:17:28.521348 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 972/1868] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:17:28 2022] GET /compute/v2.1/os-server-groups/11f18c89-031b-470c-8f91-81f3a040bd15 => generated 266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:28.523377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a98257e3-126f-4531-bf52-e2eac6d3f835 req-097dcbaf-c964-428c-97fe-19f3b39ff439 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "tag": "397f9ff4-1b58-4780-9dd6-0187ed997835"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:28.533748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a98257e3-126f-4531-bf52-e2eac6d3f835 req-097dcbaf-c964-428c-97fe-19f3b39ff439 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.534480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a98257e3-126f-4531-bf52-e2eac6d3f835 req-097dcbaf-c964-428c-97fe-19f3b39ff439 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.558771 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a98257e3-126f-4531-bf52-e2eac6d3f835 req-097dcbaf-c964-428c-97fe-19f3b39ff439 service nova] Creating event network-changed:397f9ff4-1b58-4780-9dd6-0187ed997835 for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:28.583992 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a98257e3-126f-4531-bf52-e2eac6d3f835 req-097dcbaf-c964-428c-97fe-19f3b39ff439 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065125 May 14 21:17:28.585707 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 973/1869] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:28.594456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:28.595275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:28.602843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.604099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.605857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.606392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.728509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:28.739383 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c635301-eddd-4768-a5f3-cf63b5184fd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1243 microversion: 2.1 time: 0.151588 May 14 21:17:28.740509 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 974/1870] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:28 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1243 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:28.746663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-55cad090-e6f6-4b3f-bfaa-f591e6f35398 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:28.747616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-55cad090-e6f6-4b3f-bfaa-f591e6f35398 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:28.759633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55cad090-e6f6-4b3f-bfaa-f591e6f35398 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.759633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55cad090-e6f6-4b3f-bfaa-f591e6f35398 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.760488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55cad090-e6f6-4b3f-bfaa-f591e6f35398 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.760970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55cad090-e6f6-4b3f-bfaa-f591e6f35398 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.814999 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9584a491-4e1d-4823-bf60-951884a9b9d8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 204 len: 0 microversion: 2.1 time: 0.485748 May 14 21:17:28.816586 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 897/1871] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:17:28 2022] DELETE /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:17:28.827595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:28.828916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:28.841584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.842914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:28.845243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:28.845243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.035678 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-55cad090-e6f6-4b3f-bfaa-f591e6f35398 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 200 len: 1620 microversion: 2.1 time: 0.290251 May 14 21:17:29.036725 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 975/1872] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:28 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 1620 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:29.055250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea421443-3461-41b6-a41c-9cc9d5d14146 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:29.056321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea421443-3461-41b6-a41c-9cc9d5d14146 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:29.065098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea421443-3461-41b6-a41c-9cc9d5d14146 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:29.065740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea421443-3461-41b6-a41c-9cc9d5d14146 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.067602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea421443-3461-41b6-a41c-9cc9d5d14146 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:29.074002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea421443-3461-41b6-a41c-9cc9d5d14146 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.139944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:29.148889 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96ee67a2-f575-49e8-b2c1-3cb6cdc01653 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1468 microversion: 2.1 time: 0.328362 May 14 21:17:29.154066 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 898/1873] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:28 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1468 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:29.159903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-764e17df-7e89-4da4-99ee-ca0052a89950 req-7457980f-245c-4c02-95af-c1f960d44d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "name": "network-vif-plugged", "status": "completed", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:29.168889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-764e17df-7e89-4da4-99ee-ca0052a89950 req-7457980f-245c-4c02-95af-c1f960d44d28 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:29.169551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-764e17df-7e89-4da4-99ee-ca0052a89950 req-7457980f-245c-4c02-95af-c1f960d44d28 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.191353 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-764e17df-7e89-4da4-99ee-ca0052a89950 req-7457980f-245c-4c02-95af-c1f960d44d28 service nova] Creating event network-vif-plugged:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch2-master-1 May 14 21:17:29.197468 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-764e17df-7e89-4da4-99ee-ca0052a89950 req-7457980f-245c-4c02-95af-c1f960d44d28 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043207 May 14 21:17:29.198228 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 899/1874] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:29.257693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea421443-3461-41b6-a41c-9cc9d5d14146 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1619 microversion: 2.1 time: 0.207241 May 14 21:17:29.259469 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 976/1875] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:29 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1619 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:29.281252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-41628770-a9e7-45bc-90c9-5c4ff6f9ff6a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: .version_select at 0x7fb1a767dd30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-982885949", "policies": ["anti-affinity"]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:29.311080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-41628770-a9e7-45bc-90c9-5c4ff6f9ff6a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:29.320058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-41628770-a9e7-45bc-90c9-5c4ff6f9ff6a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:29.429100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:29.429100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:29.440835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:29.441221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.441996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:29.442437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.473025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-41628770-a9e7-45bc-90c9-5c4ff6f9ff6a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:29.488750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-41628770-a9e7-45bc-90c9-5c4ff6f9ff6a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:29.519780 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-41628770-a9e7-45bc-90c9-5c4ff6f9ff6a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.243951 May 14 21:17:29.521577 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 900/1876] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:17:29 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:29.628065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:29.647318 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5c08fcd3-5da4-4349-a1b7-e33816439def tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.222539 May 14 21:17:29.657229 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 977/1877] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:29 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:29.674020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-51823330", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "274c6800-dd69-4e99-9c50-7695004c5ebc"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:29.748327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:17:29.758794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:29.759805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:29.766567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:29.767300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.768118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:29.768560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:29.843144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:29.851311 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d623b97-5856-4573-9adc-d3379add6826 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1235 microversion: 2.1 time: 0.097920 May 14 21:17:29.859300 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 978/1878] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:29 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1235 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:30.169728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:30.170421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:30.177037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:30.177610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:30.178510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:30.179123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:30.239257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:17:30.240050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:17:30.240875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:17:30.241839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:17:30.242824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:17:30.268812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:30.269550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:30.271022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:30.272486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:30.300138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:30.311927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:30.350071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Going to run 2 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:17:30.355052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:17:30.401714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:30.415572 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b68544f4-86be-4052-9bec-4d3215bd3e86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1468 microversion: 2.1 time: 0.250190 May 14 21:17:30.417128 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 979/1879] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:30 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1468 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:30.587344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1676741756", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:30.658318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] validate_networks() for [('be6063db-fd04-41cd-809f-05d0d8d9b38d', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:17:31.435011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:17:31.435614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:17:31.436258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:17:31.436436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:17:31.436940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:17:31.447465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:31.448008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:31.448790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:31.458056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:31.466437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Getting quotas for project 7c7360a8f423452e97311ffc9675e801. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:31.471915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Getting quotas for user 8bb480362ced445da9819798a17819c3 and project 7c7360a8f423452e97311ffc9675e801. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:31.485109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:17:31.487432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:17:32.358190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:32.372318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:32.485121 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04fd18da-b530-4e53-9442-3ea4d614f54c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.989712 May 14 21:17:32.492797 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 980/1880] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:17:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:17:32.529717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:32.529717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:32.529717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:32.529717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:32.529717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:32.529717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:32.610857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:32.621282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:32.644601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=94b2dd32-2b1b-43a0-9320-b086ccc02e33,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:17:32.778025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:32.788060 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a5a3bb19-3f72-41de-a2c5-245970ccca6a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.293079 May 14 21:17:32.800462 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 981/1881] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:32 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:32.803862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:32.804708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:32.812494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:32.813201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:32.814178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:32.814827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:32.887311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:32.901215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:32.905450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:32.910369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b67be31f-6707-4189-8a2b-849e6b9d46c9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1291 microversion: 2.1 time: 0.110995 May 14 21:17:32.911596 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 982/1882] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:32 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1291 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:32.923173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:32.924049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:32.943313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:32.943852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:32.952437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:32.952437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:33.013583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:33.021707 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c0a599a-0609-43df-a08d-5723a37d9f1e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1426 microversion: 2.1 time: 0.108829 May 14 21:17:33.022882 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 983/1883] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:32 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:33.035331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-b7dc666d-693b-4de3-8320-d435b46c29bb req-61d22c1d-8019-4906-a1d7-372c8e7b25fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40624658-3d24-4f0d-81e8-73a5cebb2820", "name": "network-vif-deleted", "tag": "6c350058-cff2-443a-abaf-aacd188ca6b0"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:33.046173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b7dc666d-693b-4de3-8320-d435b46c29bb req-61d22c1d-8019-4906-a1d7-372c8e7b25fb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:33.046876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b7dc666d-693b-4de3-8320-d435b46c29bb req-61d22c1d-8019-4906-a1d7-372c8e7b25fb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:33.059361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:33.062731 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-b7dc666d-693b-4de3-8320-d435b46c29bb req-61d22c1d-8019-4906-a1d7-372c8e7b25fb service nova] Creating event network-vif-deleted:6c350058-cff2-443a-abaf-aacd188ca6b0 for instance 40624658-3d24-4f0d-81e8-73a5cebb2820 on nch2-master-1 May 14 21:17:33.065176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:33.070423 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-b7dc666d-693b-4de3-8320-d435b46c29bb req-61d22c1d-8019-4906-a1d7-372c8e7b25fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046045 May 14 21:17:33.071323 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 984/1884] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:33.078129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1651e7c9-0f7d-4767-b038-df1351853827 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:33.079040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1651e7c9-0f7d-4767-b038-df1351853827 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:33.116741 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14266ad9-270d-46a8-ad6c-1ae62bcbc228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.447586 May 14 21:17:33.117666 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 901/1885] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:17:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 3450 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 14 21:17:33.131179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:33.135585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:33.136386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Searching by: {'deleted': False, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:17:33.148616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1651e7c9-0f7d-4767-b038-df1351853827 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:33.156097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:33.156547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1651e7c9-0f7d-4767-b038-df1351853827 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1214 microversion: 2.1 time: 0.083012 May 14 21:17:33.159522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:33.159653 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 985/1886] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:33 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:33.167699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:33.168153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:33.202148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:17:33.235712 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e8e4916-a1ea-46d4-951c-8c439b4f00e7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1662 microversion: 2.1 time: 0.111874 May 14 21:17:33.236318 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 902/1887] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:17:33 2022] GET /compute/v2.1/servers => generated 1662 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:33.249607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0be39b18-2127-4394-a639-2e324dc736a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:33.251234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0be39b18-2127-4394-a639-2e324dc736a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:33.371440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0be39b18-2127-4394-a639-2e324dc736a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:33.392402 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0be39b18-2127-4394-a639-2e324dc736a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1217 microversion: 2.1 time: 0.146675 May 14 21:17:33.393127 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 986/1888] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:33 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:33.806706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:33.807404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:33.814342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:33.814827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:33.815690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:33.816140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:33.937204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:33.938198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:33.956080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:33.958421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:33.961387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:33.962423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:34.060028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:34.069462 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ed83352-4e13-43bb-a435-5536ee0fa0cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1291 microversion: 2.1 time: 0.138765 May 14 21:17:34.076424 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 987/1889] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:33 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1291 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:34.083098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:34.083769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:34.090484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:34.090950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:34.091840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:34.092316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:34.103170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:34.111101 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3f82233f-24c8-4ff4-9989-79645868c359 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.308441 May 14 21:17:34.111726 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 903/1890] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:33 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:34.132970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:34.133696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:34.134166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lazy-loading 'fault' on Instance uuid 40624658-3d24-4f0d-81e8-73a5cebb2820 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:34.176130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:34.176627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:34.181158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:34.184471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:34.184934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:34.185775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:34.186061 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a57db46-ab12-40d2-9e6b-b432898e349b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 200 len: 1303 microversion: 2.1 time: 0.108140 May 14 21:17:34.186272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:34.186709 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 988/1891] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:34 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:34.285608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:34.300356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e1e853df-eafa-4110-b67b-b00939d73949 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1218 microversion: 2.1 time: 0.128832 May 14 21:17:34.301288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 904/1892] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:34 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:34.421651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b768e43-5449-496a-a1fe-e3bb3f6c326a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:34.421651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b768e43-5449-496a-a1fe-e3bb3f6c326a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:34.509176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3b768e43-5449-496a-a1fe-e3bb3f6c326a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:34.518597 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b768e43-5449-496a-a1fe-e3bb3f6c326a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1217 microversion: 2.1 time: 0.110395 May 14 21:17:34.520500 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 989/1893] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:34 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:35.087085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:35.087742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:35.109706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.111227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.113188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.116134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.129638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:35.132308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:35.140195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.141545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.142994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.143732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.199026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:35.207166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0240f29c-7c17-45a4-8515-2ec5b3049655 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1297 microversion: 2.1 time: 0.124640 May 14 21:17:35.208184 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 905/1894] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:35 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:35.213368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:35.214295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 40624658-3d24-4f0d-81e8-73a5cebb2820] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:35.220530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.221078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.221949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.222469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.245604 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] HTTP exception thrown: Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 could not be found. May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Request method failure captured: May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 HTTP/1.1 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBssDLYgUNOvC771G8m0__E2HUEL981uRKSVKwv5YPKnWewehTE6KuVpC_w7Ps4UZeNG9bKoxYrkPcZN41oGpVVC7eU_4JHaA8ADN6-Fc_83w8j9GLPxzfrhZsyzHPdF8IxMK9PzAwNHxSWeSx0fe6teoclViS8TRS3FHsOhlMlv-WQ May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35a0e2c4a9054b4b962b9bc72c64517c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-MigrationsAdminTest-2010048286 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 5b93d6c3d03d407f8be4aa38e2fbb154 May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 could not be found. May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '40624658-3d24-4f0d-81e8-73a5cebb2820'} May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 could not be found. May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 could not be found. May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:35.247369 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:35.251806 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:35.251806 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:35.251806 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:35.251806 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:17:35.251806 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:17:35.251806 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 could not be found. May 14 21:17:35.251806 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:35.253043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Returning 404 to user: Instance 40624658-3d24-4f0d-81e8-73a5cebb2820 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:17:35.254328 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0852411c-bea2-48af-b5ab-c734b3bebbbf tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820" status: 404 len: 111 microversion: 2.1 time: 0.044631 May 14 21:17:35.255033 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 906/1895] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:35 2022] GET /compute/v2.1/servers/40624658-3d24-4f0d-81e8-73a5cebb2820 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:17:35.267817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:35.268589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:35.276010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.276730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.277842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.280975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.313001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:17:35.323273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:35.331389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89fe21d0-85f8-4f6c-a256-38952dc60676 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.206447 May 14 21:17:35.332019 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 990/1896] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:35 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:35.336898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:35.338458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:35.344821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.345558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.346569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.347083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.418033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:35.426322 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4d37e28a-641f-41f8-bb8d-bcb009a55ede tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1266 microversion: 2.1 time: 0.093045 May 14 21:17:35.427192 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 991/1897] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:35 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:35.538931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:35.539601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:35.546801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.547319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.548428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.549106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.616540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:35.624712 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3579c599-86d5-4b40-ade8-c5d8f77f5cda tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1221 microversion: 2.1 time: 0.090416 May 14 21:17:35.625697 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 992/1898] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:35 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1221 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:35.821200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b08b3f5e-ed2e-4f27-801b-8eef48aae3ca tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 204 len: 0 microversion: 2.1 time: 0.561164 May 14 21:17:35.823535 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 907/1899] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:17:35 2022] DELETE /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:17:35.830457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:35.835747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:35.837602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.838139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:35.838941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:35.839391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.039448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:36.055625 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e76d585-5e1a-4b57-98cb-f287b828cbab tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1532 microversion: 2.1 time: 0.225056 May 14 21:17:36.059536 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 993/1900] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:35 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1532 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:36.105409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:36.106218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:36.113232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.113694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.114516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.114962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.226268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:36.226905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:36.237697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.242555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.242555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.242555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.397397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:36.407108 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0341f951-fbf8-440c-968b-9af84dcf3df9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.184733 May 14 21:17:36.419637 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 994/1901] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:36 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:36.435649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:36.436515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:36.448039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.449408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.450895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.451277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:36.452274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.496592 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b4ad16f-defe-4b76-8ac1-78e9799f3d07 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 2128 microversion: 2.25 time: 0.394784 May 14 21:17:36.497683 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 908/1902] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:36 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 2128 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:36.503026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:36.507546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:36.534674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.535128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.535968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.536420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.668716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:36.685841 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-02b13ccb-97ce-485e-aa66-8176b20af39e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1284 microversion: 2.1 time: 0.187056 May 14 21:17:36.686815 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 909/1903] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:36 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1284 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:36.695413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:36.697944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:36.703761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:36.707654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.708634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.712368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-21c55838-a631-4484-a2b6-0e6f07f92bc6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.290682 May 14 21:17:36.713213 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 995/1904] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:36 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:36.713558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.714189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.718772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:36.719389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:36.737870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.738330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.739130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:36.739624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:36.760367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'flavor' on Instance uuid 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:36.807683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Going to try to live migrate instance to nch2-master-1 {{(pid=130637) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:17:36.867153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:36.878256 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-25c9eba2-8c33-4b6e-8426-14915d615362 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1213 microversion: 2.1 time: 0.162741 May 14 21:17:36.892636 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 996/1905] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:36 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1213 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:37.072547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:37.073176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:37.089483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:37.090193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:37.091071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:37.091626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:37.422861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:37.437438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0fcc52b1-2ea1-4b21-9840-78d47e821039 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1532 microversion: 2.1 time: 0.365220 May 14 21:17:37.446131 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 997/1906] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:37 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1532 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:37.454336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:37.455320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:37.502766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:37.503904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:37.508892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:37.508892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:37.740947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:37.740947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33d8407d-617d-4aac-ba06-cd879a8d23bd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.291777 May 14 21:17:37.740947 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 998/1907] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:37 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:37.745104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:37.745944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:37.754417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:37.755297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:37.757097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:37.757877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.069571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:38.083267 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6a1fe78-4253-4013-96dc-1a3b9e32ca71 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.336626 May 14 21:17:38.083267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 999/1908] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:37 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:38.083267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:38.083267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:38.091937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:38.093777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.095029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:38.095675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.471223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:38.483589 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c999dd99-71ee-46d6-9c89-0eb164124e6c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.397093 May 14 21:17:38.483589 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1000/1909] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:38 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:38.487419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e4c6546f-5440-434d-94e3-cb9e08387f9c req-4ab6e639-3288-4510-87d0-5e8635b3fd74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:38.508100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e4c6546f-5440-434d-94e3-cb9e08387f9c req-4ab6e639-3288-4510-87d0-5e8635b3fd74 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:38.508343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e4c6546f-5440-434d-94e3-cb9e08387f9c req-4ab6e639-3288-4510-87d0-5e8635b3fd74 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.531129 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e4c6546f-5440-434d-94e3-cb9e08387f9c req-4ab6e639-3288-4510-87d0-5e8635b3fd74 service nova] Creating event network-changed:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:17:38.542621 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e4c6546f-5440-434d-94e3-cb9e08387f9c req-4ab6e639-3288-4510-87d0-5e8635b3fd74 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064193 May 14 21:17:38.543861 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1001/1910] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:38.551168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:38.552408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:38.578117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:38.578586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.579391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:38.587698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.711919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:38.729404 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f01a08c9-0040-451e-a6b4-42d4f6b228ce tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1277 microversion: 2.1 time: 0.184020 May 14 21:17:38.744943 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1002/1911] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:38 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:38.762015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:38.762015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:38.768737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:38.769422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.770215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:38.770824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:38.988225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:39.000757 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-816a2d67-8b1e-4b81-a14f-49454acc4bdc tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1532 microversion: 2.1 time: 0.254651 May 14 21:17:39.002604 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1003/1912] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:38 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1532 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:39.011620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:39.012252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:39.029497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.029961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:39.031679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.032438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:39.299744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:39.309739 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d90c4a2a-29d4-4434-ab58-fad4e10e853c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.307237 May 14 21:17:39.315544 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1004/1913] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:39 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:39.321450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:39.321450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:39.329580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.331794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:39.335807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.340474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:39.597980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:39.605572 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92947513-54ec-422a-aabc-d1e51fac071a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.288855 May 14 21:17:39.606170 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1005/1914] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:39 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:39.610715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:39.611870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:39.621140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.621677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:39.622601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.623260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:39.865551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:39.895296 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0220d2a-64b1-4f28-9210-76dbce516218 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.287830 May 14 21:17:39.896180 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1006/1915] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:39 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:39.921047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:39.927217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:39.944093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.947767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:39.949239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:39.953962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.073137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:40.085629 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eab477f1-46db-47a3-a996-5917a66051e6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1275 microversion: 2.1 time: 0.173671 May 14 21:17:40.086681 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1007/1916] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:39 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1275 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:40.091738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:40.092559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:40.101162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.104026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.104026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.104026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.176969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:40.185248 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1166a624-36a6-4769-91d5-3601b13589d3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 200 len: 1490 microversion: 2.1 time: 0.097221 May 14 21:17:40.185839 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1008/1917] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:40 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 1490 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:40.378549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-da860589-1233-4e34-baf8-02b9aaee8471 req-cd6eb44d-5b85-4a9d-aaa2-87bc94bcaef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94b2dd32-2b1b-43a0-9320-b086ccc02e33", "tag": "7a1c258b-59bb-470f-b35e-e0e21b6dcd42"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:40.394498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-da860589-1233-4e34-baf8-02b9aaee8471 req-cd6eb44d-5b85-4a9d-aaa2-87bc94bcaef6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.395886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-da860589-1233-4e34-baf8-02b9aaee8471 req-cd6eb44d-5b85-4a9d-aaa2-87bc94bcaef6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.415852 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-da860589-1233-4e34-baf8-02b9aaee8471 req-cd6eb44d-5b85-4a9d-aaa2-87bc94bcaef6 service nova] Creating event network-changed:7a1c258b-59bb-470f-b35e-e0e21b6dcd42 for instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 on nch2-master-1 May 14 21:17:40.416150 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-da860589-1233-4e34-baf8-02b9aaee8471 req-cd6eb44d-5b85-4a9d-aaa2-87bc94bcaef6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139330 May 14 21:17:40.416772 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1009/1918] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:17:40.423042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:40.423826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:40.430733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.431202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.432032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.432479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.637818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:40.646665 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b479882-10d2-4a9a-8c58-338ab86afbfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.228427 May 14 21:17:40.647266 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1010/1919] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:40 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:40.662008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:40.663123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:40.669860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.670321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.671106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.671767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.852722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:40.863634 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-606a48d9-05d0-4aa0-898d-ee25f88c7a79 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.205549 May 14 21:17:40.867752 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1011/1920] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:40 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:40.871021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0ba87b76-97d1-462a-b9dd-7b2ef0c6d053 req-1eccd072-fca0-4904-b51b-46f251ffd3a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6444107-b523-485b-8113-41eafdabeb52", "name": "network-vif-deleted", "tag": "5d17285a-833f-4da9-b08a-4a08fee7366e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:40.882150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0ba87b76-97d1-462a-b9dd-7b2ef0c6d053 req-1eccd072-fca0-4904-b51b-46f251ffd3a9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.898563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0ba87b76-97d1-462a-b9dd-7b2ef0c6d053 req-1eccd072-fca0-4904-b51b-46f251ffd3a9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.941361 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0ba87b76-97d1-462a-b9dd-7b2ef0c6d053 req-1eccd072-fca0-4904-b51b-46f251ffd3a9 service nova] Creating event network-vif-deleted:5d17285a-833f-4da9-b08a-4a08fee7366e for instance a6444107-b523-485b-8113-41eafdabeb52 on nch1-master-1 May 14 21:17:40.949629 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0ba87b76-97d1-462a-b9dd-7b2ef0c6d053 req-1eccd072-fca0-4904-b51b-46f251ffd3a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083634 May 14 21:17:40.952604 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1012/1921] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:40.961955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:40.963084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:40.990939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.991579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:40.992383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:40.992832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.145964 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00bd8309-3eb2-4f98-aa7d-36085194315f tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/action" status: 202 len: 0 microversion: 2.25 time: 4.457621 May 14 21:17:41.147844 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 910/1922] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:17:36 2022] POST /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/action => generated 0 bytes in 4460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:17:41.155596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:41.155596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:41.168137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.176319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.177430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.177643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.367709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:41.377434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2afe04ba-b205-457c-a337-2552cbb1ee5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.423232 May 14 21:17:41.387935 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1013/1923] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:40 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:41.393118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:41.393747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:41.400796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.401473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.403006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.403645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.652145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:41.663525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:41.666552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:41.669453 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33fc0c53-5041-4842-933a-8cb750176e11 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.280175 May 14 21:17:41.674149 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1014/1924] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:41 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:41.675806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:41.676653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: a6444107-b523-485b-8113-41eafdabeb52] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:41.683107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.688118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.688948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.689403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.715170 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] HTTP exception thrown: Instance a6444107-b523-485b-8113-41eafdabeb52 could not be found. May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Request method failure captured: May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 HTTP/1.1 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBssDLYgUNOvC771G8m0__E2HUEL981uRKSVKwv5YPKnWewehTE6KuVpC_w7Ps4UZeNG9bKoxYrkPcZN41oGpVVC7eU_4JHaA8ADN6-Fc_83w8j9GLPxzfrhZsyzHPdF8IxMK9PzAwNHxSWeSx0fe6teoclViS8TRS3FHsOhlMlv-WQ May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35a0e2c4a9054b4b962b9bc72c64517c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-MigrationsAdminTest-2010048286 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 5b93d6c3d03d407f8be4aa38e2fbb154 May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance a6444107-b523-485b-8113-41eafdabeb52 could not be found. May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'a6444107-b523-485b-8113-41eafdabeb52'} May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6444107-b523-485b-8113-41eafdabeb52 could not be found. May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6444107-b523-485b-8113-41eafdabeb52 could not be found. May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:41.717851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:41.723267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:41.723267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:41.723267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:41.723267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:17:41.723267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:17:41.723267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6444107-b523-485b-8113-41eafdabeb52 could not be found. May 14 21:17:41.723267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:41.725215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Returning 404 to user: Instance a6444107-b523-485b-8113-41eafdabeb52 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:17:41.726698 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c0a8881-4e7b-4fcd-9ec5-ebae484297a3 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52" status: 404 len: 111 microversion: 2.1 time: 0.054951 May 14 21:17:41.727308 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1015/1925] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:41 2022] GET /compute/v2.1/servers/a6444107-b523-485b-8113-41eafdabeb52 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:17:41.733080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:41.734004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:41.741991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.742743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.743591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.744634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.788700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:41.802693 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-07b3350e-b9d7-447c-a20b-901c08fa4ea1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.653381 May 14 21:17:41.811540 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 911/1926] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:41 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:41.811540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:41.811540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:41.817739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.817739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.818083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:41.819235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:41.857737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:17:42.035280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:42.048687 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-790d3fe6-ad4c-4675-8b4f-74d6f4594f06 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.320174 May 14 21:17:42.049361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1016/1927] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:41 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:42.059851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:42.060827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:42.067357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.068157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.069379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.069991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.335363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:42.342782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c723d89-2893-422b-a216-190857443ea4 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 204 len: 0 microversion: 2.1 time: 0.537519 May 14 21:17:42.346838 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 912/1928] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:17:41 2022] DELETE /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:17:42.350374 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c601eae6-d1e8-4bb8-a9a7-9f45e7c6f491 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.299965 May 14 21:17:42.359311 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1017/1929] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:42 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:42.362833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:42.363528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:42.364614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-4802bb99-d660-4ea6-ab9c-81ed445ef157 req-309ccf65-2e84-4590-8d91-8ade23f7a104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-plugged", "status": "completed", "tag": "71f13a97-5bd0-4446-9085-0270aee83186"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:42.373735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4802bb99-d660-4ea6-ab9c-81ed445ef157 req-309ccf65-2e84-4590-8d91-8ade23f7a104 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.374375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4802bb99-d660-4ea6-ab9c-81ed445ef157 req-309ccf65-2e84-4590-8d91-8ade23f7a104 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.385096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.385096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.385096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.385096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.392113 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-4802bb99-d660-4ea6-ab9c-81ed445ef157 req-309ccf65-2e84-4590-8d91-8ade23f7a104 service nova] Creating event network-vif-plugged:71f13a97-5bd0-4446-9085-0270aee83186 for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:42.401528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-4802bb99-d660-4ea6-ab9c-81ed445ef157 req-309ccf65-2e84-4590-8d91-8ade23f7a104 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052709 May 14 21:17:42.409052 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 913/1930] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:42.414121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:42.419695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:42.425616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.429433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.434682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.440042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.595524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:42.603722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8342f363-5444-464e-8647-3fc7358f2529 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1469 microversion: 2.1 time: 0.247955 May 14 21:17:42.604337 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1018/1931] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:42 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1469 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:42.689294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:42.690789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:42.699155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.701365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.702510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.703112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.776976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:42.784908 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45b78ea6-dfe9-4d0b-8d0d-d818fca6fbd5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.374845 May 14 21:17:42.798876 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 914/1932] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:42 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:42.823629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:42.824780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:42.831136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.831976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.833162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.833820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:42.851106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:42.861033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:42.862574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:42.863802 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c8a1215-2c4c-446b-a570-30ecc78969a9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.179118 May 14 21:17:42.864709 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1019/1933] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:42 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:17:42.985989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-cd7c4f47-2f15-40af-ba57-5249bfa8d976 req-053c9210-7ad1-4645-a106-40c017a1735d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1158c4ab-5f12-4ba4-8ee6-a9b92aade119", "tag": "90cac83b-ecf9-42a5-984e-9c943dbe93d1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:42.996942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cd7c4f47-2f15-40af-ba57-5249bfa8d976 req-053c9210-7ad1-4645-a106-40c017a1735d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:42.997922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cd7c4f47-2f15-40af-ba57-5249bfa8d976 req-053c9210-7ad1-4645-a106-40c017a1735d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.012158 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-cd7c4f47-2f15-40af-ba57-5249bfa8d976 req-053c9210-7ad1-4645-a106-40c017a1735d service nova] Creating event network-changed:90cac83b-ecf9-42a5-984e-9c943dbe93d1 for instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 on nch2-master-1 May 14 21:17:43.017254 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-cd7c4f47-2f15-40af-ba57-5249bfa8d976 req-053c9210-7ad1-4645-a106-40c017a1735d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035470 May 14 21:17:43.018200 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1020/1934] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:43.022253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:43.030695 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ee8f435-36a9-42a8-b925-a087395a15f5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.211119 May 14 21:17:43.035609 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 915/1935] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:42 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:43.066526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:43.067278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:43.074409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.074867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.075696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.076153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.233192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:43.242651 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c47185ae-d4af-48ac-a657-e69de207695a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.180339 May 14 21:17:43.252491 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1021/1936] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:43 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:43.369367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:43.371241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:43.379437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.380235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.390090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.392092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.606878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:43.616509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a99672e-0072-424e-acd6-fe7069a62dd9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.253847 May 14 21:17:43.623825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:43.624800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:43.627910 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 916/1937] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:43 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:43.631958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.633290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.634566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.635246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.804168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:43.804949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:43.812701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.819136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.819136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.819136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.820197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:43.824971 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9913b966-c3e3-4f3b-b16e-83a4a5d84c13 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1469 microversion: 2.1 time: 0.206404 May 14 21:17:43.825926 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1022/1938] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:43 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:43.884852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:43.885410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:43.898658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.899130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:43.899944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:43.900378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.039046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:44.048149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:44.049743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:44.050502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:44.051003 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ecbf835c-83e2-44e3-8201-eceb3e06d31f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.171197 May 14 21:17:44.053856 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1023/1939] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:43 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:44.057489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:44.058115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:44.060066 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9b645a85-8d91-41e1-8ea9-959d5cf4c487 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.262107 May 14 21:17:44.060774 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 917/1940] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:43 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:44.068988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.069651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.070549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.071071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.209221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:44.217093 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d66346e-5ec7-40fe-be2b-2c2b4e7c4339 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.164180 May 14 21:17:44.217675 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1024/1941] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:44 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:44.260331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:44.261042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:44.266962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.267425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.268234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.268683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.402915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:44.410685 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ae7d198-8bbf-41b2-a979-66c610705233 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.155181 May 14 21:17:44.411451 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 918/1942] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:44 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:44.422018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-bf178352-6304-4fe1-b3fe-e2fa47c42544 req-c271dc32-f53e-43d4-a902-c693fc1bb459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-plugged", "status": "completed", "tag": "e3119c30-cd1d-44fb-bf9c-dd51415d53ae"}, {"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-plugged", "status": "completed", "tag": "397f9ff4-1b58-4780-9dd6-0187ed997835"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:44.431050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bf178352-6304-4fe1-b3fe-e2fa47c42544 req-c271dc32-f53e-43d4-a902-c693fc1bb459 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.431525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bf178352-6304-4fe1-b3fe-e2fa47c42544 req-c271dc32-f53e-43d4-a902-c693fc1bb459 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.442796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-bf178352-6304-4fe1-b3fe-e2fa47c42544 req-c271dc32-f53e-43d4-a902-c693fc1bb459 service nova] Creating event network-vif-plugged:e3119c30-cd1d-44fb-bf9c-dd51415d53ae for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:44.444014 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-bf178352-6304-4fe1-b3fe-e2fa47c42544 req-c271dc32-f53e-43d4-a902-c693fc1bb459 service nova] Creating event network-vif-plugged:397f9ff4-1b58-4780-9dd6-0187ed997835 for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:44.449289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-bf178352-6304-4fe1-b3fe-e2fa47c42544 req-c271dc32-f53e-43d4-a902-c693fc1bb459 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031104 May 14 21:17:44.449886 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1025/1943] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:44.645270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:44.645967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:44.654185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.654777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.655671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.656176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.801239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:44.812100 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3cd95ec-ec9a-46a0-8008-c9d7860c0180 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.171250 May 14 21:17:44.823187 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 919/1944] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:44 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:44.842938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:44.843933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:44.851459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.852344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.853677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:44.854228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:44.994517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:45.002709 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bae08d51-7418-4910-9171-0347f3a5c49b tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1469 microversion: 2.1 time: 0.164099 May 14 21:17:45.003407 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1026/1945] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:44 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:45.040280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6ee8d9f1-d39a-4444-89ae-2d4ba0b1eec9 req-84ace584-d11f-44b9-b7cb-76b5e7c2d536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5", "tag": "be084366-46b1-428d-8388-e556e6c19d3c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:45.051224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6ee8d9f1-d39a-4444-89ae-2d4ba0b1eec9 req-84ace584-d11f-44b9-b7cb-76b5e7c2d536 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.051732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6ee8d9f1-d39a-4444-89ae-2d4ba0b1eec9 req-84ace584-d11f-44b9-b7cb-76b5e7c2d536 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.064736 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6ee8d9f1-d39a-4444-89ae-2d4ba0b1eec9 req-84ace584-d11f-44b9-b7cb-76b5e7c2d536 service nova] Creating event network-changed:be084366-46b1-428d-8388-e556e6c19d3c for instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 on nch1-master-1 May 14 21:17:45.072671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:45.073651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:45.081049 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6ee8d9f1-d39a-4444-89ae-2d4ba0b1eec9 req-84ace584-d11f-44b9-b7cb-76b5e7c2d536 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052176 May 14 21:17:45.081833 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 920/1946] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:45.086170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.087362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.088333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.089372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.092269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:45.093418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:45.102669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.104520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.104520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.104520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.243309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:45.253133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:45.254927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:45.256700 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7e5ae056-e485-44a6-914c-33dc8c42fefb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.190102 May 14 21:17:45.257550 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1027/1947] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:45 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:45.263099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:45.263951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:45.270615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.271263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.272432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.272882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.316992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:45.325822 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4469cf40-a0c0-4d0d-874a-ad4deb6625bc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.238496 May 14 21:17:45.327518 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 921/1948] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:45 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:45.408554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:45.416882 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7bd937a7-70b0-4f58-996b-eae47cbd1cbf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.158099 May 14 21:17:45.417476 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1028/1949] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:45 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:45.436235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:45.437236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:45.444396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.444853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.445634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.446073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.834754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:45.842084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:45.849292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.851207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.852268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:45.853035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:45.868023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:45.878027 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1d52bb58-6dad-4c2f-81e1-d30fdc79f334 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.445472 May 14 21:17:45.889590 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 922/1950] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:45 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:46.020188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:46.020814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:46.027841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.029390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.030518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.031328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.107763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:46.116320 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-832f4fc7-8443-4e4b-88f9-30960cd538c7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.289074 May 14 21:17:46.123569 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1029/1951] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:45 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:46.123569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e677235f-8bf3-49e0-898c-08042f621f6c req-1ef68676-4171-4848-8d97-bd44b4d95c23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71dcc3c9-cd38-40e8-9060-8b3740681925", "name": "network-vif-deleted", "tag": "b5e80fb6-d607-4cd2-bf6a-fc74ad375750"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:46.129681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e677235f-8bf3-49e0-898c-08042f621f6c req-1ef68676-4171-4848-8d97-bd44b4d95c23 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.130747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e677235f-8bf3-49e0-898c-08042f621f6c req-1ef68676-4171-4848-8d97-bd44b4d95c23 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.145530 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e677235f-8bf3-49e0-898c-08042f621f6c req-1ef68676-4171-4848-8d97-bd44b4d95c23 service nova] Creating event network-vif-deleted:b5e80fb6-d607-4cd2-bf6a-fc74ad375750 for instance 71dcc3c9-cd38-40e8-9060-8b3740681925 on nch2-master-1 May 14 21:17:46.153096 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e677235f-8bf3-49e0-898c-08042f621f6c req-1ef68676-4171-4848-8d97-bd44b4d95c23 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034915 May 14 21:17:46.154150 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1030/1952] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:46.166581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:46.174300 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3cdb1cd-92be-4e00-965b-fc3471c7fb86 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1427 microversion: 2.1 time: 0.157884 May 14 21:17:46.174892 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 923/1953] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:46 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:46.278475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:46.279307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:46.286137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.286689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.287604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.288293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.343443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:46.344343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:46.360142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.360699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.362042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.362217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.470700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:46.481142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:46.482752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:46.484148 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-00efc18a-3ab6-4939-85bd-0ec51f3ef25d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.210068 May 14 21:17:46.485376 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1031/1954] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:46 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:46.491722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:46.492536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:46.504079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.504595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.505626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.506813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.544341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:46.552241 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a4062bc-9595-4fb6-ad70-73647dd28155 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1355 microversion: 2.1 time: 0.212619 May 14 21:17:46.552994 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 924/1955] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:46 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1355 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:46.559693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1e231912-4607-4079-8cb7-63d2824180f5 req-a7630cb2-6e98-42f4-8720-168d42474eac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-plugged", "status": "completed", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:46.568704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1e231912-4607-4079-8cb7-63d2824180f5 req-a7630cb2-6e98-42f4-8720-168d42474eac service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.569153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1e231912-4607-4079-8cb7-63d2824180f5 req-a7630cb2-6e98-42f4-8720-168d42474eac service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.580874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1e231912-4607-4079-8cb7-63d2824180f5 req-a7630cb2-6e98-42f4-8720-168d42474eac service nova] Creating event network-vif-plugged:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:17:46.586693 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1e231912-4607-4079-8cb7-63d2824180f5 req-a7630cb2-6e98-42f4-8720-168d42474eac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031961 May 14 21:17:46.587299 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 925/1956] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:46.644710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:46.653383 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3e9fa060-8a76-48dd-b3bd-547147e90315 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.166542 May 14 21:17:46.654097 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1032/1957] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:46 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:46.897556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:46.898607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:46.905880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.906525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:46.915394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:46.915394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.058256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.069100 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5506a88-7111-4a23-9a07-2bcd97db946d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.176138 May 14 21:17:47.069709 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 926/1958] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:46 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:47.134000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:47.134626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:47.141228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.141680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.142459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.142907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.192118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:47.198177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:47.201052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.201452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.202327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.202860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.242514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.243010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.243732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lazy-loading 'fault' on Instance uuid 71dcc3c9-cd38-40e8-9060-8b3740681925 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:47.290053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.290194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.297828 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad266625-aa27-420b-bb8e-945eb9323033 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1303 microversion: 2.1 time: 0.109851 May 14 21:17:47.298588 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 927/1959] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:47 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:47.299711 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fa5dadfc-4e8d-4b77-a4b8-1f161c67188f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.170544 May 14 21:17:47.300331 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1033/1960] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:47 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:47.503000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:47.503883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:47.511910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.512454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.513314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.513831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.569748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:47.570662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:47.576804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.577604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.578617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.579132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.657603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.666293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.667829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.668998 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8f8453cc-568b-4cae-af37-1e57dd03b8b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.170006 May 14 21:17:47.669564 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 928/1961] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:47 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:47.679574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:47.679574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:47.680527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.680978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.681753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.682190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.731626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.739514 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1f6ac0c4-275a-4202-b7f6-837575a425c0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1804 microversion: 2.1 time: 0.173808 May 14 21:17:47.740188 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1034/1962] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:47 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1804 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:47.756116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4290c515-8bba-4879-bb89-585898822f3e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:47.756735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4290c515-8bba-4879-bb89-585898822f3e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:47.763851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4290c515-8bba-4879-bb89-585898822f3e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.763983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4290c515-8bba-4879-bb89-585898822f3e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.764716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4290c515-8bba-4879-bb89-585898822f3e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.765155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4290c515-8bba-4879-bb89-585898822f3e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.800495 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4290c515-8bba-4879-bb89-585898822f3e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71/ips" status: 200 len: 217 microversion: 2.1 time: 0.048146 May 14 21:17:47.801092 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1035/1963] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:17:47 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71/ips => generated 217 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:17:47.812081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:47.812618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:47.819293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.820321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.821103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:47.821541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:47.825493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:47.832901 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-055de98b-310b-4187-a06e-4fa2886ff902 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.162373 May 14 21:17:47.833484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 929/1964] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:47 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:47.848624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:17:48.085288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:48.085913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:48.091970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.092432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.093221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.093669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.234355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:48.247634 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4795fb5a-66cf-4927-86c2-2e7b1b97a285 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1364 microversion: 2.1 time: 0.166138 May 14 21:17:48.248162 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 930/1965] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:48 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:48.282794 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-06a6aa3e-d1e9-49f6-819d-a49d764572b7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "DELETE /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 204 len: 0 microversion: 2.1 time: 0.474206 May 14 21:17:48.283901 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1036/1966] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:17:47 2022] DELETE /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:17:48.292153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:48.292772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:48.298602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.299054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.299843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.300282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.320061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:48.321800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:48.329052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.329515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.330312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.330846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.372976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.373435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.373891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lazy-loading 'fault' on Instance uuid 71dcc3c9-cd38-40e8-9060-8b3740681925 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:48.416745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:48.434908 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba0daffe-99d9-4f85-8da1-b9008a0d1bf5 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1303 microversion: 2.1 time: 0.111282 May 14 21:17:48.434908 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1037/1967] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:48 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:48.434908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:48.434908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:48.436729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.437188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.438039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.438485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.464654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:48.472430 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3955af46-d554-44a3-99c9-5e78a43fa08b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1810 microversion: 2.1 time: 0.184595 May 14 21:17:48.473021 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 931/1968] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:48 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:48.574431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:48.584332 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3659cbae-4969-47dd-9111-8af97cdb14f2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.157854 May 14 21:17:48.584933 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1038/1969] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:48 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:48.686608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:48.687235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:48.694398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.695401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.696222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.696722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.832211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:48.840835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:48.842349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:48.843568 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6115b817-6c07-4086-b1bb-1e9479726e23 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.161017 May 14 21:17:48.844139 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 932/1970] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:48 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:17:48.850405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:48.851282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:48.859788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.860600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:48.861497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:48.861841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.005768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:49.016526 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcc7cf04-c6b7-4bb5-8fff-95e8a18f0817 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.170110 May 14 21:17:49.017530 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1039/1971] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:48 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:49.265328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:49.265988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:49.272442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.272899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.273845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.274289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.362215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4a6ee752-cf3e-4db0-a183-95acc367f1e8 req-c747fdd9-7a08-49a1-87f2-7352b7ee9d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1158c4ab-5f12-4ba4-8ee6-a9b92aade119", "name": "network-vif-plugged", "status": "completed", "tag": "90cac83b-ecf9-42a5-984e-9c943dbe93d1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:49.380662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4a6ee752-cf3e-4db0-a183-95acc367f1e8 req-c747fdd9-7a08-49a1-87f2-7352b7ee9d0d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.381125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4a6ee752-cf3e-4db0-a183-95acc367f1e8 req-c747fdd9-7a08-49a1-87f2-7352b7ee9d0d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.404955 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4a6ee752-cf3e-4db0-a183-95acc367f1e8 req-c747fdd9-7a08-49a1-87f2-7352b7ee9d0d service nova] Creating event network-vif-plugged:90cac83b-ecf9-42a5-984e-9c943dbe93d1 for instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 on nch2-master-1 May 14 21:17:49.410506 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4a6ee752-cf3e-4db0-a183-95acc367f1e8 req-c747fdd9-7a08-49a1-87f2-7352b7ee9d0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053130 May 14 21:17:49.411124 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1040/1972] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:17:49.443225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:49.444234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:49.453233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:49.458101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.458763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.459748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.461148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.462471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b29eca12-370e-46e3-9feb-4c91d2c7b820 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1552 microversion: 2.1 time: 0.201045 May 14 21:17:49.463149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 933/1973] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:49 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1552 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:49.480360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f704595c-5747-41bd-b91a-dcdeb8726eba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:49.481920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f704595c-5747-41bd-b91a-dcdeb8726eba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:49.487858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f704595c-5747-41bd-b91a-dcdeb8726eba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.488308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f704595c-5747-41bd-b91a-dcdeb8726eba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.489209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f704595c-5747-41bd-b91a-dcdeb8726eba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.489680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f704595c-5747-41bd-b91a-dcdeb8726eba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.502696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.503145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.504804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lazy-loading 'fault' on Instance uuid 71dcc3c9-cd38-40e8-9060-8b3740681925 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:49.556276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:49.564484 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b73f5c02-96c2-4c40-8454-ac56127ba4b2 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 200 len: 1303 microversion: 2.1 time: 0.125505 May 14 21:17:49.568354 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1041/1974] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:49 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:49.570360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:49.570981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:49.576585 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f704595c-5747-41bd-b91a-dcdeb8726eba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101226 May 14 21:17:49.578239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 934/1975] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:17:49 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:49.581586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.582273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.583259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.583846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.615040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:49.615040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:49.621412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.622112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.623311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.623940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.832224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:49.840447 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e442f987-6332-48b6-8943-da1c903c45fc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1810 microversion: 2.1 time: 0.273938 May 14 21:17:49.841142 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1042/1976] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:49 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:49.862036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:49.862690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:49.869739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.870102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:49.870898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:49.871348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.042096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:50.051576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:50.053102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:50.055084 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e2d11a77-6f7e-43cf-b587-2f91205c93df tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.196887 May 14 21:17:50.056057 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1043/1977] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:49 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:17:50.066673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:50.067442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:50.074314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.074957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.076051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.076603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.214561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:50.222210 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81a292e2-8a87-4896-8da7-fa243ff5a460 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.165075 May 14 21:17:50.222983 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1044/1978] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:50 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:50.260704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:50.268222 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c063a257-d095-41ba-aabd-9fcfc0cb5154 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.663265 May 14 21:17:50.268804 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 935/1979] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:49 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:50.581431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:50.582061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 71dcc3c9-cd38-40e8-9060-8b3740681925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:50.589761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.590223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.590997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.591438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.609543 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] HTTP exception thrown: Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 could not be found. May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Request method failure captured: May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 HTTP/1.1 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBssDLYgUNOvC771G8m0__E2HUEL981uRKSVKwv5YPKnWewehTE6KuVpC_w7Ps4UZeNG9bKoxYrkPcZN41oGpVVC7eU_4JHaA8ADN6-Fc_83w8j9GLPxzfrhZsyzHPdF8IxMK9PzAwNHxSWeSx0fe6teoclViS8TRS3FHsOhlMlv-WQ May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35a0e2c4a9054b4b962b9bc72c64517c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-MigrationsAdminTest-2010048286 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 5b93d6c3d03d407f8be4aa38e2fbb154 May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 could not be found. May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '71dcc3c9-cd38-40e8-9060-8b3740681925'} May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 could not be found. May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 could not be found. May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:50.611610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 could not be found. May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Returning 404 to user: Instance 71dcc3c9-cd38-40e8-9060-8b3740681925 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d42a866-9eb2-45b9-afbb-d87875270c6f tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925" status: 404 len: 111 microversion: 2.1 time: 0.035523 May 14 21:17:50.625869 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1045/1980] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:50 2022] GET /compute/v2.1/servers/71dcc3c9-cd38-40e8-9060-8b3740681925 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:17:50.626656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:50.626656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:50.628982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.629443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.630218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.630662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.656771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:17:50.858206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:50.872114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:50.872114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.872114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:50.872114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:50.872114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.054835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:51.066835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28c2b1bf-47a4-4577-b09f-3bf1aba3ed61 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1810 microversion: 2.1 time: 0.211847 May 14 21:17:51.075869 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1046/1981] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:50 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:51.082147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:51.083526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:51.092188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.092647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.093454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.093895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.256655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:51.266029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:51.267795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:51.269055 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c31e9d6-7657-448b-bd03-24e81922de80 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.192148 May 14 21:17:51.269708 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1047/1982] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:51 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:51.275170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:51.275965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:51.279009 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c63aee1c-b22a-4ad2-85dd-b6e5e420ee62 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 204 len: 0 microversion: 2.1 time: 0.659203 May 14 21:17:51.281227 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 936/1983] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:17:50 2022] DELETE /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:17:51.284312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.290188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.290188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.290188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.290484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:51.292369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:51.301876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.302807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.304771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.305526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.525553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:51.535812 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a6913dd-419b-48bb-9cb5-ca9723f26a15 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.264933 May 14 21:17:51.547633 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1048/1984] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:51 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:51.552668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:51.553302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:51.559849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.564649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.564649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.564649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.663596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:51.676200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac4693fa-7236-4fcd-bcce-db961a610204 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1314 microversion: 2.1 time: 0.393155 May 14 21:17:51.676799 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 937/1985] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:51 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:51.699355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9e9def8b-8e59-4260-b2e9-50aa777f8e3d req-8505d892-ad41-4f51-bf2e-661554562abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5", "name": "network-vif-plugged", "status": "completed", "tag": "be084366-46b1-428d-8388-e556e6c19d3c"}, {"server_uuid": "94b2dd32-2b1b-43a0-9320-b086ccc02e33", "name": "network-vif-plugged", "status": "completed", "tag": "7a1c258b-59bb-470f-b35e-e0e21b6dcd42"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:51.710565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9e9def8b-8e59-4260-b2e9-50aa777f8e3d req-8505d892-ad41-4f51-bf2e-661554562abf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.711434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9e9def8b-8e59-4260-b2e9-50aa777f8e3d req-8505d892-ad41-4f51-bf2e-661554562abf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.724821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9e9def8b-8e59-4260-b2e9-50aa777f8e3d req-8505d892-ad41-4f51-bf2e-661554562abf service nova] Creating event network-vif-plugged:be084366-46b1-428d-8388-e556e6c19d3c for instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 on nch1-master-1 May 14 21:17:51.725340 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9e9def8b-8e59-4260-b2e9-50aa777f8e3d req-8505d892-ad41-4f51-bf2e-661554562abf service nova] Creating event network-vif-plugged:7a1c258b-59bb-470f-b35e-e0e21b6dcd42 for instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 on nch2-master-1 May 14 21:17:51.733657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9e9def8b-8e59-4260-b2e9-50aa777f8e3d req-8505d892-ad41-4f51-bf2e-661554562abf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045186 May 14 21:17:51.734615 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 938/1986] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:51.740725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:51.742492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:51.752725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.753467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.754264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.755041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.831308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:51.839584 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-62ba4e00-349d-4887-9e83-c8e456e02257 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1468 microversion: 2.1 time: 0.290649 May 14 21:17:51.840819 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1049/1987] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:51 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:51.848681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-f7a90492-09bc-48c4-8c07-fc218918edef req-90ddf4dd-e415-44f2-b9d5-7a938d4893b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:51.888911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f7a90492-09bc-48c4-8c07-fc218918edef req-90ddf4dd-e415-44f2-b9d5-7a938d4893b9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:51.889402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f7a90492-09bc-48c4-8c07-fc218918edef req-90ddf4dd-e415-44f2-b9d5-7a938d4893b9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:51.912268 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-f7a90492-09bc-48c4-8c07-fc218918edef req-90ddf4dd-e415-44f2-b9d5-7a938d4893b9 service nova] Creating event network-changed:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:17:51.914541 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-f7a90492-09bc-48c4-8c07-fc218918edef req-90ddf4dd-e415-44f2-b9d5-7a938d4893b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071803 May 14 21:17:51.915576 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1050/1988] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:52.089296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:52.090425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:52.105046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.106684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.108415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.110396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.150110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:52.158942 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b2122f9f-d44a-4e3d-9759-f023225c07ad tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1552 microversion: 2.1 time: 0.422934 May 14 21:17:52.171630 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 939/1989] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:51 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1552 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:52.177644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:52.179623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:52.186421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.186986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.188013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.188613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.347045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:52.362210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b1f48c6-3642-4884-8901-fcd1c1fca4ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1552 microversion: 2.1 time: 0.188797 May 14 21:17:52.372645 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 940/1990] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:52 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1552 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:52.379963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:52.379963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:52.384335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.384977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.385780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.386228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.448019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:52.456529 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-333444ab-d3cc-40ac-8062-8b92696941ac tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1789 microversion: 2.1 time: 0.372459 May 14 21:17:52.468324 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1051/1991] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:52 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1789 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:52.484207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-908f9708-2eef-4342-bda0-c76a7975d8b1 req-46003e44-d7ff-421d-a15e-921bdf03eeba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd12aad-4b1b-4433-a46d-66a5d3fa7862", "name": "network-vif-unplugged", "status": "completed", "tag": "1aef7905-067e-45bd-9e0e-044b18eaa72b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:52.493800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-908f9708-2eef-4342-bda0-c76a7975d8b1 req-46003e44-d7ff-421d-a15e-921bdf03eeba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.494432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-908f9708-2eef-4342-bda0-c76a7975d8b1 req-46003e44-d7ff-421d-a15e-921bdf03eeba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.508533 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-908f9708-2eef-4342-bda0-c76a7975d8b1 req-46003e44-d7ff-421d-a15e-921bdf03eeba service nova] Creating event network-vif-unplugged:1aef7905-067e-45bd-9e0e-044b18eaa72b for instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 on nch1-master-1 May 14 21:17:52.518731 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-908f9708-2eef-4342-bda0-c76a7975d8b1 req-46003e44-d7ff-421d-a15e-921bdf03eeba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040308 May 14 21:17:52.520038 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1052/1992] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:52.555846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:52.556988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:52.564219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.565026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.566326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.566880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.648932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:52.658499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:52.660802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:52.666087 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1870873c-8d84-4c86-b51a-d7257251bac4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.300232 May 14 21:17:52.667108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 941/1993] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:52 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:52.704809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:52.714769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:52.725214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.729472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.733448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.734902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.780772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:52.796179 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c00a2d29-e33d-412e-949c-2baf7ae961f4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1317 microversion: 2.1 time: 0.242932 May 14 21:17:52.807397 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1053/1994] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:52 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:52.858246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:52.859651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:52.867534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.868585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:52.869694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:52.870157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.199052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:53.212604 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dfba015d-7b1c-458e-9bee-7255d87fd77a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1501 microversion: 2.1 time: 0.522037 May 14 21:17:53.213208 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 942/1995] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:52 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1501 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:53.223607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:53.234607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b39add5-eb32-4ea8-a5e8-9a85d7a141ba tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1468 microversion: 2.1 time: 0.380523 May 14 21:17:53.235102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:53.248173 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1054/1996] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:52 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1468 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:53.266648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:53.286080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.286080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.286080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.286080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.334352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lazy-loading 'flavor' on Instance uuid 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:53.386967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:53.390381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:53.409782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.412441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.417732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.419713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.733861 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1316e20c-fefa-4f25-8af9-8de87422f34c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "POST /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119/action" status: 200 len: 32 microversion: 2.1 time: 0.508619 May 14 21:17:53.740899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 943/1997] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:17:53 2022] POST /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119/action => generated 32 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:17:53.748192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:53.749180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:53.759077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.760209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.761450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.762103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.835613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:53.856173 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec4c0b13-f600-45db-a669-471de79aa134 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1552 microversion: 2.1 time: 0.473581 May 14 21:17:53.856173 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1055/1998] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:53 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1552 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:53.856173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:53.856794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:53.867723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.868423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:53.868975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:53.869422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.016958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.041339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.041927 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3cf4479-cd81-4862-a835-f76d23feb846 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1789 microversion: 2.1 time: 0.295141 May 14 21:17:54.042720 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 944/1999] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:53 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1789 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:54.056997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:54.057870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:54.067218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.067728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.068528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.068668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.068972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.070214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.071835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72d52a66-13f1-47a8-ae17-e27833740635 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.219098 May 14 21:17:54.076346 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1056/2000] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:53 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:54.082517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-314c349d-e445-405b-b3c0-090fed204878 req-3620c7ef-0ee2-4782-a98a-e2d445474c56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-unplugged", "status": "completed", "tag": "e3119c30-cd1d-44fb-bf9c-dd51415d53ae"}, {"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-unplugged", "status": "completed", "tag": "397f9ff4-1b58-4780-9dd6-0187ed997835"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:54.097149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-314c349d-e445-405b-b3c0-090fed204878 req-3620c7ef-0ee2-4782-a98a-e2d445474c56 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.097609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-314c349d-e445-405b-b3c0-090fed204878 req-3620c7ef-0ee2-4782-a98a-e2d445474c56 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.134757 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-314c349d-e445-405b-b3c0-090fed204878 req-3620c7ef-0ee2-4782-a98a-e2d445474c56 service nova] Creating event network-vif-unplugged:e3119c30-cd1d-44fb-bf9c-dd51415d53ae for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:54.135742 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-314c349d-e445-405b-b3c0-090fed204878 req-3620c7ef-0ee2-4782-a98a-e2d445474c56 service nova] Creating event network-vif-unplugged:397f9ff4-1b58-4780-9dd6-0187ed997835 for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:54.142685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-314c349d-e445-405b-b3c0-090fed204878 req-3620c7ef-0ee2-4782-a98a-e2d445474c56 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.064110 May 14 21:17:54.144451 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1057/2001] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:54.151393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:54.152238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:54.160658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.161232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.162147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.162767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.345913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.369658 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9e9e3899-bed9-48e7-a1fa-f6fa76367d6b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.316414 May 14 21:17:54.370527 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 945/2002] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:54 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:54.372347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.378822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-72151909-3c66-41b9-9cc8-f7a73ac3ed2c req-ac7215c5-6e74-4f34-a5ec-f5a86b139d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-deleted", "tag": "71f13a97-5bd0-4446-9085-0270aee83186"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:54.381527 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2b2366b1-053c-43e2-acd8-0ca0aac09272 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1466 microversion: 2.1 time: 0.235796 May 14 21:17:54.385629 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1058/2003] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:54 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1466 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:54.393205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-72151909-3c66-41b9-9cc8-f7a73ac3ed2c req-ac7215c5-6e74-4f34-a5ec-f5a86b139d5e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.393901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-72151909-3c66-41b9-9cc8-f7a73ac3ed2c req-ac7215c5-6e74-4f34-a5ec-f5a86b139d5e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.395585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:54.396220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:54.409747 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-72151909-3c66-41b9-9cc8-f7a73ac3ed2c req-ac7215c5-6e74-4f34-a5ec-f5a86b139d5e service nova] Creating event network-vif-deleted:71f13a97-5bd0-4446-9085-0270aee83186 for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:54.410351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.410818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.411655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.416000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.416306 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-72151909-3c66-41b9-9cc8-f7a73ac3ed2c req-ac7215c5-6e74-4f34-a5ec-f5a86b139d5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044450 May 14 21:17:54.416919 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 946/2004] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:54.426046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:54.426046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:54.432604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.433459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.434448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.435208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.530836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.541990 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf0a054d-38f4-4ae8-8aee-ceb5dae474f8 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1297 microversion: 2.1 time: 0.156366 May 14 21:17:54.543266 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1059/2005] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:54 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1297 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:54.554630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-394429f6-2894-48bf-bcc0-1b3f68d02bd5 req-3cb02e6a-0334-4065-86bd-eea6dd9435b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd12aad-4b1b-4433-a46d-66a5d3fa7862", "tag": "1aef7905-067e-45bd-9e0e-044b18eaa72b"}, {"server_uuid": "2a5a5886-95f4-4ee4-9bf7-013456bfa20b", "name": "network-vif-deleted", "tag": "18b50999-4ef7-4c21-8dba-c0606fe826e1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:54.564497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-394429f6-2894-48bf-bcc0-1b3f68d02bd5 req-3cb02e6a-0334-4065-86bd-eea6dd9435b8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.570203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-394429f6-2894-48bf-bcc0-1b3f68d02bd5 req-3cb02e6a-0334-4065-86bd-eea6dd9435b8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.577891 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-394429f6-2894-48bf-bcc0-1b3f68d02bd5 req-3cb02e6a-0334-4065-86bd-eea6dd9435b8 service nova] Creating event network-changed:1aef7905-067e-45bd-9e0e-044b18eaa72b for instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 on nch1-master-1 May 14 21:17:54.578396 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-394429f6-2894-48bf-bcc0-1b3f68d02bd5 req-3cb02e6a-0334-4065-86bd-eea6dd9435b8 service nova] Creating event network-vif-deleted:18b50999-4ef7-4c21-8dba-c0606fe826e1 for instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b on nch2-master-1 May 14 21:17:54.586607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-394429f6-2894-48bf-bcc0-1b3f68d02bd5 req-3cb02e6a-0334-4065-86bd-eea6dd9435b8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041934 May 14 21:17:54.587211 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1060/2006] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:54.606976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:54.614805 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f639fb7-ab35-4a87-bb78-28233f35f413 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 200 len: 1317 microversion: 2.1 time: 0.196510 May 14 21:17:54.615382 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 947/2007] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:54 2022] GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:54.870548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:54.871946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:54.878661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.881684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:54.881684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:54.881684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.065433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:55.067026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:55.086694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.088677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.090578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.091852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.102083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.110833 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-21b7e329-129b-425d-bc6d-7e30b98cb205 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1552 microversion: 2.1 time: 0.246870 May 14 21:17:55.111715 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1061/2008] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:54 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:55.124600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:55.126616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:55.133418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.134117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.134895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.135329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.284869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.295175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.296945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.298358 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-05a6ab5c-b269-4e41-b0fe-9cb8b17b145a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.179287 May 14 21:17:55.303720 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1062/2009] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:55 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:55.387099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:55.387893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:55.393997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.400300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.400300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.400300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.441924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.471569 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-65b6078d-0ca7-44cd-9559-f37e887793e0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1653 microversion: 2.1 time: 0.412057 May 14 21:17:55.472824 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 948/2010] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:55 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1653 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:55.560317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:55.561156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:55.567537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.568158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.569803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.570470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.617478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.617983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.618450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lazy-loading 'fault' on Instance uuid 2a5a5886-95f4-4ee4-9bf7-013456bfa20b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:55.668248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.681357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b93d6c3d03d407f8be4aa38e2fbb154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a0e2c4a9054b4b962b9bc72c64517c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.682204 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d13cd856-c67d-40d8-920a-48a6c66dfa39 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.299109 May 14 21:17:55.691819 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1063/2011] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:55 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:55.692015 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2bb6ae21-ef81-4de2-afd6-001027819b6e tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 200 len: 1302 microversion: 2.1 time: 0.134045 May 14 21:17:55.692131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:55.692131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:55.692447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 949/2012] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:55 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 1302 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:55.707297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.707919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.708909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.709370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.872229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.884333 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92e2917c-2b90-45c3-bb76-cb56a6222a8b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 200 len: 1466 microversion: 2.1 time: 0.199256 May 14 21:17:55.885010 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1064/2013] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:55 2022] GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 1466 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:55.902726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:55.906641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:55.908991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Searching by: {'reservation_id': 'r-i0oc0hde', 'deleted': False, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:17:55.913311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.914170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:55.915199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:55.915676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.016343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:17:56.090714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.097365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.097822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.128842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.134330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.137208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.137722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.138492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.138930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.222147 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a5db0c5-8d17-4baf-9635-09124cca81e9 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?reservation_id=r-i0oc0hde" status: 200 len: 2925 microversion: 2.1 time: 0.323502 May 14 21:17:56.222767 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 950/2014] 10.222.0.52 () {58 vars in 1196 bytes} [Sat May 14 21:17:55 2022] GET /compute/v2.1/servers/detail?reservation_id=r-i0oc0hde => generated 2925 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:56.242863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cf7e4c3a-134b-431a-849a-f2bebd903a8d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.258380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.compute.server_groups [None req-cf7e4c3a-134b-431a-849a-f2bebd903a8d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Querying cell eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) for 2 instances {{(pid=130637) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 14 21:17:56.259442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf7e4c3a-134b-431a-849a-f2bebd903a8d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.260131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf7e4c3a-134b-431a-849a-f2bebd903a8d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.276426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.284499 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-862a24ac-0284-4347-b99a-446c514fe5f0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.159695 May 14 21:17:56.285085 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1065/2015] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:56.290990 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cf7e4c3a-134b-431a-849a-f2bebd903a8d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/274c6800-dd69-4e99-9c50-7695004c5ebc" status: 200 len: 270 microversion: 2.1 time: 0.053843 May 14 21:17:56.291988 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 951/2016] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/os-server-groups/274c6800-dd69-4e99-9c50-7695004c5ebc => generated 270 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:17:56.301213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c9ee090-f54d-42ef-9837-379deafbb8e5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.304121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c9ee090-f54d-42ef-9837-379deafbb8e5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.304251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.305148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.309863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c9ee090-f54d-42ef-9837-379deafbb8e5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.310419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c9ee090-f54d-42ef-9837-379deafbb8e5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.311446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c9ee090-f54d-42ef-9837-379deafbb8e5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.311959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c9ee090-f54d-42ef-9837-379deafbb8e5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.315326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.316062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.316840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.317430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.458840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.461451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c9ee090-f54d-42ef-9837-379deafbb8e5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1617 microversion: 2.1 time: 0.164031 May 14 21:17:56.462049 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 952/2017] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1617 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:56.466791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.467403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.468738 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-54723455-1ffe-4aac-9e08-6a094e124c1d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.171576 May 14 21:17:56.470128 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1066/2018] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:56.475145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.476332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.477100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.477776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.481754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e327b0c9-6ce7-43d9-84ab-6443076e50e1 req-3ec84a35-a074-494c-a02d-a5683379ca58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-deleted", "tag": "397f9ff4-1b58-4780-9dd6-0187ed997835"}, {"server_uuid": "52bb515d-9e62-40b2-bccd-8d35505e8f71", "name": "network-vif-deleted", "tag": "e3119c30-cd1d-44fb-bf9c-dd51415d53ae"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:56.493735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e327b0c9-6ce7-43d9-84ab-6443076e50e1 req-3ec84a35-a074-494c-a02d-a5683379ca58 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.494191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e327b0c9-6ce7-43d9-84ab-6443076e50e1 req-3ec84a35-a074-494c-a02d-a5683379ca58 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.505237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e327b0c9-6ce7-43d9-84ab-6443076e50e1 req-3ec84a35-a074-494c-a02d-a5683379ca58 service nova] Creating event network-vif-deleted:397f9ff4-1b58-4780-9dd6-0187ed997835 for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:56.505758 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e327b0c9-6ce7-43d9-84ab-6443076e50e1 req-3ec84a35-a074-494c-a02d-a5683379ca58 service nova] Creating event network-vif-deleted:e3119c30-cd1d-44fb-bf9c-dd51415d53ae for instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 on nch2-master-1 May 14 21:17:56.511677 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e327b0c9-6ce7-43d9-84ab-6443076e50e1 req-3ec84a35-a074-494c-a02d-a5683379ca58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039588 May 14 21:17:56.512283 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1067/2019] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:17:56.517108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-feec6530-3b99-40db-b4c0-00c5bd34d05f tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.517821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-feec6530-3b99-40db-b4c0-00c5bd34d05f tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.525379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feec6530-3b99-40db-b4c0-00c5bd34d05f tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.526242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feec6530-3b99-40db-b4c0-00c5bd34d05f tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.528009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feec6530-3b99-40db-b4c0-00c5bd34d05f tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.528480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feec6530-3b99-40db-b4c0-00c5bd34d05f tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.622156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.630858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.634011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.634195 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23ccef3c-94f6-4da1-b558-829dfaa88364 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.170855 May 14 21:17:56.634649 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 953/2020] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:56.649694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.650308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.656343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.659143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.659143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.659143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.661160 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-feec6530-3b99-40db-b4c0-00c5bd34d05f tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 200 len: 1617 microversion: 2.1 time: 0.147661 May 14 21:17:56.661744 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1068/2021] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 1617 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:56.668688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1835b553-09d8-4a98-92bb-9f44751092b5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-769925734"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:56.670268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1835b553-09d8-4a98-92bb-9f44751092b5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.681605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1835b553-09d8-4a98-92bb-9f44751092b5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.682204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1835b553-09d8-4a98-92bb-9f44751092b5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.683071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1835b553-09d8-4a98-92bb-9f44751092b5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.683900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1835b553-09d8-4a98-92bb-9f44751092b5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.698539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.699686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.700562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lazy-loading 'fault' on Instance uuid 52bb515d-9e62-40b2-bccd-8d35505e8f71 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:17:56.752249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.761047 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2232a4da-6138-47d9-b692-84502272bb62 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 200 len: 1303 microversion: 2.1 time: 0.115035 May 14 21:17:56.767646 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 954/2022] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:56.773115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.773732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.779761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.780241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.781018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.781459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.919592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:56.927363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5706b9fd-d107-4351-872e-c5366f0d24aa tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.158102 May 14 21:17:56.928893 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 955/2023] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:56.933517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:56.934130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] [instance: 2a5a5886-95f4-4ee4-9bf7-013456bfa20b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:56.939968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.940425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.941200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:56.941640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:56.955870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] HTTP exception thrown: Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b could not be found. May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Request method failure captured: May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b HTTP/1.1 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBssDLYgUNOvC771G8m0__E2HUEL981uRKSVKwv5YPKnWewehTE6KuVpC_w7Ps4UZeNG9bKoxYrkPcZN41oGpVVC7eU_4JHaA8ADN6-Fc_83w8j9GLPxzfrhZsyzHPdF8IxMK9PzAwNHxSWeSx0fe6teoclViS8TRS3FHsOhlMlv-WQ May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/35a0e2c4a9054b4b962b9bc72c64517c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_35a0e2c4a9054b4b962b9bc72c64517c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-MigrationsAdminTest-2010048286 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 35a0e2c4a9054b4b962b9bc72c64517c May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-MigrationsAdminTest-2010048286 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 5b93d6c3d03d407f8be4aa38e2fbb154 May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-MigrationsAdminTest-2010048286-project May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b could not be found. May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '2a5a5886-95f4-4ee4-9bf7-013456bfa20b'} May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b could not be found. May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b could not be found. May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:56.957506 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b could not be found. May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] Returning 404 to user: Instance 2a5a5886-95f4-4ee4-9bf7-013456bfa20b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c6435d71-7a53-4dec-a405-d8c624aa4442 tempest-MigrationsAdminTest-2010048286 tempest-MigrationsAdminTest-2010048286-project] 10.222.0.52 "GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b" status: 404 len: 111 microversion: 2.1 time: 0.029180 May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 956/2024] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:56 2022] GET /compute/v2.1/servers/2a5a5886-95f4-4ee4-9bf7-013456bfa20b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:17:56.965837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-228115585", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "aebd3dc2-1a09-4160-9276-8df5efb2fa05"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:17:57.032093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:17:57.254172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:17:57.263905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:17:57.263905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:17:57.263905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:17:57.263905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:17:57.265844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.266299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:57.267218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.267807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:57.285123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:17:57.291094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:17:57.303763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:17:57.306180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:17:57.314329 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1835b553-09d8-4a98-92bb-9f44751092b5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.651132 May 14 21:17:57.322395 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1069/2025] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:17:56 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 14 21:17:57.519970 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60f62268-6889-468a-97f0-517b47e36e35 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559333 May 14 21:17:57.526212 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 957/2026] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:17:57.532384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-39ce6d2a-c871-4a8e-85e7-81b66dffdd65 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:57.533164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-39ce6d2a-c871-4a8e-85e7-81b66dffdd65 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:57.606258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39ce6d2a-c871-4a8e-85e7-81b66dffdd65 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:57.617532 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-39ce6d2a-c871-4a8e-85e7-81b66dffdd65 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1216 microversion: 2.1 time: 0.085809 May 14 21:17:57.623958 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1070/2027] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:57 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1216 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:17:57.654653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:57.656117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:57.665083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.665545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:57.666327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.666767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:57.782439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:57.783131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:57.789759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.790216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:57.791017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.791687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:57.806295 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] HTTP exception thrown: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Request method failure captured: May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 HTTP/1.1 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBw-uwE8Da7QZoiYIy2nWNlDjeYOGK1v0FeRuF5Jb8H_Ahi5nQTE1dU5m21O55N2j2io0ACLM2223BWa6lDbFTDqCHLNyH6LTawdiFAyUbCB2hNic-sjFBgzt0Ur79pLiJ41fwp4Y0hvUtCAnL7hxZR8mVkAYSrI7U2zPfwJYJHel_Q May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestMultiNic-150548444 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9197ea49e7544e7c96dd2d4b1a55fa29", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestMultiNic-150548444 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestMultiNic-150548444 May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestMultiNic-150548444-project May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6ae75ac4b3ed44eda1e8717ff641cd0c May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestMultiNic-150548444-project May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '52bb515d-9e62-40b2-bccd-8d35505e8f71'} May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:17:57.807937 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Returning 404 to user: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-26f9b1a0-ada3-414e-91a4-3c9cc17f4706 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 404 len: 111 microversion: 2.1 time: 0.031032 May 14 21:17:57.813959 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1071/2028] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:57 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:17:57.838897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:57.849618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:57.851842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:57.853052 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4ff6fda-1c26-40f4-98a5-95470f85b2e6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.203574 May 14 21:17:57.863789 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 958/2029] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:57 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:57.971140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:57.971783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:57.991686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.991686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:57.991686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:57.991686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:58.175195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:58.183647 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c8bed67f-952d-4ff0-84a9-0e72fe1a5e0f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.242423 May 14 21:17:58.184214 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1072/2030] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:57 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:58.630956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:58.631767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:58.656509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:58.657239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:58.658030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:58.658663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:58.727701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:58.735744 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2c230eeb-4c25-45df-8d61-b5f858a3a5a6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1220 microversion: 2.1 time: 0.108577 May 14 21:17:58.736318 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 959/2031] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:58 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:58.871017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:58.871636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:58.877776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:58.878386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:58.879244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:58.879729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:59.120024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:59.149072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:59.149072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:59.149072 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9b6d9793-b52f-452d-a87d-d6ac66ef2fd0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.267702 May 14 21:17:59.149072 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1073/2032] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:17:58 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:17:59.202056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:59.202926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:59.209755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:59.210216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:59.211030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:59.211509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:59.420531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:59.446802 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc8a03f9-ba13-4d13-8afa-944ae8331b5c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.234672 May 14 21:17:59.446802 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 960/2033] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:59 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:17:59.753140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:17:59.754113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:17:59.761620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:59.762338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:59.763335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:17:59.764418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:17:59.843758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:17:59.853095 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f114ac14-43f5-4f2a-89af-711eca98d8b0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1268 microversion: 2.1 time: 0.104172 May 14 21:17:59.854017 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1074/2034] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:17:59 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1268 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:00.156079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:00.157694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:00.165996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:00.171145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:00.171145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:00.171145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:00.457283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:00.458196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:00.466321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:00.467932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:00.470053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:00.470692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:00.481140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:00.494739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:00.497559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:00.503793 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd4511b5-08b7-4cc1-b595-185a74d1adbc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.349404 May 14 21:18:00.505013 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 961/2035] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:00 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:00.635844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:00.643559 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8cff1d13-c9e1-4dbc-8bb7-8393ec78f7bd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.193280 May 14 21:18:00.644155 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1075/2036] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:00 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:00.876784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:00.877430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:00.885413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:00.885626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:00.886783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:00.887427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:00.979560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:00.987413 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9b0f2a0-8ec8-4270-8f5b-7b670e035940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1274 microversion: 2.1 time: 0.121299 May 14 21:18:00.997484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 962/2037] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:00 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:01.525558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:01.526215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:01.536226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:01.536770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:01.538579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:01.539444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:01.663575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:01.665316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:01.675420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:01.676320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:01.677768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:01.679018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:01.778902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:01.789057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:01.791436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:01.792866 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b136992e-78a1-4613-976f-db63977e4fc4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.272473 May 14 21:18:01.793523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1076/2038] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:01 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:02.004445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:02.005080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:02.023207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:02.023703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:02.024525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:02.024952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:02.213685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:02.224607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-675e1ad1-2e37-4905-be5d-56eb91302e4a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 0.223968 May 14 21:18:02.231167 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1077/2039] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:01 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:02.345971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:02.355689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d45fd10-0687-45a4-bdcd-96036f67036a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.698170 May 14 21:18:02.369377 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 963/2040] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:01 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:02.812105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:02.813434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:02.821352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:02.821798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:02.822784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:02.823224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:03.246702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:03.247735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:03.261490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:03.278378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:03.279018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:03.279856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:03.280939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:03.284078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:03.284419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:03.293291 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b6cdf6f-a0d1-432f-8e40-a7f91ae0677d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.485077 May 14 21:18:03.307635 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1078/2041] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:02 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:03.375443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:03.376363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:03.386242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:03.387639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:03.388592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:03.389255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:03.651975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:03.692523 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-171496ec-4994-44af-a8ac-ea0a171dec6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.307499 May 14 21:18:03.694817 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1079/2042] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:03 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:03.700759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1322a969-034d-47c5-b438-30ebff149618 req-9ce67928-b004-4e79-9315-499532c96850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-plugged", "status": "completed", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:03.712641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:03.717500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1322a969-034d-47c5-b438-30ebff149618 req-9ce67928-b004-4e79-9315-499532c96850 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:03.718277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1322a969-034d-47c5-b438-30ebff149618 req-9ce67928-b004-4e79-9315-499532c96850 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:03.731824 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1322a969-034d-47c5-b438-30ebff149618 req-9ce67928-b004-4e79-9315-499532c96850 service nova] Creating event network-vif-plugged:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:18:03.733742 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b59f25de-766a-418d-a860-84276824043c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 0.490292 May 14 21:18:03.734054 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 964/2043] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:03 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:03.747062 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1322a969-034d-47c5-b438-30ebff149618 req-9ce67928-b004-4e79-9315-499532c96850 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049796 May 14 21:18:03.749495 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1080/2044] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:03.905224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9d8b410d-69a0-4d49-9d07-b543baf0e620 req-b3e095a2-a894-4cfc-8460-b54253234e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016519b2-b932-4be6-ba69-5ce679fec414", "tag": "8fbb69dd-a1d9-4bd5-9188-ffd595b8948c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:03.940101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9d8b410d-69a0-4d49-9d07-b543baf0e620 req-b3e095a2-a894-4cfc-8460-b54253234e8d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:03.948261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9d8b410d-69a0-4d49-9d07-b543baf0e620 req-b3e095a2-a894-4cfc-8460-b54253234e8d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:03.996232 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9d8b410d-69a0-4d49-9d07-b543baf0e620 req-b3e095a2-a894-4cfc-8460-b54253234e8d service nova] Creating event network-changed:8fbb69dd-a1d9-4bd5-9188-ffd595b8948c for instance 016519b2-b932-4be6-ba69-5ce679fec414 on nch1-master-1 May 14 21:18:04.021161 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9d8b410d-69a0-4d49-9d07-b543baf0e620 req-b3e095a2-a894-4cfc-8460-b54253234e8d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136370 May 14 21:18:04.028230 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 965/2045] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:04.322929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:04.326971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:04.361295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:04.361295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:04.361295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:04.361295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:04.714342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:04.717026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:04.732144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:04.739183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:04.742367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:04.742367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:04.742773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:04.743309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:04.751331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:04.754494 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1091f5b0-bd69-4b3d-9b77-08b36df3ef75 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.443981 May 14 21:18:04.759291 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1081/2046] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:04 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:04.771980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:04.788693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:04.808215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:04.817307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:04.817307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:04.817307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:05.200654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:05.211579 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-31b22e65-f73e-499c-b27e-22ee7783b14b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 0.450667 May 14 21:18:05.215466 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1082/2047] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:04 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:05.287891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:05.304264 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d17208af-e8e6-4818-8c95-da28d47875f6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.588734 May 14 21:18:05.313477 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 966/2048] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:04 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:05.779788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:05.780693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:05.791420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:05.792170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:05.794275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:05.795100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:06.022846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:06.049839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:06.053663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:06.059143 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-034c8c04-d48e-40e1-b251-eb811941a643 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.282875 May 14 21:18:06.061704 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1083/2049] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:05 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:06.188106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2053697529", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "66ef981e-67ba-4260-838c-71b0d625aa4a"}, {"uuid": "baab4bd8-a048-42d7-aa1d-4d68d9a4ad3d"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:06.232079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:06.233012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:06.252606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:06.263138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:06.263138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:06.263138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:06.296095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] validate_networks() for [('66ef981e-67ba-4260-838c-71b0d625aa4a', None, None, None, None, None), ('baab4bd8-a048-42d7-aa1d-4d68d9a4ad3d', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:18:06.476234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:06.484826 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ad63cefe-4652-4849-a3dc-3f3b06b2cbcf tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 0.256871 May 14 21:18:06.494852 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1084/2050] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:06 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:06.499261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:06.500183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:06.507506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:06.512323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:06.512323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:06.512323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:06.753894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:06.765948 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-00b5e952-3dd3-448b-b36f-2d952828db88 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.271819 May 14 21:18:06.767452 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1085/2051] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:06 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:07.086035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:07.090569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:07.117133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:07.117764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:07.118607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:07.121586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:07.459121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:07.469894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:07.471891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:07.484941 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd301508-f530-4fdb-9499-0bcd675d1a01 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.399195 May 14 21:18:07.486222 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1086/2052] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:07 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:18:07.510115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:07.511041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:07.518497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:07.525609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:07.527399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:07.528101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:07.720345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:07.733659 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4524fe8c-b744-4012-89c6-eb33087b59ae tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 0.232569 May 14 21:18:07.746217 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1087/2053] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:07 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:07.784556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:07.785504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:07.804905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:07.808868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:07.809718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:07.815421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:08.058176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:08.081195 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c44dc84c-4002-4185-95b5-48dd36101c15 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.300777 May 14 21:18:08.083964 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1088/2054] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:07 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:08.532354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:08.532354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:08.539904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:08.540370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:08.541174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:08.541625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:08.749694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:08.762089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-40dddbcd-4b57-467c-bc6e-3fa981329d4a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.266612 May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1089/2055] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:08 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:08.808440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:09.067138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:09.092019 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1e50ba3b-8403-449a-9670-4caae1f19b01 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 0.310443 May 14 21:18:09.096880 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1090/2056] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:08 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:09.105794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:09.107684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:09.127991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:09.128808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:09.130251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:09.131993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:09.415760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:18:09.418329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:18:09.419387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:18:09.420519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:18:09.420989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:18:09.440495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:09.441072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:09.441902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:09.442601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:09.467763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Getting quotas for project 9197ea49e7544e7c96dd2d4b1a55fa29. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:09.476886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Getting quotas for user 6ae75ac4b3ed44eda1e8717ff641cd0c and project 9197ea49e7544e7c96dd2d4b1a55fa29. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:09.510833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:18:09.513387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:18:09.603071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:09.612254 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6eb32630-730a-4506-82f9-0f7393c8134b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.513422 May 14 21:18:09.613570 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1091/2057] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:09 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:09.719694 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-362bd5a6-215c-4190-bc8f-943f8846239d tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.545250 May 14 21:18:09.730693 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 967/2058] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:18:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:18:09.735963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6487929e-0bc7-44f5-b2d3-dde8f39305b4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:09.736888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6487929e-0bc7-44f5-b2d3-dde8f39305b4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:09.788532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:09.789158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:09.803545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:09.806854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:09.807913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:09.810971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:09.957302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6487929e-0bc7-44f5-b2d3-dde8f39305b4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:09.964768 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6487929e-0bc7-44f5-b2d3-dde8f39305b4 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1213 microversion: 2.1 time: 0.233654 May 14 21:18:09.967544 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1092/2059] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:09 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:10.112658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:10.113423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:10.128396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:10.132138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:10.142421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:10.142421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:10.369123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:10.382886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:10.386065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:10.395578 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a7c49fff-0d68-453b-a815-d919bb716343 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1646 microversion: 2.25 time: 0.613033 May 14 21:18:10.399049 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 968/2060] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:09 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1646 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:18:10.636399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:10.640778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:10.655320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:10.660292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:10.663020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:10.663948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:10.962709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:10.971541 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d3d3766-cf9c-4d13-ac8b-338791bd5fd2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.344534 May 14 21:18:10.973189 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 969/2061] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:10 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:10.983980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ca4d28f8-7179-4a53-89bd-4a93d48fb1c7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:10.988880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ca4d28f8-7179-4a53-89bd-4a93d48fb1c7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:11.123435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ca4d28f8-7179-4a53-89bd-4a93d48fb1c7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:11.132980 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ca4d28f8-7179-4a53-89bd-4a93d48fb1c7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1213 microversion: 2.1 time: 0.152723 May 14 21:18:11.135170 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 970/2062] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:10 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:11.173653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:11.185118 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-87354435-df9c-4999-b859-63ee41092704 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 1.074497 May 14 21:18:11.198924 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1093/2063] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:10 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:11.420963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:11.421980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:11.434794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:11.441188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:11.442351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:11.445665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:11.634104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:11.651311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:11.653923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:11.656296 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc656894-bb4b-48e6-9ddd-6367ad5ccdaf tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1636 microversion: 2.25 time: 0.239011 May 14 21:18:11.670392 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 971/2064] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:11 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1636 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:11.689546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea155813-c518-4b74-9a3a-f42e4b2b55ed tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '.version_select at 0x7fb1b985fca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:11.695206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea155813-c518-4b74-9a3a-f42e4b2b55ed tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:11.700324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea155813-c518-4b74-9a3a-f42e4b2b55ed tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:11.739210 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea155813-c518-4b74-9a3a-f42e4b2b55ed tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2783 microversion: 2.25 time: 0.065434 May 14 21:18:11.747074 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1094/2065] 10.222.0.52 () {60 vars in 1183 bytes} [Sat May 14 21:18:11 2022] GET /compute/v2.1/os-migrations => generated 2783 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:18:11.759865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:11.760842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:11.768390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:11.769149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:11.770173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:11.770957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:11.807762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1941d79b-112d-4ec2-8057-605a72b358ba req-6d0c99f4-6fa0-409d-b557-1f40e72a2410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016519b2-b932-4be6-ba69-5ce679fec414", "name": "network-vif-plugged", "status": "completed", "tag": "8fbb69dd-a1d9-4bd5-9188-ffd595b8948c"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:11.826165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1941d79b-112d-4ec2-8057-605a72b358ba req-6d0c99f4-6fa0-409d-b557-1f40e72a2410 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:11.837021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1941d79b-112d-4ec2-8057-605a72b358ba req-6d0c99f4-6fa0-409d-b557-1f40e72a2410 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:11.853697 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1941d79b-112d-4ec2-8057-605a72b358ba req-6d0c99f4-6fa0-409d-b557-1f40e72a2410 service nova] Creating event network-vif-plugged:8fbb69dd-a1d9-4bd5-9188-ffd595b8948c for instance 016519b2-b932-4be6-ba69-5ce679fec414 on nch1-master-1 May 14 21:18:11.860227 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1941d79b-112d-4ec2-8057-605a72b358ba req-6d0c99f4-6fa0-409d-b557-1f40e72a2410 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058410 May 14 21:18:11.870375 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1095/2066] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:18:12.003000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:12.003000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:12.011728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.019778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.020815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.021379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.059113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:18:12.090040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2246ce7-68ff-411f-a172-122c7af520d9 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 2128 microversion: 2.25 time: 0.334297 May 14 21:18:12.130398 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 972/2067] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:11 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 2128 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:12.154921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:12.156805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:12.174274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.174621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.175452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.182750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.358833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:12.371939 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-20bac94b-37d3-4956-8a1c-2b99dec05001 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.385019 May 14 21:18:12.381106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:18:12.383021 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1096/2068] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:11 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:12.399329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:12.399992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:12.417423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.417886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.418632 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2b1f05f-3476-41b5-948c-e54c504b090c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 2128 microversion: 2.25 time: 0.283210 May 14 21:18:12.418760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.419094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.420534 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 973/2069] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:12 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 2128 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:12.431636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:12.453108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:12.519206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.526583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.528217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.528879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.642257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:12.653474 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b1b29f8-7b60-4de1-a977-3c002edf461c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1209 microversion: 2.1 time: 0.269327 May 14 21:18:12.675423 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1097/2070] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:12 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1209 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:12.681919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:12.682578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:12.689588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.690958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.692183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:12.692861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:12.884289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:12.898763 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff5116eb-2090-48d4-93ab-83fbe378f9f6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1316 microversion: 2.1 time: 0.476084 May 14 21:18:12.909414 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 974/2071] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:12 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:12.937113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lazy-loading 'services' on Instance uuid 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:18:13.384435 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d9a2cb51-64c7-4073-a9a0-f5a177248b6f tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments/2a72aa90-a850-47be-bc0c-572dbc34980a" status: 202 len: 0 microversion: 2.25 time: 0.706809 May 14 21:18:13.387156 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1098/2072] 10.222.0.52 () {60 vars in 1456 bytes} [Sat May 14 21:18:12 2022] DELETE /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments/2a72aa90-a850-47be-bc0c-572dbc34980a => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:18:13.391025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:13.391799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:13.403664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-308bc5f2-26b1-4b59-9c7f-0fabf60a65ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:13.405753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-308bc5f2-26b1-4b59-9c7f-0fabf60a65ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:13.406415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.406983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:13.409851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.415933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308bc5f2-26b1-4b59-9c7f-0fabf60a65ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.416650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308bc5f2-26b1-4b59-9c7f-0fabf60a65ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:13.417731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308bc5f2-26b1-4b59-9c7f-0fabf60a65ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.418074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:13.418613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308bc5f2-26b1-4b59-9c7f-0fabf60a65ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:13.510626 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-308bc5f2-26b1-4b59-9c7f-0fabf60a65ff tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.118638 May 14 21:18:13.512027 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1099/2073] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:18:13 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:18:13.689573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:13.690335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:13.714523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.719624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:13.724446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.727720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:13.828004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:13.844532 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a6fce58-9587-4ca1-a968-be53d5ad9064 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.458018 May 14 21:18:13.849337 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 975/2074] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:13 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:13.888689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:13.898453 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-86db1af7-10e6-4150-bfc6-c3d663d17b99 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1265 microversion: 2.1 time: 0.214930 May 14 21:18:13.899526 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1100/2075] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:13 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:13.918142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:13.919006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:13.932090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.932090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:13.932090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:13.932090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.312731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:14.322917 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27595591-a794-4cf1-baeb-841727e91610 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1465 microversion: 2.1 time: 0.409614 May 14 21:18:14.323981 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 976/2076] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:13 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1465 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:14.339787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a632b350-07c5-4bdf-b8f4-5d3ab58094ba tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:14.340285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a632b350-07c5-4bdf-b8f4-5d3ab58094ba tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:14.348486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a632b350-07c5-4bdf-b8f4-5d3ab58094ba tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.348943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a632b350-07c5-4bdf-b8f4-5d3ab58094ba tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.353751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a632b350-07c5-4bdf-b8f4-5d3ab58094ba tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.355248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a632b350-07c5-4bdf-b8f4-5d3ab58094ba tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.523066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d2f3e372-7297-4a1a-b6c3-1dba858c83fb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:14.524714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d2f3e372-7297-4a1a-b6c3-1dba858c83fb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:14.538825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f3e372-7297-4a1a-b6c3-1dba858c83fb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.545590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f3e372-7297-4a1a-b6c3-1dba858c83fb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.546789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f3e372-7297-4a1a-b6c3-1dba858c83fb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.548011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f3e372-7297-4a1a-b6c3-1dba858c83fb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.638571 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d2f3e372-7297-4a1a-b6c3-1dba858c83fb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.119791 May 14 21:18:14.639675 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 977/2077] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:18:14 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:18:14.694751 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a632b350-07c5-4bdf-b8f4-5d3ab58094ba tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1616 microversion: 2.1 time: 0.358527 May 14 21:18:14.704498 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1101/2078] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:14 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1616 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:14.863945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:14.864554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:14.889073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.892542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.893403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.896261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.914763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:14.916118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:14.931111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.933409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:14.936382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:14.941589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:15.030051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:15.055105 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-69ff6257-07a0-4f70-8ddb-7e49e60ad834 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1283 microversion: 2.1 time: 0.144716 May 14 21:18:15.066893 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1102/2079] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:14 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1283 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:15.066893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-504093955", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["aebd3dc2-1a09-4160-9276-8df5efb2fa05"]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:15.166838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:18:15.405639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:15.425956 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f26b8f6-8485-4a01-b70c-44e419f3e469 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.564726 May 14 21:18:15.427209 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 978/2080] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:14 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:15.496061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:18:15.496490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:18:15.496991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:18:15.497449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:18:15.497880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:18:15.514339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:15.515120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:15.516180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:15.516816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:15.560566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:15.574776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:15.594848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:18:15.603188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:18:15.652054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21dc92a5-3d90-40bb-b915-4b02fc35f8e9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:15.653687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21dc92a5-3d90-40bb-b915-4b02fc35f8e9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:15.667004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21dc92a5-3d90-40bb-b915-4b02fc35f8e9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:15.669300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21dc92a5-3d90-40bb-b915-4b02fc35f8e9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:15.672899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21dc92a5-3d90-40bb-b915-4b02fc35f8e9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:15.673420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21dc92a5-3d90-40bb-b915-4b02fc35f8e9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:15.763514 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d214d71-217a-4712-b7d3-9337b2dea9b8 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.703877 May 14 21:18:15.772839 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21dc92a5-3d90-40bb-b915-4b02fc35f8e9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.117760 May 14 21:18:15.775513 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1103/2081] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:18:15.775668 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 979/2082] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:18:15 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:15.782228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5097a8fc-e28d-4854-9b43-b5c6355de4d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:15.783648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5097a8fc-e28d-4854-9b43-b5c6355de4d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:15.886529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5097a8fc-e28d-4854-9b43-b5c6355de4d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:15.896945 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5097a8fc-e28d-4854-9b43-b5c6355de4d4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1216 microversion: 2.1 time: 0.120550 May 14 21:18:15.899698 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1104/2083] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:15 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1216 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:16.075442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:16.075996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:16.108814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:16.109600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:16.115941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:16.116429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:16.448359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:16.449440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:16.473528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:16.473996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:16.475937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:16.481824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:16.940096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:16.951080 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c78e0c61-19ec-40a4-9a89-f14dc0a79150 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.510586 May 14 21:18:16.955255 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1105/2084] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:16 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:16.968187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d054b07-d78a-4daf-8c83-6a5e82cf0246 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:16.971100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d054b07-d78a-4daf-8c83-6a5e82cf0246 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:17.147650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d054b07-d78a-4daf-8c83-6a5e82cf0246 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:17.171800 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d054b07-d78a-4daf-8c83-6a5e82cf0246 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1216 microversion: 2.1 time: 0.214803 May 14 21:18:17.174064 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1106/2085] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:16 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1216 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:17.237824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:17.248207 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d3669ad5-6a63-4ccc-9b1a-71411b7ecfb7 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1313 microversion: 2.1 time: 1.177432 May 14 21:18:17.253757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 980/2086] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:16 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1313 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:17.973468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:17.975853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:17.985012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:17.992629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:17.992629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:17.992629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:18.201443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:18.202014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:18.254478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:18.254761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:18.254761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:18.254761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:18.254761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:18.265459 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-10ef7443-527c-4350-8c7d-d947b02e0fe2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.297234 May 14 21:18:18.284508 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1107/2087] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:17 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:18.290476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:18.292301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:18.300345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:18.300968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:18.301896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:18.302481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:18.447044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:18.457157 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c3a04da-8a13-4024-9c48-67f96472cc2e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1212 microversion: 2.1 time: 0.269188 May 14 21:18:18.458109 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 981/2088] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:18 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1212 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:18.535439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:18.562976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29e759fc-dff4-4ff9-ab37-4b7750008121 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1313 microversion: 2.1 time: 0.260192 May 14 21:18:18.562976 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1108/2089] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:18 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:19.296010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:19.297454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:19.313466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:19.316204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:19.317373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:19.320158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:19.479080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:19.480574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:19.502160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:19.502969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:19.515183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:19.516274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:19.720043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:19.731555 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0593a0a2-7c1a-4733-8a06-15f42afcb6c4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1268 microversion: 2.1 time: 0.259506 May 14 21:18:19.742146 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1109/2090] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:19 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1268 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:19.751146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:19.757087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:19.776677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:19.778072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:19.779161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:19.780494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:19.946473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:19.960611 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e10671ae-433d-4be5-827b-1f6d01d957c9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.668433 May 14 21:18:19.982381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 982/2091] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:19 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:20.116307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:20.128270 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a950d871-9f4d-4670-aed2-de882e96467c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.382285 May 14 21:18:20.128933 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1110/2092] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:19 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:20.763775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:20.766994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:20.794744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:20.795260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:20.796149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:20.796599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:20.980614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:20.981949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:20.989438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:20.990181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:20.991082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:20.991592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:21.056117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:21.069727 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-56867ae7-29e0-4be0-affe-0b19a6ac5183 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1274 microversion: 2.1 time: 0.319325 May 14 21:18:21.071330 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 983/2093] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:20 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1274 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:21.151889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:21.155287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:21.187096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:21.187096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:21.187096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:21.187096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:21.300336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:21.320410 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf17d04a-4faf-4c63-b2d3-fdf4040d3b64 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.340976 May 14 21:18:21.329343 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1111/2094] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:20 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:21.726922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:21.750859 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e51e0663-22a3-4cf1-baa6-89b5f3ab31fb tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.607581 May 14 21:18:21.760758 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 984/2095] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:21 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:22.095314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:22.096797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:22.112506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:22.112993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:22.113809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:22.114255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:22.338314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:22.339106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:22.355199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:22.355760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:22.356853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:22.357552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:22.501397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:22.513862 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c1076df-45bd-4e5f-bb53-b12998280698 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.423270 May 14 21:18:22.525008 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1112/2096] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:22 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:22.551530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:22.551530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:22.562351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:22.562909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:22.563806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:22.564252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:22.955036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:22.963719 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15a3d19a-12aa-4c8f-a9b4-e97e692ca207 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.420464 May 14 21:18:22.967062 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1113/2097] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:22 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:22.972035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:22.982206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:22.999671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:23.000622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:23.001713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:23.002389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:23.228158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:23.237508 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76f7e3a6-a0ff-41e7-9a4d-4895437a8cb2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.903092 May 14 21:18:23.238469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 985/2098] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:22 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:23.247159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d50c967b-f3dc-459c-a330-469da67140a5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-569865953"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:23.260478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d50c967b-f3dc-459c-a330-469da67140a5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:23.268640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d50c967b-f3dc-459c-a330-469da67140a5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:23.269094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d50c967b-f3dc-459c-a330-469da67140a5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:23.270285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d50c967b-f3dc-459c-a330-469da67140a5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:23.270899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d50c967b-f3dc-459c-a330-469da67140a5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:23.305636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:23.313600 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-681c4e6a-48dc-4cc5-8de8-2c2dc0032a1c tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.345361 May 14 21:18:23.314301 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1114/2099] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:22 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:23.532143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e4e8f162-ba68-44b5-9376-3ad53a5293b0 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Calling method '.version_select at 0x7fb1b97c3790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:23.594884 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e4e8f162-ba68-44b5-9376-3ad53a5293b0 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.220422 May 14 21:18:23.596089 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1115/2100] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:18:23 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:18:23.604901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0f8f3edf-b58e-4795-a463-a9aa9fc22e49 req-66df4f8d-90a5-4076-bd86-af1801c557a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b864be50-c70a-4a29-86b1-5e5f69ec5230", "tag": "abb89be5-20ae-48c5-802d-2c1c67e66d1d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:23.626067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0f8f3edf-b58e-4795-a463-a9aa9fc22e49 req-66df4f8d-90a5-4076-bd86-af1801c557a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:23.626657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0f8f3edf-b58e-4795-a463-a9aa9fc22e49 req-66df4f8d-90a5-4076-bd86-af1801c557a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:23.642510 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0f8f3edf-b58e-4795-a463-a9aa9fc22e49 req-66df4f8d-90a5-4076-bd86-af1801c557a4 service nova] Creating event network-changed:abb89be5-20ae-48c5-802d-2c1c67e66d1d for instance b864be50-c70a-4a29-86b1-5e5f69ec5230 on nch2-master-1 May 14 21:18:23.647795 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0f8f3edf-b58e-4795-a463-a9aa9fc22e49 req-66df4f8d-90a5-4076-bd86-af1801c557a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050204 May 14 21:18:23.648681 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1116/2101] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:23.657010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:23.657795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:23.672545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:23.672921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:23.676686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:23.682832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:23.949318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:23.964654 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1dcefd5f-c1a1-4741-8e17-f76c8f3275fa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.314440 May 14 21:18:23.965950 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1117/2102] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:23 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:23.975930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06917a9c-8fe2-47c7-a672-2533f75db0ef tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Action: 'create', calling method: .version_select at 0x7fb1b97b4940>, body: {"pool": "non_exist_pool"} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:23.986702 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d50c967b-f3dc-459c-a330-469da67140a5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.744995 May 14 21:18:23.987580 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 986/2103] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:18:23 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 14 21:18:24.130777 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-06917a9c-8fe2-47c7-a672-2533f75db0ef tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] HTTP exception thrown: Floating IP pool not found. May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06917a9c-8fe2-47c7-a672-2533f75db0ef tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Request method failure captured: May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 26 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigByfGjIyosSIMjH-9VbmFrpN24P3tUmOqR7Tg2FSLYT8FZAmNu-ytXMxs-ZL1sf9BtYS_Q0vCyC3ui91o8pF1wLcChPIc8HVo2dH7qE14WhItPG1DIRdWzIKqfOlCxrjgUidK5_xZhEmj7R6eT4sjpQA3OryGiJUfwF2dhit2IOJBXY May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 811e6ec5009a4bc09493edbdac6ee64b May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1767047314 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/811e6ec5009a4bc09493edbdac6ee64b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/811e6ec5009a4bc09493edbdac6ee64b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/811e6ec5009a4bc09493edbdac6ee64b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_811e6ec5009a4bc09493edbdac6ee64b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1767047314 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 811e6ec5009a4bc09493edbdac6ee64b May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1767047314 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPsNegativeTestJSON-1767047314-project May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 2f9db469c467477abf9f9f25bafaaf11 May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1767047314-project May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: {"pool": "non_exist_pool"} May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: exception: Floating IP pool not found. May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'pool': 'non_exist_pool'}} May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2957, in allocate_floating_ip May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2947, in _get_floating_ip_pool_id_by_name_or_id May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:18:24.133409 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:18:24.140154 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 14 21:18:24.140154 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:24.141708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06917a9c-8fe2-47c7-a672-2533f75db0ef tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Returning 404 to user: Floating IP pool not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:18:24.143066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-06917a9c-8fe2-47c7-a672-2533f75db0ef tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.175143 May 14 21:18:24.144260 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1118/2104] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:18:23 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:18:24.155423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0431335-d435-47ee-87f8-40e2648b8369 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Calling method '.version_select at 0x7fb1b9780ee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:24.239633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-a0431335-d435-47ee-87f8-40e2648b8369 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e761f987-0bff-499c-850f-388582b9b610 could not be found", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:18:24.240580 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a0431335-d435-47ee-87f8-40e2648b8369 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] HTTP exception thrown: Floating IP not found for ID e761f987-0bff-499c-850f-388582b9b610 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0431335-d435-47ee-87f8-40e2648b8369 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Request method failure captured: May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-floating-ips/e761f987-0bff-499c-850f-388582b9b610 HTTP/1.1 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigByfGjIyosSIMjH-9VbmFrpN24P3tUmOqR7Tg2FSLYT8FZAmNu-ytXMxs-ZL1sf9BtYS_Q0vCyC3ui91o8pF1wLcChPIc8HVo2dH7qE14WhItPG1DIRdWzIKqfOlCxrjgUidK5_xZhEmj7R6eT4sjpQA3OryGiJUfwF2dhit2IOJBXY May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 811e6ec5009a4bc09493edbdac6ee64b May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1767047314 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/811e6ec5009a4bc09493edbdac6ee64b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/811e6ec5009a4bc09493edbdac6ee64b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/811e6ec5009a4bc09493edbdac6ee64b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_811e6ec5009a4bc09493edbdac6ee64b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1767047314 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 811e6ec5009a4bc09493edbdac6ee64b May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1767047314 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FloatingIPsNegativeTestJSON-1767047314-project May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2f9db469c467477abf9f9f25bafaaf11 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1767047314-project May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: exception: Floating IP not found for ID e761f987-0bff-499c-850f-388582b9b610 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'e761f987-0bff-499c-850f-388582b9b610'} May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e761f987-0bff-499c-850f-388582b9b610 could not be found May 14 21:18:24.242966 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f1789a32-ce44-424f-ad93-5e0939b8df07'] May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e761f987-0bff-499c-850f-388582b9b610. May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e761f987-0bff-499c-850f-388582b9b610 May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e761f987-0bff-499c-850f-388582b9b610 May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0431335-d435-47ee-87f8-40e2648b8369 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] Returning 404 to user: Floating IP not found for ID e761f987-0bff-499c-850f-388582b9b610 {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:18:24.249041 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0431335-d435-47ee-87f8-40e2648b8369 tempest-FloatingIPsNegativeTestJSON-1767047314 tempest-FloatingIPsNegativeTestJSON-1767047314-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/e761f987-0bff-499c-850f-388582b9b610" status: 404 len: 111 microversion: 2.1 time: 0.096446 May 14 21:18:24.259146 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 987/2105] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:18:24 2022] DELETE /compute/v2.1/os-floating-ips/e761f987-0bff-499c-850f-388582b9b610 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:18:24.260367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:24.261018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:24.269146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:24.275308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:24.275308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:24.275308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:24.333080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:24.335307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:24.345493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:24.346336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:24.347394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:24.348188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:24.755067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:24.764951 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99179f21-9d07-4902-a16b-a0805471eec8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.437004 May 14 21:18:24.780674 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 988/2106] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:24 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:24.982241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:24.982883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:25.021946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:25.021946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:25.023009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:25.023491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:25.302125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:25.310387 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-026f0e26-90b9-4151-b2fb-ece1a04245df tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 1.057321 May 14 21:18:25.320814 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1119/2107] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:24 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:25.421583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:25.448972 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d0967db-5610-4b6c-a3ba-de4e9eebc108 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.470698 May 14 21:18:25.450286 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 989/2108] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:24 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:25.730410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-bc9f501f-bcf0-4185-863e-40105f0a4733 req-bd36f5aa-1ec6-4283-a52f-cbe1621688aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0852bda-1b69-4893-aed5-4970dc57d1c2", "tag": "4fd5f38e-2d88-4afe-ad3f-275929a09686"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:25.750419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bc9f501f-bcf0-4185-863e-40105f0a4733 req-bd36f5aa-1ec6-4283-a52f-cbe1621688aa service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:25.763076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bc9f501f-bcf0-4185-863e-40105f0a4733 req-bd36f5aa-1ec6-4283-a52f-cbe1621688aa service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:25.789213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:25.790241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:25.798657 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-bc9f501f-bcf0-4185-863e-40105f0a4733 req-bd36f5aa-1ec6-4283-a52f-cbe1621688aa service nova] Creating event network-changed:4fd5f38e-2d88-4afe-ad3f-275929a09686 for instance e0852bda-1b69-4893-aed5-4970dc57d1c2 on nch1-master-1 May 14 21:18:25.806903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:25.806903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:25.807166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:25.807535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:25.816929 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-bc9f501f-bcf0-4185-863e-40105f0a4733 req-bd36f5aa-1ec6-4283-a52f-cbe1621688aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094796 May 14 21:18:25.825467 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1120/2109] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:26.330354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:26.332631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:26.339369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:26.344837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:26.345981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:26.346620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:26.428870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:26.440930 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1dee049f-0d8c-4dcc-b12b-82e85916bb5a tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.656697 May 14 21:18:26.444480 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 990/2110] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:25 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:26.466267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:26.466899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:26.473621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:26.474505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:26.475674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:26.476675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:26.656361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:26.665476 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2542190-9ff5-4e33-90a3-654e40363e01 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.341281 May 14 21:18:26.671844 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1121/2111] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:26 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:26.778887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:26.793693 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3c869648-06f9-44ee-aaea-7cee237562aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.326999 May 14 21:18:26.793693 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 991/2112] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:26 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:27.303769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-5a9ea9e5-9b42-46d7-89d4-7003e75f43d8 req-ad236083-b276-4d16-9f4c-0a594c41879b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-unplugged", "status": "completed", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:27.313123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5a9ea9e5-9b42-46d7-89d4-7003e75f43d8 req-ad236083-b276-4d16-9f4c-0a594c41879b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:27.313899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5a9ea9e5-9b42-46d7-89d4-7003e75f43d8 req-ad236083-b276-4d16-9f4c-0a594c41879b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:27.331976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-5a9ea9e5-9b42-46d7-89d4-7003e75f43d8 req-ad236083-b276-4d16-9f4c-0a594c41879b service nova] Creating event network-vif-unplugged:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:18:27.334520 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-5a9ea9e5-9b42-46d7-89d4-7003e75f43d8 req-ad236083-b276-4d16-9f4c-0a594c41879b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034098 May 14 21:18:27.336001 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1122/2113] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:27.458248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:27.466388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:27.476428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:27.477103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:27.478106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:27.478561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:27.688659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:27.689399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:27.702439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:27.707431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:27.707431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:27.707431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:27.769624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:27.780152 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9fc28cdd-ad0e-4335-bf6a-6b613441ab52 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.325601 May 14 21:18:27.790738 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 992/2114] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:27 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:27.821625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:27.823071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:27.830622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:27.831287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:27.832279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:27.832890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:27.904471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:27.917068 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0a3966f-4b9f-4410-a454-2300289fd35d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.233160 May 14 21:18:27.918406 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1123/2115] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:27 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:27.989348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-3813dbd3-5101-458b-9dbe-eb10e37ff6d2 req-0dfdcc38-b847-42d2-9ad0-0bb6f4322015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b864be50-c70a-4a29-86b1-5e5f69ec5230", "tag": "fd470c7c-db03-44a7-9389-4a1055607c0f"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:28.011740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3813dbd3-5101-458b-9dbe-eb10e37ff6d2 req-0dfdcc38-b847-42d2-9ad0-0bb6f4322015 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:28.012522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3813dbd3-5101-458b-9dbe-eb10e37ff6d2 req-0dfdcc38-b847-42d2-9ad0-0bb6f4322015 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:28.025040 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-3813dbd3-5101-458b-9dbe-eb10e37ff6d2 req-0dfdcc38-b847-42d2-9ad0-0bb6f4322015 service nova] Creating event network-changed:fd470c7c-db03-44a7-9389-4a1055607c0f for instance b864be50-c70a-4a29-86b1-5e5f69ec5230 on nch2-master-1 May 14 21:18:28.030294 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-3813dbd3-5101-458b-9dbe-eb10e37ff6d2 req-0dfdcc38-b847-42d2-9ad0-0bb6f4322015 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048421 May 14 21:18:28.031433 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1124/2116] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:28.086851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:28.105375 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-971bd9d3-336f-4135-ae93-4d10de9a04c2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.294816 May 14 21:18:28.107189 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 993/2117] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:27 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:28.798306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:28.799080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:28.806402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:28.807135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:28.808186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:28.808869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:28.937558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:28.938194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:28.946418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:28.950786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:28.951850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:28.952514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:29.158215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:29.171718 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-93952b61-fd71-4e05-882e-fa16a9587fc3 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.377950 May 14 21:18:29.173672 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1125/2118] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:28 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:29.179726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:29.181122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:29.187627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:29.188401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:29.189200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:29.189636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:29.286978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:29.296102 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79fe5434-dab0-456a-9723-dfe5a83ee0be tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1507 microversion: 2.1 time: 0.362679 May 14 21:18:29.297911 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 994/2119] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:28 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:29.400908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:29.432285 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a307892-6a54-4830-90a4-f0ecdae08d14 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.257336 May 14 21:18:29.432950 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1126/2120] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:29 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:30.191843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:30.192555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:30.232648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:30.235604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:30.242594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:30.244381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:30.320882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:30.321578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:30.330534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:30.331283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:30.332861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:30.333607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:30.626406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:30.639282 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ace6910-a742-43e3-a13e-6d90c795ce17 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1487 microversion: 2.1 time: 0.327531 May 14 21:18:30.652315 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1127/2121] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:30 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1487 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:30.665917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:30.665917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:30.671764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:30.673151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:30.674597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:30.675319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:30.735353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:30.764434 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9c7f3aa1-ab95-4e88-97cc-b6f70559bef8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.576426 May 14 21:18:30.765210 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 995/2122] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:30 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:30.839867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-492336198", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:30.947840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] validate_networks() for [('be6063db-fd04-41cd-809f-05d0d8d9b38d', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:18:30.999413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:31.011748 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c99d11b2-cce3-4d13-b73a-32d04a43fc83 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.357121 May 14 21:18:31.013299 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1128/2123] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:30 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:31.330705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-93606ebe-67d1-4af0-91d7-83535eedfba6 req-58f92784-ffc1-485c-91f3-f0683eaa0e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-plugged", "status": "completed", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:31.347719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-93606ebe-67d1-4af0-91d7-83535eedfba6 req-58f92784-ffc1-485c-91f3-f0683eaa0e4d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:31.348530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-93606ebe-67d1-4af0-91d7-83535eedfba6 req-58f92784-ffc1-485c-91f3-f0683eaa0e4d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:31.364389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-93606ebe-67d1-4af0-91d7-83535eedfba6 req-58f92784-ffc1-485c-91f3-f0683eaa0e4d service nova] Creating event network-vif-plugged:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:18:31.370895 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-93606ebe-67d1-4af0-91d7-83535eedfba6 req-58f92784-ffc1-485c-91f3-f0683eaa0e4d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048118 May 14 21:18:31.372192 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1129/2124] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:18:31.782561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:31.783519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:31.791507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:31.809652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:31.810891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:31.813509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:31.845644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:18:31.846148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:18:31.846698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:18:31.847800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:18:31.848290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:18:31.865693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:31.866530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:31.867535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:31.869932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:31.888495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Getting quotas for project 7c7360a8f423452e97311ffc9675e801. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:31.894745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Getting quotas for user 8bb480362ced445da9819798a17819c3 and project 7c7360a8f423452e97311ffc9675e801. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:31.908947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:18:31.912217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:18:32.030538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:32.038799 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72d97553-5204-4bca-81ba-ee6fbf7a882e tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.260211 May 14 21:18:32.040505 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1130/2125] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:31 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:32.048759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:32.049657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:32.056357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:32.057136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:32.058333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:32.058962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:32.087456 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-906a2b17-2460-48ee-a294-b7eb23502ef6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.252609 May 14 21:18:32.088283 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 996/2126] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:18:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:18:32.099963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5910f52c-87d2-434c-8d01-aa7f77101d6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:32.104224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5910f52c-87d2-434c-8d01-aa7f77101d6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:32.191625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5910f52c-87d2-434c-8d01-aa7f77101d6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:32.202515 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5910f52c-87d2-434c-8d01-aa7f77101d6d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1213 microversion: 2.1 time: 0.106811 May 14 21:18:32.213514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 997/2127] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:32 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:32.252615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:32.263509 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7e42d14b-0e72-43cc-a20f-d754ed6cbfa1 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.221626 May 14 21:18:32.267214 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1131/2128] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:32 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:33.065291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:33.067235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:33.081935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:33.082924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:33.084309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:33.087693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:33.221683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:33.223050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:33.231206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:33.232071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:33.233123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:33.233874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:33.265890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:33.275320 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a77d3b67-a45d-49ca-a130-050c48c868f6 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.222021 May 14 21:18:33.279707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 998/2129] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:33 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:33.288602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:33.293538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:33.305281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:33.306008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:33.307057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:33.307817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:33.376010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:33.390047 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-758ec4b4-356f-41f8-9466-dcb4f2a43633 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1217 microversion: 2.1 time: 0.172008 May 14 21:18:33.390047 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1132/2130] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:33 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1217 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:33.404109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-f1004166-c80c-4012-9b68-e69713a35106 req-67b20966-1829-447a-a92d-868efcd903fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0852bda-1b69-4893-aed5-4970dc57d1c2", "name": "network-vif-plugged", "status": "completed", "tag": "4fd5f38e-2d88-4afe-ad3f-275929a09686"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:33.412567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f1004166-c80c-4012-9b68-e69713a35106 req-67b20966-1829-447a-a92d-868efcd903fd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:33.413540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f1004166-c80c-4012-9b68-e69713a35106 req-67b20966-1829-447a-a92d-868efcd903fd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:33.424196 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-f1004166-c80c-4012-9b68-e69713a35106 req-67b20966-1829-447a-a92d-868efcd903fd service nova] Creating event network-vif-plugged:4fd5f38e-2d88-4afe-ad3f-275929a09686 for instance e0852bda-1b69-4893-aed5-4970dc57d1c2 on nch1-master-1 May 14 21:18:33.429968 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-f1004166-c80c-4012-9b68-e69713a35106 req-67b20966-1829-447a-a92d-868efcd903fd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039241 May 14 21:18:33.434915 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1133/2131] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:33.634906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:33.645668 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-103700e2-6a80-4c3f-8d85-f2001e209235 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.362228 May 14 21:18:33.648579 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 999/2132] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:33 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:34.297683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:34.299268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:34.306834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:34.307287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:34.308504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:34.309098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:34.415076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:34.415754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:34.426429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:34.427747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:34.429153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:34.430796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:34.494511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:34.501962 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b8900dfe-33f5-46ab-a77f-ab526ce74acc tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.210337 May 14 21:18:34.502547 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1134/2133] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:34 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:34.514426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:34.525003 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-485a1e2f-9aae-4fe8-9af5-2dc649e70422 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1265 microversion: 2.1 time: 0.121992 May 14 21:18:34.525714 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1000/2134] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:34 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1265 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:34.665123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:34.665665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:34.672768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:34.673220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:34.673995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:34.674427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:34.805859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:34.813338 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-656cbb9d-19a2-4d7b-a9d2-bdd171fa72ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1316 microversion: 2.1 time: 0.153444 May 14 21:18:34.813911 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1135/2135] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:34 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:35.521803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:35.523513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:35.532575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:35.533585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:35.535192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:35.535901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:35.551663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:35.552963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:35.573649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:35.574110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:35.584126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:35.584866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:35.718051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:35.726689 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65051621-05ac-46d1-87f0-40dc7ccea97a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1283 microversion: 2.1 time: 0.187580 May 14 21:18:35.733153 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1136/2136] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:35 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:35.831465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:35.832107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:35.843691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:35.845345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:35.847383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:35.848049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:35.884739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:35.911797 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bb50e10b-7589-4889-ae06-b4bcc7802ea5 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.393941 May 14 21:18:35.913658 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1001/2137] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:35 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:36.055714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:36.066758 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7251734c-54ba-44ca-834b-7cb296fb4dd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1466 microversion: 2.1 time: 0.237760 May 14 21:18:36.088468 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1137/2138] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:35 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1466 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:36.112542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba38fae2-2fcf-4c13-b74b-e50d2f2ea8d5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:36.113174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba38fae2-2fcf-4c13-b74b-e50d2f2ea8d5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:36.123674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba38fae2-2fcf-4c13-b74b-e50d2f2ea8d5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:36.124131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba38fae2-2fcf-4c13-b74b-e50d2f2ea8d5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:36.125076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba38fae2-2fcf-4c13-b74b-e50d2f2ea8d5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:36.125517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba38fae2-2fcf-4c13-b74b-e50d2f2ea8d5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:36.752338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:36.756112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:36.791594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:36.798656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:36.833154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:36.836288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:37.009457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:37.028752 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92d22d67-e067-40ff-8c09-708ea2fa37bb tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1271 microversion: 2.1 time: 0.286702 May 14 21:18:37.030026 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1138/2139] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:36 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1271 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:37.055210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba38fae2-2fcf-4c13-b74b-e50d2f2ea8d5 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1617 microversion: 2.1 time: 0.947796 May 14 21:18:37.057130 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1002/2140] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:36 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1617 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:37.064443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:37.068695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:37.077973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-44489fe0-6939-4c8f-9283-7e4e9785e297 req-72484223-ef66-4765-b7d6-78530373a64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b864be50-c70a-4a29-86b1-5e5f69ec5230", "name": "network-vif-plugged", "status": "completed", "tag": "fd470c7c-db03-44a7-9389-4a1055607c0f"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:37.080785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:37.086707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:37.087727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:37.088933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:37.132322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-44489fe0-6939-4c8f-9283-7e4e9785e297 req-72484223-ef66-4765-b7d6-78530373a64c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:37.135248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-44489fe0-6939-4c8f-9283-7e4e9785e297 req-72484223-ef66-4765-b7d6-78530373a64c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:37.181643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-44489fe0-6939-4c8f-9283-7e4e9785e297 req-72484223-ef66-4765-b7d6-78530373a64c service nova] Creating event network-vif-plugged:fd470c7c-db03-44a7-9389-4a1055607c0f for instance b864be50-c70a-4a29-86b1-5e5f69ec5230 on nch2-master-1 May 14 21:18:37.195800 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-44489fe0-6939-4c8f-9283-7e4e9785e297 req-72484223-ef66-4765-b7d6-78530373a64c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117580 May 14 21:18:37.198602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1003/2141] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:37.220716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1895198758", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "aebd3dc2-1a09-4160-9276-8df5efb2fa05"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:37.314836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:18:37.451438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:37.463798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aeab0ec3-3ebd-46ee-9879-b488c25e92d8 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.424202 May 14 21:18:37.465642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1139/2142] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:37 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:37.478393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1086257081", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "50d8d8e6-f9b7-435c-a51a-cb3e21091d0c"}], "block_device_mapping_v2": [{"uuid": "a73964bc-4e69-4eef-b351-fcd6ec89ade1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:37.621515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] validate_networks() for [('50d8d8e6-f9b7-435c-a51a-cb3e21091d0c', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:18:38.455100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:18:38.456262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:18:38.456959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:18:38.457623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:18:38.458352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:18:38.500703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:38.508198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:38.510750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:38.511579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:38.567019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:38.582559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Getting quotas for user 154d05e107d74202beabaa0b60dab8c8 and project a1c562e1e1414d32b858e08cb6379e8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:38.615219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:18:38.619442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:18:38.896965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:18:38.900624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:18:38.901775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:18:38.902562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:18:38.903251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:18:38.927849 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f4dc741-fe4d-48e1-8952-1c32b6fd031b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712333 May 14 21:18:38.928780 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1004/2143] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:18:38.932168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:38.934275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:38.940062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:38.941222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:38.951169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:38.954515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:38.972212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:38.972703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:38.973563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:38.977097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:38.999424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:39.017590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Getting quotas for user 038739f45c3d4ab09457d6eed20b41d4 and project 763cf73206604d8abbe1542afe44fa95. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:39.203348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:18:39.203348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a73964bc-4e69-4eef-b351-fcd6ec89ade1',volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:18:39.626378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:39.635437 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0933c682-9095-4d3d-b97b-ee564e164e94 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1313 microversion: 2.1 time: 0.705064 May 14 21:18:39.642636 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1005/2144] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:38 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:39.657704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:39.659118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:39.672250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:39.673000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:39.673959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:39.675433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:39.821608 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-25b3dd5c-e30a-4764-85eb-55b47803a5d5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.354633 May 14 21:18:39.825816 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1140/2145] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:18:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:18:39.838241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef512c99-8cc8-4f78-958b-0163d9ca6968 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:39.841960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef512c99-8cc8-4f78-958b-0163d9ca6968 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:39.970548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef512c99-8cc8-4f78-958b-0163d9ca6968 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:39.977577 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef512c99-8cc8-4f78-958b-0163d9ca6968 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1217 microversion: 2.1 time: 0.150415 May 14 21:18:39.978829 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1141/2146] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:39 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:39.984352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c7323ac5-8a16-4cf6-94bb-e79d33516f4c req-72f21ae0-038f-4745-a214-d0b31b2e84ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b864be50-c70a-4a29-86b1-5e5f69ec5230", "name": "network-vif-plugged", "status": "completed", "tag": "abb89be5-20ae-48c5-802d-2c1c67e66d1d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:39.994199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:40.001760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c7323ac5-8a16-4cf6-94bb-e79d33516f4c req-72f21ae0-038f-4745-a214-d0b31b2e84ca service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:40.002790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c7323ac5-8a16-4cf6-94bb-e79d33516f4c req-72f21ae0-038f-4745-a214-d0b31b2e84ca service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:40.018651 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c7323ac5-8a16-4cf6-94bb-e79d33516f4c req-72f21ae0-038f-4745-a214-d0b31b2e84ca service nova] Creating event network-vif-plugged:abb89be5-20ae-48c5-802d-2c1c67e66d1d for instance b864be50-c70a-4a29-86b1-5e5f69ec5230 on nch2-master-1 May 14 21:18:40.019239 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ea044532-ae4b-4052-9f86-70246ac1bb04 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.372770 May 14 21:18:40.024568 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1006/2147] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:39 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:40.026695 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c7323ac5-8a16-4cf6-94bb-e79d33516f4c req-72f21ae0-038f-4745-a214-d0b31b2e84ca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046403 May 14 21:18:40.027570 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1142/2148] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:40.033402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89642b79-5fd4-48c0-967f-a2b7dab9c6f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:40.034310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-89642b79-5fd4-48c0-967f-a2b7dab9c6f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:40.204884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1a8059b7-4e0c-4703-8189-cb0c6428a870 req-f15bb442-84d6-4732-8270-843a9d63d27a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce274e08-ca06-45ce-aa97-0149f081eb19", "tag": "7b6bd46d-2f3e-4883-8027-72b762aafcce"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:40.218187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1a8059b7-4e0c-4703-8189-cb0c6428a870 req-f15bb442-84d6-4732-8270-843a9d63d27a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:40.218822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1a8059b7-4e0c-4703-8189-cb0c6428a870 req-f15bb442-84d6-4732-8270-843a9d63d27a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:40.244438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1a8059b7-4e0c-4703-8189-cb0c6428a870 req-f15bb442-84d6-4732-8270-843a9d63d27a service nova] Creating event network-changed:7b6bd46d-2f3e-4883-8027-72b762aafcce for instance ce274e08-ca06-45ce-aa97-0149f081eb19 on nch1-master-1 May 14 21:18:40.250039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1a8059b7-4e0c-4703-8189-cb0c6428a870 req-f15bb442-84d6-4732-8270-843a9d63d27a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049812 May 14 21:18:40.271268 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1143/2149] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:18:40.302963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89642b79-5fd4-48c0-967f-a2b7dab9c6f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:40.308247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-89642b79-5fd4-48c0-967f-a2b7dab9c6f9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1053 microversion: 2.1 time: 0.282461 May 14 21:18:40.318137 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1007/2150] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:40 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1053 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:40.660510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:40.662155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:40.669091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:40.669822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:40.670916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:40.671540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:40.831305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:40.841670 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-41cf1054-5884-413f-89e1-91cbf570e067 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1313 microversion: 2.1 time: 0.185400 May 14 21:18:40.842720 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1144/2151] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:40 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:40.995630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:40.996247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:41.004483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:41.005598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:41.006747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:41.007454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:41.041067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:41.041704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:41.048571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:41.061141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:41.061141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:41.061141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:41.106129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:41.122588 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-49e1d3b1-7a51-479d-ba42-352dbfc06621 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1221 microversion: 2.1 time: 0.130781 May 14 21:18:41.124000 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1008/2152] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:40 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:41.225114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:41.236801 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6f534e04-72e9-4d47-9413-26c3bb036662 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1334 microversion: 2.1 time: 0.197738 May 14 21:18:41.236801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1145/2153] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:41 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1334 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:41.325566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0102a6e4-94c1-411e-8c6f-5ecb3cbb5396 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:41.326525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0102a6e4-94c1-411e-8c6f-5ecb3cbb5396 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:41.465747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0102a6e4-94c1-411e-8c6f-5ecb3cbb5396 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:41.474337 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0102a6e4-94c1-411e-8c6f-5ecb3cbb5396 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1053 microversion: 2.1 time: 0.153063 May 14 21:18:41.475429 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1009/2154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:41 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1053 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:41.859196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:41.859845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:41.869585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:41.870145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:41.872289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:41.872972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.140256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:42.140806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:42.153094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.153551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.154354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.154799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.291828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:42.300724 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5fd88bff-5e76-4848-85e8-2e73d096d4fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1269 microversion: 2.1 time: 0.164438 May 14 21:18:42.311391 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1010/2155] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:42 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:42.317781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:42.318821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:42.325272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.326318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.327349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.328048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.573481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:42.588338 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b512e1dd-bb15-4239-a0cf-7d8ab296a713 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1313 microversion: 2.1 time: 0.731995 May 14 21:18:42.590618 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1146/2156] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:41 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1313 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:42.598259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:42.601736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:42.609577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.610576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.611621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.613061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.854106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:42.866409 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5415675-6b92-4563-91f0-24ccff286746 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1667 microversion: 2.1 time: 0.552962 May 14 21:18:42.872006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:42.872418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1011/2157] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:42 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1667 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:42.887420 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf038537-453f-4bcd-b540-fb78193a5ae4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1095 microversion: 2.1 time: 0.295526 May 14 21:18:42.892507 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1147/2158] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:42 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1095 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:42.897825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-faeafc5c-fdc1-4bbd-bbfb-3b5865e6fd25 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:42.900805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-faeafc5c-fdc1-4bbd-bbfb-3b5865e6fd25 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:42.917739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faeafc5c-fdc1-4bbd-bbfb-3b5865e6fd25 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.928540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faeafc5c-fdc1-4bbd-bbfb-3b5865e6fd25 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.928540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faeafc5c-fdc1-4bbd-bbfb-3b5865e6fd25 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:42.929619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faeafc5c-fdc1-4bbd-bbfb-3b5865e6fd25 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:42.987122 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-faeafc5c-fdc1-4bbd-bbfb-3b5865e6fd25 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230/ips" status: 200 len: 177 microversion: 2.1 time: 0.101426 May 14 21:18:42.988144 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1012/2159] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:18:42 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230/ips => generated 177 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:43.000810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:43.002163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:43.009857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.010344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:43.011198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.011942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:43.048547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:18:43.320786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:43.322203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:43.329663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.330522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:43.331841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.332509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:43.484984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:43.501697 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3ad427da-0552-4d28-a1ad-9af08f03c549 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1275 microversion: 2.1 time: 0.179499 May 14 21:18:43.502376 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1013/2160] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:43 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1275 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:43.593214 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cb9bb3db-f0d4-40a3-ada9-339d62eb8178 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 204 len: 0 microversion: 2.1 time: 0.597351 May 14 21:18:43.594296 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1148/2161] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:18:42 2022] DELETE /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:18:43.604538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:43.605167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:43.608844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:43.611132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:43.611543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.612014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:43.612800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.613247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:43.632612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.633084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:43.635214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:43.635701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:44.012699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:44.026560 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ca872104-0d4d-4d81-b858-c2a3f392479b tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1673 microversion: 2.1 time: 0.427715 May 14 21:18:44.027526 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1014/2162] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:43 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1673 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:44.058966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:44.058966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:44.058966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:44.059791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:44.060252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:44.061168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:44.180022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:44.198162 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b8f05696-b910-4420-a80c-08318d89816c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1313 microversion: 2.1 time: 0.589325 May 14 21:18:44.198898 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1149/2163] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:43 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1313 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:18:44.460114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:44.470868 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bdf7a879-a82c-48bb-b54b-e4a12fb70640 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1159 microversion: 2.1 time: 0.442184 May 14 21:18:44.473147 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1015/2164] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:44 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1159 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:44.532112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:44.532899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:44.551059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:44.551822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:44.574505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:44.574505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:44.673353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-690730757", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b18d0003-8116-4e27-8e01-369db6cad7e2"}], "security_groups": [{"name": "tempest-securitygroup--532258053"}], "key_name": "tempest-keypair-1727142335", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "022c11da-58a1-4855-977c-de51c3870d3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:45.108858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] validate_networks() for [('b18d0003-8116-4e27-8e01-369db6cad7e2', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:18:45.511734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:45.522986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9355d005-5755-4bee-9d3c-b3a348dd0751 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1317 microversion: 2.1 time: 1.001761 May 14 21:18:45.532324 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1150/2165] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:44 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1317 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:45.538138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:45.539133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:45.557025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:45.557842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:45.558967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:45.559596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:45.863175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:45.876860 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-397eccca-4c54-45e3-895c-7006747b2293 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1673 microversion: 2.1 time: 0.349080 May 14 21:18:45.880688 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1151/2166] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:45 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1673 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:45.899777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-4791849", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2f366748-ecde-43ad-b849-3c9dce1cc30b"}], "block_device_mapping_v2": [{"uuid": "bed49647-1dd3-42d1-9736-4e72f9fde77c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:46.077785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] validate_networks() for [('2f366748-ecde-43ad-b849-3c9dce1cc30b', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:18:46.729617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:18:46.730239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:18:46.730664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:18:46.731334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:18:46.731944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:18:46.750203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:46.766693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:46.769577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:46.770088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:46.861330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:46.905133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Getting quotas for user cfcb989a491440b3bf74ddc055ee14d3 and project 74bb7b020fae4bcaa3a440acc60c7a1d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:46.989741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Getting quotas for project ef1f3155d52e42bb9c54f43a8360a74e. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:47.021513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Getting quotas for user 4e87a5a5713748b6a0d73984a279009b and project ef1f3155d52e42bb9c54f43a8360a74e. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:47.050842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:18:47.055299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:18:47.055299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:18:47.055299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:18:47.055299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:18:47.068241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:47.071570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:47.077025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:47.084254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:47.084506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:18:47.085152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bed49647-1dd3-42d1-9736-4e72f9fde77c',volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:18:47.110770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Getting quotas for project ef1f3155d52e42bb9c54f43a8360a74e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:18:47.119872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Getting quotas for user 4e87a5a5713748b6a0d73984a279009b and project ef1f3155d52e42bb9c54f43a8360a74e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:18:47.463022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:18:47.466101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='022c11da-58a1-4855-977c-de51c3870d3f',volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:18:48.158321 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9269c383-7dd2-47c4-a0b4-89defdb587e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.276255 May 14 21:18:48.168283 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1152/2167] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:18:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2287 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:18:48.180364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:48.185608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:48.220926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:48.221915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:48.224020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:48.229751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:48.409994 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f0d01a8-047b-4353-8f17-d8c9a4c59980 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.759115 May 14 21:18:48.410686 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1016/2168] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:18:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 3761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:18:48.428910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:48.429925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:48.442804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:48.443692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:48.445858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:48.446556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:48.703857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:48.712988 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c147e6fb-75b3-4e20-989b-6ba6f82f5a0b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1313 microversion: 2.1 time: 0.543166 May 14 21:18:48.722991 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1153/2169] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:48 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1313 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:48.735446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:48.736671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:48.749966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:48.752842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:48.753660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:48.761310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:49.034460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:49.049869 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efdc19cc-53d2-47a6-8817-e2d8e3dddc7a tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1211 microversion: 2.1 time: 0.635360 May 14 21:18:49.064239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1017/2170] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:48 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1211 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:49.074217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:49.086139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:49.089615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:49.090516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:49.091681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:49.092841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:49.237067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:49.246223 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f68052d1-59c8-4bfb-9431-6f11fdb87888 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1317 microversion: 2.1 time: 0.523888 May 14 21:18:49.256281 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1154/2171] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:48 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:49.261852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-66caa8eb-6327-4fe6-9860-cca383d2dddb req-e7d3327f-197e-4b89-adc8-77bf09b7d45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b864be50-c70a-4a29-86b1-5e5f69ec5230", "name": "network-vif-deleted", "tag": "fd470c7c-db03-44a7-9389-4a1055607c0f"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:49.289026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-66caa8eb-6327-4fe6-9860-cca383d2dddb req-e7d3327f-197e-4b89-adc8-77bf09b7d45d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:49.289934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-66caa8eb-6327-4fe6-9860-cca383d2dddb req-e7d3327f-197e-4b89-adc8-77bf09b7d45d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:49.318297 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-66caa8eb-6327-4fe6-9860-cca383d2dddb req-e7d3327f-197e-4b89-adc8-77bf09b7d45d service nova] Creating event network-vif-deleted:fd470c7c-db03-44a7-9389-4a1055607c0f for instance b864be50-c70a-4a29-86b1-5e5f69ec5230 on nch2-master-1 May 14 21:18:49.331527 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-66caa8eb-6327-4fe6-9860-cca383d2dddb req-e7d3327f-197e-4b89-adc8-77bf09b7d45d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073581 May 14 21:18:49.332650 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1155/2172] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:49.346795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-eef37dd7-c1c6-42f7-8c34-d276e54cf760 req-d6c35eee-b57e-41cf-b319-8b7ff1d4ed90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b864be50-c70a-4a29-86b1-5e5f69ec5230", "name": "network-vif-unplugged", "status": "completed", "tag": "abb89be5-20ae-48c5-802d-2c1c67e66d1d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:49.368471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-eef37dd7-c1c6-42f7-8c34-d276e54cf760 req-d6c35eee-b57e-41cf-b319-8b7ff1d4ed90 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:49.369029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-eef37dd7-c1c6-42f7-8c34-d276e54cf760 req-d6c35eee-b57e-41cf-b319-8b7ff1d4ed90 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:49.405238 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-eef37dd7-c1c6-42f7-8c34-d276e54cf760 req-d6c35eee-b57e-41cf-b319-8b7ff1d4ed90 service nova] Creating event network-vif-unplugged:abb89be5-20ae-48c5-802d-2c1c67e66d1d for instance b864be50-c70a-4a29-86b1-5e5f69ec5230 on nch2-master-1 May 14 21:18:49.422545 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-eef37dd7-c1c6-42f7-8c34-d276e54cf760 req-d6c35eee-b57e-41cf-b319-8b7ff1d4ed90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087879 May 14 21:18:49.428381 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1156/2173] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:49.818408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ae75ac4b3ed44eda1e8717ff641cd0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9197ea49e7544e7c96dd2d4b1a55fa29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:49.835084 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78f67a38-a27c-4fbd-9825-8b06b22c3892 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 200 len: 1652 microversion: 2.1 time: 0.764290 May 14 21:18:49.835084 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1018/2174] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:49 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 1652 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:49.847787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:49.849852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:49.874672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:49.875468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:49.878014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:49.881282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:49.901183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a8043dc-cdd1-4e7b-8639-5158aad09a04 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Action: 'create', calling method: .version_select at 0x7fb1b97b4940>, body: {"pool": null} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:50.046527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:50.059688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:50.069721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:50.076900 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-244f36e8-8194-479b-91da-c8ca822ef582 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1182 microversion: 2.25 time: 0.237516 May 14 21:18:50.089312 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1019/2175] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:49 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1182 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:50.101708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4eb0468-a187-4bce-aa58-4424386ee6c1 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:50.105848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4eb0468-a187-4bce-aa58-4424386ee6c1 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:50.651986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4eb0468-a187-4bce-aa58-4424386ee6c1 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:50.662662 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4eb0468-a187-4bce-aa58-4424386ee6c1 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1121 microversion: 2.1 time: 0.568164 May 14 21:18:50.663571 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1020/2176] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:50 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1121 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:50.672143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:50.673600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:50.689199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:50.694834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:50.694834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:50.694834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.032238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:51.047019 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-545debe6-18dd-4b56-91d8-110383cb5741 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1313 microversion: 2.1 time: 0.382145 May 14 21:18:51.052476 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1021/2177] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:50 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1313 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:51.107717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:51.107717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:51.107717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.107717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.107717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.107717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.471592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:51.483928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-131b8dda-e824-49ea-88a6-ff3c63ebd90b tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.426688 May 14 21:18:51.487409 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1022/2178] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:51 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:51.498002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:51.498915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:51.505570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.506314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.507288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.507939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.725157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:51.733594 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f14e9b5d-9648-4cd7-8de7-3f2e5cb55bd0 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1317 microversion: 2.1 time: 0.246879 May 14 21:18:51.743282 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1023/2179] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:51 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:51.743282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:51.743282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:51.746924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.747456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.752629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.752629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.763222 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] HTTP exception thrown: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Request method failure captured: May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 HTTP/1.1 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBw-uwE8Da7QZoiYIy2nWNlDjeYOGK1v0FeRuF5Jb8H_Ahi5nQTE1dU5m21O55N2j2io0ACLM2223BWa6lDbFTDqCHLNyH6LTawdiFAyUbCB2hNic-sjFBgzt0Ur79pLiJ41fwp4Y0hvUtCAnL7hxZR8mVkAYSrI7U2zPfwJYJHel_Q May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9197ea49e7544e7c96dd2d4b1a55fa29", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestMultiNic-150548444 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestMultiNic-150548444-project May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6ae75ac4b3ed44eda1e8717ff641cd0c May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestMultiNic-150548444-project May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'b864be50-c70a-4a29-86b1-5e5f69ec5230'} May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:51.764913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Returning 404 to user: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b6444bc7-06ad-4d7b-8d72-b82417cb2c02 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 404 len: 111 microversion: 2.1 time: 0.030532 May 14 21:18:51.771593 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1024/2180] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:51 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:18:51.776396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:51.776396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:51.782734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.783182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.783997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.784764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.913138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:51.924280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:51.925847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:51.933798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afaf6c5c-f38a-4fed-a7f1-e1f2a71c2ae9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1238 microversion: 2.25 time: 0.155799 May 14 21:18:51.934736 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1025/2181] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:51 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1238 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:51.951239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:51.952188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:51.958625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.965195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:51.965195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:51.965195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:52.275704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:52.285710 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2fa4fcc-d585-4cb9-834b-87d7bb2dfa00 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.338235 May 14 21:18:52.286307 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1026/2182] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:51 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:52.301150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6ca05213-217f-4e74-810f-1be9e5ca8670 req-43ff554f-6202-4fe3-a76d-9d12a9b55845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb037f1e-9300-4512-a6ac-4aa2c31e4183", "tag": "290d17d6-ed0e-4c77-9c1a-57fa7081a50d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:52.313809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6ca05213-217f-4e74-810f-1be9e5ca8670 req-43ff554f-6202-4fe3-a76d-9d12a9b55845 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:52.320024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6ca05213-217f-4e74-810f-1be9e5ca8670 req-43ff554f-6202-4fe3-a76d-9d12a9b55845 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:52.333488 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6ca05213-217f-4e74-810f-1be9e5ca8670 req-43ff554f-6202-4fe3-a76d-9d12a9b55845 service nova] Creating event network-changed:290d17d6-ed0e-4c77-9c1a-57fa7081a50d for instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 on nch2-master-1 May 14 21:18:52.341609 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6ca05213-217f-4e74-810f-1be9e5ca8670 req-43ff554f-6202-4fe3-a76d-9d12a9b55845 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053442 May 14 21:18:52.342939 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1027/2183] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:52.351632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-26728c26-e47b-427c-ad5c-dc4c84ace6fe req-3e6d943b-de37-42e9-9da5-73ba52b3d445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4518927-db68-441f-9e1b-ff7afce1badd", "tag": "c53ffbc4-b57b-4146-b9cd-8b7476f89088"}, {"server_uuid": "b864be50-c70a-4a29-86b1-5e5f69ec5230", "name": "network-vif-deleted", "tag": "abb89be5-20ae-48c5-802d-2c1c67e66d1d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:52.364526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-26728c26-e47b-427c-ad5c-dc4c84ace6fe req-3e6d943b-de37-42e9-9da5-73ba52b3d445 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:52.366908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-26728c26-e47b-427c-ad5c-dc4c84ace6fe req-3e6d943b-de37-42e9-9da5-73ba52b3d445 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:52.386830 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-26728c26-e47b-427c-ad5c-dc4c84ace6fe req-3e6d943b-de37-42e9-9da5-73ba52b3d445 service nova] Creating event network-changed:c53ffbc4-b57b-4146-b9cd-8b7476f89088 for instance d4518927-db68-441f-9e1b-ff7afce1badd on nch2-master-1 May 14 21:18:52.387688 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-26728c26-e47b-427c-ad5c-dc4c84ace6fe req-3e6d943b-de37-42e9-9da5-73ba52b3d445 service nova] Creating event network-vif-deleted:abb89be5-20ae-48c5-802d-2c1c67e66d1d for instance b864be50-c70a-4a29-86b1-5e5f69ec5230 on nch2-master-1 May 14 21:18:52.398086 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-26728c26-e47b-427c-ad5c-dc4c84ace6fe req-3e6d943b-de37-42e9-9da5-73ba52b3d445 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.053574 May 14 21:18:52.399250 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1028/2184] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:52.407290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f8047ee3-caa7-4ef5-983e-bec0abe3ddf5 req-a2c16165-4870-46be-9f6a-57d31483c54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce274e08-ca06-45ce-aa97-0149f081eb19", "name": "network-vif-plugged", "status": "completed", "tag": "7b6bd46d-2f3e-4883-8027-72b762aafcce"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:52.419860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f8047ee3-caa7-4ef5-983e-bec0abe3ddf5 req-a2c16165-4870-46be-9f6a-57d31483c54b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:52.428398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f8047ee3-caa7-4ef5-983e-bec0abe3ddf5 req-a2c16165-4870-46be-9f6a-57d31483c54b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:52.447709 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f8047ee3-caa7-4ef5-983e-bec0abe3ddf5 req-a2c16165-4870-46be-9f6a-57d31483c54b service nova] Creating event network-vif-plugged:7b6bd46d-2f3e-4883-8027-72b762aafcce for instance ce274e08-ca06-45ce-aa97-0149f081eb19 on nch1-master-1 May 14 21:18:52.463627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f8047ee3-caa7-4ef5-983e-bec0abe3ddf5 req-a2c16165-4870-46be-9f6a-57d31483c54b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060540 May 14 21:18:52.467219 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1029/2185] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:52.476199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:52.478205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:52.490956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:52.492007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:52.492965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:52.493567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:52.796529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:52.806004 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e26e333-e316-419e-a9f2-c071e6532b12 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1237 microversion: 2.1 time: 0.335492 May 14 21:18:52.822387 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1030/2186] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:52 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1237 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:52.827463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:52.828112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:52.856976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:52.857241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:52.858056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:52.858516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:53.564616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:53.587837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-816da8be-9414-4978-b935-c1e1418657b9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1313 microversion: 2.1 time: 0.764060 May 14 21:18:53.591452 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1031/2187] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:52 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:53.593957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-152f23c2-f33d-40b8-93f8-36ddf38e658a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2044806044"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:53.603944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-152f23c2-f33d-40b8-93f8-36ddf38e658a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:53.618909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-152f23c2-f33d-40b8-93f8-36ddf38e658a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:53.620109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-152f23c2-f33d-40b8-93f8-36ddf38e658a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:53.620824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-152f23c2-f33d-40b8-93f8-36ddf38e658a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:53.623122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-152f23c2-f33d-40b8-93f8-36ddf38e658a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:53.655269 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a8043dc-cdd1-4e7b-8639-5158aad09a04 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.225384 May 14 21:18:53.656090 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1157/2188] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:18:49 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:53.669893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:53.670650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:53.702496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:53.703020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:53.706915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:53.708588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:53.994014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:54.001720 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef4afe22-f08f-4d9e-a1fc-72ffc3590dfe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.344634 May 14 21:18:54.002464 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1158/2189] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:53 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:54.019302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:54.021663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:54.028720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.029635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:54.036442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.037319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:54.308262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:54.316434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b5a24c7e-0367-40e0-bea5-5d60b31bbe0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1317 microversion: 2.1 time: 0.312691 May 14 21:18:54.326867 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1159/2190] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:54 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:54.326867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:54.329068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:54.337089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.337743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:54.338816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.339502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:54.390991 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-152f23c2-f33d-40b8-93f8-36ddf38e658a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.799768 May 14 21:18:54.391969 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1032/2191] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:18:53 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 14 21:18:54.404997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-317f55a6-f5dc-4fb9-850b-7612b5a77ac7 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Action: 'create', calling method: .version_select at 0x7fb1b96dd310>, body: {"pool": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:54.568623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:54.579770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:54.581807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:54.583729 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f15719a4-700c-4cb8-aac0-05ae402e61cc tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1248 microversion: 2.25 time: 0.264436 May 14 21:18:54.584666 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1160/2192] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:54 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1248 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:54.590369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:54.592727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:54.604631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.604631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:54.604631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.605575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:54.698839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:54.720600 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-011a70f1-b6ad-412e-873f-30e63ac5f7d0 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1237 microversion: 2.1 time: 0.130141 May 14 21:18:54.720600 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1161/2193] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:54 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1237 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:54.731928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:54.733301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:54.749689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.750512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:54.753407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:54.755155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.042583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:55.063085 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d294f86-52e0-4890-bda0-82977b843bd6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.334554 May 14 21:18:55.084389 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1162/2194] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:54 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:55.090635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-12382323-a548-4509-b870-8b9bdb870f24 req-0009338a-600c-4ba0-933f-35105c6bcb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-unplugged", "status": "completed", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:55.099817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-12382323-a548-4509-b870-8b9bdb870f24 req-0009338a-600c-4ba0-933f-35105c6bcb32 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.100172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-12382323-a548-4509-b870-8b9bdb870f24 req-0009338a-600c-4ba0-933f-35105c6bcb32 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.114968 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-12382323-a548-4509-b870-8b9bdb870f24 req-0009338a-600c-4ba0-933f-35105c6bcb32 service nova] Creating event network-vif-unplugged:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:18:55.121089 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-12382323-a548-4509-b870-8b9bdb870f24 req-0009338a-600c-4ba0-933f-35105c6bcb32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035109 May 14 21:18:55.122635 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1163/2195] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:55.128077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:55.129132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:55.136913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.137375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.138165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.138610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.380393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:55.388833 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fa5d38da-6e99-4878-9593-f3aac1955105 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1499 microversion: 2.1 time: 0.264890 May 14 21:18:55.389905 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1164/2196] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:55 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1499 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:55.395998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:55.396647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:55.403038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.403528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.404444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.405045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.541241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:55.551926 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab417af7-06d2-4093-a59f-2a216a7662c8 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.160601 May 14 21:18:55.552941 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1165/2197] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:55 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:55.557981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:55.558815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:55.586566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.589468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.591087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.591586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.902567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:55.952755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-08cc9b18-beae-4b8f-a95e-b7a3de74f322 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1317 microversion: 2.1 time: 0.398799 May 14 21:18:55.955378 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1166/2198] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:55 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:55.965756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:55.970017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:55.986178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.986942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:55.988117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:55.988804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:56.027495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lazy-loading 'flavor' on Instance uuid ce274e08-ca06-45ce-aa97-0149f081eb19 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:18:56.401760 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1cd684e8-cc40-47a5-9a5a-8dac4b70b8e8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "POST /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19/action" status: 200 len: 32 microversion: 2.1 time: 0.444860 May 14 21:18:56.403218 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1167/2199] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:18:55 2022] POST /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19/action => generated 32 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:18:56.422040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:56.422670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:56.450094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:56.451970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:56.454408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:56.454408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:56.731605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:56.740684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:56.742633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:56.744100 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca145a03-0ce3-4831-80f9-96a88e59e951 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.339679 May 14 21:18:56.745422 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1168/2200] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:56 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:56.750310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:56.751256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:56.758883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:56.759966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:56.764223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:56.764223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.020952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:57.029910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d058004a-2f5a-4466-9795-3df08c5ccfae tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.283147 May 14 21:18:57.030700 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1169/2201] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:56 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:57.036114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:57.036753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:57.044245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.044706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.045988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.046437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.267701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:57.280728 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2b6ae69-8ceb-4428-a279-1c55ef129e35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1688 microversion: 2.1 time: 0.248740 May 14 21:18:57.281995 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1170/2202] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:57 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1688 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:57.288382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:57.289221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:57.297552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.298274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.299068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.299870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.753785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:57.761926 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ebe4fa61-5683-4dbe-a32e-09663e19f265 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.478539 May 14 21:18:57.762687 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1171/2203] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:57 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:57.768051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:57.768051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:57.774615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.777874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.777874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.777874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.791998 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] HTTP exception thrown: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Request method failure captured: May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 HTTP/1.1 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBw-uwE8Da7QZoiYIy2nWNlDjeYOGK1v0FeRuF5Jb8H_Ahi5nQTE1dU5m21O55N2j2io0ACLM2223BWa6lDbFTDqCHLNyH6LTawdiFAyUbCB2hNic-sjFBgzt0Ur79pLiJ41fwp4Y0hvUtCAnL7hxZR8mVkAYSrI7U2zPfwJYJHel_Q May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9197ea49e7544e7c96dd2d4b1a55fa29", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestMultiNic-150548444 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestMultiNic-150548444-project May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6ae75ac4b3ed44eda1e8717ff641cd0c May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestMultiNic-150548444-project May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b864be50-c70a-4a29-86b1-5e5f69ec5230'} May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:18:57.793692 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Returning 404 to user: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-49decc8b-a6a3-45af-bf13-253a095ec8f0 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 404 len: 111 microversion: 2.1 time: 0.031500 May 14 21:18:57.798446 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1172/2204] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:18:57 2022] DELETE /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:18:57.801045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:57.802139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:57.807889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.808340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.809115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:57.809554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:57.991424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:58.000220 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-767201ab-922a-4612-a185-042fad1017e3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.202684 May 14 21:18:58.002449 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1173/2205] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:57 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:58.007440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.008402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.015792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.017036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.018202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.018883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.200318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:58.208460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c27506b-1695-49af-9329-8c876c49568b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1317 microversion: 2.1 time: 0.205986 May 14 21:18:58.209044 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1174/2206] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:58 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:58.213956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-7d50bd64-37a6-4610-bb81-d232f13959b9 req-1c6543b3-01f2-4c8c-bec9-a6d9d8e3a8a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b7a619-b4c9-41fa-ae67-011162dbdab2", "tag": "d403d7ba-1fe1-41c0-8b4a-8aedc3448d15"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:58.225676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7d50bd64-37a6-4610-bb81-d232f13959b9 req-1c6543b3-01f2-4c8c-bec9-a6d9d8e3a8a5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.228910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7d50bd64-37a6-4610-bb81-d232f13959b9 req-1c6543b3-01f2-4c8c-bec9-a6d9d8e3a8a5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.238152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-7d50bd64-37a6-4610-bb81-d232f13959b9 req-1c6543b3-01f2-4c8c-bec9-a6d9d8e3a8a5 service nova] Creating event network-changed:d403d7ba-1fe1-41c0-8b4a-8aedc3448d15 for instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 on nch1-master-1 May 14 21:18:58.244575 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-7d50bd64-37a6-4610-bb81-d232f13959b9 req-1c6543b3-01f2-4c8c-bec9-a6d9d8e3a8a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033991 May 14 21:18:58.245169 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1175/2207] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:58.250538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.252139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.258335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.258688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.259986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.260599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.417853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:58.426909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:58.428523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:58.429806 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd6a8f19-75c0-450a-aa51-18cafd91ea71 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.183264 May 14 21:18:58.430437 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1176/2208] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:58 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:58.435063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.435892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: b864be50-c70a-4a29-86b1-5e5f69ec5230] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.445028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.445599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.446389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.446858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.460980 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] HTTP exception thrown: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Request method failure captured: May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 HTTP/1.1 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBw-uwE8Da7QZoiYIy2nWNlDjeYOGK1v0FeRuF5Jb8H_Ahi5nQTE1dU5m21O55N2j2io0ACLM2223BWa6lDbFTDqCHLNyH6LTawdiFAyUbCB2hNic-sjFBgzt0Ur79pLiJ41fwp4Y0hvUtCAnL7hxZR8mVkAYSrI7U2zPfwJYJHel_Q May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9197ea49e7544e7c96dd2d4b1a55fa29", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestMultiNic-150548444-project May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6ae75ac4b3ed44eda1e8717ff641cd0c May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestMultiNic-150548444-project May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b864be50-c70a-4a29-86b1-5e5f69ec5230'} May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:58.462678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Returning 404 to user: Instance b864be50-c70a-4a29-86b1-5e5f69ec5230 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c185444b-1b65-4ea1-99aa-04182eb45fee tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230" status: 404 len: 111 microversion: 2.1 time: 0.032554 May 14 21:18:58.467460 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1177/2209] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:58 2022] GET /compute/v2.1/servers/b864be50-c70a-4a29-86b1-5e5f69ec5230 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:18:58.469367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.469979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.476697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.477152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.477932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.478376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.616962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:58.625541 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19b09526-0be7-4198-96af-6f3b7dfbd500 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.159840 May 14 21:18:58.626128 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1178/2210] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:58 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:58.631663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-87713908-996b-4e9a-92e9-6a07fed6e163 req-a893c26f-560b-4185-9032-e19e6f54449a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4518927-db68-441f-9e1b-ff7afce1badd", "name": "network-vif-plugged", "status": "completed", "tag": "c53ffbc4-b57b-4146-b9cd-8b7476f89088"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:58.640267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-87713908-996b-4e9a-92e9-6a07fed6e163 req-a893c26f-560b-4185-9032-e19e6f54449a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.640724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-87713908-996b-4e9a-92e9-6a07fed6e163 req-a893c26f-560b-4185-9032-e19e6f54449a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.654285 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-87713908-996b-4e9a-92e9-6a07fed6e163 req-a893c26f-560b-4185-9032-e19e6f54449a service nova] Creating event network-vif-plugged:c53ffbc4-b57b-4146-b9cd-8b7476f89088 for instance d4518927-db68-441f-9e1b-ff7afce1badd on nch2-master-1 May 14 21:18:58.659430 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-87713908-996b-4e9a-92e9-6a07fed6e163 req-a893c26f-560b-4185-9032-e19e6f54449a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032168 May 14 21:18:58.660057 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1179/2211] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:58.666713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.667567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.684386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.684865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.686337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.686790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.840107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:58.848834 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c7741027-21ba-4ffe-9b0f-be86fbc118a9 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.186311 May 14 21:18:58.849617 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1180/2212] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:58 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:58.854294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.854873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.861627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.863193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.863193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.864339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.879278 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] HTTP exception thrown: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Request method failure captured: May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 HTTP/1.1 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBw-uwE8Da7QZoiYIy2nWNlDjeYOGK1v0FeRuF5Jb8H_Ahi5nQTE1dU5m21O55N2j2io0ACLM2223BWa6lDbFTDqCHLNyH6LTawdiFAyUbCB2hNic-sjFBgzt0Ur79pLiJ41fwp4Y0hvUtCAnL7hxZR8mVkAYSrI7U2zPfwJYJHel_Q May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9197ea49e7544e7c96dd2d4b1a55fa29", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestMultiNic-150548444-project May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6ae75ac4b3ed44eda1e8717ff641cd0c May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestMultiNic-150548444-project May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '52bb515d-9e62-40b2-bccd-8d35505e8f71'} May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:18:58.881314 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Returning 404 to user: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-32c71fc2-c4dc-43e2-971c-0e9990501775 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "DELETE /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 404 len: 111 microversion: 2.1 time: 0.032076 May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1181/2213] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:18:58 2022] DELETE /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.890228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.895517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.895977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.896765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.897297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.956878 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-317f55a6-f5dc-4fb9-850b-7612b5a77ac7 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.563150 May 14 21:18:58.960055 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1033/2214] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:18:54 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:18:58.965032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:58.966539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] [instance: 52bb515d-9e62-40b2-bccd-8d35505e8f71] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:58.973900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.974432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.975229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:58.976138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:58.994851 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] HTTP exception thrown: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Request method failure captured: May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 HTTP/1.1 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBw-uwE8Da7QZoiYIy2nWNlDjeYOGK1v0FeRuF5Jb8H_Ahi5nQTE1dU5m21O55N2j2io0ACLM2223BWa6lDbFTDqCHLNyH6LTawdiFAyUbCB2hNic-sjFBgzt0Ur79pLiJ41fwp4Y0hvUtCAnL7hxZR8mVkAYSrI7U2zPfwJYJHel_Q May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9197ea49e7544e7c96dd2d4b1a55fa29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9197ea49e7544e7c96dd2d4b1a55fa29", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9197ea49e7544e7c96dd2d4b1a55fa29 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestMultiNic-150548444 May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestMultiNic-150548444-project May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 6ae75ac4b3ed44eda1e8717ff641cd0c May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestMultiNic-150548444-project May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '52bb515d-9e62-40b2-bccd-8d35505e8f71'} May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:18:58.996641 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:59.001541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:18:59.001541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:18:59.001541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:18:59.001541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:18:59.001541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:18:59.001541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. May 14 21:18:59.001541 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:18:59.003348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] Returning 404 to user: Instance 52bb515d-9e62-40b2-bccd-8d35505e8f71 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:18:59.005140 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0902dc07-189e-4a8f-862c-925aa2dde301 tempest-ServersTestMultiNic-150548444 tempest-ServersTestMultiNic-150548444-project] 10.222.0.52 "GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71" status: 404 len: 111 microversion: 2.1 time: 0.043121 May 14 21:18:59.005816 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1034/2215] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:58 2022] GET /compute/v2.1/servers/52bb515d-9e62-40b2-bccd-8d35505e8f71 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:18:59.010873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71d68592-b9f4-4912-bb45-6c67d53a733a tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Action: 'create', calling method: .version_select at 0x7fb1b97448b0>, body: {"pool": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:18:59.071939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:59.079434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6755ac1-48cd-4018-91a9-2bfadc076d59 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.195179 May 14 21:18:59.080043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1182/2216] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:58 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:59.085572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:59.086373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:59.094613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.095077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.102833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.102833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.255215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:59.263585 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a0d337e8-e8ae-4d8b-b9b5-f3e4af94e2ed tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.182480 May 14 21:18:59.264860 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1183/2217] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:59 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:59.270026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:59.270904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:59.279232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.280064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.281064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.281713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.432926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:59.440455 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6be30ea-2fb5-4d1a-b6f3-36908c45b24d tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1317 microversion: 2.1 time: 0.174295 May 14 21:18:59.441045 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1184/2218] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:59 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:18:59.447643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:59.448814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:59.454887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.455348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.456239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.456919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.650098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:59.659154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:59.663594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:18:59.665122 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c9ffc2f-a971-4eb9-b097-2ee4c009c591 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.221270 May 14 21:18:59.665772 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1185/2219] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:18:59 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:18:59.687959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:18:59.689118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:18:59.702246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.704154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.705346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:18:59.705854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:18:59.998272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:00.007214 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a6a8f35d-26bf-406b-9437-2bc6ba61ab1d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.323230 May 14 21:19:00.007853 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1186/2220] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:18:59 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:00.029979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:00.031959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:00.041305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.041767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:00.042564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.043014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:00.299855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:00.311934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97dd0c74-d54e-49f7-871c-ffd6fbcc7c5c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.292475 May 14 21:19:00.316124 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1187/2221] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:00 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:00.329831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:00.330829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:00.349480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.350600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:00.351766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.352514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:00.549942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:00.560165 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eb9b4859-a1f4-40b4-8a26-78df2aa97d76 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.241984 May 14 21:19:00.561262 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1188/2222] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:00 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:00.569924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:00.570719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:00.578689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.579342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:00.580586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.581249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:00.815221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:00.825729 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-824d4f66-aca8-4212-bebe-854a9570fc1d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.263300 May 14 21:19:00.845301 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1189/2223] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:00 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:00.851984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:00.853740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:00.868276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.869917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:00.871604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:00.872369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.080740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:01.090959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-09e8d985-c451-40fd-b9df-b664971f84fd tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1466 microversion: 2.1 time: 0.243654 May 14 21:19:01.092545 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1190/2224] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:00 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1466 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:01.099721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:01.100688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:01.110165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.117323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.117323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.117323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.305564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:01.321095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:01.324545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:01.326299 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5eb6c862-587b-4656-abf8-b9bdec229b87 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.232453 May 14 21:19:01.327181 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1191/2225] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:01 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:01.333963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-875eda9f-6394-4ce9-ac24-a1f3a880496a req-9945b92b-0029-4a84-a093-518a24eea788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbed9277-7da0-4bf4-b27f-c647a23dcb2c", "tag": "aa620ac9-bfdf-4a61-ae23-4f9baea1b233"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:01.352242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-875eda9f-6394-4ce9-ac24-a1f3a880496a req-9945b92b-0029-4a84-a093-518a24eea788 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.353976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-875eda9f-6394-4ce9-ac24-a1f3a880496a req-9945b92b-0029-4a84-a093-518a24eea788 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.368851 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-875eda9f-6394-4ce9-ac24-a1f3a880496a req-9945b92b-0029-4a84-a093-518a24eea788 service nova] Creating event network-changed:aa620ac9-bfdf-4a61-ae23-4f9baea1b233 for instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c on nch1-master-1 May 14 21:19:01.375237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-875eda9f-6394-4ce9-ac24-a1f3a880496a req-9945b92b-0029-4a84-a093-518a24eea788 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046584 May 14 21:19:01.376520 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1192/2226] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:01.383197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:01.384658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:01.393039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.393814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.395023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.395787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.589318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:01.600396 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7bd4231a-4ca8-418e-9363-9933ffc3416a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.222400 May 14 21:19:01.610016 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1193/2227] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:01 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:01.615994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b3b4146-61e9-43fc-a2da-0de702642058 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:01.619537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b3b4146-61e9-43fc-a2da-0de702642058 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:01.625887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3b4146-61e9-43fc-a2da-0de702642058 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.626880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3b4146-61e9-43fc-a2da-0de702642058 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.628114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3b4146-61e9-43fc-a2da-0de702642058 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.628794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3b4146-61e9-43fc-a2da-0de702642058 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.826002 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b3b4146-61e9-43fc-a2da-0de702642058 tempest-ServersOnMultiNodesTest-1479417155 tempest-ServersOnMultiNodesTest-1479417155-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1617 microversion: 2.1 time: 0.214734 May 14 21:19:01.828434 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1194/2228] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:01 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1617 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:01.833855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:01.834818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:01.843166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.843994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:01.845113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:01.845862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.040598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:02.050693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c33b4b5-2620-4364-a1f9-6a4025acdd48 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.220917 May 14 21:19:02.063170 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1195/2229] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:01 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:02.063170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:02.063170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:02.070242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.076865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.076865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.076865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.237322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:02.246199 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73e5ef28-4fd6-4203-af80-9b0ccfd2099d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.190429 May 14 21:19:02.246801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1196/2230] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:02 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:02.252842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:02.253468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:02.261768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.262616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.263808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.264415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.420273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:02.430304 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ffa24a9b-a056-4ee7-aa46-4888d0002cef tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.182461 May 14 21:19:02.432332 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1197/2231] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:02 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:02.437654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:02.438437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:02.451232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.452086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.453092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.453734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.509594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:02.887867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7d455166-e968-4c1b-9406-f39c39a17e07 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 204 len: 0 microversion: 2.1 time: 0.453826 May 14 21:19:02.889419 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1198/2232] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:02 2022] DELETE /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:02.904623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:02.907784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:02.929763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.930656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:02.932534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:02.934347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.117093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:03.130746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:03.135962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:03.138157 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6fdd3c18-830d-4c78-a8b3-806f8db04878 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.246459 May 14 21:19:03.139358 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1199/2233] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:02 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:03.146823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:03.147787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:03.155680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.156249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.157953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.158495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.372645 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71d68592-b9f4-4912-bb45-6c67d53a733a tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.365677 May 14 21:19:03.373330 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1035/2234] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:18:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:03.379305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:03.380424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:03.393304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.397111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.398218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.400068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.433131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:03.447697 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b3d4f74-d078-44cf-9064-51bdf98008ac tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.306427 May 14 21:19:03.451218 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1200/2235] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:03 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:03.464924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:03.465615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:03.479461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.481451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.485202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.485724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.750171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:03.761243 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9fa2e8cc-eae9-4689-aea5-b911be5d78ee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.308575 May 14 21:19:03.762039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1201/2236] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:03 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:03.768547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:03.769187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:03.780411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.780848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:03.782734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:03.785869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:04.004773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:04.017337 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-08740b62-5899-4dd9-92b1-740b1dbca638 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.253831 May 14 21:19:04.018683 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1202/2237] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:03 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:04.023758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ffab90e-2eb8-4336-ba4e-11cec27376a4 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Action: 'create', calling method: .version_select at 0x7fb1b970e160>, body: {"pool": null} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:04.197032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:04.206496 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4dca8a9b-1ed5-49a4-9411-c2979266e26e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1472 microversion: 2.1 time: 0.831291 May 14 21:19:04.207706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1036/2238] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:03 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1472 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:04.214018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:04.214861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:04.225320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:04.226020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:04.226990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:04.227638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:04.683661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:04.706470 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c4f4b3c-51cf-42d7-8a1e-2b715d85ee3d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.496440 May 14 21:19:04.708739 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1037/2239] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:04 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:04.721792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-14ecd33e-91f0-497f-964c-f79c6bc9db32 req-ec9e7b79-41dc-4de7-b4e6-53371f532469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-plugged", "status": "completed", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:04.742343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-14ecd33e-91f0-497f-964c-f79c6bc9db32 req-ec9e7b79-41dc-4de7-b4e6-53371f532469 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:04.746869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-14ecd33e-91f0-497f-964c-f79c6bc9db32 req-ec9e7b79-41dc-4de7-b4e6-53371f532469 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:04.775845 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-14ecd33e-91f0-497f-964c-f79c6bc9db32 req-ec9e7b79-41dc-4de7-b4e6-53371f532469 service nova] Creating event network-vif-plugged:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:19:04.792933 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-14ecd33e-91f0-497f-964c-f79c6bc9db32 req-ec9e7b79-41dc-4de7-b4e6-53371f532469 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080815 May 14 21:19:04.803927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1038/2240] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:04.815352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:04.817000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:04.834520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:04.835400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:04.836490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:04.837167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:05.403678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:05.420830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:05.425462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:05.429104 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22ae6425-647c-44c2-b447-a26d61c9eb3b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.622294 May 14 21:19:05.429957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1039/2241] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:04 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:05.437510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:05.439136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:05.450557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:05.451569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:05.452979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:05.453606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:05.879061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:05.888855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-edad43cf-7b5b-4c0d-8fff-8f8ebc6b52d2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.457172 May 14 21:19:05.890453 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1040/2242] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:05 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:05.898793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:05.901377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:05.933608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:05.934999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:05.936665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:05.937748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.207027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:06.217318 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-16aa13e3-8b35-4314-be62-c618aefbabd1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.325409 May 14 21:19:06.227372 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1041/2243] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:05 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:06.235897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:06.235897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:06.240307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.240766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.241562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.242013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.502441 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ffab90e-2eb8-4336-ba4e-11cec27376a4 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.483040 May 14 21:19:06.504421 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1203/2244] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:19:04 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:06.511258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:06.511258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:06.526302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.526773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.532798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.533410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.574070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.574526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.574993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lazy-loading 'fault' on Instance uuid d4518927-db68-441f-9e1b-ff7afce1badd {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:06.648431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:06.654099 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f021ec4a-89ea-4406-b4b0-146e8c9572e5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 200 len: 1307 microversion: 2.1 time: 0.148366 May 14 21:19:06.654996 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1204/2245] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:06 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:06.662154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:06.663176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:06.675415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.677015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.678438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.682547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.697148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:06.705162 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6ca0907-5d27-4814-9c64-996e5232a20e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.476661 May 14 21:19:06.705756 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1042/2246] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:06 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:06.731023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-90a1d9a4-ab34-46e4-90a9-5f534312f83b req-70a61bad-2c40-4a49-b7c2-40a88e9f1e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4518927-db68-441f-9e1b-ff7afce1badd", "name": "network-vif-deleted", "tag": "c53ffbc4-b57b-4146-b9cd-8b7476f89088"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:06.747372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90a1d9a4-ab34-46e4-90a9-5f534312f83b req-70a61bad-2c40-4a49-b7c2-40a88e9f1e88 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.747860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90a1d9a4-ab34-46e4-90a9-5f534312f83b req-70a61bad-2c40-4a49-b7c2-40a88e9f1e88 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.783545 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-90a1d9a4-ab34-46e4-90a9-5f534312f83b req-70a61bad-2c40-4a49-b7c2-40a88e9f1e88 service nova] Creating event network-vif-deleted:c53ffbc4-b57b-4146-b9cd-8b7476f89088 for instance d4518927-db68-441f-9e1b-ff7afce1badd on nch2-master-1 May 14 21:19:06.793477 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-90a1d9a4-ab34-46e4-90a9-5f534312f83b req-70a61bad-2c40-4a49-b7c2-40a88e9f1e88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068666 May 14 21:19:06.795086 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1043/2247] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:06.800444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:06.804463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:06.818641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.820875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.825692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:06.826362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:06.939182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:06.954237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b43227be-1c59-49ed-b803-d8692439b3fe tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.293067 May 14 21:19:06.954237 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1205/2248] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:06 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:06.955840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2aa92652-1a6b-4384-998b-213eff752138 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Calling method '.version_select at 0x7fb1b97a73a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:07.183928 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2aa92652-1a6b-4384-998b-213eff752138 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/3f706bd4-b8f5-4dfb-871d-ff57b54dcaec" status: 200 len: 141 microversion: 2.1 time: 0.231892 May 14 21:19:07.184898 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1206/2249] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:19:06 2022] GET /compute/v2.1/os-floating-ips/3f706bd4-b8f5-4dfb-871d-ff57b54dcaec => generated 141 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:07.185260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:07.189894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4634a4b9-0689-4d3f-ab75-3e46db53e625 req-3945f709-ccfe-4ae1-8b93-f0783993c917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb037f1e-9300-4512-a6ac-4aa2c31e4183", "name": "network-vif-plugged", "status": "completed", "tag": "290d17d6-ed0e-4c77-9c1a-57fa7081a50d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:07.198905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:07.200745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:07.201675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4634a4b9-0689-4d3f-ab75-3e46db53e625 req-3945f709-ccfe-4ae1-8b93-f0783993c917 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:07.201899 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fffbf6bc-df56-40ab-ad88-d6efaed745a0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.405528 May 14 21:19:07.202473 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1044/2250] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:06 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:07.202854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4634a4b9-0689-4d3f-ab75-3e46db53e625 req-3945f709-ccfe-4ae1-8b93-f0783993c917 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:07.217994 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4634a4b9-0689-4d3f-ab75-3e46db53e625 req-3945f709-ccfe-4ae1-8b93-f0783993c917 service nova] Creating event network-vif-plugged:290d17d6-ed0e-4c77-9c1a-57fa7081a50d for instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 on nch2-master-1 May 14 21:19:07.220299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:07.226026 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4634a4b9-0689-4d3f-ab75-3e46db53e625 req-3945f709-ccfe-4ae1-8b93-f0783993c917 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039260 May 14 21:19:07.227415 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1207/2251] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:07.229796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:07.241923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd641506-e989-416f-b3d4-e1a3aeabfd75 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Calling method '.version_select at 0x7fb1b9789af0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:07.258971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:07.260037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:07.262715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:07.263338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:07.553280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:07.568727 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87082090-eefd-4f38-b598-bf5810ec0ed4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.352062 May 14 21:19:07.569906 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1045/2252] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:07 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:07.574609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:07.575414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:07.589429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:07.589989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:07.598192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:07.599799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:07.808559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:07.817275 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9ff11e20-d3c1-4024-8405-413286f07bd0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.245379 May 14 21:19:07.822619 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1046/2253] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:07 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:07.849321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:07.850284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d4518927-db68-441f-9e1b-ff7afce1badd] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:07.856740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:07.857396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:07.858374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:07.858992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.170769 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance d4518927-db68-441f-9e1b-ff7afce1badd could not be found. May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd HTTP/1.1 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d4518927-db68-441f-9e1b-ff7afce1badd could not be found. May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd4518927-db68-441f-9e1b-ff7afce1badd'} May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4518927-db68-441f-9e1b-ff7afce1badd could not be found. May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4518927-db68-441f-9e1b-ff7afce1badd could not be found. May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:08.173018 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4518927-db68-441f-9e1b-ff7afce1badd could not be found. May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:08.178618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance d4518927-db68-441f-9e1b-ff7afce1badd could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:08.179442 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76261722-93bb-49e3-a290-2a88be110ebb tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd" status: 404 len: 111 microversion: 2.1 time: 0.345216 May 14 21:19:08.183798 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1047/2254] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:07 2022] GET /compute/v2.1/servers/d4518927-db68-441f-9e1b-ff7afce1badd => generated 111 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:08.186335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:08.187208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:08.194345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.194956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.196143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.196696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.392095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:08.405200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-95fd5704-e8e5-41b2-90bb-28735f85b616 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.223344 May 14 21:19:08.405910 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1048/2255] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:08 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:08.411445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:08.412148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:08.418320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.419006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.420361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.421495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.653085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:08.666416 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01eb006c-cb6f-42fb-9f98-6380d5353488 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1199 microversion: 2.1 time: 0.259259 May 14 21:19:08.667006 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1049/2256] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:08 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1199 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:08.672044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:08.672775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:08.681674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.682472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.683269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.683758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.721536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:08.971515 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd641506-e989-416f-b3d4-e1a3aeabfd75 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/3f706bd4-b8f5-4dfb-871d-ff57b54dcaec" status: 202 len: 0 microversion: 2.1 time: 1.743286 May 14 21:19:08.973798 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1208/2257] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:19:07 2022] DELETE /compute/v2.1/os-floating-ips/3f706bd4-b8f5-4dfb-871d-ff57b54dcaec => generated 0 bytes in 1746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:08.978678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:08.980830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:08.993257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.993721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:08.994544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:08.995196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.128337 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f858f507-6bd0-4704-938a-89a8afb22677 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 204 len: 0 microversion: 2.1 time: 0.458774 May 14 21:19:09.130171 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1050/2258] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:08 2022] DELETE /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:09.153166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.154665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:09.169034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.169676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.170574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.171201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.208590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.210554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.212723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.214212 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58817148-323e-4a09-b2c8-777cf3783304 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.239419 May 14 21:19:09.214863 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1209/2259] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:08 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:09.226595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.226595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:09.233322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.233881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.234672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.235117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.377642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.391254 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b2e92d1-d58c-4e85-b2c7-40327c3a2154 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.259814 May 14 21:19:09.393200 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1051/2260] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:09.402458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.406478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-356e6be9-b970-4019-8102-608438eb3eec tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Calling method '.version_select at 0x7fb1b9773280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.411768 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cd30d4d-5be4-4ba3-a7d2-0a1c9101e341 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.195529 May 14 21:19:09.412373 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1210/2261] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:09.418190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.419078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:09.426174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.426686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.427469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.427932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.579302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.587747 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e4fef4fe-3738-43a1-89b1-867106fe9513 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1472 microversion: 2.1 time: 0.174132 May 14 21:19:09.588339 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1211/2262] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:09.592951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d04204ed-f270-4b3d-b98f-800455b2bd8b req-89d4ca23-f8db-4fce-8710-5a5f58e7e4c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7a619-b4c9-41fa-ae67-011162dbdab2", "name": "network-vif-plugged", "status": "completed", "tag": "d403d7ba-1fe1-41c0-8b4a-8aedc3448d15"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:09.601551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d04204ed-f270-4b3d-b98f-800455b2bd8b req-89d4ca23-f8db-4fce-8710-5a5f58e7e4c9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.602016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d04204ed-f270-4b3d-b98f-800455b2bd8b req-89d4ca23-f8db-4fce-8710-5a5f58e7e4c9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.613521 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d04204ed-f270-4b3d-b98f-800455b2bd8b req-89d4ca23-f8db-4fce-8710-5a5f58e7e4c9 service nova] Creating event network-vif-plugged:d403d7ba-1fe1-41c0-8b4a-8aedc3448d15 for instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 on nch1-master-1 May 14 21:19:09.618687 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d04204ed-f270-4b3d-b98f-800455b2bd8b req-89d4ca23-f8db-4fce-8710-5a5f58e7e4c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029181 May 14 21:19:09.619485 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1212/2263] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:09.626648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.627374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:09.635205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.635693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.636482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.636959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.653610 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-356e6be9-b970-4019-8102-608438eb3eec tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.259025 May 14 21:19:09.654385 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1052/2264] 10.222.0.52 () {58 vars in 1163 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:19:09.665768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b8b0f6a-e3f0-432f-bb9d-474ddda8918c tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Calling method '.version_select at 0x7fb1b97733a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.797769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.806168 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1e32f874-ac95-4eb2-9482-a5969dc28b89 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.185413 May 14 21:19:09.806799 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1213/2265] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:09.811356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.815395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:09.818686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.819144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.819947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:09.820382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:09.953133 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b8b0f6a-e3f0-432f-bb9d-474ddda8918c tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips" status: 200 len: 396 microversion: 2.1 time: 0.285019 May 14 21:19:09.953791 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1053/2266] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/os-floating-ips => generated 396 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:19:09.965724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:09.968099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-da01d60f-9050-458c-a225-b6e73cf9d3cb tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Calling method '.version_select at 0x7fb1b98d8790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:09.973687 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b14779d6-6603-417e-be61-a88d69574228 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1382 microversion: 2.1 time: 0.165810 May 14 21:19:09.975619 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1214/2267] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1382 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:10.187362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8bceac6f-ed86-4699-9443-3fe3a6a6dc0b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:10.188303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8bceac6f-ed86-4699-9443-3fe3a6a6dc0b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:10.199044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bceac6f-ed86-4699-9443-3fe3a6a6dc0b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.201363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bceac6f-ed86-4699-9443-3fe3a6a6dc0b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:10.203995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bceac6f-ed86-4699-9443-3fe3a6a6dc0b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.206087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bceac6f-ed86-4699-9443-3fe3a6a6dc0b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:10.375309 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8bceac6f-ed86-4699-9443-3fe3a6a6dc0b tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1533 microversion: 2.1 time: 0.381243 May 14 21:19:10.376184 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1215/2268] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:09 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1533 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:10.383277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:10.383932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:10.397912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.397912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:10.397912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.397912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:10.580863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:10.592314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:10.593952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:10.595964 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-614169fc-0802-4737-9631-09f6d762261a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.218984 May 14 21:19:10.607437 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1216/2269] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:10 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:10.615641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cb33e2d-7c65-459e-9aa3-a2ffc71dcead tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:10.616277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cb33e2d-7c65-459e-9aa3-a2ffc71dcead tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:10.639933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cb33e2d-7c65-459e-9aa3-a2ffc71dcead tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.640654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cb33e2d-7c65-459e-9aa3-a2ffc71dcead tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:10.643641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cb33e2d-7c65-459e-9aa3-a2ffc71dcead tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.643641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cb33e2d-7c65-459e-9aa3-a2ffc71dcead tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:10.838673 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cb33e2d-7c65-459e-9aa3-a2ffc71dcead tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1533 microversion: 2.1 time: 0.229903 May 14 21:19:10.840014 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1217/2270] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:10 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1533 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:10.844883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:10.845748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:10.853331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.854023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:10.854985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:10.855632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.038611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:11.048651 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c15657af-00ce-4989-86b4-29f212ed521d tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.207232 May 14 21:19:11.060890 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1218/2271] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:10 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:11.067153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:11.068143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:11.075228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.076518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.077874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.078591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.265060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:11.278257 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-259b200f-7000-43da-a35c-e1fef34ba6c4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.215528 May 14 21:19:11.279581 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1219/2272] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:11 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:11.285703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:11.286364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:11.301396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.301396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.301396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.301396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.544264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:11.556867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-490d8390-e27e-4498-8980-bfc9f33831b4 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 200 len: 1472 microversion: 2.1 time: 0.276341 May 14 21:19:11.567663 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1220/2273] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:11 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:11.582709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:11.583346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:11.595519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.601462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.604496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.604969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.821447 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-da01d60f-9050-458c-a225-b6e73cf9d3cb tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/7f2e0b1a-2533-4c47-b57e-55a53cd880ce" status: 202 len: 0 microversion: 2.1 time: 1.857957 May 14 21:19:11.822892 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1054/2274] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:19:09 2022] DELETE /compute/v2.1/os-floating-ips/7f2e0b1a-2533-4c47-b57e-55a53cd880ce => generated 0 bytes in 1860 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:19:11.833497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4d70911-50ef-423e-9103-ff9c189e19e1 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:11.836021 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:19:11.836021 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:19:11.840869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4d70911-50ef-423e-9103-ff9c189e19e1 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.841624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4d70911-50ef-423e-9103-ff9c189e19e1 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.842784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4d70911-50ef-423e-9103-ff9c189e19e1 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.845337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4d70911-50ef-423e-9103-ff9c189e19e1 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.942267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:11.956182 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e155719d-e900-46b8-a4bf-7611271bc971 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.386726 May 14 21:19:11.958117 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1221/2275] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:11 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:11.962913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4d70911-50ef-423e-9103-ff9c189e19e1 tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.138706 May 14 21:19:11.963774 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1055/2276] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:19:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:11.970050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:11.970360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bc631e7-13d1-418b-9156-3488cc1eb5ef tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Calling method '.version_select at 0x7fb1a75de8b0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:11.971047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:11.978819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.979383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:11.980231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:11.980669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:12.147343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:12.157124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:12.160284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:12.161639 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c11eae7-ce9f-4e50-bbf9-282131a5ccd5 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1278 microversion: 2.25 time: 0.202532 May 14 21:19:12.173081 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1222/2277] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:11 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1278 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:12.179152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:12.181494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:12.189418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:12.190067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:12.192769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:12.192769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:12.224876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lazy-loading 'flavor' on Instance uuid eb037f1e-9300-4512-a6ac-4aa2c31e4183 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:12.252542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Going to try to live migrate instance to nch1-master-1 {{(pid=130638) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:19:13.564241 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bc631e7-13d1-418b-9156-3488cc1eb5ef tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/e454b050-7435-4561-bc5b-e251286cc1f7" status: 202 len: 0 microversion: 2.1 time: 1.599259 May 14 21:19:13.564896 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1056/2278] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:19:11 2022] DELETE /compute/v2.1/os-floating-ips/e454b050-7435-4561-bc5b-e251286cc1f7 => generated 0 bytes in 1600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:13.576853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:13.577770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:13.628139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:13.630293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:13.631522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:13.635823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:13.856550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:13.869537 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b63d406c-e467-4b0d-8baa-cee2961757f7 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.300717 May 14 21:19:13.870142 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1057/2279] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:13 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:13.876160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:13.876504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:13.886149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:13.886884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:13.888464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:13.890589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.068323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:14.076460 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-453df18f-218e-4dc3-a35b-ad6669d972fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.205153 May 14 21:19:14.077047 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1058/2280] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:13 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:14.083520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:14.084142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: e0852bda-1b69-4893-aed5-4970dc57d1c2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:14.094490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.095247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.098854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.099448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.115819 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance e0852bda-1b69-4893-aed5-4970dc57d1c2 could not be found. May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 HTTP/1.1 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance e0852bda-1b69-4893-aed5-4970dc57d1c2 could not be found. May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'e0852bda-1b69-4893-aed5-4970dc57d1c2'} May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0852bda-1b69-4893-aed5-4970dc57d1c2 could not be found. May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0852bda-1b69-4893-aed5-4970dc57d1c2 could not be found. May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:14.117497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0852bda-1b69-4893-aed5-4970dc57d1c2 could not be found. May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance e0852bda-1b69-4893-aed5-4970dc57d1c2 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31f64ce3-54a9-4e6b-b347-09b986af4db6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2" status: 404 len: 111 microversion: 2.1 time: 0.041054 May 14 21:19:14.125425 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1059/2281] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:14 2022] GET /compute/v2.1/servers/e0852bda-1b69-4893-aed5-4970dc57d1c2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:14.142860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-321ea746-83c3-4271-98c0-cc36cb7648b8 req-9452044c-eb45-40fe-a6dc-60d9c4453788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0852bda-1b69-4893-aed5-4970dc57d1c2", "name": "network-vif-deleted", "tag": "4fd5f38e-2d88-4afe-ad3f-275929a09686"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:14.157575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-321ea746-83c3-4271-98c0-cc36cb7648b8 req-9452044c-eb45-40fe-a6dc-60d9c4453788 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.164532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-321ea746-83c3-4271-98c0-cc36cb7648b8 req-9452044c-eb45-40fe-a6dc-60d9c4453788 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.172829 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-321ea746-83c3-4271-98c0-cc36cb7648b8 req-9452044c-eb45-40fe-a6dc-60d9c4453788 service nova] Creating event network-vif-deleted:4fd5f38e-2d88-4afe-ad3f-275929a09686 for instance e0852bda-1b69-4893-aed5-4970dc57d1c2 on nch1-master-1 May 14 21:19:14.178301 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-321ea746-83c3-4271-98c0-cc36cb7648b8 req-9452044c-eb45-40fe-a6dc-60d9c4453788 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053953 May 14 21:19:14.183784 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1060/2282] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:14.189548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:14.191003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:14.200344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.201088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.202594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.203216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.411779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:14.424579 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb83c38e-9957-4a4a-99e5-dab953d97d7e tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.239423 May 14 21:19:14.425911 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1061/2283] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:14 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:14.431166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:14.432015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:14.438799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.439647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.440659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.441530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.636570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:14.647363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:14.648940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:14.650250 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-17662974-c9b7-425d-b7fc-ad0ccf4a505b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1474 microversion: 2.25 time: 0.223127 May 14 21:19:14.651082 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1062/2284] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:14 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:14.655823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-245a6414-d0c0-40ab-a291-a170d7b98e99 req-e36ffb2a-8bf6-4633-ac97-4717e925fb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbed9277-7da0-4bf4-b27f-c647a23dcb2c", "name": "network-vif-plugged", "status": "completed", "tag": "aa620ac9-bfdf-4a61-ae23-4f9baea1b233"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:14.664997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-245a6414-d0c0-40ab-a291-a170d7b98e99 req-e36ffb2a-8bf6-4633-ac97-4717e925fb02 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:14.665585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-245a6414-d0c0-40ab-a291-a170d7b98e99 req-e36ffb2a-8bf6-4633-ac97-4717e925fb02 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:14.678273 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-245a6414-d0c0-40ab-a291-a170d7b98e99 req-e36ffb2a-8bf6-4633-ac97-4717e925fb02 service nova] Creating event network-vif-plugged:aa620ac9-bfdf-4a61-ae23-4f9baea1b233 for instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c on nch1-master-1 May 14 21:19:14.690349 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-245a6414-d0c0-40ab-a291-a170d7b98e99 req-e36ffb2a-8bf6-4633-ac97-4717e925fb02 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038091 May 14 21:19:14.691503 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1063/2285] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:14.699153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-73c040ec-8ba7-42d2-8dd5-5a5b6f53e1f0 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] Calling method '.version_select at 0x7fb1b98d8040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:15.647627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-73c040ec-8ba7-42d2-8dd5-5a5b6f53e1f0 tempest-FloatingIPDetailsTestJSON-1860958794 tempest-FloatingIPDetailsTestJSON-1860958794-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/0eb84340-ad61-44d4-b84a-c6f4b383ae63" status: 202 len: 0 microversion: 2.1 time: 0.954352 May 14 21:19:15.651770 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1064/2286] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:19:14 2022] DELETE /compute/v2.1/os-floating-ips/0eb84340-ad61-44d4-b84a-c6f4b383ae63 => generated 0 bytes in 959 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:15.657099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:15.657985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:15.673025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:15.674426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:15.676754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:15.677400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:15.719033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:16.361015 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b231eca0-82fd-454b-9786-ac89629ec82e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 204 len: 0 microversion: 2.1 time: 0.707899 May 14 21:19:16.366067 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1065/2287] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:15 2022] DELETE /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:16.438482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1630416306", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3bdbef8a-a684-458d-bfe2-b4f322a15d2e"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:16.474863 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f45320ec-dba4-49dd-a4d4-735f528a50dc tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183/action" status: 202 len: 0 microversion: 2.1 time: 4.299477 May 14 21:19:16.479194 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1223/2288] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:19:12 2022] POST /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183/action => generated 0 bytes in 4302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:16.482813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:16.483521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:16.492766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:16.493389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:16.494309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:16.494760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:16.500921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] validate_networks() for [('3bdbef8a-a684-458d-bfe2-b4f322a15d2e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:19:16.652755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 92b7a619-b4c9-41fa-ae67-011162dbdab2 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:16.670912 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1905c2a7-7787-435b-829d-6c29f045af9a tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1964 microversion: 2.25 time: 0.194218 May 14 21:19:16.671565 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1224/2289] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:16 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1964 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:16.677829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:16.678785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:16.685829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:16.686590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:16.687625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:16.688237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:16.846013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:16.856932 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7683e34d-890c-4275-8348-90cab083765a tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1292 microversion: 2.1 time: 0.180981 May 14 21:19:16.857742 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1225/2290] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:16 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1292 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:16.873021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:16.879112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:16.881473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:16.881932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:16.882720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:16.883164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.021183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:17.029481 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-141c0faf-f11e-4dad-8dc3-fd0061fcbc29 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1683 microversion: 2.1 time: 0.169987 May 14 21:19:17.030068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1226/2291] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:16 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:17.036217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:17.036860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:17.043459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.045993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.045993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.045993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.189617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:17.198648 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f5f9ad5-d37d-4b5b-b232-aec506c91e05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.167489 May 14 21:19:17.199725 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1227/2292] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:17 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:17.204981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:17.205726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:17.212904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.213349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.214123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.216357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.358356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:17.366864 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd00a13b-94cb-4650-a407-9630671911d7 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1471 microversion: 2.1 time: 0.166273 May 14 21:19:17.367680 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1228/2293] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:17 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:17.377093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:17.377866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:17.386748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.387245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.388178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.388717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.548330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:17.557777 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b7051efa-bc6f-49b3-b4be-e3f2d49188bf tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1392 microversion: 2.1 time: 0.189017 May 14 21:19:17.558385 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1229/2294] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:17 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1392 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:17.564867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:17.565833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:17.573758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.579059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.579059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.579059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.674775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:19:17.675392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:19:17.676636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:19:17.677168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:19:17.677599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:19:17.696120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.700045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.700045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.700750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.723811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:17.730245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for user 71080496c33c4e2c8b2e16b950f0b9ea and project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:17.742766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 92b7a619-b4c9-41fa-ae67-011162dbdab2 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:17.744066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:19:17.746505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:19:17.760644 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-17f5e0d4-620d-4fa5-a3d9-387835a4497c tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1964 microversion: 2.25 time: 0.199898 May 14 21:19:17.761397 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1230/2295] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:17 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1964 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:17.779306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-77fc02e4-7987-40d8-8b3b-895002ef2928 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:17.780846 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:19:17.780846 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:19:17.782230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77fc02e4-7987-40d8-8b3b-895002ef2928 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.782808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77fc02e4-7987-40d8-8b3b-895002ef2928 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.783859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77fc02e4-7987-40d8-8b3b-895002ef2928 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.784715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77fc02e4-7987-40d8-8b3b-895002ef2928 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.817722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-77fc02e4-7987-40d8-8b3b-895002ef2928 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.037190 May 14 21:19:17.818794 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1231/2296] 10.222.0.52 () {60 vars in 1216 bytes} [Sat May 14 21:19:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:19:17.837263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:17.838500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:17.845155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.845715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.846517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.847180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.876507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'flavor' on Instance uuid 92b7a619-b4c9-41fa-ae67-011162dbdab2 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:17.890172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3244c391-4d1b-40f2-87a6-823eaf45fc7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.527195 May 14 21:19:17.891259 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1066/2297] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:19:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:19:17.896119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:17.898970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Going to try to live migrate instance to nch2-master-1 {{(pid=130638) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:19:17.903044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:17.911163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.911663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:17.912475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:17.912926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:18.470830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:18.493870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de6b6d3b-3687-4552-ac1e-2a8a70e82fb8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1484 microversion: 2.1 time: 0.601420 May 14 21:19:18.501239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1067/2298] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:17 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1484 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:18.517602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f7b3f5b-e17d-41c1-a28f-29fc26274d90 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:18.518408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f7b3f5b-e17d-41c1-a28f-29fc26274d90 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:18.632486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f7b3f5b-e17d-41c1-a28f-29fc26274d90 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:18.641961 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f7b3f5b-e17d-41c1-a28f-29fc26274d90 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1215 microversion: 2.1 time: 0.138630 May 14 21:19:18.642635 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1068/2299] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:18 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:18.662217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:18.662930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:18.671529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:18.672063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:18.673335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:18.673960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.119101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:19.131705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d6d8fd9-724c-4568-aa2b-812128baa19a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.487948 May 14 21:19:19.142674 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1069/2300] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:18 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:19.149737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:19.150380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:19.157852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.158562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.160097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.160777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.469475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:19.477619 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18b86b67-f170-46dc-88bd-c3ab74db545b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.333764 May 14 21:19:19.481075 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1070/2301] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:19 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:19.498569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:19.499284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:19.511568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.512296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.514085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.514744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.666842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:19.675768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31252b1c-ec72-4837-85ed-b63356753749 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1429 microversion: 2.1 time: 0.192077 May 14 21:19:19.686590 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1071/2302] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:19 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1429 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:19.693167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3dbf7968-e036-4aed-a4c3-7b713552da78 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:19.694087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3dbf7968-e036-4aed-a4c3-7b713552da78 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:19.701359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dbf7968-e036-4aed-a4c3-7b713552da78 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.701832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dbf7968-e036-4aed-a4c3-7b713552da78 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.702677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dbf7968-e036-4aed-a4c3-7b713552da78 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.703304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dbf7968-e036-4aed-a4c3-7b713552da78 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.882770 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3dbf7968-e036-4aed-a4c3-7b713552da78 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194402 May 14 21:19:19.885843 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1072/2303] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:19:19 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c/os-interface => generated 285 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:19.891178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:19.892603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:19.904108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.905788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:19.907226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:19.907984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:20.189241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:20.198383 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a2149b9-0c65-43b1-ac01-3a4cede1c0af tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1392 microversion: 2.1 time: 0.311133 May 14 21:19:20.203163 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1073/2304] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:19 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1392 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:20.212228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:20.216289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:20.228392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:20.228855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:20.229703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:20.230149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:20.508459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:20.532828 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1e3d21e8-ce49-4e53-98bc-98d43b17efac tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.328111 May 14 21:19:20.534584 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1074/2305] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:20 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:20.552565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:20.553770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:20.568808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:20.569371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:20.570982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:20.571537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:20.732703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:20.743010 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c4d24993-514a-4f94-9709-8dec44dec53b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1267 microversion: 2.1 time: 0.204551 May 14 21:19:20.755751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1075/2306] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:20 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1267 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:20.766206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7aaca6a8-7dc7-4c48-b152-e3121fd01676 req-abd819be-1773-455a-ab9f-cedeaf11af9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016519b2-b932-4be6-ba69-5ce679fec414", "name": "network-vif-deleted", "tag": "8fbb69dd-a1d9-4bd5-9188-ffd595b8948c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:20.789028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7aaca6a8-7dc7-4c48-b152-e3121fd01676 req-abd819be-1773-455a-ab9f-cedeaf11af9d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:20.791309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7aaca6a8-7dc7-4c48-b152-e3121fd01676 req-abd819be-1773-455a-ab9f-cedeaf11af9d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:20.812076 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7aaca6a8-7dc7-4c48-b152-e3121fd01676 req-abd819be-1773-455a-ab9f-cedeaf11af9d service nova] Creating event network-vif-deleted:8fbb69dd-a1d9-4bd5-9188-ffd595b8948c for instance 016519b2-b932-4be6-ba69-5ce679fec414 on nch1-master-1 May 14 21:19:20.821265 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7aaca6a8-7dc7-4c48-b152-e3121fd01676 req-abd819be-1773-455a-ab9f-cedeaf11af9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075502 May 14 21:19:20.827385 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1076/2307] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:20.834499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:20.835388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:20.845939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:20.846663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:20.848637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:20.849930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.139765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:21.149641 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26d17de1-b063-47b7-bf10-08b84e49bf1c tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.320541 May 14 21:19:21.150461 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1077/2308] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:20 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:21.161372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:21.162572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:21.170813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.171281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.172108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.172763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.216058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.218140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.218919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lazy-loading 'fault' on Instance uuid 016519b2-b932-4be6-ba69-5ce679fec414 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:21.322464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:21.349468 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2433725d-4b0e-40bd-8f7a-d4404d5e8d0f tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 200 len: 1306 microversion: 2.1 time: 0.197327 May 14 21:19:21.351138 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1078/2309] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:21 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 1306 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:21.365866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-838e87d5-47e1-43c9-84a8-4817f1935dd5 req-68063f7e-597b-4e38-acb1-e6b5ce2b2299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-unplugged", "status": "completed", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:21.392754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-838e87d5-47e1-43c9-84a8-4817f1935dd5 req-68063f7e-597b-4e38-acb1-e6b5ce2b2299 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.396344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-838e87d5-47e1-43c9-84a8-4817f1935dd5 req-68063f7e-597b-4e38-acb1-e6b5ce2b2299 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.422839 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-838e87d5-47e1-43c9-84a8-4817f1935dd5 req-68063f7e-597b-4e38-acb1-e6b5ce2b2299 service nova] Creating event network-vif-unplugged:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:19:21.430344 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-838e87d5-47e1-43c9-84a8-4817f1935dd5 req-68063f7e-597b-4e38-acb1-e6b5ce2b2299 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073864 May 14 21:19:21.434190 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1079/2310] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:21.449718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:21.451822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:21.479839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.479839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.480270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.481358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.809763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf892d6b-0c09-4989-ab75-23dd19f4190f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1392 microversion: 2.1 time: 0.382717 May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1080/2311] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:21 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1392 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:21.891107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:21.918397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:21.934536 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3412c604-5aad-49db-9aa7-114f39295fc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1285 microversion: 2.1 time: 0.111810 May 14 21:19:21.935100 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1081/2312] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:21 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:22.167855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:22.169133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:22.207067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.208495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.215979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.216459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.453089 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd131a6e-62ed-4bd0-bb59-f12b70cd0c81 tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2/action" status: 202 len: 0 microversion: 2.25 time: 4.621754 May 14 21:19:22.459217 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1232/2313] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:19:17 2022] POST /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2/action => generated 0 bytes in 4631 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 14 21:19:22.465879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:22.467441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 016519b2-b932-4be6-ba69-5ce679fec414] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:22.485124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.486765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.489398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.491809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.523699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:22.531942 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2208935b-ceb5-49e8-be46-b29750ff9f35 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.367986 May 14 21:19:22.532389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance 016519b2-b932-4be6-ba69-5ce679fec414 could not be found. May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 HTTP/1.1 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 016519b2-b932-4be6-ba69-5ce679fec414 could not be found. May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '016519b2-b932-4be6-ba69-5ce679fec414'} May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016519b2-b932-4be6-ba69-5ce679fec414 could not be found. May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016519b2-b932-4be6-ba69-5ce679fec414 could not be found. May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:22.534254 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:22.540341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:22.540341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:22.540341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:22.540341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:22.540341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:22.540341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016519b2-b932-4be6-ba69-5ce679fec414 could not be found. May 14 21:19:22.540341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:22.547002 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1082/2314] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:22 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:22.551242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance 016519b2-b932-4be6-ba69-5ce679fec414 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:22.551242 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-61045aad-c192-4997-8c5e-619b4c2b798e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414" status: 404 len: 111 microversion: 2.1 time: 0.088191 May 14 21:19:22.551242 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1233/2315] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:22 2022] GET /compute/v2.1/servers/016519b2-b932-4be6-ba69-5ce679fec414 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:22.559712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:22.560023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:22.560517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:22.561859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:22.574261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.580435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.589933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.589933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.590167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.590167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.590167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:22.590167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:22.651423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:23.132321 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2657862e-b363-43d1-87a2-ca26235ef92c tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 204 len: 0 microversion: 2.1 time: 0.578410 May 14 21:19:23.138153 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1234/2316] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:22 2022] DELETE /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:19:23.138439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:23.139156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:23.150487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.151332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.152317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.159179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.263705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:23.278145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:23.283981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:23.283981 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-af7ed7bc-cc9b-4012-a9d6-e444d3cf8f2b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.733214 May 14 21:19:23.283981 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1083/2317] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:22 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:23.289153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:23.290046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:23.300821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.302897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.304290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.306789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.388793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:23.403931 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-545fa077-637f-44d0-8be2-a89081cfebd9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1273 microversion: 2.1 time: 0.118055 May 14 21:19:23.405567 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1084/2318] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:23 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1273 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:23.415059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:23.415868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:23.427807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.427807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.427807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.429996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.478958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:23.481264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:23.492127 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e39360b-2fc0-4e79-adee-81a6cd19404e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1392 microversion: 2.1 time: 0.357946 May 14 21:19:23.494353 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1235/2319] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:23 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1392 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:23.502475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:23.514210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:23.523692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.524457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.525539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.526214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.770574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:23.779710 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7478a29f-ad7a-4fad-9bac-ceae3b559ae5 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1484 microversion: 2.1 time: 0.284034 May 14 21:19:23.782385 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1236/2320] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:23 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1484 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:23.788944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-608a6dcd-0c11-44cc-bf0f-19bdc9026f27 req-3b670169-e340-4a4a-b1ff-6fce85b317d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbed9277-7da0-4bf4-b27f-c647a23dcb2c", "tag": "aa620ac9-bfdf-4a61-ae23-4f9baea1b233"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:23.813378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-608a6dcd-0c11-44cc-bf0f-19bdc9026f27 req-3b670169-e340-4a4a-b1ff-6fce85b317d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.813829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-608a6dcd-0c11-44cc-bf0f-19bdc9026f27 req-3b670169-e340-4a4a-b1ff-6fce85b317d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.851139 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bdb5b465-6894-4efa-9a69-aaa89da6e6d6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 204 len: 0 microversion: 2.1 time: 0.443952 May 14 21:19:23.852080 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1085/2321] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:23 2022] DELETE /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:23.858667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:23.859314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:23.871798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.872782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:23.878564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:23.879395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.099916 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-608a6dcd-0c11-44cc-bf0f-19bdc9026f27 req-3b670169-e340-4a4a-b1ff-6fce85b317d1 service nova] Creating event network-changed:aa620ac9-bfdf-4a61-ae23-4f9baea1b233 for instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c on nch1-master-1 May 14 21:19:24.105284 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-608a6dcd-0c11-44cc-bf0f-19bdc9026f27 req-3b670169-e340-4a4a-b1ff-6fce85b317d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321594 May 14 21:19:24.105792 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1237/2322] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:24.110944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:24.111706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:24.117974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.118422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.119198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.119677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.164564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:24.185093 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-faab50b0-b03c-4059-8566-fab27d305fa9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.331452 May 14 21:19:24.186076 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1086/2323] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:23 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:24.191365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:24.192373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:24.198974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.205942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.207695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.208379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.540416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:24.549194 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2ea66410-8692-431a-941d-6c1995eb543a tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 200 len: 1472 microversion: 2.1 time: 0.442182 May 14 21:19:24.549790 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1238/2324] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:24 2022] GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 1472 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:24.560948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:24.579885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:24.595965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.596803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.598542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.599325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.774243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:24.824257 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-adfde92c-aefa-485b-865c-f918cc487547 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.629656 May 14 21:19:24.825696 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1087/2325] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:24 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:24.841820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:24.846793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:24.866379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.867422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:24.868732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:24.870252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.058235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:25.073217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:25.075814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:25.078750 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f43ffa34-e514-40e7-a821-348d8545ca86 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.521656 May 14 21:19:25.093295 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1239/2326] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:24 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:25.101426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:25.103776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:25.114537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.115404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.116532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.117245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.454675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:25.465572 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c1aa3d1f-3e5d-433d-a0eb-1542e3e5091e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1315 microversion: 2.1 time: 0.638488 May 14 21:19:25.466692 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1088/2327] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:24 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:25.473176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:25.475413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:25.483069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.484150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.485052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.485496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.736991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:25.750233 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-810a5337-5ebf-4695-a26e-c8cef91cc9cc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1392 microversion: 2.1 time: 0.655558 May 14 21:19:25.750835 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1240/2328] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:25 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1392 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:25.756249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:25.757109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:25.768200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.769394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.770240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.770935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.798531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:25.806307 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c49e4b5-9ea7-4b6c-9b6b-b774a57481fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.338402 May 14 21:19:25.808561 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1089/2329] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:25 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:25.820189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:25.821080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:25.834187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.836084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.840145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:25.840633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:25.965771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:25.980123 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6d9e6d9-d413-4910-908f-a1ef5a32f373 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 200 len: 1430 microversion: 2.1 time: 0.169525 May 14 21:19:25.981078 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1090/2330] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:25 2022] GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 1430 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:25.994570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:25.995246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:26.008452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.008910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.014385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.015249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.133854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:26.154152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcb435ef-0246-4401-bccb-54afdf6e0a4f tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.401720 May 14 21:19:26.155577 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1241/2331] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:25 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:26.164273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-36de602d-a98e-4726-9788-4f88c29d1913 req-5adcfc61-e472-4a2a-af73-f1e7423f9411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94b2dd32-2b1b-43a0-9320-b086ccc02e33", "name": "network-vif-deleted", "tag": "7a1c258b-59bb-470f-b35e-e0e21b6dcd42"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:26.177536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-36de602d-a98e-4726-9788-4f88c29d1913 req-5adcfc61-e472-4a2a-af73-f1e7423f9411 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.178407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-36de602d-a98e-4726-9788-4f88c29d1913 req-5adcfc61-e472-4a2a-af73-f1e7423f9411 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.192378 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-36de602d-a98e-4726-9788-4f88c29d1913 req-5adcfc61-e472-4a2a-af73-f1e7423f9411 service nova] Creating event network-vif-deleted:7a1c258b-59bb-470f-b35e-e0e21b6dcd42 for instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 on nch2-master-1 May 14 21:19:26.210498 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-36de602d-a98e-4726-9788-4f88c29d1913 req-5adcfc61-e472-4a2a-af73-f1e7423f9411 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042396 May 14 21:19:26.213937 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1242/2332] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:26.226736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:26.234251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:26.246390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.246864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.250220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.252553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.725212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:26.736572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:26.738519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:26.739763 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b91250ea-12db-4c64-9fc1-74dada1eff62 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.523906 May 14 21:19:26.751853 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1243/2333] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:26 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:26.757371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:26.758014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:26.770715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.775289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.776961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.777776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.871338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:26.886352 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-680633d3-d226-4516-919b-588f89ef117b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.904112 May 14 21:19:26.888600 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1091/2334] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:25 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:26.897872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:26.899229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:26.909853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.910962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:26.911975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:26.912579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.052314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:27.069725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65843751-4ae7-4214-84e0-5570fffccbc4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1315 microversion: 2.1 time: 0.315422 May 14 21:19:27.071669 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1244/2335] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:26 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:27.078929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c2cceb8-bc88-4111-a770-98fbe243c1da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:27.080546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4c2cceb8-bc88-4111-a770-98fbe243c1da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:27.096426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c2cceb8-bc88-4111-a770-98fbe243c1da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.097459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c2cceb8-bc88-4111-a770-98fbe243c1da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.099020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c2cceb8-bc88-4111-a770-98fbe243c1da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.099768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c2cceb8-bc88-4111-a770-98fbe243c1da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.330228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:27.351467 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-712104df-7b2f-4bf8-ae29-faf1c1ad2e21 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1392 microversion: 2.1 time: 0.460924 May 14 21:19:27.353908 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1092/2336] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:26 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1392 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:27.360258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:27.361710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:27.369077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.370027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.371145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.371794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.438363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.439026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.439709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lazy-loading 'fault' on Instance uuid 94b2dd32-2b1b-43a0-9320-b086ccc02e33 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:27.546500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:27.560009 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c2cceb8-bc88-4111-a770-98fbe243c1da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.483675 May 14 21:19:27.560009 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1245/2337] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:19:27 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:27.580160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:27.584348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:27.599267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.610069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.610069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.610069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.610642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3ccba0f6-c095-4f16-811b-c14c3cc1d450 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 200 len: 1307 microversion: 2.1 time: 0.229859 May 14 21:19:27.610642 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1093/2338] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:27 2022] GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:27.638067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-33cbc394-7575-4011-98f8-7a602ad2b41c req-e810f51e-0cc8-4224-9a00-281061ca5cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5", "name": "network-vif-deleted", "tag": "be084366-46b1-428d-8388-e556e6c19d3c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:27.666277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-33cbc394-7575-4011-98f8-7a602ad2b41c req-e810f51e-0cc8-4224-9a00-281061ca5cbd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.667102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-33cbc394-7575-4011-98f8-7a602ad2b41c req-e810f51e-0cc8-4224-9a00-281061ca5cbd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.694637 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-33cbc394-7575-4011-98f8-7a602ad2b41c req-e810f51e-0cc8-4224-9a00-281061ca5cbd service nova] Creating event network-vif-deleted:be084366-46b1-428d-8388-e556e6c19d3c for instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 on nch1-master-1 May 14 21:19:27.708119 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-33cbc394-7575-4011-98f8-7a602ad2b41c req-e810f51e-0cc8-4224-9a00-281061ca5cbd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095207 May 14 21:19:27.711875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1094/2339] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:27.721811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:27.724034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:27.731543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.732395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.733619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.734492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.907851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:27.930518 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5eee9507-e4fb-4a04-9d3d-4b1dc965e66b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.365635 May 14 21:19:27.931524 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1246/2340] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:27 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:27.936671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:27.941760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:27.943746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.944223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:27.945120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:27.945560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.111173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:28.120737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:28.122507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:28.123744 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e314ccb-a53a-4b49-976f-e96a0f593936 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.191027 May 14 21:19:28.124491 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1247/2341] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:27 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:28.146948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.147938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:28.157846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.158307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.159742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.161413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.319528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:28.332063 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e4305ab9-742c-4eb4-8bd5-f763a9086477 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1315 microversion: 2.1 time: 0.190502 May 14 21:19:28.332952 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1248/2342] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:28 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:28.353500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-9d4a331f-95b0-4b41-af77-5e1660b90cad req-4a80c19d-42b0-4f8a-8750-38e447bd1356 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d209b6a-5acd-489a-a90e-7007404e063d", "tag": "8ba8255b-e658-44bc-8857-dd535d71b0ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:28.367439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9d4a331f-95b0-4b41-af77-5e1660b90cad req-4a80c19d-42b0-4f8a-8750-38e447bd1356 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.367918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9d4a331f-95b0-4b41-af77-5e1660b90cad req-4a80c19d-42b0-4f8a-8750-38e447bd1356 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.380503 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9d4a331f-95b0-4b41-af77-5e1660b90cad req-4a80c19d-42b0-4f8a-8750-38e447bd1356 service nova] Creating event network-changed:8ba8255b-e658-44bc-8857-dd535d71b0ea for instance 2d209b6a-5acd-489a-a90e-7007404e063d on nch2-master-1 May 14 21:19:28.385770 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-9d4a331f-95b0-4b41-af77-5e1660b90cad req-4a80c19d-42b0-4f8a-8750-38e447bd1356 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036751 May 14 21:19:28.386363 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1249/2343] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:28.391747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.392735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:28.405449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.408108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.409111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.409730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.534625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:28.544728 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ef048887-3728-4344-81cc-cfa7d20dee3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1672 microversion: 2.1 time: 0.830480 May 14 21:19:28.555766 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1095/2344] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:27 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1672 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:28.556169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:28.566583 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de45445a-e7a1-4be7-8d4d-59579d31fd8c tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1382 microversion: 2.1 time: 0.176900 May 14 21:19:28.566789 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1250/2345] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:28 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1382 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:28.582526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e56003a8-0783-44c2-9d08-69e0c817701d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '.version_select at 0x7fb1a76b7a60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.585752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56003a8-0783-44c2-9d08-69e0c817701d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.586209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56003a8-0783-44c2-9d08-69e0c817701d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.598164 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e56003a8-0783-44c2-9d08-69e0c817701d tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 3088 microversion: 2.1 time: 0.019717 May 14 21:19:28.598772 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1096/2346] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:19:28 2022] GET /compute/v2.1/os-migrations => generated 3088 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:28.616463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-678070b0-2c79-4760-8a87-43a0372686cf tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.617097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-678070b0-2c79-4760-8a87-43a0372686cf tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:28.624214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.624926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 94b2dd32-2b1b-43a0-9320-b086ccc02e33] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:28.631218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-678070b0-2c79-4760-8a87-43a0372686cf tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.632755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.633378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.634297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.635073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.635190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-678070b0-2c79-4760-8a87-43a0372686cf tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.636384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-678070b0-2c79-4760-8a87-43a0372686cf tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.636836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-678070b0-2c79-4760-8a87-43a0372686cf tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.649982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 could not be found. May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 HTTP/1.1 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 could not be found. May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '94b2dd32-2b1b-43a0-9320-b086ccc02e33'} May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 could not be found. May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 could not be found. May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:28.651853 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 could not be found. May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance 94b2dd32-2b1b-43a0-9320-b086ccc02e33 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db6aea0a-370c-4021-83d3-7eb7d3078fa6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33" status: 404 len: 111 microversion: 2.1 time: 0.033079 May 14 21:19:28.658979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1097/2347] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:28 2022] GET /compute/v2.1/servers/94b2dd32-2b1b-43a0-9320-b086ccc02e33 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:19:28.662079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.662720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:28.669530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.669995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.670936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.671391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.716359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.716936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.717289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lazy-loading 'fault' on Instance uuid d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:28.780456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:28.788889 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b514c6c2-0610-4a59-9247-878e069dee4e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1307 microversion: 2.1 time: 0.130738 May 14 21:19:28.789549 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1098/2348] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:28 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1307 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:28.804475 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-678070b0-2c79-4760-8a87-43a0372686cf tempest-LiveMigrationTest-151813528 tempest-LiveMigrationTest-151813528-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1533 microversion: 2.1 time: 0.196947 May 14 21:19:28.805065 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1251/2349] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:28 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1533 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:28.857677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.858187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:28.866247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.866836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.868022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.868801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.906265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:28.949451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:28.951460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:28.961607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.962414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:28.966389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:28.966389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.153604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.162529 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-75053b4c-10e8-4944-9f33-0c109a61edb7 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.218875 May 14 21:19:29.163132 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1252/2350] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:28 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:29.286627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72086629-0c0e-42d0-af36-2150c8e987c2 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Calling method '.version_select at 0x7fb1b978c430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.309738 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-72086629-0c0e-42d0-af36-2150c8e987c2 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] HTTP exception thrown: Image not found. May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72086629-0c0e-42d0-af36-2150c8e987c2 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Request method failure captured: May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/297b41b3-7ec1-42d1-95bf-9e3c7ba3be4d/metadata/os_distro HTTP/1.1 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzgeWa1JyYicWpis4pPRG2hmNVvyM7cVlawU2Hy31VYWgp5gH8CmlrQUyAsnlSl31-0CUhMjBsbVwSg4Y89gSNjGLv88Pluf2bUDH37qEntqGEdOe010D_WfTU9vrcwJlisW1zLqX-xJzsENG8r3aFYj8W69GQewbk9ubYMAaVo-A4 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba3b55bf19d34bd69c9c7b0259f2b164", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 0d57e5af9dcf42238802ccc5007e3559 May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'image_id': '297b41b3-7ec1-42d1-95bf-9e3c7ba3be4d', 'id': 'os_distro'} May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 297b41b3-7ec1-42d1-95bf-9e3c7ba3be4d May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:19:29.317412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 297b41b3-7ec1-42d1-95bf-9e3c7ba3be4d could not be found. May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72086629-0c0e-42d0-af36-2150c8e987c2 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72086629-0c0e-42d0-af36-2150c8e987c2 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] 10.222.0.52 "DELETE /compute/v2.1/images/297b41b3-7ec1-42d1-95bf-9e3c7ba3be4d/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.154436 May 14 21:19:29.328039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1253/2351] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:19:29 2022] DELETE /compute/v2.1/images/297b41b3-7ec1-42d1-95bf-9e3c7ba3be4d/metadata/os_distro => generated 62 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:19:29.332476 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fafed17f-0315-4716-9629-778aecfb5cfc tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 204 len: 0 microversion: 2.1 time: 0.468318 May 14 21:19:29.332476 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1099/2352] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:28 2022] DELETE /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:29.335968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.336477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d99e2ad3-547b-468d-b928-55406091d5fc tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Calling method '.version_select at 0x7fb1a7658b80>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.336689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:29.346231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.346231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.347352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.348112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.361083 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d99e2ad3-547b-468d-b928-55406091d5fc tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] HTTP exception thrown: Image not found. May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d99e2ad3-547b-468d-b928-55406091d5fc tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Request method failure captured: May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/images/6f255952-4fe6-4cc3-a3b7-6d980145e7f1/metadata/os_version HTTP/1.1 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzgeWa1JyYicWpis4pPRG2hmNVvyM7cVlawU2Hy31VYWgp5gH8CmlrQUyAsnlSl31-0CUhMjBsbVwSg4Y89gSNjGLv88Pluf2bUDH37qEntqGEdOe010D_WfTU9vrcwJlisW1zLqX-xJzsENG8r3aFYj8W69GQewbk9ubYMAaVo-A4 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba3b55bf19d34bd69c9c7b0259f2b164", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 0d57e5af9dcf42238802ccc5007e3559 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: exception: Image not found. May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'image_id': '6f255952-4fe6-4cc3-a3b7-6d980145e7f1', 'id': 'os_version'} May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6f255952-4fe6-4cc3-a3b7-6d980145e7f1 May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:19:29.365796 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6f255952-4fe6-4cc3-a3b7-6d980145e7f1 could not be found. May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d99e2ad3-547b-468d-b928-55406091d5fc tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Returning 404 to user: Image not found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:29.373264 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d99e2ad3-547b-468d-b928-55406091d5fc tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] 10.222.0.52 "GET /compute/v2.1/images/6f255952-4fe6-4cc3-a3b7-6d980145e7f1/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.038824 May 14 21:19:29.380389 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1100/2353] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:19:29 2022] GET /compute/v2.1/images/6f255952-4fe6-4cc3-a3b7-6d980145e7f1/metadata/os_version => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:19:29.381408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.383914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:29.390858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.391311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.392168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.392623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.523904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.532861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.535035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.536331 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fae86df6-843c-41f4-a740-cb1ea03da283 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.211942 May 14 21:19:29.536911 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1254/2354] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:29 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:29.549514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.549514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:29.555361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.557168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.558413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.559363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.605201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.614865 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c902517-49af-4192-801d-70fb530a7a8d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1388 microversion: 2.1 time: 0.240448 May 14 21:19:29.615432 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1101/2355] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:29 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1388 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:29.620500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dea234ab-c17d-468d-8dbe-6b8b88ffff85 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Calling method '.version_select at 0x7fb1a767d1f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.644374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-dea234ab-c17d-468d-8dbe-6b8b88ffff85 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] HTTP exception thrown: Image not found. May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dea234ab-c17d-468d-8dbe-6b8b88ffff85 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Request method failure captured: May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/images/680c7fd7-2f6f-41ba-acc1-eae518f8b4a8/metadata HTTP/1.1 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzgeWa1JyYicWpis4pPRG2hmNVvyM7cVlawU2Hy31VYWgp5gH8CmlrQUyAsnlSl31-0CUhMjBsbVwSg4Y89gSNjGLv88Pluf2bUDH37qEntqGEdOe010D_WfTU9vrcwJlisW1zLqX-xJzsENG8r3aFYj8W69GQewbk9ubYMAaVo-A4 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba3b55bf19d34bd69c9c7b0259f2b164", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 0d57e5af9dcf42238802ccc5007e3559 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: exception: Image not found. May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'image_id': '680c7fd7-2f6f-41ba-acc1-eae518f8b4a8'} May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 680c7fd7-2f6f-41ba-acc1-eae518f8b4a8 May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:19:29.646456 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 680c7fd7-2f6f-41ba-acc1-eae518f8b4a8 could not be found. May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dea234ab-c17d-468d-8dbe-6b8b88ffff85 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Returning 404 to user: Image not found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dea234ab-c17d-468d-8dbe-6b8b88ffff85 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] 10.222.0.52 "GET /compute/v2.1/images/680c7fd7-2f6f-41ba-acc1-eae518f8b4a8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.031539 May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1102/2356] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:19:29 2022] GET /compute/v2.1/images/680c7fd7-2f6f-41ba-acc1-eae518f8b4a8/metadata => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:19:29.656149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.660896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:29.665893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.666361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.667413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.667939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.713275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.726200 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee20ed9a-c958-4558-87db-63da1b756e2f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1315 microversion: 2.1 time: 0.187754 May 14 21:19:29.726811 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1255/2357] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:29 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:29.735126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fab80c09-ce65-4020-a532-9446c9109ea0 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Action: 'update_all', calling method: .version_select at 0x7fb1b97dbf70>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:29.757887 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-fab80c09-ce65-4020-a532-9446c9109ea0 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] HTTP exception thrown: Image not found. May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fab80c09-ce65-4020-a532-9446c9109ea0 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Request method failure captured: May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/images/56aa5e7d-5f5c-4b75-a748-2f87b4789996/metadata HTTP/1.1 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 57 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzgeWa1JyYicWpis4pPRG2hmNVvyM7cVlawU2Hy31VYWgp5gH8CmlrQUyAsnlSl31-0CUhMjBsbVwSg4Y89gSNjGLv88Pluf2bUDH37qEntqGEdOe010D_WfTU9vrcwJlisW1zLqX-xJzsENG8r3aFYj8W69GQewbk9ubYMAaVo-A4 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba3b55bf19d34bd69c9c7b0259f2b164", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 0d57e5af9dcf42238802ccc5007e3559 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'image_id': '56aa5e7d-5f5c-4b75-a748-2f87b4789996', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 56aa5e7d-5f5c-4b75-a748-2f87b4789996 May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:19:29.760310 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 56aa5e7d-5f5c-4b75-a748-2f87b4789996 could not be found. May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fab80c09-ce65-4020-a532-9446c9109ea0 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fab80c09-ce65-4020-a532-9446c9109ea0 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] 10.222.0.52 "PUT /compute/v2.1/images/56aa5e7d-5f5c-4b75-a748-2f87b4789996/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030627 May 14 21:19:29.765619 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1256/2358] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:19:29 2022] PUT /compute/v2.1/images/56aa5e7d-5f5c-4b75-a748-2f87b4789996/metadata => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:19:29.772175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffcd79a6-eb79-455b-b9a1-6bc5034a8f57 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Action: 'update', calling method: .version_select at 0x7fb1b96c6790>, body: {"meta": {"os_distro": "alt"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:29.794756 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ffcd79a6-eb79-455b-b9a1-6bc5034a8f57 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] HTTP exception thrown: Image not found. May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffcd79a6-eb79-455b-b9a1-6bc5034a8f57 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Request method failure captured: May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/images/52ae0a1e-132c-4f0e-831a-bb5b671bf27f/metadata/os_distro HTTP/1.1 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 30 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzgeWa1JyYicWpis4pPRG2hmNVvyM7cVlawU2Hy31VYWgp5gH8CmlrQUyAsnlSl31-0CUhMjBsbVwSg4Y89gSNjGLv88Pluf2bUDH37qEntqGEdOe010D_WfTU9vrcwJlisW1zLqX-xJzsENG8r3aFYj8W69GQewbk9ubYMAaVo-A4 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba3b55bf19d34bd69c9c7b0259f2b164", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 0d57e5af9dcf42238802ccc5007e3559 May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: {"meta": {"os_distro": "alt"}} May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'image_id': '52ae0a1e-132c-4f0e-831a-bb5b671bf27f', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 52ae0a1e-132c-4f0e-831a-bb5b671bf27f May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:19:29.796916 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 52ae0a1e-132c-4f0e-831a-bb5b671bf27f could not be found. May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffcd79a6-eb79-455b-b9a1-6bc5034a8f57 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ffcd79a6-eb79-455b-b9a1-6bc5034a8f57 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] 10.222.0.52 "PUT /compute/v2.1/images/52ae0a1e-132c-4f0e-831a-bb5b671bf27f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.030702 May 14 21:19:29.806488 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1257/2359] 10.222.0.52 () {60 vars in 1309 bytes} [Sat May 14 21:19:29 2022] PUT /compute/v2.1/images/52ae0a1e-132c-4f0e-831a-bb5b671bf27f/metadata/os_distro => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:19:29.810956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:29.810956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:29.818323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.831082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.831082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.831082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.832050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.836249 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3475b6b-d77b-47bc-a1f9-ccf0fa25f886 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1672 microversion: 2.1 time: 0.186001 May 14 21:19:29.836934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1103/2360] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:29 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:29.841980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b01a2dab-b6f7-4713-8b53-3f604a1e0711 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Action: 'create', calling method: .version_select at 0x7fb1a76b7a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:29.860132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:29.860595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:29.861065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lazy-loading 'fault' on Instance uuid d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:29.864583 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b01a2dab-b6f7-4713-8b53-3f604a1e0711 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] HTTP exception thrown: Image not found. May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b01a2dab-b6f7-4713-8b53-3f604a1e0711 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Request method failure captured: May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/images/2e5d6334-547d-4610-80f9-532a813b6577/metadata HTTP/1.1 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 57 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzgeWa1JyYicWpis4pPRG2hmNVvyM7cVlawU2Hy31VYWgp5gH8CmlrQUyAsnlSl31-0CUhMjBsbVwSg4Y89gSNjGLv88Pluf2bUDH37qEntqGEdOe010D_WfTU9vrcwJlisW1zLqX-xJzsENG8r3aFYj8W69GQewbk9ubYMAaVo-A4 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba3b55bf19d34bd69c9c7b0259f2b164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba3b55bf19d34bd69c9c7b0259f2b164", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: ba3b55bf19d34bd69c9c7b0259f2b164 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-325614992 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 0d57e5af9dcf42238802ccc5007e3559 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-325614992-project May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: exception: Image not found. May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'image_id': '2e5d6334-547d-4610-80f9-532a813b6577', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2e5d6334-547d-4610-80f9-532a813b6577 May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:19:29.866873 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2e5d6334-547d-4610-80f9-532a813b6577 could not be found. May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b01a2dab-b6f7-4713-8b53-3f604a1e0711 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] Returning 404 to user: Image not found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b01a2dab-b6f7-4713-8b53-3f604a1e0711 tempest-ImagesMetadataNegativeTestJSON-325614992 tempest-ImagesMetadataNegativeTestJSON-325614992-project] 10.222.0.52 "POST /compute/v2.1/images/2e5d6334-547d-4610-80f9-532a813b6577/metadata" status: 404 len: 62 microversion: 2.1 time: 0.030554 May 14 21:19:29.873265 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1104/2361] 10.222.0.52 () {60 vars in 1280 bytes} [Sat May 14 21:19:29 2022] POST /compute/v2.1/images/2e5d6334-547d-4610-80f9-532a813b6577/metadata => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:19:29.940061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:29.952636 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e87fe55-e726-47b4-a1a6-0ec4a0df2270 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 200 len: 1307 microversion: 2.1 time: 0.144081 May 14 21:19:29.952636 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1258/2362] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:29 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 1307 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:30.179831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:30.180639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:30.194536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.195232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.197632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.198374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.387271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:30.397251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f01ef045-ab54-4297-9ad5-434179752fff tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.221223 May 14 21:19:30.397998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1105/2363] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:30 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:30.560607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:30.561900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:30.569384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.570345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.571396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.572066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.642120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:30.642825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:30.653905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.654357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.656170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.656669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.750747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:30.760199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:30.761927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:30.763233 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3623ff33-087d-4df3-ba9e-dd4cc67e1c77 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.207566 May 14 21:19:30.774331 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1259/2364] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:30 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:30.779681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:30.780675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:30.789575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.789575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.790391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.791103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.916650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:30.941664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6baca79b-2d64-4139-a962-1bdb17ae45a7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1388 microversion: 2.1 time: 0.307890 May 14 21:19:30.943578 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1106/2365] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:30 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1388 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:30.949811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:30.950656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:30.958599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.959353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:30.961037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:30.963302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.034588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:31.042929 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a7249cf-6a45-458c-a075-206829f563e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1315 microversion: 2.1 time: 0.267111 May 14 21:19:31.055383 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1260/2366] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:30 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:31.061352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:31.062297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:31.069037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.069596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.070569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.071089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.087238 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 could not be found. May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 HTTP/1.1 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 could not be found. May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5'} May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 could not be found. May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 could not be found. May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:31.088941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 could not be found. May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-040e19ad-0563-4b3b-b5c8-91d7d1066ea2 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5" status: 404 len: 111 microversion: 2.1 time: 0.033291 May 14 21:19:31.102717 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1261/2367] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:31 2022] GET /compute/v2.1/servers/d87fdf2d-bd2d-4e9f-a36c-7d2b23e015e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:31.105382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d968ac37-e182-4fa7-9853-f1307c2439b5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:31.192039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:31.200470 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-571e4677-3a6d-4ec1-9acb-873f6117dcee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1672 microversion: 2.1 time: 0.255155 May 14 21:19:31.201057 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1107/2368] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:30 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1672 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:31.213627 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d968ac37-e182-4fa7-9853-f1307c2439b5 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/274c6800-dd69-4e99-9c50-7695004c5ebc" status: 204 len: 0 microversion: 2.1 time: 0.113301 May 14 21:19:31.214302 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1262/2369] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:19:31 2022] DELETE /compute/v2.1/os-server-groups/274c6800-dd69-4e99-9c50-7695004c5ebc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:31.224536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:31.225319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:31.232505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.232971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.233844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.234184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.264140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:31.414888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:31.415534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:31.421474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.421929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.422698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.423135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.564755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d45011c-c6b2-4947-8036-212f9b625701 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 204 len: 0 microversion: 2.1 time: 0.345493 May 14 21:19:31.565992 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1108/2370] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:31 2022] DELETE /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:31.574168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:31.575897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:31.576476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:31.585407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.586679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.589254 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e679fccb-3c4d-47ad-af4c-fbb291209ba1 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1485 microversion: 2.1 time: 0.177121 May 14 21:19:31.591331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.591331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.591632 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1263/2371] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:31 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1485 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:31.609620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-062ddfc2-89cf-4654-b06f-127454a178c2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:31.610510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-062ddfc2-89cf-4654-b06f-127454a178c2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:31.632072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:31.638224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062ddfc2-89cf-4654-b06f-127454a178c2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.638897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062ddfc2-89cf-4654-b06f-127454a178c2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.639797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062ddfc2-89cf-4654-b06f-127454a178c2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.640954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062ddfc2-89cf-4654-b06f-127454a178c2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.934152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-062ddfc2-89cf-4654-b06f-127454a178c2 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "POST /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19/action" status: 202 len: 0 microversion: 2.1 time: 0.328574 May 14 21:19:31.937835 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1264/2372] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:19:31 2022] POST /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:19:31.942008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:31.942828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:31.949690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.950144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:31.950921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:31.951369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.029811 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b821983-b3eb-4adf-a60e-0902dc51f3aa tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 204 len: 0 microversion: 2.1 time: 0.457952 May 14 21:19:32.030220 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1109/2373] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:31 2022] DELETE /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:32.039357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:32.040143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:32.046220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.046675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.047460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.047934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.086712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.095996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.097890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.099108 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a61a255d-2a72-4c62-b126-4b52b88eb241 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.162773 May 14 21:19:32.099742 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1265/2374] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:31 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:32.105817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:32.106670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:32.113971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.114520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.115348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.115883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.206347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.217977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1489d092-5029-4fd7-a85d-7cb36b996ebc tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1493 microversion: 2.1 time: 0.181481 May 14 21:19:32.228428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1110/2375] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:32 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1493 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:32.233698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:32.234618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:32.242597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.243067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.244868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.245383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.291980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.301309 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7212a094-a3a3-4388-9047-5df8e52abdc5 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1388 microversion: 2.1 time: 0.200530 May 14 21:19:32.301903 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1266/2376] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:32 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1388 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:32.307249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:32.308722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:32.315941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.316460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.317263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.317710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.398201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.407028 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3cde38d8-2016-4075-a614-3b7f005f868e tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1474 microversion: 2.1 time: 0.177403 May 14 21:19:32.408576 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1111/2377] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:32 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1474 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:32.414038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:32.414706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:32.421537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.422217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.423967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.425357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.464223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.478054 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a7f51e1-eaf6-4c7b-8a7c-ce8df12cfd1f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1315 microversion: 2.1 time: 0.170457 May 14 21:19:32.478054 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1267/2378] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:32 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:32.632012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f36a7d5b-e23d-484c-a3ba-50ef7a74e8e5 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1b9789ee0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuHelP01elcwYa2EDGJuRz6FxA4fg3iVRSN55kaszzGLYTFrjaj5l0QCWkeqwYviHjr9WPPLtpJsNDJDeKoDlpjqu7GsdN6KsTpV23fDOMQEeKU9O6EWlRb06w4Mbk+Sg=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:32.637194 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-f36a7d5b-e23d-484c-a3ba-50ef7a74e8e5 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f36a7d5b-e23d-484c-a3ba-50ef7a74e8e5 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 257 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuHelP01elcwYa2EDGJuRz6FxA4fg3iVRSN55kaszzGLYTFrjaj5l0QCWkeqwYviHjr9WPPLtpJsNDJDeKoDlpjqu7GsdN6KsTpV23fDOMQEeKU9O6EWlRb06w4Mbk+Sg=="}} May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuHelP01elcwYa2EDGJuRz6FxA4fg3iVRSN55kaszzGLYTFrjaj5l0QCWkeqwYviHjr9WPPLtpJsNDJDeKoDlpjqu7GsdN6KsTpV23fDOMQEeKU9O6EWlRb06w4Mbk+Sg=='}}} May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:32.639739 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f36a7d5b-e23d-484c-a3ba-50ef7a74e8e5 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f36a7d5b-e23d-484c-a3ba-50ef7a74e8e5 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.166694 May 14 21:19:32.649451 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1268/2379] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:19:32 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:19:32.657376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-98b80ed8-e9cb-4945-a83b-e7153a7ddc6d req-6933ddd2-afe3-49b8-b9b2-66dd609f8915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d209b6a-5acd-489a-a90e-7007404e063d", "name": "network-vif-plugged", "status": "completed", "tag": "8ba8255b-e658-44bc-8857-dd535d71b0ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:32.667000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-98b80ed8-e9cb-4945-a83b-e7153a7ddc6d req-6933ddd2-afe3-49b8-b9b2-66dd609f8915 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:32.667411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-98b80ed8-e9cb-4945-a83b-e7153a7ddc6d req-6933ddd2-afe3-49b8-b9b2-66dd609f8915 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:32.678365 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-98b80ed8-e9cb-4945-a83b-e7153a7ddc6d req-6933ddd2-afe3-49b8-b9b2-66dd609f8915 service nova] Creating event network-vif-plugged:8ba8255b-e658-44bc-8857-dd535d71b0ea for instance 2d209b6a-5acd-489a-a90e-7007404e063d on nch2-master-1 May 14 21:19:32.684239 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-98b80ed8-e9cb-4945-a83b-e7153a7ddc6d req-6933ddd2-afe3-49b8-b9b2-66dd609f8915 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039500 May 14 21:19:32.684933 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1269/2380] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:32.691346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-42d92d09-d510-4811-8411-45366777f210 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1b97c3dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1675639634", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:32.708034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-42d92d09-d510-4811-8411-45366777f210 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:32.713798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-42d92d09-d510-4811-8411-45366777f210 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for user 100d512e54924bc1bb24cb21684f6fdc and project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:32.733951 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-42d92d09-d510-4811-8411-45366777f210 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-42d92d09-d510-4811-8411-45366777f210 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 2167 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1675639634", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:32.760041 ncdv-master-1 devstack@n-api.service[130638]: exception: Keypair data is invalid: failed to generate fingerprint May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1675639634', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:32.766337 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-42d92d09-d510-4811-8411-45366777f210 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-42d92d09-d510-4811-8411-45366777f210 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.075390 May 14 21:19:32.771065 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1270/2381] 10.222.0.52 () {60 vars in 1159 bytes} [Sat May 14 21:19:32 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:19:32.780128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-16115579-e228-4a49-83b4-b6601c65c141 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1b97a7820>, body: {"keypair": {"name": "tempest-keypair-1188344185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRzPFNeyPlAMcAuRhg2KbmFx1PxZWatF1ZutzBodQmPYDJAe/vKwp9jbvsccIQjONAoKwS9N2uvoPIVUa0kI4T3cJSZtcmYWWFr8hUvWO6v+Dzay+cdjaArgU9PzsKn5A=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:32.794349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:32.803714 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8c808eb-b951-45b6-b117-4f2e25ac826c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1677 microversion: 2.1 time: 0.393849 May 14 21:19:32.808614 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1112/2382] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:32 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1677 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:32.837841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-16115579-e228-4a49-83b4-b6601c65c141 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:32.858305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-16115579-e228-4a49-83b4-b6601c65c141 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for user 100d512e54924bc1bb24cb21684f6fdc and project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:33.076755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-16115579-e228-4a49-83b4-b6601c65c141 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.302700 May 14 21:19:33.077649 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1271/2383] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:19:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:19:33.090449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-05ae50bd-bd05-4165-82ab-85b2f3cccc28 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1b9780820>, body: {"keypair": {"name": "tempest-keypair-1188344185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLlD7RwzrycxVN2K6D/ghBah1EefGY8MWMseHOSyofMJmqO5sAq9ZneUCpyYiEQgvAOLy0EPhwi/ECJB6EhbF65WpCmzjj7ZpA6S4XkkDvdcmtp2lfhadfGeFOBHbJU6w=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:33.108178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-05ae50bd-bd05-4165-82ab-85b2f3cccc28 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:33.119098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.120664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:33.129967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-05ae50bd-bd05-4165-82ab-85b2f3cccc28 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for user 100d512e54924bc1bb24cb21684f6fdc and project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:33.133304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.134032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.135348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.138892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.229177 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-05ae50bd-bd05-4165-82ab-85b2f3cccc28 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] HTTP exception thrown: Key pair 'tempest-keypair-1188344185' already exists. May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-05ae50bd-bd05-4165-82ab-85b2f3cccc28 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 273 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: {"keypair": {"name": "tempest-keypair-1188344185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLlD7RwzrycxVN2K6D/ghBah1EefGY8MWMseHOSyofMJmqO5sAq9ZneUCpyYiEQgvAOLy0EPhwi/ECJB6EhbF65WpCmzjj7ZpA6S4XkkDvdcmtp2lfhadfGeFOBHbJU6w=="}} May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: exception: Key pair 'tempest-keypair-1188344185' already exists. May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1188344185', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLlD7RwzrycxVN2K6D/ghBah1EefGY8MWMseHOSyofMJmqO5sAq9ZneUCpyYiEQgvAOLy0EPhwi/ECJB6EhbF65WpCmzjj7ZpA6S4XkkDvdcmtp2lfhadfGeFOBHbJU6w=='}}} May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = self._query(query) May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi conn.query(q) May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result.read() May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '100d512e54924bc1bb24cb21684f6fdc-tempest-keypair-1188344185' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 14 21:19:33.236318 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi session.flush() May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._flush(objects) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi compat.raise_( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi flush_context.execute() May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi rec.execute(self) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = self._query(query) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi conn.query(q) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result.read() May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 14 21:19:33.242626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '100d512e54924bc1bb24cb21684f6fdc-tempest-keypair-1188344185' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 14, 21, 19, 33, 170704), 'updated_at': None, 'name': 'tempest-keypair-1188344185', 'user_id': '100d512e54924bc1bb24cb21684f6fdc', 'fingerprint': 'c3:09:e8:66:65:a9:00:c3:b5:b0:52:b1:b2:6d:7f:a6', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLlD7RwzrycxVN2K6D/ghBah1EefGY8MWMseHOSyofMJmqO5sAq9ZneUCpyYiEQgvAOLy0EPhwi/ECJB6EhbF65WpCmzjj7ZpA6S4XkkDvdcmtp2lfhadfGeFOBHbJU6w==', 'type': 'ssh'}] May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi keypair.create() May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._create() May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1188344185' already exists. May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 14 21:19:33.260337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1188344185' already exists. May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1188344185' already exists. May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-05ae50bd-bd05-4165-82ab-85b2f3cccc28 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 409 to user: Key pair 'tempest-keypair-1188344185' already exists. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-05ae50bd-bd05-4165-82ab-85b2f3cccc28 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.152253 May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1113/2384] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:19:33 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.271502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.413836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:33.423882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:33.425662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:33.430952 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d4b8103e-5211-46e5-9b10-165da69fa6e0 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.316581 May 14 21:19:33.432562 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1272/2385] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:33 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:33.438052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-687e2734-fcda-4b66-8ea5-499606928e01 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Calling method '.version_select at 0x7fb1b971f280>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.469376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:33.477688 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b2c797c9-f871-4793-b99b-ca7fa16b9312 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1493 microversion: 2.1 time: 0.237610 May 14 21:19:33.478254 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1114/2386] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:33 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:33.482658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.485120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:33.491727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.492288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.493082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.493528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.510875 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-687e2734-fcda-4b66-8ea5-499606928e01 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188344185" status: 202 len: 0 microversion: 2.1 time: 0.077216 May 14 21:19:33.513579 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1273/2387] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:19:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188344185 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:33.516673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c095dfce-9748-48c6-b475-2eb495ad88ba req-8c402a63-bb63-4d40-99c6-bd936e30878d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb037f1e-9300-4512-a6ac-4aa2c31e4183", "name": "network-vif-deleted", "tag": "290d17d6-ed0e-4c77-9c1a-57fa7081a50d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:33.528219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c095dfce-9748-48c6-b475-2eb495ad88ba req-8c402a63-bb63-4d40-99c6-bd936e30878d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.528923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c095dfce-9748-48c6-b475-2eb495ad88ba req-8c402a63-bb63-4d40-99c6-bd936e30878d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.541532 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c095dfce-9748-48c6-b475-2eb495ad88ba req-8c402a63-bb63-4d40-99c6-bd936e30878d service nova] Creating event network-vif-deleted:290d17d6-ed0e-4c77-9c1a-57fa7081a50d for instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 on nch2-master-1 May 14 21:19:33.547143 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c095dfce-9748-48c6-b475-2eb495ad88ba req-8c402a63-bb63-4d40-99c6-bd936e30878d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034186 May 14 21:19:33.547998 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1274/2388] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:33.554142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ba1f87e5-3fc7-43fe-b7b5-1f7d23f29f9b req-b1fd6b4d-c0be-4989-a3d0-52c94e90be15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7a619-b4c9-41fa-ae67-011162dbdab2", "name": "network-vif-unplugged", "status": "completed", "tag": "d403d7ba-1fe1-41c0-8b4a-8aedc3448d15"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:33.562560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ba1f87e5-3fc7-43fe-b7b5-1f7d23f29f9b req-b1fd6b4d-c0be-4989-a3d0-52c94e90be15 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.563013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ba1f87e5-3fc7-43fe-b7b5-1f7d23f29f9b req-b1fd6b4d-c0be-4989-a3d0-52c94e90be15 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.574579 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ba1f87e5-3fc7-43fe-b7b5-1f7d23f29f9b req-b1fd6b4d-c0be-4989-a3d0-52c94e90be15 service nova] Creating event network-vif-unplugged:d403d7ba-1fe1-41c0-8b4a-8aedc3448d15 for instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 on nch1-master-1 May 14 21:19:33.579416 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ba1f87e5-3fc7-43fe-b7b5-1f7d23f29f9b req-b1fd6b4d-c0be-4989-a3d0-52c94e90be15 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029741 May 14 21:19:33.580209 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1275/2389] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:33.586109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.586819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:33.593068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.593532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.594567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.594858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.604965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:33.615585 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-855a9d36-a201-4ee1-9c42-c10f74a1929e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1346 microversion: 2.1 time: 0.136181 May 14 21:19:33.616516 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1115/2390] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:33 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:33.623094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.624326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:33.631569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.632916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.633795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.634317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.753494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:33.761740 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-858fad09-c469-41c5-ab22-2ae887f9a293 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1474 microversion: 2.1 time: 0.179629 May 14 21:19:33.763224 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1276/2391] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:33 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1474 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:33.766767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5532c79-6c88-420b-8b3f-c0cefbf5bd37 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1b97c3040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ8qhTCXWcVq+Ay6JSrkGlfcRkkSQsav9N+BG5svbYNTuOqADf1nYhtqxXDBPICKYYXWwAufxFY6cJfX7qEGOknZ5l86Ce6rvMDb+bpaaT95S5P6hSlVH4nqcd6TlQOAA=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5532c79-6c88-420b-8b3f-c0cefbf5bd37 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 247 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ8qhTCXWcVq+Ay6JSrkGlfcRkkSQsav9N+BG5svbYNTuOqADf1nYhtqxXDBPICKYYXWwAufxFY6cJfX7qEGOknZ5l86Ce6rvMDb+bpaaT95S5P6hSlVH4nqcd6TlQOAA=="}} May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute name. Value: . '' is too short May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQ8qhTCXWcVq+Ay6JSrkGlfcRkkSQsav9N+BG5svbYNTuOqADf1nYhtqxXDBPICKYYXWwAufxFY6cJfX7qEGOknZ5l86Ce6rvMDb+bpaaT95S5P6hSlVH4nqcd6TlQOAA=='}}} May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi '' May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:19:33.770020 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5532c79-6c88-420b-8b3f-c0cefbf5bd37 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5532c79-6c88-420b-8b3f-c0cefbf5bd37 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.008205 May 14 21:19:33.776127 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1277/2392] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:19:33 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:19:33.782209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d70e726c-17bf-40a7-9a4b-bca0f5f25833 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1b978caf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1494353273", "public_key": " "}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:33.798338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d70e726c-17bf-40a7-9a4b-bca0f5f25833 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:33.805738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d70e726c-17bf-40a7-9a4b-bca0f5f25833 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for user 100d512e54924bc1bb24cb21684f6fdc and project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:33.807789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:33.822075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d70e726c-17bf-40a7-9a4b-bca0f5f25833 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d70e726c-17bf-40a7-9a4b-bca0f5f25833 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 95 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1494353273", "public_key": " "}} May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: exception: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1494353273', 'public_key': ' '}}} May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.824095 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d70e726c-17bf-40a7-9a4b-bca0f5f25833 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:33.829638 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d70e726c-17bf-40a7-9a4b-bca0f5f25833 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047544 May 14 21:19:33.838377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1278/2393] 10.222.0.52 () {60 vars in 1157 bytes} [Sat May 14 21:19:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:19:33.839178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.840267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:33.843377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-248d452c-540a-407f-8cfd-b5b4283a78c5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1315 microversion: 2.1 time: 0.224669 May 14 21:19:33.844038 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1116/2394] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:33 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:33.847369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.847860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.848659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:33.849109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:33.850517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9da023b9-c8bb-41fd-a720-8e220052aa85 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1a76a7940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEra1HwsKo7Da8pzTIIOBO5Bb5lfGzsKXskpUB/KsJDALNZGC9LpJmkslz5qIheuWSxNWZwU2t2NCwg/R5MZfuH8iPGqySTv6padNJxPO5xM+P5xShosoj8iA2nilo++0g=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9da023b9-c8bb-41fd-a720-8e220052aa85 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 507 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEra1HwsKo7Da8pzTIIOBO5Bb5lfGzsKXskpUB/KsJDALNZGC9LpJmkslz5qIheuWSxNWZwU2t2NCwg/R5MZfuH8iPGqySTv6padNJxPO5xM+P5xShosoj8iA2nilo++0g=="}} May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEra1HwsKo7Da8pzTIIOBO5Bb5lfGzsKXskpUB/KsJDALNZGC9LpJmkslz5qIheuWSxNWZwU2t2NCwg/R5MZfuH8iPGqySTv6padNJxPO5xM+P5xShosoj8iA2nilo++0g=='}}} May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 14 21:19:33.854340 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9da023b9-c8bb-41fd-a720-8e220052aa85 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9da023b9-c8bb-41fd-a720-8e220052aa85 tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.012795 May 14 21:19:33.868453 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1117/2395] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:19:33 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:19:33.878484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-62dd188d-7e91-4dcb-b768-1d2833957c7d tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Action: 'create', calling method: .version_select at 0x7fb1b9780940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2080969941", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:33.900488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-62dd188d-7e91-4dcb-b768-1d2833957c7d tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:33.907227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-62dd188d-7e91-4dcb-b768-1d2833957c7d tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Getting quotas for user 100d512e54924bc1bb24cb21684f6fdc and project 65e462b8fb9a4a45b1fa6305c738e24d. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:33.942070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-62dd188d-7e91-4dcb-b768-1d2833957c7d tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-62dd188d-7e91-4dcb-b768-1d2833957c7d tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 118 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2080969941", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: exception: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2080969941', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 14 21:19:33.944658 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 14 21:19:33.953969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.957401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-62dd188d-7e91-4dcb-b768-1d2833957c7d tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:33.957903 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-62dd188d-7e91-4dcb-b768-1d2833957c7d tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.084652 May 14 21:19:33.958795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1118/2396] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:19:33 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:19:33.968265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae3641d9-e80b-4f8f-aec8-66eee753121f tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Calling method '.version_select at 0x7fb1a768f790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:33.980255 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ae3641d9-e80b-4f8f-aec8-66eee753121f tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-788726629 not found for user 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae3641d9-e80b-4f8f-aec8-66eee753121f tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Request method failure captured: May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-788726629 HTTP/1.1 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzkSZbbqU5deiJeI0kBlED3qbM4EVGIw_yDgPJhKWLuWD1WfXg8sua5pn9F7RCVpLKwASFNeoMljiZl-_dLqULdLUATQ6KppC_QdKw5rqusNJFxovcFMHLtnBinM2MBGsJ1oUp6g5BYRVpqmqCZKZTz-fGhjnrmrIdXzUAwljObjC0 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/65e462b8fb9a4a45b1fa6305c738e24d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_65e462b8fb9a4a45b1fa6305c738e24d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 65e462b8fb9a4a45b1fa6305c738e24d May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1186908201 May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1186908201-project May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: exception: Keypair tempest-keypair-non-existent-788726629 not found for user 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'tempest-keypair-non-existent-788726629'} May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-788726629 not found for user 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.982037 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-788726629 not found for user 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-788726629 not found for user 100d512e54924bc1bb24cb21684f6fdc May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae3641d9-e80b-4f8f-aec8-66eee753121f tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] Returning 404 to user: Keypair tempest-keypair-non-existent-788726629 not found for user 100d512e54924bc1bb24cb21684f6fdc {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae3641d9-e80b-4f8f-aec8-66eee753121f tempest-KeyPairsNegativeTestJSON-1186908201 tempest-KeyPairsNegativeTestJSON-1186908201-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-788726629" status: 404 len: 144 microversion: 2.1 time: 0.019185 May 14 21:19:33.987005 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1119/2397] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:19:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-788726629 => generated 144 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:34.024009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.032223 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19ccde3f-9373-4cd3-ad2e-e3900845b985 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.196785 May 14 21:19:34.032810 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1279/2398] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:33 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:34.051640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e14cbb0b-74cf-418a-bbf5-a36cf288d55c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:34.053335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e14cbb0b-74cf-418a-bbf5-a36cf288d55c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.061943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e14cbb0b-74cf-418a-bbf5-a36cf288d55c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.062671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e14cbb0b-74cf-418a-bbf5-a36cf288d55c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.063524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e14cbb0b-74cf-418a-bbf5-a36cf288d55c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.063993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e14cbb0b-74cf-418a-bbf5-a36cf288d55c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.126747 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e14cbb0b-74cf-418a-bbf5-a36cf288d55c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 200 len: 145 microversion: 2.1 time: 0.081374 May 14 21:19:34.127634 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1120/2399] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:19:34 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:34.138109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:34.138917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.145635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.147348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.147348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.147348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.301889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.313701 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-34f6db1f-0340-4002-99fa-8eeda0db6903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.179940 May 14 21:19:34.314553 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1280/2400] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:34 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:34.336102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:34.336817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.346307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.347005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.348634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.349354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.454579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:34.456763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.472182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.473904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.476266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.477346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.638229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.647040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-924a59c6-02d5-4d79-891b-9b29503235c7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.318609 May 14 21:19:34.647650 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1121/2401] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:34 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:34.652249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:34.652892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.660444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.661046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.670085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.670085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.696262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.711990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.713532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.714724 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-25d21c23-c106-4ce5-ba62-90e8c0ff6251 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.265445 May 14 21:19:34.715292 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1281/2402] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:34 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:34.724376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:34.725001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.731769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.732321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.733176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.733750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.842283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.842571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:34.854528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba6265d6-922c-4d4c-9675-086bcb6af8c3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1493 microversion: 2.1 time: 0.205383 May 14 21:19:34.854934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14d428b1-c1db-40aa-8d22-63261e78b991 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 200 len: 1184 microversion: 2.1 time: 0.137625 May 14 21:19:34.855326 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1122/2403] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:34 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1493 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:34.860615 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1282/2404] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:34 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 1184 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:34.864798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:34.865518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.867387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c6adf6fe-443f-4338-b290-bd8e687288d0 req-fc551c3e-ed2a-48c2-8fb2-7b7d70917ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb037f1e-9300-4512-a6ac-4aa2c31e4183", "name": "network-vif-unplugged", "status": "completed", "tag": "290d17d6-ed0e-4c77-9c1a-57fa7081a50d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:34.875183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.876848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.878406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.879511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.883790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c6adf6fe-443f-4338-b290-bd8e687288d0 req-fc551c3e-ed2a-48c2-8fb2-7b7d70917ecd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.887737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c6adf6fe-443f-4338-b290-bd8e687288d0 req-fc551c3e-ed2a-48c2-8fb2-7b7d70917ecd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.909861 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c6adf6fe-443f-4338-b290-bd8e687288d0 req-fc551c3e-ed2a-48c2-8fb2-7b7d70917ecd service nova] Creating event network-vif-unplugged:290d17d6-ed0e-4c77-9c1a-57fa7081a50d for instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 on nch2-master-1 May 14 21:19:34.918251 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c6adf6fe-443f-4338-b290-bd8e687288d0 req-fc551c3e-ed2a-48c2-8fb2-7b7d70917ecd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054902 May 14 21:19:34.919923 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1283/2405] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:34.929959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:34.934160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:34.944618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.945927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:34.947390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:34.948211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:35.177185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:35.188023 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c6436a6-219a-4b23-ba3c-1d8327486429 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1474 microversion: 2.1 time: 0.266246 May 14 21:19:35.189597 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1284/2406] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:34 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1474 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:35.197089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:35.198098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:35.208345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:35.215995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:35.215995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:35.215995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:35.494310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:35.512719 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2815069d-3eb4-45da-b5db-961482b49bbf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1502 microversion: 2.1 time: 0.314211 May 14 21:19:35.525747 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1285/2407] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:35 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1502 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:35.533054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:35.534534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:35.542620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:35.543094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:35.543920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:35.544640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:35.597591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:35.636744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:35.646021 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-786551d0-1c67-4f9e-8b1b-4b046acaffcd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.788145 May 14 21:19:35.657827 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1123/2408] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:34 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:35.664486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-52ebcea3-1f6f-4db2-93d4-e998cf1072c5 req-860867bf-31d9-4dd2-9b17-1e374b940598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b7a619-b4c9-41fa-ae67-011162dbdab2", "tag": "d403d7ba-1fe1-41c0-8b4a-8aedc3448d15"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:35.686524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-52ebcea3-1f6f-4db2-93d4-e998cf1072c5 req-860867bf-31d9-4dd2-9b17-1e374b940598 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:35.686993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-52ebcea3-1f6f-4db2-93d4-e998cf1072c5 req-860867bf-31d9-4dd2-9b17-1e374b940598 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:35.703804 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-52ebcea3-1f6f-4db2-93d4-e998cf1072c5 req-860867bf-31d9-4dd2-9b17-1e374b940598 service nova] Creating event network-changed:d403d7ba-1fe1-41c0-8b4a-8aedc3448d15 for instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 on nch1-master-1 May 14 21:19:35.710047 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-52ebcea3-1f6f-4db2-93d4-e998cf1072c5 req-860867bf-31d9-4dd2-9b17-1e374b940598 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050674 May 14 21:19:35.711089 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1124/2409] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:35.716232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:35.716965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:35.725380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:35.725968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:35.727052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:35.727469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.067454 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-69c7cf52-5492-47a3-b993-aa14052dccc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 204 len: 0 microversion: 2.1 time: 0.530807 May 14 21:19:36.072938 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1286/2410] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:35 2022] DELETE /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:36.084589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:36.086450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:36.092587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:36.101766 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f3f6b2f-d885-4126-8c88-28c296e226e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.389607 May 14 21:19:36.106234 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1125/2411] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:35 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:36.116785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:36.120171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:36.135077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.135077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.135077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.135458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.135458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.135765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.136767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.138401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.355787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:36.374853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:36.374853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:36.374853 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9379a8fa-2324-420b-b64e-a70781f7f6ec tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.299734 May 14 21:19:36.375182 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1287/2412] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:36 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:36.387115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:36.387921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: eb037f1e-9300-4512-a6ac-4aa2c31e4183] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:36.396631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.397678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.399023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.400012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.421173 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] HTTP exception thrown: Instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 could not be found. May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Request method failure captured: May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 HTTP/1.1 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuFY4g0wq4WgHSemyKorU8Z1KEdyjn56SNZqlZwUQb-5uBMAAKkVZOMQ32XFxNHWahLYnBaStRJN6BmuO6R1-ghItgt_Y5AvHjsczvOf2pq0BEmvGK37gqHJFIzJrlVFvhlwZKT6mK6YqYfeqyQNiw5WNm9mHDg0_BCVWUFd--4QDk May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-LiveMigrationTest-772526 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_763cf73206604d8abbe1542afe44fa95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-LiveMigrationTest-772526 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-LiveMigrationTest-772526 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-LiveMigrationTest-772526-project May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 038739f45c3d4ab09457d6eed20b41d4 May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-LiveMigrationTest-772526-project May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 could not be found. May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'eb037f1e-9300-4512-a6ac-4aa2c31e4183'} May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 could not be found. May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 could not be found. May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:36.423622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 could not be found. May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Returning 404 to user: Instance eb037f1e-9300-4512-a6ac-4aa2c31e4183 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-443faaca-b217-46df-b65e-f843115ac9b3 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183" status: 404 len: 111 microversion: 2.1 time: 0.051991 May 14 21:19:36.432711 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1288/2413] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:36 2022] GET /compute/v2.1/servers/eb037f1e-9300-4512-a6ac-4aa2c31e4183 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:36.440303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:36.441185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:36.453200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.453661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.454646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.455102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.460465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:36.470153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aaced000-7aba-4963-ac0a-35c852d0497b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1493 microversion: 2.1 time: 0.362286 May 14 21:19:36.470749 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1126/2414] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:36 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1493 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:36.489103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:36.495282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:36.509985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.514627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.519554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.525173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.616390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:36.632152 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-69ef48b9-0ce6-4ef0-8e37-70042c58f9ac tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1432 microversion: 2.1 time: 0.147490 May 14 21:19:36.634205 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1127/2415] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:36 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1432 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:36.639555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c993b509-3ce8-404c-849c-a48cfcc4d3d7 req-a5c64995-54b9-4bbc-a24a-345358d0f2c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62fa985e-ce99-4aa4-b8f4-7eea574ff735", "name": "network-vif-deleted", "tag": "8d9e55ad-f15d-4d89-82b6-1590b8ae3515"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:36.648839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c993b509-3ce8-404c-849c-a48cfcc4d3d7 req-a5c64995-54b9-4bbc-a24a-345358d0f2c3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:36.649516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c993b509-3ce8-404c-849c-a48cfcc4d3d7 req-a5c64995-54b9-4bbc-a24a-345358d0f2c3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:36.654528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:36.662374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c993b509-3ce8-404c-849c-a48cfcc4d3d7 req-a5c64995-54b9-4bbc-a24a-345358d0f2c3 service nova] Creating event network-vif-deleted:8d9e55ad-f15d-4d89-82b6-1590b8ae3515 for instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 on nch1-master-1 May 14 21:19:36.664040 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eb796ef3-b6b0-4c8e-9b0e-3c2d60dc47c2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1508 microversion: 2.1 time: 0.234009 May 14 21:19:36.665039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1289/2416] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:36 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:36.670933 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c993b509-3ce8-404c-849c-a48cfcc4d3d7 req-a5c64995-54b9-4bbc-a24a-345358d0f2c3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034912 May 14 21:19:36.678767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-75722193", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "5fb69a44-68f6-44d7-9bcb-ee9798387585"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:36.682071 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1128/2417] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:36.771572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] validate_networks() for [('5fb69a44-68f6-44d7-9bcb-ee9798387585', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:19:37.181154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:19:37.181154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:19:37.181154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:19:37.181154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:19:37.181154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:19:37.192613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.193150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.194055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.194579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.225708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:37.233082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for user a42e0caa0878447f98544e74f767c7ca and project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:37.249752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:19:37.253866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:19:37.395917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:37.396667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:37.403339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.403849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.404668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.405119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.526648 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b63067c-3481-476f-b42f-9fb3740dbd3c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859931 May 14 21:19:37.528297 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1290/2418] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:19:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:19:37.537326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:37.538439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:37.545835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.546579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.547571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.548177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.722525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:37.727429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:37.729427 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e010efe9-2f4b-4b0f-9707-26a6cdd2503b tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1493 microversion: 2.1 time: 0.199921 May 14 21:19:37.730119 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1291/2419] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:37 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1493 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:37.736725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6413627-bd60-4dba-9d75-f9a77e25c4c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:37.737944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c6413627-bd60-4dba-9d75-f9a77e25c4c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:37.744699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:37.748074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:37.754202 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7edd8b7f-f94f-45a9-955a-537a71d6041a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.361622 May 14 21:19:37.754912 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1129/2420] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:37 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:37.764720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:37.766760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:37.774499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.775825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.778991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.778991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.801442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c6413627-bd60-4dba-9d75-f9a77e25c4c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:37.813057 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6413627-bd60-4dba-9d75-f9a77e25c4c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1213 microversion: 2.1 time: 0.080173 May 14 21:19:37.813057 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1292/2421] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:37 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:37.818367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:37.820195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:37.826960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.828396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.829408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:37.830124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:37.985297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:37.992704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-662b7b87-9f6b-4e35-8e39-f64ea95e6228 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1304 microversion: 2.1 time: 0.236408 May 14 21:19:38.003144 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1130/2422] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:37 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:38.009029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:38.009226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-caaec9d8-3ae4-48f4-a87e-2709b2293c38 req-c3eaa793-647a-4d6c-ab0c-12daee28e78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f6c282-322e-4eac-b6d0-959de031b52a", "name": "network-vif-deleted", "tag": "577c7de2-4e7f-4990-ace6-4e5aa42e5998"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:38.017465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-caaec9d8-3ae4-48f4-a87e-2709b2293c38 req-c3eaa793-647a-4d6c-ab0c-12daee28e78d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.017880 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ece1eb9e-44c4-4a8d-a4b9-ee0655655670 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1508 microversion: 2.1 time: 0.204976 May 14 21:19:38.018029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-caaec9d8-3ae4-48f4-a87e-2709b2293c38 req-c3eaa793-647a-4d6c-ab0c-12daee28e78d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.019923 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1293/2423] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:37 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1508 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:38.032336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-caaec9d8-3ae4-48f4-a87e-2709b2293c38 req-c3eaa793-647a-4d6c-ab0c-12daee28e78d service nova] Creating event network-vif-deleted:577c7de2-4e7f-4990-ace6-4e5aa42e5998 for instance b9f6c282-322e-4eac-b6d0-959de031b52a on nch1-master-1 May 14 21:19:38.038319 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-caaec9d8-3ae4-48f4-a87e-2709b2293c38 req-c3eaa793-647a-4d6c-ab0c-12daee28e78d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033417 May 14 21:19:38.039159 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1131/2424] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:38.747026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:38.747693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:38.754296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.755061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.755938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.756506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.775517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:38.776227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:38.782462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.782924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.783733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.785177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.904413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:38.914391 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6f5629b3-9a17-41bc-bf36-171739d13957 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1499 microversion: 2.1 time: 0.171181 May 14 21:19:38.915814 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1294/2425] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:38 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:38.931813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:38.937387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:38.938325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:38.945711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.949690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.949690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.949690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.950216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:38.950216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:38.950879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-43b619e4-4e00-4558-87e1-8f8f1d3e9e64 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.180388 May 14 21:19:38.952080 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1132/2426] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:38 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:38.959452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:38.960119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:38.973975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.974469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:38.975273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:38.976025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.006069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:39.025594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:39.042920 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-474c1e82-2afc-49ce-82ec-6bc024a3c7f4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1217 microversion: 2.1 time: 0.125692 May 14 21:19:39.045377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1295/2427] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:38 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:39.052986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:39.053955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:39.065741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.066483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.067333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.067818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.121427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.121799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.123025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lazy-loading 'fault' on Instance uuid b9f6c282-322e-4eac-b6d0-959de031b52a {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:39.215447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:39.240329 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fec4b10f-58d5-499c-babe-ee17396b1fd6 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 200 len: 1309 microversion: 2.1 time: 0.193575 May 14 21:19:39.243793 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1296/2428] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:39 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 1309 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:39.258530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:39.259746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:39.266507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.267220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.269005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.269812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.316746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.317274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.317758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'fault' on Instance uuid 2d209b6a-5acd-489a-a90e-7007404e063d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:39.361244 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5befc776-d6fa-4b15-a860-0f435fed3bcd tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 204 len: 0 microversion: 2.1 time: 0.405997 May 14 21:19:39.364947 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1133/2429] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:38 2022] DELETE /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:39.365121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:39.372943 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-116f7db3-90f7-4564-a9ac-6838611ebba7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 200 len: 1305 microversion: 2.1 time: 0.127859 May 14 21:19:39.373454 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1297/2430] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:39 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:39.383262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:39.383262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:39.386253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.387523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.388321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.388768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.512316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6e143aa4-8463-48f0-811f-4b6a220e18c3 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1a76a7a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-958746035", "description": "tempest-description-1524654264"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:39.530067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:39.540729 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-95d2771a-951c-4f42-967b-e6c5aba320d6 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.166104 May 14 21:19:39.541676 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1298/2431] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:39 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:39.919419 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6e143aa4-8463-48f0-811f-4b6a220e18c3 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.555614 May 14 21:19:39.920923 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1134/2432] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:19:39 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:39.933078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-837a0019-56a2-46f1-bbbf-4f6cb5b4e613 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1b96d6ee0>, body: {"security_group_rule": {"parent_group_id": "23b2b053-8a5c-42d4-a604-0ef99a0ef831", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:39.972303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:39.972992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:39.980349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.980812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:39.981812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:39.982266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.216029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:40.232187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:40.232187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:40.233363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e18d089f-86d1-4713-91c0-8a59bcbd399a tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.266585 May 14 21:19:40.245544 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1135/2433] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:39 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:40.251407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:40.255317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:40.258911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.259389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.260651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.261356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.354387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:40.363461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0222dfc0-cc12-46e7-8499-e5a65c43afb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1273 microversion: 2.1 time: 0.116705 May 14 21:19:40.365455 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1136/2434] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:40 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:40.369491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8e7808e8-e38d-4ad7-ad47-972341aa84f5 req-f4252952-156e-40ce-a689-4de70b677c6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d209b6a-5acd-489a-a90e-7007404e063d", "name": "network-vif-deleted", "tag": "8ba8255b-e658-44bc-8857-dd535d71b0ea"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:40.378218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8e7808e8-e38d-4ad7-ad47-972341aa84f5 req-f4252952-156e-40ce-a689-4de70b677c6e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.378742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8e7808e8-e38d-4ad7-ad47-972341aa84f5 req-f4252952-156e-40ce-a689-4de70b677c6e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.395055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8e7808e8-e38d-4ad7-ad47-972341aa84f5 req-f4252952-156e-40ce-a689-4de70b677c6e service nova] Creating event network-vif-deleted:8ba8255b-e658-44bc-8857-dd535d71b0ea for instance 2d209b6a-5acd-489a-a90e-7007404e063d on nch2-master-1 May 14 21:19:40.402335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8e7808e8-e38d-4ad7-ad47-972341aa84f5 req-f4252952-156e-40ce-a689-4de70b677c6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036812 May 14 21:19:40.403865 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1137/2435] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:40.416491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:40.417229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: b9f6c282-322e-4eac-b6d0-959de031b52a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:40.423618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.424535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.425359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.425795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.443029 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance b9f6c282-322e-4eac-b6d0-959de031b52a could not be found. May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a HTTP/1.1 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance b9f6c282-322e-4eac-b6d0-959de031b52a could not be found. May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'b9f6c282-322e-4eac-b6d0-959de031b52a'} May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9f6c282-322e-4eac-b6d0-959de031b52a could not be found. May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f6c282-322e-4eac-b6d0-959de031b52a could not be found. May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.445163 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f6c282-322e-4eac-b6d0-959de031b52a could not be found. May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance b9f6c282-322e-4eac-b6d0-959de031b52a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a283929-b997-40a9-b20c-37e663a8fb80 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a" status: 404 len: 111 microversion: 2.1 time: 0.041417 May 14 21:19:40.450555 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1138/2436] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:40 2022] GET /compute/v2.1/servers/b9f6c282-322e-4eac-b6d0-959de031b52a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:40.454672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:40.455315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:40.462290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.465706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.465706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.465706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.478936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d HTTP/1.1 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '2d209b6a-5acd-489a-a90e-7007404e063d'} May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.480580 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c1976ccd-f192-4e99-9a4d-7e378981d248 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 404 len: 111 microversion: 2.1 time: 0.033845 May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1139/2437] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:40 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:40.488322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:40.490920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: 62fa985e-ce99-4aa4-b8f4-7eea574ff735] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:40.495803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.495803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.496787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.497286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.514185 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 could not be found. May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 HTTP/1.1 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 could not be found. May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '62fa985e-ce99-4aa4-b8f4-7eea574ff735'} May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 could not be found. May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 could not be found. May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.515851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 could not be found. May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance 62fa985e-ce99-4aa4-b8f4-7eea574ff735 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86ac4dfd-cbbb-4636-9c4e-bc7a831e350b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735" status: 404 len: 111 microversion: 2.1 time: 0.033674 May 14 21:19:40.521391 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1140/2438] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:40 2022] GET /compute/v2.1/servers/62fa985e-ce99-4aa4-b8f4-7eea574ff735 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:40.527165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8df0311-ce08-4ebd-bcf2-98287a0d09db tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:40.557810 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-837a0019-56a2-46f1-bbbf-4f6cb5b4e613 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.629102 May 14 21:19:40.558449 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1299/2439] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:39 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:40.568270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:40.569136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:40.575294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.575794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.576573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.577016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.665150 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8df0311-ce08-4ebd-bcf2-98287a0d09db tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/11f18c89-031b-470c-8f91-81f3a040bd15" status: 204 len: 0 microversion: 2.1 time: 0.141636 May 14 21:19:40.665761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1141/2440] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:19:40 2022] DELETE /compute/v2.1/os-server-groups/11f18c89-031b-470c-8f91-81f3a040bd15 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:40.670515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd0a6bd6-7f31-4d19-a0c6-6607e7615873 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1a7684670>, body: {"security_group_rule": {"parent_group_id": "23b2b053-8a5c-42d4-a604-0ef99a0ef831", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:40.732970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:40.741039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2ae1444a-1e88-42c5-affe-75b235109a1d tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.181500 May 14 21:19:40.741612 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1300/2441] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:40 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:40.746665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1507255311", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3bdbef8a-a684-458d-bfe2-b4f322a15d2e"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:40.781862 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-cd0a6bd6-7f31-4d19-a0c6-6607e7615873 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: This rule already exists in group 23b2b053-8a5c-42d4-a604-0ef99a0ef831 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd0a6bd6-7f31-4d19-a0c6-6607e7615873 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 138 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: {"security_group_rule": {"parent_group_id": "23b2b053-8a5c-42d4-a604-0ef99a0ef831", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: exception: This rule already exists in group 23b2b053-8a5c-42d4-a604-0ef99a0ef831 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'security_group_rule': {'parent_group_id': '23b2b053-8a5c-42d4-a604-0ef99a0ef831', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 23b2b053-8a5c-42d4-a604-0ef99a0ef831 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 23b2b053-8a5c-42d4-a604-0ef99a0ef831 May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:40.783453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:40.790924 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:40.790924 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:40.790924 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 23b2b053-8a5c-42d4-a604-0ef99a0ef831 May 14 21:19:40.790924 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:40.790924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd0a6bd6-7f31-4d19-a0c6-6607e7615873 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 400 to user: This rule already exists in group 23b2b053-8a5c-42d4-a604-0ef99a0ef831 {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:40.790924 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd0a6bd6-7f31-4d19-a0c6-6607e7615873 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.118433 May 14 21:19:40.790924 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1142/2442] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:40 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:19:40.799397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:40.799983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:40.801263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] validate_networks() for [('3bdbef8a-a684-458d-bfe2-b4f322a15d2e', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:19:40.806872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.807336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.808166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:40.808620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:40.835537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:41.199361 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8df4a94b-a709-40e6-9eaa-89c249918667 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 204 len: 0 microversion: 2.1 time: 0.411913 May 14 21:19:41.200316 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1143/2443] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:40 2022] DELETE /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:41.206292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4fca01a-ac57-4917-abd3-498b070a4f1e tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Calling method '.version_select at 0x7fb1a77889d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:41.230690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:19:41.232000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:19:41.232471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:19:41.232907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:19:41.233387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:19:41.245131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.245587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.246621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.247235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.268410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:41.275922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for user 71080496c33c4e2c8b2e16b950f0b9ea and project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:41.292139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:19:41.294665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:19:41.407334 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab65f29f-ee8b-43e8-8e80-2f9ec884ad0b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664442 May 14 21:19:41.408183 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1301/2444] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:19:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:19:41.413208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:41.414118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:41.420794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.428951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.428951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.428951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.518061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4fca01a-ac57-4917-abd3-498b070a4f1e tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/774e4d8c-2698-4690-9188-4e186d3008cd" status: 202 len: 0 microversion: 2.1 time: 0.312071 May 14 21:19:41.518061 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1144/2445] 10.222.0.52 () {58 vars in 1286 bytes} [Sat May 14 21:19:41 2022] DELETE /compute/v2.1/os-security-group-rules/774e4d8c-2698-4690-9188-4e186d3008cd => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:41.538217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:41.540827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:41.552127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.553261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.554663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.555469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.600266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:41.609302 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7e6d2efb-3c77-4ceb-9989-776621c97398 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1473 microversion: 2.1 time: 0.199741 May 14 21:19:41.610295 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1302/2446] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:41 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1473 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:41.624899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:41.625549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:41.633473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.633992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.635045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.635523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.730361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:41.739909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:41.742081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:41.747750 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c16b5b18-f695-492e-84e9-bf610a633eed tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.227063 May 14 21:19:41.747750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1145/2447] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:41 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:41.750344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-649bc0d3-4ef6-4724-9b2e-1d7206edcf69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:41.752833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-649bc0d3-4ef6-4724-9b2e-1d7206edcf69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:41.791019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:41.799149 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1ec5790-770b-4672-bc1e-987f3a7af093 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.178005 May 14 21:19:41.800939 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1303/2448] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:41 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:41.808616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c47b4c6d-3770-4856-9a79-30096f30f956 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1b97a7550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1611476771", "description": "tempest-description-30607552"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:41.812686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-649bc0d3-4ef6-4724-9b2e-1d7206edcf69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:41.819947 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-649bc0d3-4ef6-4724-9b2e-1d7206edcf69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1215 microversion: 2.1 time: 0.074508 May 14 21:19:41.820530 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1146/2449] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:41 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:41.828444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:41.829216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:41.835933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.836400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.837195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:41.837650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:41.986805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:41.994903 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-596a7942-66e1-408a-9328-352478bec522 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.173346 May 14 21:19:41.998126 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1147/2450] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:41 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:42.214699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c47b4c6d-3770-4856-9a79-30096f30f956 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.409952 May 14 21:19:42.215359 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1304/2451] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:19:41 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:42.228209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1a1fc2d-6030-4f17-879d-c5740395bbf1 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1a77b10d0>, body: {"security_group_rule": {"parent_group_id": "8e1221b5-26dd-4e3b-902e-9bc56abefafb", "ip_protocol": "tcp", "from_port": 2022672958, "to_port": 22}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:42.274556 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d1a1fc2d-6030-4f17-879d-c5740395bbf1 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: Invalid port range 2022672958:22. Former value cannot be greater than the later May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1a1fc2d-6030-4f17-879d-c5740395bbf1 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 146 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: {"security_group_rule": {"parent_group_id": "8e1221b5-26dd-4e3b-902e-9bc56abefafb", "ip_protocol": "tcp", "from_port": 2022672958, "to_port": 22}} May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid port range 2022672958:22. Former value cannot be greater than the later May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8e1221b5-26dd-4e3b-902e-9bc56abefafb', 'ip_protocol': 'tcp', 'from_port': 2022672958, 'to_port': 22}}} May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 2022672958:22. Former value cannot be greater than the later May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 2022672958:22. Former value cannot be greater than the later May 14 21:19:42.276328 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 2022672958:22. Former value cannot be greater than the later May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1a1fc2d-6030-4f17-879d-c5740395bbf1 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 400 to user: Invalid port range 2022672958:22. Former value cannot be greater than the later {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d1a1fc2d-6030-4f17-879d-c5740395bbf1 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.053629 May 14 21:19:42.281999 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1148/2452] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:42 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:19:42.288190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2963247c-fb10-4492-b26d-767f4177ae19 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1b98cd8b0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-559550408", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2963247c-fb10-4492-b26d-767f4177ae19 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: Security group id should be uuid May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2963247c-fb10-4492-b26d-767f4177ae19 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 130 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-559550408", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group id should be uuid May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-559550408', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:42.293721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2963247c-fb10-4492-b26d-767f4177ae19 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 400 to user: Security group id should be uuid {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2963247c-fb10-4492-b26d-767f4177ae19 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.008893 May 14 21:19:42.298346 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1305/2453] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:42 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:19:42.302668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-116c7c5c-419b-476c-b96d-5bf3de910a3c tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1a77889d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-901171102", "description": "tempest-description-746360902"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:42.627222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:42.627957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:42.636532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:42.637144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:42.638065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:42.638922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.036521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:43.048107 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca51e7a1-3b70-4a40-864b-90728bfad940 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1473 microversion: 2.1 time: 0.423434 May 14 21:19:43.048107 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1306/2454] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:42 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:43.061255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:43.062800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:43.072509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.073224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.074204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.074833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.141358 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-116c7c5c-419b-476c-b96d-5bf3de910a3c tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.842551 May 14 21:19:43.150842 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1149/2455] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:19:42 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:43.157763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:43.163191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:43.200478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.213802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.213802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.213802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.531941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:43.550739 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c2245cc-050b-4af3-9427-7ae1bc06dcae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.388712 May 14 21:19:43.550739 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1150/2456] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:43 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:43.550739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:43.550739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:43.553947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.554413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.555212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.555711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.624493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:43.633608 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d7e06a74-85ae-4b59-bb75-1d4198489c73 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1267 microversion: 2.1 time: 0.090505 May 14 21:19:43.634875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1151/2457] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:43 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:43.640258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:43.641338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:43.650017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.650736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.651734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.653341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.703943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:43.712986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:43.714525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:43.715756 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c25edff5-8ed9-48e5-bd9e-405a4fcef692 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.658910 May 14 21:19:43.716695 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1307/2458] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:43 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:43.721966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30fe6c41-e5a5-40fe-abba-b09790006b84 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1b97c3c10>, body: {"security_group_rule": {"parent_group_id": "d4741238-beef-42e2-9910-e21316a0d4b2", "ip_protocol": "tempest-999-1218497180", "from_port": 22, "to_port": 22}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:43.866942 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-30fe6c41-e5a5-40fe-abba-b09790006b84 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: Invalid IP protocol tempest-999-1218497180. May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30fe6c41-e5a5-40fe-abba-b09790006b84 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 157 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: {"security_group_rule": {"parent_group_id": "d4741238-beef-42e2-9910-e21316a0d4b2", "ip_protocol": "tempest-999-1218497180", "from_port": 22, "to_port": 22}} May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid IP protocol tempest-999-1218497180. May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd4741238-beef-42e2-9910-e21316a0d4b2', 'ip_protocol': 'tempest-999-1218497180', 'from_port': 22, 'to_port': 22}}} May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1218497180. May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1218497180. May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:43.869239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1218497180. May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30fe6c41-e5a5-40fe-abba-b09790006b84 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 400 to user: Invalid IP protocol tempest-999-1218497180. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-30fe6c41-e5a5-40fe-abba-b09790006b84 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.155459 May 14 21:19:43.875160 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1308/2459] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:43 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:19:43.881323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d085c48b-e722-43c3-bf72-0e1257299b20 req-f07753f1-7f25-4a18-ad97-c8436dde4ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "327460c9-f487-4dc2-8b71-495cf16c0620", "tag": "ecde66c9-4927-4dbe-8a39-269b76b9b996"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:43.902431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d085c48b-e722-43c3-bf72-0e1257299b20 req-f07753f1-7f25-4a18-ad97-c8436dde4ffa service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:43.902989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d085c48b-e722-43c3-bf72-0e1257299b20 req-f07753f1-7f25-4a18-ad97-c8436dde4ffa service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:43.933182 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d085c48b-e722-43c3-bf72-0e1257299b20 req-f07753f1-7f25-4a18-ad97-c8436dde4ffa service nova] Creating event network-changed:ecde66c9-4927-4dbe-8a39-269b76b9b996 for instance 327460c9-f487-4dc2-8b71-495cf16c0620 on nch2-master-1 May 14 21:19:43.938510 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d085c48b-e722-43c3-bf72-0e1257299b20 req-f07753f1-7f25-4a18-ad97-c8436dde4ffa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063123 May 14 21:19:43.938746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:43.939697 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1309/2460] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:43.946903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4621d87-24e4-424c-bd62-e76b43b14878 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1b97c35e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2050629647", "description": "tempest-description-431659457"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:43.954159 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2bb55cec-b24e-4398-a76c-b584c4b28c05 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1505 microversion: 2.1 time: 0.317433 May 14 21:19:43.957511 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1152/2461] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:43 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:44.065168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:44.066362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:44.074774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:44.075345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:44.076707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:44.077376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:44.490931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:44.513587 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e75a8f76-d257-498f-9ef6-4a41ba82c5fc tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1431 microversion: 2.1 time: 0.455147 May 14 21:19:44.514386 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1153/2462] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:44 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1431 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:44.519958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e5c66316-9192-495a-98ad-085780fc02aa req-072985de-1530-4e3b-8df0-4d174e3c735b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebd3dc2-1a09-4160-9276-8df5efb2fa05", "name": "network-vif-deleted", "tag": "93c7b375-0812-49e1-b96d-0fc14fa1a724"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:44.531873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e5c66316-9192-495a-98ad-085780fc02aa req-072985de-1530-4e3b-8df0-4d174e3c735b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:44.532624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e5c66316-9192-495a-98ad-085780fc02aa req-072985de-1530-4e3b-8df0-4d174e3c735b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:44.547237 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e5c66316-9192-495a-98ad-085780fc02aa req-072985de-1530-4e3b-8df0-4d174e3c735b service nova] Creating event network-vif-deleted:93c7b375-0812-49e1-b96d-0fc14fa1a724 for instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 on nch2-master-1 May 14 21:19:44.554079 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e5c66316-9192-495a-98ad-085780fc02aa req-072985de-1530-4e3b-8df0-4d174e3c735b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037410 May 14 21:19:44.554707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1154/2463] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:44.566094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:44.566094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:44.575253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:44.576301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:44.577171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:44.577624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:44.626672 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b4621d87-24e4-424c-bd62-e76b43b14878 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.685322 May 14 21:19:44.628431 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1310/2464] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:19:43 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:44.640170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d757a053-305d-4782-9518-02c08d635646 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1b98c84c0>, body: {"security_group_rule": {"parent_group_id": "0d065ddc-22a8-4349-a852-0be85d79ba24", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:44.709317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d757a053-305d-4782-9518-02c08d635646 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d757a053-305d-4782-9518-02c08d635646 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 138 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: {"security_group_rule": {"parent_group_id": "0d065ddc-22a8-4349-a852-0be85d79ba24", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0d065ddc-22a8-4349-a852-0be85d79ba24', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 14 21:19:44.711075 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d757a053-305d-4782-9518-02c08d635646 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:44.715513 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d757a053-305d-4782-9518-02c08d635646 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.078169 May 14 21:19:44.726891 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1311/2465] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:44 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:19:44.739333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:44.741384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:44.750022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:44.753066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:44.753066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:44.753066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:44.821858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:44.829860 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-57bcb189-e79c-4a1c-a8fc-b0ff1ea9f083 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1273 microversion: 2.1 time: 0.111511 May 14 21:19:44.830509 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1312/2466] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:44 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:44.844345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d0ce23b-15f7-4df6-a718-ddeabf1be683 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1b98c8430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1776501054", "description": "tempest-description-537240950"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:45.063378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:45.081673 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46c1f8b8-d4be-4b20-aad9-6b53f5c8dcc6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.524318 May 14 21:19:45.091311 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1155/2467] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:44 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:45.091311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:45.091311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:45.109576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.110041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.111061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.111527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.372932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:45.382831 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d0ce23b-15f7-4df6-a718-ddeabf1be683 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.545476 May 14 21:19:45.383762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1313/2468] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:19:44 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:45.396803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:45.398637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:45.399368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:45.400440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:45.401927 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53bb8a9c-63df-46f5-aff2-2b335acab2b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.317725 May 14 21:19:45.402748 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1156/2469] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:45 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:45.405733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.406394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.407358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.408003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.408257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c06dcb78-5603-4669-9b76-52f98e0ab9fd tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1a784c310>, body: {"security_group_rule": {"parent_group_id": "9f460215-eb78-4789-a85c-775aca371459", "ip_protocol": "tcp", "from_port": 22, "to_port": 821541581}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:45.442023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.442484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.442951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lazy-loading 'fault' on Instance uuid ce274e08-ca06-45ce-aa97-0149f081eb19 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:45.500886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:45.511688 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-05fdf482-9211-4e18-a16a-8e364bec3726 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 200 len: 1303 microversion: 2.1 time: 0.125990 May 14 21:19:45.512293 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1314/2470] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:45 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:45.521813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:45.522797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:45.531051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.531051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.531051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.531051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.558371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:45.681816 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-c06dcb78-5603-4669-9b76-52f98e0ab9fd tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: Invalid port range 22:821541581. Valid TCP ports should be between 1-65535 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c06dcb78-5603-4669-9b76-52f98e0ab9fd tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 145 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: {"security_group_rule": {"parent_group_id": "9f460215-eb78-4789-a85c-775aca371459", "ip_protocol": "tcp", "from_port": 22, "to_port": 821541581}} May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid port range 22:821541581. Valid TCP ports should be between 1-65535 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9f460215-eb78-4789-a85c-775aca371459', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 821541581}}} May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:821541581. Valid TCP ports should be between 1-65535 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:821541581. Valid TCP ports should be between 1-65535 May 14 21:19:45.683579 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:821541581. Valid TCP ports should be between 1-65535 May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c06dcb78-5603-4669-9b76-52f98e0ab9fd tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 400 to user: Invalid port range 22:821541581. Valid TCP ports should be between 1-65535 {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c06dcb78-5603-4669-9b76-52f98e0ab9fd tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.280993 May 14 21:19:45.689353 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1157/2471] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:45 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:19:45.693461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:45.694105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:45.706326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.706913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.707722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.708415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.741938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.742401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.742869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lazy-loading 'fault' on Instance uuid aebd3dc2-1a09-4160-9276-8df5efb2fa05 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:45.829815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '154d05e107d74202beabaa0b60dab8c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c562e1e1414d32b858e08cb6379e8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:45.842741 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab1b248b-c2a4-4bf8-9ad2-9b2d3f03ff5b tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 200 len: 1307 microversion: 2.1 time: 0.151454 May 14 21:19:45.842741 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1158/2472] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:45 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:45.843793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cadb2ee8-7ff4-4847-ac12-bb17c71c1a58 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Action: 'create', calling method: .version_select at 0x7fb1a77ef940>, body: {"security_group_rule": {"parent_group_id": "72ac3b72-10fd-41fc-8c11-601bb8c981c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:45.958695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-cadb2ee8-7ff4-4847-ac12-bb17c71c1a58 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:19:45.959911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-cadb2ee8-7ff4-4847-ac12-bb17c71c1a58 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Neutron security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:19:45.960455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-cadb2ee8-7ff4-4847-ac12-bb17c71c1a58 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist May 14 21:19:45.960455 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-522bd38a-c1d6-494c-a266-34552102f044'] May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cadb2ee8-7ff4-4847-ac12-bb17c71c1a58 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 138 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: {"security_group_rule": {"parent_group_id": "72ac3b72-10fd-41fc-8c11-601bb8c981c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-522bd38a-c1d6-494c-a266-34552102f044'] May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'security_group_rule': {'parent_group_id': '72ac3b72-10fd-41fc-8c11-601bb8c981c0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:19:45.962478 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-522bd38a-c1d6-494c-a266-34552102f044'] May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-522bd38a-c1d6-494c-a266-34552102f044'] May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-522bd38a-c1d6-494c-a266-34552102f044'] May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-522bd38a-c1d6-494c-a266-34552102f044'] May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cadb2ee8-7ff4-4847-ac12-bb17c71c1a58 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 404 to user: Security group 72ac3b72-10fd-41fc-8c11-601bb8c981c0 does not exist May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-522bd38a-c1d6-494c-a266-34552102f044'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cadb2ee8-7ff4-4847-ac12-bb17c71c1a58 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.124410 May 14 21:19:45.968904 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1159/2473] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:19:45 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:45.975574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:45.975574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:45.981592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc9fe30c-f7f9-4712-a8d2-325519fc8d9e tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 204 len: 0 microversion: 2.1 time: 0.467782 May 14 21:19:45.983236 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1315/2474] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:45 2022] DELETE /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:45.985033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.985033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.985033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:45.985033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:45.992988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84735ed2-ad6b-4c72-8fce-e1dd8c1fce44 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Calling method '.version_select at 0x7fb1b978c430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.023905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-84735ed2-ad6b-4c72-8fce-e1dd8c1fce44 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:19:46.025604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-84735ed2-ad6b-4c72-8fce-e1dd8c1fce44 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Neutron security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 not found {{(pid=130638) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 14 21:19:46.026224 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-84735ed2-ad6b-4c72-8fce-e1dd8c1fce44 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] HTTP exception thrown: Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist May 14 21:19:46.026224 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c0473a64-673b-41fd-8a3d-699b2f3f486a'] May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84735ed2-ad6b-4c72-8fce-e1dd8c1fce44 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Request method failure captured: May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-group-rules/90241d6f-a787-404b-be1c-ba4b453e0f90 HTTP/1.1 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzrkLkHoYKrCfut-TC-zb-Xw4OeoHSUg_dcGyoqtZh4VHRZMXQbGCWdIuVitlHmRWaaz0CbVnieuhsPlfKHe_MKi7vaEtjJcgvJGWgR9ym5leocK5aLf42SDHMl11PIj951FDXTf1ThoNUqrc8OZvxSjt9hwEsWN49D9dlrxoszoAU May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/167a02a955b249cd9d3bd1bd34d95954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_167a02a955b249cd9d3bd1bd34d95954", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 167a02a955b249cd9d3bd1bd34d95954 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 35a7420bb78247a7a0c3af7878af6bcc May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c0473a64-673b-41fd-8a3d-699b2f3f486a'] May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '90241d6f-a787-404b-be1c-ba4b453e0f90'} May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:19:46.028422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0473a64-673b-41fd-8a3d-699b2f3f486a'] May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0473a64-673b-41fd-8a3d-699b2f3f486a'] May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0473a64-673b-41fd-8a3d-699b2f3f486a'] May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c0473a64-673b-41fd-8a3d-699b2f3f486a'] May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84735ed2-ad6b-4c72-8fce-e1dd8c1fce44 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Returning 404 to user: Security group rule 90241d6f-a787-404b-be1c-ba4b453e0f90 does not exist May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c0473a64-673b-41fd-8a3d-699b2f3f486a'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:46.034186 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84735ed2-ad6b-4c72-8fce-e1dd8c1fce44 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/90241d6f-a787-404b-be1c-ba4b453e0f90" status: 404 len: 199 microversion: 2.1 time: 0.047157 May 14 21:19:46.037496 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1316/2475] 10.222.0.52 () {58 vars in 1286 bytes} [Sat May 14 21:19:45 2022] DELETE /compute/v2.1/os-security-group-rules/90241d6f-a787-404b-be1c-ba4b453e0f90 => generated 199 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:46.042409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.044139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:46.050562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.051026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.051863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.052313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.118511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:46.126554 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4daa9a03-8af5-4ce1-87f9-0d5c1a55d6d1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1273 microversion: 2.1 time: 0.156705 May 14 21:19:46.127137 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1160/2476] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:45 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:46.134079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eec1a25b-9520-43bb-b4f6-d7188b9f76fb tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Calling method '.version_select at 0x7fb1a778ad30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.189553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:46.199484 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4a426478-9c5b-43ee-99b9-13aa35b0c429 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1500 microversion: 2.1 time: 0.160784 May 14 21:19:46.200097 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1317/2477] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:46 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1500 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:46.205204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.206417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:46.213203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.213662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.214450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.214895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.365565 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:46.374046 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b32fd7dd-dd7d-4f41-9cea-2139926d3b16 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.172793 May 14 21:19:46.374749 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1318/2478] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:46 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:46.420445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.421545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:46.430010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.430482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.431273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.431961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.660792 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eec1a25b-9520-43bb-b4f6-d7188b9f76fb tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9f460215-eb78-4789-a85c-775aca371459" status: 202 len: 0 microversion: 2.1 time: 0.530891 May 14 21:19:46.664463 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1161/2479] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:19:46 2022] DELETE /compute/v2.1/os-security-groups/9f460215-eb78-4789-a85c-775aca371459 => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:46.667046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.668005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: ce274e08-ca06-45ce-aa97-0149f081eb19] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:46.672051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:46.685298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:46.686806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:46.688151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8b6c1f8-b006-4618-9d24-b67cd3cabadb tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.271754 May 14 21:19:46.688906 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1319/2480] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:46 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:46.695179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.695815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.696444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.696889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.703042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-44e05c87-80a8-4220-86f8-db5e9dd6ad7e req-0f541ebb-0eca-4889-a71b-bbbf2a56f041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce274e08-ca06-45ce-aa97-0149f081eb19", "name": "network-vif-deleted", "tag": "7b6bd46d-2f3e-4883-8027-72b762aafcce"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:46.712002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-44e05c87-80a8-4220-86f8-db5e9dd6ad7e req-0f541ebb-0eca-4889-a71b-bbbf2a56f041 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.712457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-44e05c87-80a8-4220-86f8-db5e9dd6ad7e req-0f541ebb-0eca-4889-a71b-bbbf2a56f041 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.715814 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] HTTP exception thrown: Instance ce274e08-ca06-45ce-aa97-0149f081eb19 could not be found. May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Request method failure captured: May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 HTTP/1.1 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBxqsYbrE-yvvgUON0HspCwXPurkKkgjmXWrArubVwFvur4se1jD29Q6vIQj3p2OjcpEdy1rHEKQmoMhGlwNmj5CQPUCNRKEQ1SG8H_uy7aGpQHhMZ427jvMiYC9rzb4Afln13XAB1C7mWoWKlklbJWwc0UMtkEgD9SgQQrucTrbhus May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 7c7360a8f423452e97311ffc9675e801 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueTestJSON-1912036723 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c7360a8f423452e97311ffc9675e801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c7360a8f423452e97311ffc9675e801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7c7360a8f423452e97311ffc9675e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7c7360a8f423452e97311ffc9675e801", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueTestJSON-1912036723 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 7c7360a8f423452e97311ffc9675e801 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueTestJSON-1912036723 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueTestJSON-1912036723-project May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 8bb480362ced445da9819798a17819c3 May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueTestJSON-1912036723-project May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance ce274e08-ca06-45ce-aa97-0149f081eb19 could not be found. May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ce274e08-ca06-45ce-aa97-0149f081eb19'} May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce274e08-ca06-45ce-aa97-0149f081eb19 could not be found. May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce274e08-ca06-45ce-aa97-0149f081eb19 could not be found. May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:46.717758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:46.723438 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:46.723438 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:46.723438 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:46.723438 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:46.723438 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:46.723438 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce274e08-ca06-45ce-aa97-0149f081eb19 could not be found. May 14 21:19:46.723438 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:46.726796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Returning 404 to user: Instance ce274e08-ca06-45ce-aa97-0149f081eb19 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:46.726918 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-44e05c87-80a8-4220-86f8-db5e9dd6ad7e req-0f541ebb-0eca-4889-a71b-bbbf2a56f041 service nova] Creating event network-vif-deleted:7b6bd46d-2f3e-4883-8027-72b762aafcce for instance ce274e08-ca06-45ce-aa97-0149f081eb19 on nch1-master-1 May 14 21:19:46.727028 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d724a64-528d-449d-aef3-ac9068eac5a9 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19" status: 404 len: 111 microversion: 2.1 time: 0.063669 May 14 21:19:46.728321 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1162/2481] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:46 2022] GET /compute/v2.1/servers/ce274e08-ca06-45ce-aa97-0149f081eb19 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:46.734476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-031ae421-bd91-4d3f-b862-9e9a151df3de tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Calling method '.version_select at 0x7fb1a77e9820>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.735096 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-44e05c87-80a8-4220-86f8-db5e9dd6ad7e req-0f541ebb-0eca-4889-a71b-bbbf2a56f041 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045050 May 14 21:19:46.735833 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1320/2482] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:46.743446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:46.744075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:46.754284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.754908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.756049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:46.756410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:46.785805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:47.136792 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd45b5e0-3525-4c84-8db9-5a393e0ea816 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 204 len: 0 microversion: 2.1 time: 0.397161 May 14 21:19:47.138338 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1321/2483] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:46 2022] DELETE /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:47.145811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:47.146791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] [instance: aebd3dc2-1a09-4160-9276-8df5efb2fa05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:47.153722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.154342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.154985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.155423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.178831 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] HTTP exception thrown: Instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 could not be found. May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Request method failure captured: May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 HTTP/1.1 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBwsWtqmE1LcI_KZME6PjzHqA1K8jyJDiW1t5ZNrkqDh1w5_EVil5_9RumKAkv1EM26DSCi8H7GiCi5YVczwHe-2SmOSoiIZZi48epThKHM5jx3yhp1Lfpa80ZHMHrHzT3Vc6kMd5h376UzO9TGxVKLoIuwCOLUO4abq0pwivkYqkQw May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a1c562e1e1414d32b858e08cb6379e8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a1c562e1e1414d32b858e08cb6379e8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a1c562e1e1414d32b858e08cb6379e8a May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-480636702 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 154d05e107d74202beabaa0b60dab8c8 May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersOnMultiNodesTest-480636702-project May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 could not be found. May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'aebd3dc2-1a09-4160-9276-8df5efb2fa05'} May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 could not be found. May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 could not be found. May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:47.180559 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 could not be found. May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] Returning 404 to user: Instance aebd3dc2-1a09-4160-9276-8df5efb2fa05 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba62f2c8-7b29-45ae-bdb1-a0d4f33a6660 tempest-ServersOnMultiNodesTest-480636702 tempest-ServersOnMultiNodesTest-480636702-project] 10.222.0.52 "GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05" status: 404 len: 111 microversion: 2.1 time: 0.042218 May 14 21:19:47.186697 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1322/2484] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:47 2022] GET /compute/v2.1/servers/aebd3dc2-1a09-4160-9276-8df5efb2fa05 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:47.187880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:47.187880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:47.197437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.198201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.199181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.199661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.241051 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-031ae421-bd91-4d3f-b862-9e9a151df3de tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/0d065ddc-22a8-4349-a852-0be85d79ba24" status: 202 len: 0 microversion: 2.1 time: 0.510543 May 14 21:19:47.242411 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1163/2485] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:19:46 2022] DELETE /compute/v2.1/os-security-groups/0d065ddc-22a8-4349-a852-0be85d79ba24 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:47.249953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:47.251792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:47.271305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.272048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.273049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.273811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.403995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:47.413004 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d5b4ca0-12a7-4e9a-b974-7d02e3e3ee8c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.228963 May 14 21:19:47.414964 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1323/2486] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:47 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:47.425991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:47.426953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:47.434382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.435759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.441226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.441226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.530623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:47.540121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8e27182-16a2-4164-9300-0c2839ba1e68 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1493 microversion: 2.1 time: 0.296369 May 14 21:19:47.549824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:47.551324 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1164/2487] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:47 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1493 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:47.556601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f3ce9d1-778e-4cc9-bbcb-1ca0729c9f21 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Calling method '.version_select at 0x7fb1a785c9d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:47.574163 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-26494d65-0eb4-49c8-9c34-f361a13da66f tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 200 len: 1296 microversion: 2.1 time: 0.156952 May 14 21:19:47.575085 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1324/2488] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:47 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 1296 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:47.580047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:47.580956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:47.588776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.589240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.590252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.590872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.739659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:47.756094 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68f8eb5d-f653-454f-87a5-ad05a034cc15 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.174839 May 14 21:19:47.756726 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1325/2489] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:47 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:47.762365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:47.769991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:47.777553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.778239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.779033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:47.779540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:47.917296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:47.926822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:47.928479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:47.929747 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-60107aa1-c7ea-49d2-90d8-d402f7ac11b4 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1484 microversion: 2.25 time: 0.171377 May 14 21:19:47.930396 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1326/2490] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:47 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1484 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:48.025345 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f3ce9d1-778e-4cc9-bbcb-1ca0729c9f21 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/d4741238-beef-42e2-9910-e21316a0d4b2" status: 202 len: 0 microversion: 2.1 time: 0.472543 May 14 21:19:48.030357 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1165/2491] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:19:47 2022] DELETE /compute/v2.1/os-security-groups/d4741238-beef-42e2-9910-e21316a0d4b2 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:48.035139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f19e0b1d-4b6e-40c0-b7c0-8dd5c3749839 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Calling method '.version_select at 0x7fb1b97dbc10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:48.092531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a230a7c0-42a1-40f4-9138-fe9d0259daef req-e817966b-7e6f-4555-b389-b19f5cadf91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2e74105-d641-42cc-8282-4c6d13ec0581", "tag": "1c2acd91-d9e5-4266-97e0-03e3c6564b39"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:48.115218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a230a7c0-42a1-40f4-9138-fe9d0259daef req-e817966b-7e6f-4555-b389-b19f5cadf91a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.115709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a230a7c0-42a1-40f4-9138-fe9d0259daef req-e817966b-7e6f-4555-b389-b19f5cadf91a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.131109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a230a7c0-42a1-40f4-9138-fe9d0259daef req-e817966b-7e6f-4555-b389-b19f5cadf91a service nova] Creating event network-changed:1c2acd91-d9e5-4266-97e0-03e3c6564b39 for instance b2e74105-d641-42cc-8282-4c6d13ec0581 on nch1-master-1 May 14 21:19:48.136893 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a230a7c0-42a1-40f4-9138-fe9d0259daef req-e817966b-7e6f-4555-b389-b19f5cadf91a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059365 May 14 21:19:48.137948 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1166/2492] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:48.354474 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f19e0b1d-4b6e-40c0-b7c0-8dd5c3749839 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/8e1221b5-26dd-4e3b-902e-9bc56abefafb" status: 202 len: 0 microversion: 2.1 time: 0.323381 May 14 21:19:48.375845 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1327/2493] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:19:48 2022] DELETE /compute/v2.1/os-security-groups/8e1221b5-26dd-4e3b-902e-9bc56abefafb => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:19:48.379774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff168ca2-104d-4388-9089-0ae6aa288405 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] Calling method '.version_select at 0x7fb1a785c040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:48.436286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:48.436933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:48.444535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.446433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.446433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.446433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.625669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:48.636035 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-44bab20e-b20e-4b78-8405-a97917c3461c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.209296 May 14 21:19:48.636663 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1328/2494] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:48 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:48.647717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:48.649181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:48.658413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.659407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.660323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.660966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.826708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:48.836767 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a79a8f16-bfc2-4c3c-b814-5bdc12cceae8 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1493 microversion: 2.1 time: 0.199025 May 14 21:19:48.837695 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1329/2495] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:48 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1493 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:48.853881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:48.854812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:48.863313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.863719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.866362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.866362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.882233 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] HTTP exception thrown: Instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 could not be found. May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Request method failure captured: May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 HTTP/1.1 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuFY4g0wq4WgHSemyKorU8Z1KEdyjn56SNZqlZwUQb-5uBMAAKkVZOMQ32XFxNHWahLYnBaStRJN6BmuO6R1-ghItgt_Y5AvHjsczvOf2pq0BEmvGK37gqHJFIzJrlVFvhlwZKT6mK6YqYfeqyQNiw5WNm9mHDg0_BCVWUFd--4QDk May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-LiveMigrationTest-772526 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_763cf73206604d8abbe1542afe44fa95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-LiveMigrationTest-772526 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-LiveMigrationTest-772526 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-LiveMigrationTest-772526-project May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 038739f45c3d4ab09457d6eed20b41d4 May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-LiveMigrationTest-772526-project May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 could not be found. May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2'} May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 could not be found. May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 could not be found. May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:48.883866 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 could not be found. May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Returning 404 to user: Instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d27d168e-b999-4d7a-91ce-4cb754fdc096 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2" status: 404 len: 111 microversion: 2.1 time: 0.037047 May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1330/2496] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:48 2022] GET /compute/v2.1/servers/6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:48.898608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-05cda196-a025-49c8-a0ec-d2019cb9a592 req-c9d64060-1e0f-47f2-a17c-b7c2549fd01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2", "name": "network-vif-deleted", "tag": "ec8012be-be33-462f-961b-6c852f9a37d4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:48.902130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-05cda196-a025-49c8-a0ec-d2019cb9a592 req-c9d64060-1e0f-47f2-a17c-b7c2549fd01d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.902585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-05cda196-a025-49c8-a0ec-d2019cb9a592 req-c9d64060-1e0f-47f2-a17c-b7c2549fd01d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.920663 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-05cda196-a025-49c8-a0ec-d2019cb9a592 req-c9d64060-1e0f-47f2-a17c-b7c2549fd01d service nova] Creating event network-vif-deleted:ec8012be-be33-462f-961b-6c852f9a37d4 for instance 6fd3b7a9-ef4c-4c53-96bf-acaa54f083d2 on nch1-master-1 May 14 21:19:48.934322 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-05cda196-a025-49c8-a0ec-d2019cb9a592 req-c9d64060-1e0f-47f2-a17c-b7c2549fd01d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046783 May 14 21:19:48.936499 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1331/2497] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:48.944442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:48.945193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:48.953053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.953877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:48.958792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:48.958792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.103641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:49.113350 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b9bf89d2-19ae-4b78-a9a8-d9f88e87d391 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.175479 May 14 21:19:49.113954 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1332/2498] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:48 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:49.136330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:49.137110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:49.151398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.152391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.153535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.154704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.195361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:49.286710 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff168ca2-104d-4388-9089-0ae6aa288405 tempest-SecurityGroupRulesNegativeTestJSON-1636161941 tempest-SecurityGroupRulesNegativeTestJSON-1636161941-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/23b2b053-8a5c-42d4-a604-0ef99a0ef831" status: 202 len: 0 microversion: 2.1 time: 0.925189 May 14 21:19:49.287306 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1167/2499] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:19:48 2022] DELETE /compute/v2.1/os-security-groups/23b2b053-8a5c-42d4-a604-0ef99a0ef831 => generated 0 bytes in 927 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:49.292206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:49.293009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:49.302237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.303458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.304121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.304816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.495295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:49.503551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:49.505118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:49.506289 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3bd1661b-08b3-408e-a5ca-fc434997807e tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1474 microversion: 2.25 time: 0.218015 May 14 21:19:49.506849 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1168/2500] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:49 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1474 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:49.525610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f456387e-0353-4e08-b599-aeff1e74ac5e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '.version_select at 0x7fb1a785cdc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:49.528492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f456387e-0353-4e08-b599-aeff1e74ac5e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.529502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f456387e-0353-4e08-b599-aeff1e74ac5e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.543051 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f456387e-0353-4e08-b599-aeff1e74ac5e tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/os-migrations" status: 200 len: 2784 microversion: 2.25 time: 0.022020 May 14 21:19:49.548258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1169/2501] 10.222.0.52 () {60 vars in 1183 bytes} [Sat May 14 21:19:49 2022] GET /compute/v2.1/os-migrations => generated 2784 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:49.569858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:49.570482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:49.576983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.577441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.578227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.578672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.619642 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7729c165-cc15-4ee4-98b5-3b379c85153d tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 204 len: 0 microversion: 2.1 time: 0.504071 May 14 21:19:49.621341 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1333/2502] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:49 2022] DELETE /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:49.630459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:49.631173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:49.637977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.638710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.639570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.640218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.785478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] Lazy-loading 'services' on Instance uuid 92b7a619-b4c9-41fa-ae67-011162dbdab2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:49.799471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f030eac-9bc8-4ed4-955d-6c123964797b tempest-LiveAutoBlockMigrationV225Test-1177449053 tempest-LiveAutoBlockMigrationV225Test-1177449053-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1964 microversion: 2.25 time: 0.233233 May 14 21:19:49.812236 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1170/2503] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:49 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1964 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:49.812236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:49.812236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:49.812236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.812236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.812795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.813082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.942060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:49.949923 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8bf62aac-6483-4841-96dc-6df4d9f819e7 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1484 microversion: 2.1 time: 0.324386 May 14 21:19:49.950510 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1334/2504] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:49 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1484 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:49.958279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:49.958795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:49.969375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.975729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:49.977214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:49.977858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.010454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:50.069032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:50.076440 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5b794c2d-c506-4d05-8d4e-afcd4f4bef53 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.275268 May 14 21:19:50.077334 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1171/2505] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:49 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:50.082703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:50.084652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:50.091781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.092249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.093034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.093656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.335772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:50.345510 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd1a48f2-43f0-4520-9078-637fac461db3 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1493 microversion: 2.1 time: 0.266889 May 14 21:19:50.347600 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1172/2506] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:50 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1493 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:50.351839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:50.353024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:50.359419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.363142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.363142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.363142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.419265 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf387ae4-3b96-4c30-bcae-cac9077aec84 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 204 len: 0 microversion: 2.25 time: 0.467037 May 14 21:19:50.421040 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1335/2507] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:19:49 2022] DELETE /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:19:50.430318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:50.431040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:50.438012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.438470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.439272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.440491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.587661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:50.598721 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01f283c7-4659-4e52-878a-4406dd4cb948 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.250827 May 14 21:19:50.599305 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1173/2508] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:50 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:50.604418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-db5d0169-6d61-4388-a21d-0029f58ad497 req-1f91762c-5c66-4a1e-8f74-088d1e4e0c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327460c9-f487-4dc2-8b71-495cf16c0620", "name": "network-vif-plugged", "status": "completed", "tag": "ecde66c9-4927-4dbe-8a39-269b76b9b996"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:50.615217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-db5d0169-6d61-4388-a21d-0029f58ad497 req-1f91762c-5c66-4a1e-8f74-088d1e4e0c51 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.620955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-db5d0169-6d61-4388-a21d-0029f58ad497 req-1f91762c-5c66-4a1e-8f74-088d1e4e0c51 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.628370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-db5d0169-6d61-4388-a21d-0029f58ad497 req-1f91762c-5c66-4a1e-8f74-088d1e4e0c51 service nova] Creating event network-vif-plugged:ecde66c9-4927-4dbe-8a39-269b76b9b996 for instance 327460c9-f487-4dc2-8b71-495cf16c0620 on nch2-master-1 May 14 21:19:50.633298 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-db5d0169-6d61-4388-a21d-0029f58ad497 req-1f91762c-5c66-4a1e-8f74-088d1e4e0c51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032763 May 14 21:19:50.633899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1174/2509] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:50.639307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:50.648132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:50.649719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:50.651022 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4594a263-23e0-4690-92b9-764cac5ae9e7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1480 microversion: 2.25 time: 0.225162 May 14 21:19:50.651604 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1336/2510] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:50 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1480 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:50.846936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-82f95972-cb16-4709-acf9-514e9443e6d4 req-96de4b70-ae29-4477-a35c-16e52f9957f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1158c4ab-5f12-4ba4-8ee6-a9b92aade119", "name": "network-vif-deleted", "tag": "90cac83b-ecf9-42a5-984e-9c943dbe93d1"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:50.857360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-82f95972-cb16-4709-acf9-514e9443e6d4 req-96de4b70-ae29-4477-a35c-16e52f9957f9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.857909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-82f95972-cb16-4709-acf9-514e9443e6d4 req-96de4b70-ae29-4477-a35c-16e52f9957f9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.872246 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-82f95972-cb16-4709-acf9-514e9443e6d4 req-96de4b70-ae29-4477-a35c-16e52f9957f9 service nova] Creating event network-vif-deleted:90cac83b-ecf9-42a5-984e-9c943dbe93d1 for instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 on nch2-master-1 May 14 21:19:50.878158 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-82f95972-cb16-4709-acf9-514e9443e6d4 req-96de4b70-ae29-4477-a35c-16e52f9957f9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038869 May 14 21:19:50.882619 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1175/2511] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:50.967288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:50.968382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:50.976046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.976613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:50.977468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:50.978161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.095447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:51.097962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:51.105289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.112753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.112753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.112753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.170649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:51.174257 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43192863-e053-4538-b9df-f58ad1d44b77 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1484 microversion: 2.1 time: 0.211102 May 14 21:19:51.177685 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1337/2512] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:50 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1484 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:51.261760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:51.278251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-374b3354-4b9a-496b-ad3e-072d58ab37f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.187091 May 14 21:19:51.281839 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1176/2513] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:51 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:51.365238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:51.366115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:51.373106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.373677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.374555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.375007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.448378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:51.457346 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e59d1fb-69a0-4b67-9efa-a59da679f1ae tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1285 microversion: 2.1 time: 0.097067 May 14 21:19:51.458776 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1338/2514] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:51 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:51.618939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:51.620468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:51.627136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.628259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.629146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.629604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.672877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:51.674963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:51.684737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.685207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.686059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:51.686522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:51.860401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:51.869151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:51.870737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:51.871950 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4d3f876e-3f7b-42d3-bb72-4f85eeee6262 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1480 microversion: 2.25 time: 0.203841 May 14 21:19:51.872523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1339/2515] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:51 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1480 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:51.938762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:51.949410 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b13b49f-d2ae-4007-9510-c8f3760ca19e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1313 microversion: 2.1 time: 0.334929 May 14 21:19:51.949980 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1177/2516] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:51 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:52.193108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:52.193930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:52.211530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.211530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.224021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.224938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.298727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:52.299397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:52.322502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.323294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.324339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.324961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.403280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:52.414123 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-61e62c2a-3bf3-4f80-9177-4892408f9048 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1442 microversion: 2.1 time: 0.225356 May 14 21:19:52.415234 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1340/2517] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:52 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1442 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:52.476602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:52.477721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:52.487958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.489571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.493958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.496084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.609613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.610417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.611140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lazy-loading 'fault' on Instance uuid 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:52.613279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:52.625467 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26adfc9b-a2e0-433a-a59d-1c9547b0235e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.330512 May 14 21:19:52.629338 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1178/2518] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:52 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:52.660845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb480362ced445da9819798a17819c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c7360a8f423452e97311ffc9675e801', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:52.672048 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71e665c4-f9f6-45a7-bfa4-633f4984632a tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 200 len: 1304 microversion: 2.1 time: 0.200073 May 14 21:19:52.683192 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1341/2519] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:52 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 1304 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:52.893067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:52.894380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:52.897234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46ac4668-93a3-4815-867b-08e4cedb149d tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:52.898902 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:19:52.898902 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:19:52.900257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46ac4668-93a3-4815-867b-08e4cedb149d tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.900723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46ac4668-93a3-4815-867b-08e4cedb149d tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.901568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46ac4668-93a3-4815-867b-08e4cedb149d tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.902146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46ac4668-93a3-4815-867b-08e4cedb149d tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.904769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.905844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.906989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.907858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.937012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46ac4668-93a3-4815-867b-08e4cedb149d tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.194376 May 14 21:19:52.937826 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1179/2520] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:19:52 2022] GET /compute/v2.1/os-services => generated 947 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:52.942241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-29cc4d43-6355-4baf-814e-4b1d6e19c96e req-be100e5a-32b4-473f-b0d7-1d2f60edb853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d79ef89-784c-4a52-803f-2961220d5f60", "name": "network-vif-deleted", "tag": "32c5ed60-6069-4c0c-9bc2-bd74c3e72ece"}, {"server_uuid": "92b7a619-b4c9-41fa-ae67-011162dbdab2", "name": "network-vif-deleted", "tag": "d403d7ba-1fe1-41c0-8b4a-8aedc3448d15"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:52.951877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-29cc4d43-6355-4baf-814e-4b1d6e19c96e req-be100e5a-32b4-473f-b0d7-1d2f60edb853 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.952332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-29cc4d43-6355-4baf-814e-4b1d6e19c96e req-be100e5a-32b4-473f-b0d7-1d2f60edb853 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.965380 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-29cc4d43-6355-4baf-814e-4b1d6e19c96e req-be100e5a-32b4-473f-b0d7-1d2f60edb853 service nova] Creating event network-vif-deleted:32c5ed60-6069-4c0c-9bc2-bd74c3e72ece for instance 7d79ef89-784c-4a52-803f-2961220d5f60 on nch1-master-1 May 14 21:19:52.965895 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-29cc4d43-6355-4baf-814e-4b1d6e19c96e req-be100e5a-32b4-473f-b0d7-1d2f60edb853 service nova] Creating event network-vif-deleted:d403d7ba-1fe1-41c0-8b4a-8aedc3448d15 for instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 on nch2-master-1 May 14 21:19:52.975375 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-29cc4d43-6355-4baf-814e-4b1d6e19c96e req-be100e5a-32b4-473f-b0d7-1d2f60edb853 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036543 May 14 21:19:52.976103 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1180/2521] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:52.982345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61bdace2-9f0e-4ad9-8601-cb7d4ed183d7 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:52.983716 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:19:52.983716 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:19:52.985076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61bdace2-9f0e-4ad9-8601-cb7d4ed183d7 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.985536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61bdace2-9f0e-4ad9-8601-cb7d4ed183d7 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.986379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61bdace2-9f0e-4ad9-8601-cb7d4ed183d7 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:52.987566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61bdace2-9f0e-4ad9-8601-cb7d4ed183d7 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:52.991833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:53.001854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:53.005376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:53.010711 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d9571d6-83c5-4a9d-a1f9-703e2a0e17d7 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1263 microversion: 2.25 time: 0.120885 May 14 21:19:53.010711 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1342/2522] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:52 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1263 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:19:53.011972 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-61bdace2-9f0e-4ad9-8601-cb7d4ed183d7 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.034307 May 14 21:19:53.018582 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1181/2523] 10.222.0.52 () {58 vars in 1173 bytes} [Sat May 14 21:19:52 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:53.022790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:53.023442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-941f1496-0857-4ae2-a983-208c98f702be tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:53.023616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:53.025020 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:19:53.025020 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:19:53.026254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-941f1496-0857-4ae2-a983-208c98f702be tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.026707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-941f1496-0857-4ae2-a983-208c98f702be tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.027725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-941f1496-0857-4ae2-a983-208c98f702be tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.028332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-941f1496-0857-4ae2-a983-208c98f702be tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.029640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.030126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.030901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.031356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.053869 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-941f1496-0857-4ae2-a983-208c98f702be tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033937 May 14 21:19:53.054465 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1182/2524] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:19:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:53.066889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbb0646f-6b1a-4a1e-8ef4-932fbdf1b861 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:53.068204 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:19:53.068204 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:19:53.069436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb0646f-6b1a-4a1e-8ef4-932fbdf1b861 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.069892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb0646f-6b1a-4a1e-8ef4-932fbdf1b861 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.070735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb0646f-6b1a-4a1e-8ef4-932fbdf1b861 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.071175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbb0646f-6b1a-4a1e-8ef4-932fbdf1b861 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.101764 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbb0646f-6b1a-4a1e-8ef4-932fbdf1b861 tempest-ServicesAdminTestJSON-1722146450 tempest-ServicesAdminTestJSON-1722146450-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.039057 May 14 21:19:53.102393 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1183/2525] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:19:53 2022] GET /compute/v2.1/os-services => generated 947 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:19:53.235434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:53.245608 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f659fb11-258f-41c4-9797-11e5561dc8ab tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1500 microversion: 2.1 time: 0.235482 May 14 21:19:53.246212 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1343/2526] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:53 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1500 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:53.269132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bfbc0b74-f2c9-4980-b3e0-6470781f1162 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:53.281511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfbc0b74-f2c9-4980-b3e0-6470781f1162 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.282403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfbc0b74-f2c9-4980-b3e0-6470781f1162 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.347716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bfbc0b74-f2c9-4980-b3e0-6470781f1162 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Going to try to stop instance {{(pid=130637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:19:53.430571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:53.432747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:53.447424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.447972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.448767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.449458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.510205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.511327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.513280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lazy-loading 'fault' on Instance uuid 7d79ef89-784c-4a52-803f-2961220d5f60 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:53.593172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:53.605714 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-57f058a7-6efe-4c8d-9524-cfee3ca5bbd0 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 200 len: 1301 microversion: 2.1 time: 0.178453 May 14 21:19:53.606283 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1344/2527] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:53 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 1301 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:53.621873 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bfbc0b74-f2c9-4980-b3e0-6470781f1162 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620/action" status: 202 len: 0 microversion: 2.1 time: 0.356986 May 14 21:19:53.622580 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1184/2528] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:19:53 2022] POST /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:19:53.645606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:53.646322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:53.650993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:53.651677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:53.669408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.670004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.670708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.673013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.675097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.675401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.676489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.678791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.863990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:53.874155 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6de90454-d3bf-4345-94b7-c583528386d0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.232994 May 14 21:19:53.875547 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1185/2529] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:53 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:53.882274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:53.883136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] [instance: 1158c4ab-5f12-4ba4-8ee6-a9b92aade119] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:53.891359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.891856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.892693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:53.893140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:53.918063 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] HTTP exception thrown: Instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 could not be found. May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Request method failure captured: May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 HTTP/1.1 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBxqsYbrE-yvvgUON0HspCwXPurkKkgjmXWrArubVwFvur4se1jD29Q6vIQj3p2OjcpEdy1rHEKQmoMhGlwNmj5CQPUCNRKEQ1SG8H_uy7aGpQHhMZ427jvMiYC9rzb4Afln13XAB1C7mWoWKlklbJWwc0UMtkEgD9SgQQrucTrbhus May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 7c7360a8f423452e97311ffc9675e801 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueTestJSON-1912036723 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c7360a8f423452e97311ffc9675e801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7c7360a8f423452e97311ffc9675e801"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7c7360a8f423452e97311ffc9675e801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7c7360a8f423452e97311ffc9675e801", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueTestJSON-1912036723 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 7c7360a8f423452e97311ffc9675e801 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueTestJSON-1912036723 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueTestJSON-1912036723-project May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 8bb480362ced445da9819798a17819c3 May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueTestJSON-1912036723-project May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 could not be found. May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1158c4ab-5f12-4ba4-8ee6-a9b92aade119'} May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 could not be found. May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 could not be found. May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:53.921024 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 could not be found. May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] Returning 404 to user: Instance 1158c4ab-5f12-4ba4-8ee6-a9b92aade119 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:53.929326 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7db3b794-6b39-446a-acc3-a16ae962fa87 tempest-ServerRescueTestJSON-1912036723 tempest-ServerRescueTestJSON-1912036723-project] 10.222.0.52 "GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119" status: 404 len: 111 microversion: 2.1 time: 0.047057 May 14 21:19:53.930133 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1186/2530] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:53 2022] GET /compute/v2.1/servers/1158c4ab-5f12-4ba4-8ee6-a9b92aade119 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:53.979361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:54.000630 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c726b37d-70c1-4c65-82aa-a5f9069dca5e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.368456 May 14 21:19:54.005755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1345/2531] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:53 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:54.029030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:54.029704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:54.039800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.041666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.041666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.041666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.080589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.081048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.081511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lazy-loading 'fault' on Instance uuid 92b7a619-b4c9-41fa-ae67-011162dbdab2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:54.142159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:54.150559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:54.152143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:54.153301 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3821bdb6-6c9c-45a1-b53e-5da0b2a14ef1 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 200 len: 1268 microversion: 2.25 time: 0.131078 May 14 21:19:54.153857 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1187/2532] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:54 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 1268 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:19:54.623566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:54.624876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 7d79ef89-784c-4a52-803f-2961220d5f60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:54.632595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.634395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.634395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.634395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.649022 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] HTTP exception thrown: Instance 7d79ef89-784c-4a52-803f-2961220d5f60 could not be found. May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Request method failure captured: May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 HTTP/1.1 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBuFY4g0wq4WgHSemyKorU8Z1KEdyjn56SNZqlZwUQb-5uBMAAKkVZOMQ32XFxNHWahLYnBaStRJN6BmuO6R1-ghItgt_Y5AvHjsczvOf2pq0BEmvGK37gqHJFIzJrlVFvhlwZKT6mK6YqYfeqyQNiw5WNm9mHDg0_BCVWUFd--4QDk May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-LiveMigrationTest-772526 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_763cf73206604d8abbe1542afe44fa95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-LiveMigrationTest-772526 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-LiveMigrationTest-772526 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-LiveMigrationTest-772526-project May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 038739f45c3d4ab09457d6eed20b41d4 May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-LiveMigrationTest-772526-project May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 7d79ef89-784c-4a52-803f-2961220d5f60 could not be found. May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '7d79ef89-784c-4a52-803f-2961220d5f60'} May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d79ef89-784c-4a52-803f-2961220d5f60 could not be found. May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d79ef89-784c-4a52-803f-2961220d5f60 could not be found. May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:54.650721 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d79ef89-784c-4a52-803f-2961220d5f60 could not be found. May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Returning 404 to user: Instance 7d79ef89-784c-4a52-803f-2961220d5f60 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5cd60902-df51-4f51-b863-aabe6853e504 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60" status: 404 len: 111 microversion: 2.1 time: 0.032695 May 14 21:19:54.656120 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1346/2533] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:54 2022] GET /compute/v2.1/servers/7d79ef89-784c-4a52-803f-2961220d5f60 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:54.663511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:54.663511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:54.668255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.668712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.669508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.669961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.707014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:19:54.892761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:54.909842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:54.911372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.912070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:54.912951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:54.913396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.094598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:55.103344 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4355c473-eed2-45b4-8fce-23fb388967d7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.214746 May 14 21:19:55.104165 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1347/2534] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:54 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:55.108820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:55.109435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:55.115654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:55.116105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.117081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:55.117520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.154825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f91de6f-c9c6-426d-9342-a0bfc2fc23a9 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 204 len: 0 microversion: 2.1 time: 0.497449 May 14 21:19:55.155939 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1188/2535] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:19:54 2022] DELETE /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:19:55.274332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:55.282354 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cc4c544-cb4c-455e-ba99-f62455ae9646 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.177176 May 14 21:19:55.282945 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1348/2536] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:55 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:55.288007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:55.288976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:55.295983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:55.296787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.299314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:55.299314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.461887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:55.469817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-428cd0b8-ac9a-4a5f-8f27-d3af9a266d6f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1a785a700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1481639373", "description": "tempest-description-829415626"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:55.470003 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-658f1dd2-cf2f-4334-92d8-6af3356233c4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1499 microversion: 2.1 time: 0.185701 May 14 21:19:55.470598 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1349/2537] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:55 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1499 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:55.476267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:55.477134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 92b7a619-b4c9-41fa-ae67-011162dbdab2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:55.484234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:55.484724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.485501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:55.485948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.500487 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] HTTP exception thrown: Instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 could not be found. May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Request method failure captured: May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 HTTP/1.1 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvSCxyaZ3qxNvPjEfuyrbRAKJAep6VG3LxiZxF_YBBjAautUxDcP_sI_mnGzTx_iemmz6tzrXXM6pdxlzh5G2y4GUS2tWKaGAzEkN-SnaMeL61G0HL6NRPW72m0YLR4jaZRX_6puFOPzAvAweMEmxcY4_A9adNXp7u9g4c7z8ZWmhs May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.25 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74bb7b020fae4bcaa3a440acc60c7a1d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cfcb989a491440b3bf74ddc055ee14d3 May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 could not be found. May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '92b7a619-b4c9-41fa-ae67-011162dbdab2'} May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 could not be found. May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 could not be found. May 14 21:19:55.502787 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 could not be found. May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Returning 404 to user: Instance 92b7a619-b4c9-41fa-ae67-011162dbdab2 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7ec0f235-088e-40e6-8342-e8920a545bea tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2" status: 404 len: 111 microversion: 2.25 time: 0.032584 May 14 21:19:55.515208 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1350/2538] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:19:55 2022] GET /compute/v2.1/servers/92b7a619-b4c9-41fa-ae67-011162dbdab2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:19:55.799879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-79f6fb2f-251f-4fae-803c-07eac0e8e933 req-b2adba52-bd55-4ec5-aada-45f6a1c1b98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e74105-d641-42cc-8282-4c6d13ec0581", "name": "network-vif-plugged", "status": "completed", "tag": "1c2acd91-d9e5-4266-97e0-03e3c6564b39"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:55.808793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-79f6fb2f-251f-4fae-803c-07eac0e8e933 req-b2adba52-bd55-4ec5-aada-45f6a1c1b98a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:55.809251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-79f6fb2f-251f-4fae-803c-07eac0e8e933 req-b2adba52-bd55-4ec5-aada-45f6a1c1b98a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:55.822289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-79f6fb2f-251f-4fae-803c-07eac0e8e933 req-b2adba52-bd55-4ec5-aada-45f6a1c1b98a service nova] Creating event network-vif-plugged:1c2acd91-d9e5-4266-97e0-03e3c6564b39 for instance b2e74105-d641-42cc-8282-4c6d13ec0581 on nch1-master-1 May 14 21:19:55.828475 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-79f6fb2f-251f-4fae-803c-07eac0e8e933 req-b2adba52-bd55-4ec5-aada-45f6a1c1b98a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 May 14 21:19:55.831028 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1351/2539] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:56.121925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:56.123320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:56.130589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:56.131047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:56.131872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:56.132330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:56.280329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:56.288605 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2fb8545f-87de-49f0-ad1a-aa430e9e0199 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1315 microversion: 2.1 time: 0.171125 May 14 21:19:56.300784 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1352/2540] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:56 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:56.305811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:56.306625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:56.315046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:56.315910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:56.316912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:56.317534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:56.487254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:56.488214 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dee5d906-60a4-4444-bc4f-42797236d18e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.188040 May 14 21:19:56.489620 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1353/2541] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:56 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:56.494465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:56.495086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:56.502360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:56.502934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:56.503748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:56.504670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:56.516916 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-428cd0b8-ac9a-4a5f-8f27-d3af9a266d6f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.359438 May 14 21:19:56.518485 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1189/2542] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:19:55 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:56.546018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c2e99872-c778-4b4f-ae81-a10c468e4330 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1b4133dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1956154409", "description": "tempest-description-377277416"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:56.830689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:56.841568 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-96cac41c-f0cb-4b44-a38d-2a9c37b068b4 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1499 microversion: 2.1 time: 0.350735 May 14 21:19:56.842173 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1354/2543] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:56 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1499 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:56.957194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fd80955d-b441-4468-8533-1b641f941439 req-199261c3-2dde-415a-83d6-27540c2e38d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1790fe11-3d3e-47a9-ba6a-b7c026480bfe", "name": "network-vif-deleted", "tag": "c79010d0-bc70-40cb-809d-4227f14fbcda"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:56.969492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fd80955d-b441-4468-8533-1b641f941439 req-199261c3-2dde-415a-83d6-27540c2e38d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:56.969959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fd80955d-b441-4468-8533-1b641f941439 req-199261c3-2dde-415a-83d6-27540c2e38d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:56.988990 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fd80955d-b441-4468-8533-1b641f941439 req-199261c3-2dde-415a-83d6-27540c2e38d1 service nova] Creating event network-vif-deleted:c79010d0-bc70-40cb-809d-4227f14fbcda for instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe on nch1-master-1 May 14 21:19:56.995877 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fd80955d-b441-4468-8533-1b641f941439 req-199261c3-2dde-415a-83d6-27540c2e38d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042243 May 14 21:19:56.998654 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1355/2544] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:19:57.049680 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c2e99872-c778-4b4f-ae81-a10c468e4330 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.522604 May 14 21:19:57.061538 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1190/2545] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:19:56 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:19:57.201447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-223499307", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "40fe4e54-7ec0-4751-90cd-3564b5d09a77"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:57.279819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] validate_networks() for [('40fe4e54-7ec0-4751-90cd-3564b5d09a77', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:19:57.305965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:57.306720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:57.332991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:57.332991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:57.333497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:57.334633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:57.511772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:57.519509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d68afc9-df92-48b5-8d21-fc155e14acff tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1503 microversion: 2.1 time: 0.217763 May 14 21:19:57.520180 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1191/2546] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:57 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:57.524563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:57.525192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:57.531469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:57.531961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:57.532746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:57.533728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:57.774194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:57.783370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-90a4dc40-7a94-4cbc-aa77-f64f612ce15c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.262120 May 14 21:19:57.783964 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1192/2547] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:57 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:57.859595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:57.860547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:57.869969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:57.870754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:57.872630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:57.873794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:57.934675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:57.935412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:57.935929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lazy-loading 'fault' on Instance uuid 1790fe11-3d3e-47a9-ba6a-b7c026480bfe {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:19:57.985163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038739f45c3d4ab09457d6eed20b41d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '763cf73206604d8abbe1542afe44fa95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:57.993318 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9fc9a0fc-df0f-4eb0-a0dd-7424599e9203 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 200 len: 1301 microversion: 2.1 time: 0.137884 May 14 21:19:57.993986 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1193/2548] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:57 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 1301 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:58.044927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:19:58.045353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:19:58.045838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:19:58.046245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:19:58.046660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:19:58.056214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:58.056668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:58.061096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:58.061096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:58.075614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Getting quotas for project 62ef4614a33040a7b0ae010a6b1c7fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:58.083238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Getting quotas for user 985e9f2f783e4a329e9a4c100a06134c and project 62ef4614a33040a7b0ae010a6b1c7fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:58.102961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:19:58.106491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:19:58.375254 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2af3124b-f312-447e-b688-413cdf4954f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.179747 May 14 21:19:58.382608 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1356/2549] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:19:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:19:58.389279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6a31ea6-29d1-4104-ab00-a3bc8cf8e785 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:58.389995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6a31ea6-29d1-4104-ab00-a3bc8cf8e785 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:58.480913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6a31ea6-29d1-4104-ab00-a3bc8cf8e785 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:58.491172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6a31ea6-29d1-4104-ab00-a3bc8cf8e785 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1215 microversion: 2.1 time: 0.106717 May 14 21:19:58.492189 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1194/2550] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:58 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1215 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:58.807629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:58.808255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:58.815338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:58.815827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:58.816679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:58.817126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:58.984540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:58.993624 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81e4b90e-95e4-4007-af7b-e9fecbaaf102 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.189592 May 14 21:19:58.993796 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1357/2551] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:58 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:19:59.013097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:59.013596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] [instance: 1790fe11-3d3e-47a9-ba6a-b7c026480bfe] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:59.020689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:59.021408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:59.022365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:19:59.022723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d2a2e7f-2aac-4814-86dd-29f4097686b2 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1a771fe50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:59.023167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:19:59.040585 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] HTTP exception thrown: Instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe could not be found. May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Request method failure captured: May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe HTTP/1.1 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBuFY4g0wq4WgHSemyKorU8Z1KEdyjn56SNZqlZwUQb-5uBMAAKkVZOMQ32XFxNHWahLYnBaStRJN6BmuO6R1-ghItgt_Y5AvHjsczvOf2pq0BEmvGK37gqHJFIzJrlVFvhlwZKT6mK6YqYfeqyQNiw5WNm9mHDg0_BCVWUFd--4QDk May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-LiveMigrationTest-772526 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/763cf73206604d8abbe1542afe44fa95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_763cf73206604d8abbe1542afe44fa95", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-LiveMigrationTest-772526 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 763cf73206604d8abbe1542afe44fa95 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-LiveMigrationTest-772526 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-LiveMigrationTest-772526-project May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 038739f45c3d4ab09457d6eed20b41d4 May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-LiveMigrationTest-772526-project May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe could not be found. May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1790fe11-3d3e-47a9-ba6a-b7c026480bfe'} May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe could not be found. May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe could not be found. May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:59.042762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe could not be found. May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] Returning 404 to user: Instance 1790fe11-3d3e-47a9-ba6a-b7c026480bfe could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bbee603e-9a81-4982-80f7-e43d92979dc2 tempest-LiveMigrationTest-772526 tempest-LiveMigrationTest-772526-project] 10.222.0.52 "GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe" status: 404 len: 111 microversion: 2.1 time: 0.036504 May 14 21:19:59.053233 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1195/2552] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:59 2022] GET /compute/v2.1/servers/1790fe11-3d3e-47a9-ba6a-b7c026480bfe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:19:59.076299 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d2a2e7f-2aac-4814-86dd-29f4097686b2 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01" status: 200 len: 637 microversion: 2.1 time: 0.058898 May 14 21:19:59.083664 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1358/2553] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:19:59 2022] GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01 => generated 637 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:19:59.094159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f243150e-31fa-4a08-a715-b2484286a906 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update_all', calling method: .version_select at 0x7fb1a7f0e670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:19:59.148772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f243150e-31fa-4a08-a715-b2484286a906 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:19:59.154372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f243150e-31fa-4a08-a715-b2484286a906 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:19:59.508652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c09958b4-6973-450b-99b6-759f0ab4373f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:19:59.509245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c09958b4-6973-450b-99b6-759f0ab4373f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:19:59.606910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c09958b4-6973-450b-99b6-759f0ab4373f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:19:59.616464 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f243150e-31fa-4a08-a715-b2484286a906 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 61 microversion: 2.1 time: 0.526053 May 14 21:19:59.617073 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1196/2554] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:19:59 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 61 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:19:59.618921 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c09958b4-6973-450b-99b6-759f0ab4373f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1215 microversion: 2.1 time: 0.114299 May 14 21:19:59.619829 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1359/2555] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:19:59 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:19:59.629045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae4f07f7-a407-429f-a941-0498d76fa2da tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1a78c4790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:00.013402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:00.013402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:00.022453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:00.022917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:00.023734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:00.025727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:00.212650 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae4f07f7-a407-429f-a941-0498d76fa2da tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "DELETE /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.588913 May 14 21:20:00.213233 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1197/2556] 10.222.0.52 () {58 vars in 1295 bytes} [Sat May 14 21:19:59 2022] DELETE /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata/os_version => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:20:00.221456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f7bae9d-ad06-4efa-9379-b57ca4d16727 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1a7e14670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:00.262802 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f7bae9d-ad06-4efa-9379-b57ca4d16727 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 37 microversion: 2.1 time: 0.045303 May 14 21:20:00.263550 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1198/2557] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:20:00 2022] GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 37 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:20:00.281409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8e3bf05-5a0d-4140-8c98-24f466301ce0 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update_all', calling method: .version_select at 0x7fb1a784c040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:00.282764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:00.292294 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d2cc771-503b-4071-9f7c-5e2baa670397 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.286044 May 14 21:20:00.307959 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1360/2558] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:00 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:00.357396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d8e3bf05-5a0d-4140-8c98-24f466301ce0 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:00.363436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d8e3bf05-5a0d-4140-8c98-24f466301ce0 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:00.643127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:00.645198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:00.661625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:00.661625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:00.661625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:00.662415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:00.731614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:00.739746 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6589e2d-e8e7-4aa0-abd2-e083a1dfc9bd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1267 microversion: 2.1 time: 0.105724 May 14 21:20:00.740339 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1361/2559] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:00 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1267 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:00.745363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-208da729-6e02-493a-b978-f998a821cda1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "962a3525-29b8-4d27-b336-6be335779521"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:00.747999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-208da729-6e02-493a-b978-f998a821cda1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:00.753728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-208da729-6e02-493a-b978-f998a821cda1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:00.754188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-208da729-6e02-493a-b978-f998a821cda1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:00.754966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-208da729-6e02-493a-b978-f998a821cda1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:00.755490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-208da729-6e02-493a-b978-f998a821cda1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:00.844659 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8e3bf05-5a0d-4140-8c98-24f466301ce0 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 61 microversion: 2.1 time: 0.574671 May 14 21:20:00.845260 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1199/2560] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:00 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 61 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:00.856765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-950fdb4b-f45b-405e-8efc-f08dcc3a8790 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1a7fa69d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:00.916988 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-950fdb4b-f45b-405e-8efc-f08dcc3a8790 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.065852 May 14 21:20:00.917573 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1200/2561] 10.222.0.52 () {58 vars in 1289 bytes} [Sat May 14 21:20:00 2022] GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata/os_distro => generated 33 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:20:00.929139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03145fe9-6973-4655-8ab5-23cb3cf57994 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update_all', calling method: .version_select at 0x7fb1a7e14d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:00.982738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-03145fe9-6973-4655-8ab5-23cb3cf57994 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:00.988286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-03145fe9-6973-4655-8ab5-23cb3cf57994 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:01.313174 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03145fe9-6973-4655-8ab5-23cb3cf57994 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 61 microversion: 2.1 time: 0.388328 May 14 21:20:01.313976 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1201/2562] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:00 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 61 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:01.321084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:01.322580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:01.330749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:01.332094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:01.336282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:01.336282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:01.541372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:01.549001 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-16edf4da-12c0-40a8-bb72-27d0b4734f18 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.234058 May 14 21:20:01.550104 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1202/2563] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:01 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:01.555156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd948690-1783-468b-a192-2a581e51e8b3 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1a7ffc1f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:01.606534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd948690-1783-468b-a192-2a581e51e8b3 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 61 microversion: 2.1 time: 0.055330 May 14 21:20:01.612920 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1203/2564] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:20:01 2022] GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 61 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:01.618570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-39408ac8-9c44-46b6-920d-cc0d8d73169e tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update_all', calling method: .version_select at 0x7fb1a7e2d550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:01.685179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-39408ac8-9c44-46b6-920d-cc0d8d73169e tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:01.692765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-39408ac8-9c44-46b6-920d-cc0d8d73169e tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:01.820130 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-208da729-6e02-493a-b978-f998a821cda1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.078527 May 14 21:20:01.824099 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1362/2565] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:20:00 2022] POST /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:01.841275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:01.855420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:01.876083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:01.878652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:01.878652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:01.879132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:02.003061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:02.013686 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d650a851-6ee3-4d2c-bc99-ba1c63164a57 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1273 microversion: 2.1 time: 0.177776 May 14 21:20:02.016754 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1363/2566] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:01 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:02.047093 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-39408ac8-9c44-46b6-920d-cc0d8d73169e tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 61 microversion: 2.1 time: 0.432657 May 14 21:20:02.047738 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1204/2567] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:01 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 61 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:20:02.058964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d653c164-0613-49ac-874d-e382b5ff0ae8 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update_all', calling method: .version_select at 0x7fb1a77e69d0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:02.110560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d653c164-0613-49ac-874d-e382b5ff0ae8 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:02.131267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d653c164-0613-49ac-874d-e382b5ff0ae8 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:02.570156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:02.571169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:02.581664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:02.582712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:02.583743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:02.584410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:02.701581 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d653c164-0613-49ac-874d-e382b5ff0ae8 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 64 microversion: 2.1 time: 0.647552 May 14 21:20:02.702318 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1364/2568] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:02 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 64 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:02.711341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a4fb4bdd-505c-4032-93a7-18c1edfc1933 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1b9789c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:02.767271 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a4fb4bdd-505c-4032-93a7-18c1edfc1933 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 64 microversion: 2.1 time: 0.059478 May 14 21:20:02.768759 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1365/2569] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:20:02 2022] GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 64 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:02.780733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78326961-650a-4d06-a9da-eccaa4bfb817 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update_all', calling method: .version_select at 0x7fb1a7702f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:02.846167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-78326961-650a-4d06-a9da-eccaa4bfb817 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:02.866753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-78326961-650a-4d06-a9da-eccaa4bfb817 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:02.953517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:02.966021 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fc2180c5-3b75-400f-b624-db9815bb3502 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.402886 May 14 21:20:02.966832 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1205/2570] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:02 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:03.033260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:03.035047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:03.042137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:03.042794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:03.044244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:03.044857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:03.214162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:03.224409 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6924308c-2cb2-4026-a900-178513d8cb9c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1315 microversion: 2.1 time: 0.195292 May 14 21:20:03.226729 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1206/2571] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:03 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:03.443939 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-78326961-650a-4d06-a9da-eccaa4bfb817 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 61 microversion: 2.1 time: 0.667614 May 14 21:20:03.445291 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1366/2572] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:02 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 61 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:20:03.454886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8f12b436-1269-44af-a739-1dc59184950b tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update', calling method: .version_select at 0x7fb1b40ea0d0>, body: {"meta": {"os_version": "alt"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:03.516815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8f12b436-1269-44af-a739-1dc59184950b tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:03.523139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8f12b436-1269-44af-a739-1dc59184950b tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:03.682900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6bece5ab-0aba-4aa4-9a0c-53269abd44be req-a3a07098-e1d4-4807-a42f-aeef1b891915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa76855-e975-43d4-96d6-c1c97823573e", "tag": "37039dca-7f50-4abf-b9c9-024d3e2f3d10"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:03.691668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6bece5ab-0aba-4aa4-9a0c-53269abd44be req-a3a07098-e1d4-4807-a42f-aeef1b891915 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:03.692340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6bece5ab-0aba-4aa4-9a0c-53269abd44be req-a3a07098-e1d4-4807-a42f-aeef1b891915 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:03.703197 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6bece5ab-0aba-4aa4-9a0c-53269abd44be req-a3a07098-e1d4-4807-a42f-aeef1b891915 service nova] Creating event network-changed:37039dca-7f50-4abf-b9c9-024d3e2f3d10 for instance bfa76855-e975-43d4-96d6-c1c97823573e on nch1-master-1 May 14 21:20:03.708136 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6bece5ab-0aba-4aa4-9a0c-53269abd44be req-a3a07098-e1d4-4807-a42f-aeef1b891915 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028942 May 14 21:20:03.709098 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1367/2573] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:20:03.940890 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8f12b436-1269-44af-a739-1dc59184950b tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.490070 May 14 21:20:03.941796 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1207/2574] 10.222.0.52 () {60 vars in 1312 bytes} [Sat May 14 21:20:03 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata/os_version => generated 31 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:03.957849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cfc68de8-f7e8-4cb8-88f8-95d36ba74f33 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1b97a7040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:03.984756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:03.985384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:04.000925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:04.000925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:04.000925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:04.000925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:04.001376 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cfc68de8-f7e8-4cb8-88f8-95d36ba74f33 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 58 microversion: 2.1 time: 0.050985 May 14 21:20:04.001376 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1368/2575] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:20:03 2022] GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 58 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:04.011690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b303a2c-f306-41cd-aadb-1b57e83a4f21 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'update_all', calling method: .version_select at 0x7fb1a77ea700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:04.085866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7b303a2c-f306-41cd-aadb-1b57e83a4f21 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:04.097633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7b303a2c-f306-41cd-aadb-1b57e83a4f21 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:04.316875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:04.329140 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5f449a4-9467-4c35-826f-1735089c4e76 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.348256 May 14 21:20:04.329744 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1208/2576] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:03 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:04.334608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:04.337431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:04.350139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:04.353631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:04.354830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:04.355452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:04.601842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:04.615058 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5dcb450-88f6-4626-9c57-be661df60b30 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1315 microversion: 2.1 time: 0.284034 May 14 21:20:04.626061 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1209/2577] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:04 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:04.653462 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b303a2c-f306-41cd-aadb-1b57e83a4f21 tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 61 microversion: 2.1 time: 0.646058 May 14 21:20:04.653990 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1369/2578] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:04 2022] PUT /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 61 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:04.663805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ee937e16-5c98-433e-bf16-3307ca04613a tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Action: 'create', calling method: .version_select at 0x7fb1b40e58b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:04.711672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ee937e16-5c98-433e-bf16-3307ca04613a tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:04.716896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ee937e16-5c98-433e-bf16-3307ca04613a tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Getting quotas for user 3e9d68295c424cd29e55832142029113 and project 0836fd7ee18244cca109e577b9194b2a. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:05.187110 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ee937e16-5c98-433e-bf16-3307ca04613a tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "POST /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 85 microversion: 2.1 time: 0.527420 May 14 21:20:05.187757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1210/2579] 10.222.0.52 () {60 vars in 1280 bytes} [Sat May 14 21:20:04 2022] POST /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 85 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:05.197541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06829b09-7fc7-4b08-a071-0d115cfb824c tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] Calling method '.version_select at 0x7fb1a783d0d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:05.253230 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-06829b09-7fc7-4b08-a071-0d115cfb824c tempest-ImagesMetadataTestJSON-1577502668 tempest-ImagesMetadataTestJSON-1577502668-project] 10.222.0.52 "GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata" status: 200 len: 85 microversion: 2.1 time: 0.060397 May 14 21:20:05.258319 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1370/2580] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:20:05 2022] GET /compute/v2.1/images/8c6e49a2-133d-4e13-8f30-414824b74d01/metadata => generated 85 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:05.348233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:05.348884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:05.362485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:05.363377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:05.375746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:05.376346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:05.529011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:05.537186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e25949c-12ad-4aa5-88d8-bdd532f98a50 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.194102 May 14 21:20:05.537784 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1211/2581] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:05 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:05.633450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:05.635519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:05.642992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:05.644407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:05.645405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:05.651614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:05.838650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:05.847463 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3868c3ac-adb4-4798-b3bb-ba803a0d7f0e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1315 microversion: 2.1 time: 0.217494 May 14 21:20:05.848081 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1371/2582] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:05 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:06.370957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:06.371645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:06.382773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:06.389837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:06.389837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:06.389837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:06.424760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:20:06.556973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:06.558692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:06.568475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:06.573442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:06.573442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:06.573442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:06.806067 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0420979-15f3-414c-9985-bbad51c20edd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 204 len: 0 microversion: 2.1 time: 0.439008 May 14 21:20:06.806844 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1212/2583] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:20:06 2022] DELETE /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:20:06.865401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:06.873399 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df1fdc53-51fe-4767-b69a-3a1a0e4fe95d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.323290 May 14 21:20:06.874151 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1372/2584] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:06 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:06.879368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:06.880141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:06.888148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:06.888148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:06.889091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:06.889888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:06.982064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d20c433d-2ac7-4119-bcd8-616b96717097 tempest-NetworksTest-1505418600 tempest-NetworksTest-1505418600-project-admin] Calling method '.version_select at 0x7fb1a7e14f70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:07.103990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:07.114949 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-acb7035a-52dc-4bf2-b149-93c15f69c3de tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1555 microversion: 2.1 time: 0.239362 May 14 21:20:07.115934 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1373/2585] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:06 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:07.120895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:07.121788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:07.128684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:07.129131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:07.129911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:07.130353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:07.254431 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d20c433d-2ac7-4119-bcd8-616b96717097 tempest-NetworksTest-1505418600 tempest-NetworksTest-1505418600-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 6747 microversion: 2.1 time: 0.442007 May 14 21:20:07.255328 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1213/2586] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:20:06 2022] GET /compute/v2.1/os-networks => generated 6747 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:07.264904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14e8fe6e-68df-4465-8130-381c3c947d8d tempest-NetworksTest-1505418600 tempest-NetworksTest-1505418600-project-admin] Calling method '.version_select at 0x7fb1a7e144c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:07.411968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14e8fe6e-68df-4465-8130-381c3c947d8d tempest-NetworksTest-1505418600 tempest-NetworksTest-1505418600-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks/01e3ef00-a182-4fcf-a405-9a420eb1352e" status: 200 len: 652 microversion: 2.1 time: 0.151724 May 14 21:20:07.413358 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1214/2587] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:20:07 2022] GET /compute/v2.1/os-networks/01e3ef00-a182-4fcf-a405-9a420eb1352e => generated 652 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:20:07.423837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e064ac32-6529-41b2-8019-bb6453b1e1a5 tempest-NetworksTest-1505418600 tempest-NetworksTest-1505418600-project-admin] Calling method '.version_select at 0x7fb1b4133dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:07.478729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:07.490024 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d9b8bebd-fbef-4dd2-b2ff-665122134114 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1315 microversion: 2.1 time: 0.372392 May 14 21:20:07.491211 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1374/2588] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:07 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:07.567845 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e064ac32-6529-41b2-8019-bb6453b1e1a5 tempest-NetworksTest-1505418600 tempest-NetworksTest-1505418600-project-admin] 10.222.0.52 "GET /compute/v2.1/os-networks" status: 200 len: 6747 microversion: 2.1 time: 0.147270 May 14 21:20:07.567845 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1215/2589] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:20:07 2022] GET /compute/v2.1/os-networks => generated 6747 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:07.890720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:07.891521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:07.899321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:07.900158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:07.900975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:07.901417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:08.126631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:08.137340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:08.138442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:08.142880 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f0935fb-432d-4197-87a2-8acf71c67a94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.256127 May 14 21:20:08.144132 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1375/2590] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:07 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:08.147278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:08.147922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:08.148793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:08.149315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:08.372987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:08.381542 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d84dc3a3-b332-4203-aeb9-04ad363fe83e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1555 microversion: 2.1 time: 0.252921 May 14 21:20:08.382145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1216/2591] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:08 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1555 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:08.517702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:08.520950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:08.530299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:08.531135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:08.532462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:08.533290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:08.802568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:08.811997 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ccafa18d-6b06-4a5d-9c9f-0e1e93a4034f tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1315 microversion: 2.1 time: 0.305511 May 14 21:20:08.813766 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1376/2592] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:08 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:09.160975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:09.164543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:09.195700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:09.200558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:09.201417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:09.201873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:09.399935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:09.401339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:09.415276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:09.416979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:09.419931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:09.420610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:09.504328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:09.522745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0a93de0-0e7d-4791-8e8d-6c8914417e6b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.365269 May 14 21:20:09.523956 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1217/2593] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:09 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:09.524660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:09.540904 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-133b6ce2-a360-47e1-94d8-be1dce89eb35 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1513 microversion: 2.1 time: 0.145712 May 14 21:20:09.541895 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1377/2594] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:09 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:09.664002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-907595151", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:09.685578 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b8c414d6-4feb-40a0-89da-ab03d50a64dc tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] 10.222.0.52 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.140143 May 14 21:20:09.687547 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1378/2595] 10.222.0.52 () {58 vars in 1127 bytes} [Sat May 14 21:20:09 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 14 21:20:09.717711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6a6022ee-b635-4f3a-a48a-1160aba9104b req-e3d8dc50-42bb-44c1-bbf2-066cb998d67c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2e74105-d641-42cc-8282-4c6d13ec0581", "name": "network-vif-deleted", "tag": "1c2acd91-d9e5-4266-97e0-03e3c6564b39"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:09.746858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6a6022ee-b635-4f3a-a48a-1160aba9104b req-e3d8dc50-42bb-44c1-bbf2-066cb998d67c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:09.747897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6a6022ee-b635-4f3a-a48a-1160aba9104b req-e3d8dc50-42bb-44c1-bbf2-066cb998d67c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:09.770332 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6a6022ee-b635-4f3a-a48a-1160aba9104b req-e3d8dc50-42bb-44c1-bbf2-066cb998d67c service nova] Creating event network-vif-deleted:1c2acd91-d9e5-4266-97e0-03e3c6564b39 for instance b2e74105-d641-42cc-8282-4c6d13ec0581 on nch1-master-1 May 14 21:20:09.777850 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6a6022ee-b635-4f3a-a48a-1160aba9104b req-e3d8dc50-42bb-44c1-bbf2-066cb998d67c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088433 May 14 21:20:09.779835 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1379/2596] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:09.788396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] validate_networks() for [('b1539874-6ea7-49e4-8f22-60e0ae9b0c3a', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:20:09.796590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1dc28c44-9abc-49f9-b806-44e3676063a5 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Calling method '.version_select at 0x7fb1a7771af0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:09.884012 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1dc28c44-9abc-49f9-b806-44e3676063a5 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] HTTP exception thrown: Image not found. May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1dc28c44-9abc-49f9-b806-44e3676063a5 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Request method failure captured: May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB0JRt0iMciY3Wpt7J87ovi5M2HobfHQRR-mFd-b-Z8YAs9cI8DEvS__HcEWV4RgdIN4LHpxewEs43ISBCx1E29ywRNsgClZCPekfd4usZ3Ev9H2elssBUYE108JoaM4GW6Jn7smYXc7rPr9_AGkNNg1JG0oVSqFHjJ_KvPp5Vb0vFs May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a85582b3e294f99828623a9a7331bee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 55c6e0dec0484d9bb0fe104203a6e4cb May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '-1'} May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:09.886455 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1dc28c44-9abc-49f9-b806-44e3676063a5 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1dc28c44-9abc-49f9-b806-44e3676063a5 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] 10.222.0.52 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.106414 May 14 21:20:09.897384 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1380/2597] 10.222.0.52 () {58 vars in 1133 bytes} [Sat May 14 21:20:09 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:20:09.905263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:09.906450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:09.914727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:09.915743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:09.917443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:09.918069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.101443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:10.109816 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e76fc38-6c5f-45b5-874a-88cd63ec9419 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1315 microversion: 2.1 time: 0.219596 May 14 21:20:10.111063 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1381/2598] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:09 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:10.116093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5430520a-63c9-49ec-add9-7e43f140e6b9 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Calling method '.version_select at 0x7fb1a783d3a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:10.139607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5430520a-63c9-49ec-add9-7e43f140e6b9 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] HTTP exception thrown: Image not found. May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5430520a-63c9-49ec-add9-7e43f140e6b9 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Request method failure captured: May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/7c3e4f75-2fbd-404c-89dc-41fc1a97740j HTTP/1.1 May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB0JRt0iMciY3Wpt7J87ovi5M2HobfHQRR-mFd-b-Z8YAs9cI8DEvS__HcEWV4RgdIN4LHpxewEs43ISBCx1E29ywRNsgClZCPekfd4usZ3Ev9H2elssBUYE108JoaM4GW6Jn7smYXc7rPr9_AGkNNg1JG0oVSqFHjJ_KvPp5Vb0vFs May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a85582b3e294f99828623a9a7331bee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 55c6e0dec0484d9bb0fe104203a6e4cb May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '7c3e4f75-2fbd-404c-89dc-41fc1a97740j'} May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7c3e4f75-2fbd-404c-89dc-41fc1a97740j to delete May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7c3e4f75-2fbd-404c-89dc-41fc1a97740j could not be found. May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:10.141536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5430520a-63c9-49ec-add9-7e43f140e6b9 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5430520a-63c9-49ec-add9-7e43f140e6b9 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] 10.222.0.52 "DELETE /compute/v2.1/images/7c3e4f75-2fbd-404c-89dc-41fc1a97740j" status: 404 len: 62 microversion: 2.1 time: 0.030897 May 14 21:20:10.147338 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1382/2599] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:10 2022] DELETE /compute/v2.1/images/7c3e4f75-2fbd-404c-89dc-41fc1a97740j => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:20:10.153424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:10.153424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:10.157872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.158239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.159148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.159640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.214574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:20:10.367467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:20:10.368066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:20:10.368677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:20:10.369318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:20:10.369975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:20:10.384301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.385264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.386208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.386614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.406721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Getting quotas for project d272971274514577b827dd8ac81c9e58. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:10.413312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Getting quotas for user b3b5b688171045d586128236e85aee0b and project d272971274514577b827dd8ac81c9e58. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:10.428223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:20:10.430875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:20:10.638514 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a3f3c8a8-0766-4e5f-adc9-4bae35f56131 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 204 len: 0 microversion: 2.25 time: 0.491720 May 14 21:20:10.642176 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1383/2600] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:10 2022] DELETE /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:20:10.648613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d500e2e6-b8d5-42dc-92a5-a64bf123b1e4 req-f8e50ef5-1b77-46db-9215-3ac584f46d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfa76855-e975-43d4-96d6-c1c97823573e", "name": "network-vif-plugged", "status": "completed", "tag": "37039dca-7f50-4abf-b9c9-024d3e2f3d10"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:10.657770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d500e2e6-b8d5-42dc-92a5-a64bf123b1e4 req-f8e50ef5-1b77-46db-9215-3ac584f46d7a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.658483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d500e2e6-b8d5-42dc-92a5-a64bf123b1e4 req-f8e50ef5-1b77-46db-9215-3ac584f46d7a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.668751 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14e06ca9-f38a-4c4f-9ede-355b837a854e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.143342 May 14 21:20:10.671716 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1218/2601] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:20:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:20:10.672649 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d500e2e6-b8d5-42dc-92a5-a64bf123b1e4 req-f8e50ef5-1b77-46db-9215-3ac584f46d7a service nova] Creating event network-vif-plugged:37039dca-7f50-4abf-b9c9-024d3e2f3d10 for instance bfa76855-e975-43d4-96d6-c1c97823573e on nch1-master-1 May 14 21:20:10.678609 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d500e2e6-b8d5-42dc-92a5-a64bf123b1e4 req-f8e50ef5-1b77-46db-9215-3ac584f46d7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034107 May 14 21:20:10.679431 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1384/2602] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:10.685683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2eca7115-ada3-4196-b56a-c20c7498024a tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Calling method '.version_select at 0x7fb1a7d28040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:10.711075 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2eca7115-ada3-4196-b56a-c20c7498024a tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] HTTP exception thrown: Image not found. May 14 21:20:10.711498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:10.712219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2eca7115-ada3-4196-b56a-c20c7498024a tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Request method failure captured: May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/images/27e85872-29fe-4a9b-9928-e7e9a2ba5bad1 HTTP/1.1 May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0JRt0iMciY3Wpt7J87ovi5M2HobfHQRR-mFd-b-Z8YAs9cI8DEvS__HcEWV4RgdIN4LHpxewEs43ISBCx1E29ywRNsgClZCPekfd4usZ3Ev9H2elssBUYE108JoaM4GW6Jn7smYXc7rPr9_AGkNNg1JG0oVSqFHjJ_KvPp5Vb0vFs May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a85582b3e294f99828623a9a7331bee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 55c6e0dec0484d9bb0fe104203a6e4cb May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: exception: Image not found. May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '27e85872-29fe-4a9b-9928-e7e9a2ba5bad1'} May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 27e85872-29fe-4a9b-9928-e7e9a2ba5bad1 to delete May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 27e85872-29fe-4a9b-9928-e7e9a2ba5bad1 could not be found. May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:10.714123 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:20:10.719296 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:10.725335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2eca7115-ada3-4196-b56a-c20c7498024a tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Returning 404 to user: Image not found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:10.726532 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2eca7115-ada3-4196-b56a-c20c7498024a tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] 10.222.0.52 "DELETE /compute/v2.1/images/27e85872-29fe-4a9b-9928-e7e9a2ba5bad1" status: 404 len: 62 microversion: 2.1 time: 0.053727 May 14 21:20:10.727707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1219/2603] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:20:10 2022] DELETE /compute/v2.1/images/27e85872-29fe-4a9b-9928-e7e9a2ba5bad1 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:20:10.730084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.738352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.738352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.738352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.738713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:10.738713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:10.771118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.790250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.794828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.797255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.862690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.863373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.869862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'fault' on Instance uuid b2e74105-d641-42cc-8282-4c6d13ec0581 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:20:10.941302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:10.955118 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46b15888-f622-48ae-ba63-c72878d8f08e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 200 len: 1351 microversion: 2.1 time: 0.225364 May 14 21:20:10.955998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1220/2604] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:10 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 1351 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:10.962770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:10.963405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:10.974785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.975294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.976968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:10.977717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:10.992199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:11.003061 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7642c14a-2099-480f-a1fa-349ebb7452d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.322233 May 14 21:20:11.007690 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1385/2605] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:10 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:11.017421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-63064761-0a70-48c4-9d94-6bea3017cddb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:11.020835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-63064761-0a70-48c4-9d94-6bea3017cddb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:11.113810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-63064761-0a70-48c4-9d94-6bea3017cddb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:11.121248 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-63064761-0a70-48c4-9d94-6bea3017cddb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1222 microversion: 2.1 time: 0.112148 May 14 21:20:11.121971 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1386/2606] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:11 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:11.126581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9530efb4-aeaa-488f-8312-646bcf4a7887 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Calling method '.version_select at 0x7fb1b98cdc10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:11.153056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:11.157441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:11.160333 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-9530efb4-aeaa-488f-8312-646bcf4a7887 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] HTTP exception thrown: Image not found. May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9530efb4-aeaa-488f-8312-646bcf4a7887 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Request method failure captured: May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/tempest-invalid-1099405182 HTTP/1.1 May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB0JRt0iMciY3Wpt7J87ovi5M2HobfHQRR-mFd-b-Z8YAs9cI8DEvS__HcEWV4RgdIN4LHpxewEs43ISBCx1E29ywRNsgClZCPekfd4usZ3Ev9H2elssBUYE108JoaM4GW6Jn7smYXc7rPr9_AGkNNg1JG0oVSqFHjJ_KvPp5Vb0vFs May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a85582b3e294f99828623a9a7331bee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 55c6e0dec0484d9bb0fe104203a6e4cb May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'tempest-invalid-1099405182'} May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1099405182 to delete May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1099405182 could not be found. May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:11.162972 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9530efb4-aeaa-488f-8312-646bcf4a7887 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9530efb4-aeaa-488f-8312-646bcf4a7887 tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] 10.222.0.52 "DELETE /compute/v2.1/images/tempest-invalid-1099405182" status: 404 len: 62 microversion: 2.1 time: 0.041448 May 14 21:20:11.172561 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1387/2607] 10.222.0.52 () {58 vars in 1205 bytes} [Sat May 14 21:20:11 2022] DELETE /compute/v2.1/images/tempest-invalid-1099405182 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:20:11.179915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:11.179915 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-063e2693-cb22-4989-9bf0-8404ec603f36 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1564 microversion: 2.25 time: 0.215317 May 14 21:20:11.179915 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1221/2608] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:10 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1564 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:20:11.189372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-627a6ea5-9cc5-446f-80b7-4bf2899fb87e tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Calling method '.version_select at 0x7fb1a785aaf0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:11.191294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:11.192076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:11.209498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:11.209498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:11.209498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:11.209498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:11.222360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-627a6ea5-9cc5-446f-80b7-4bf2899fb87e tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] HTTP exception thrown: Image not found. May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-627a6ea5-9cc5-446f-80b7-4bf2899fb87e tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Request method failure captured: May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/images/d592cc7c-a803-4ae8-b0de-7b969c4b04b3 HTTP/1.1 May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0JRt0iMciY3Wpt7J87ovi5M2HobfHQRR-mFd-b-Z8YAs9cI8DEvS__HcEWV4RgdIN4LHpxewEs43ISBCx1E29ywRNsgClZCPekfd4usZ3Ev9H2elssBUYE108JoaM4GW6Jn7smYXc7rPr9_AGkNNg1JG0oVSqFHjJ_KvPp5Vb0vFs May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9a85582b3e294f99828623a9a7331bee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9a85582b3e294f99828623a9a7331bee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9a85582b3e294f99828623a9a7331bee May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344 May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 55c6e0dec0484d9bb0fe104203a6e4cb May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1466536344-project May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: exception: Image not found. May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd592cc7c-a803-4ae8-b0de-7b969c4b04b3'} May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d592cc7c-a803-4ae8-b0de-7b969c4b04b3 to delete May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d592cc7c-a803-4ae8-b0de-7b969c4b04b3 could not be found. May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:11.224470 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-627a6ea5-9cc5-446f-80b7-4bf2899fb87e tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] Returning 404 to user: Image not found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-627a6ea5-9cc5-446f-80b7-4bf2899fb87e tempest-ImagesDeleteNegativeTestJSON-1466536344 tempest-ImagesDeleteNegativeTestJSON-1466536344-project] 10.222.0.52 "DELETE /compute/v2.1/images/d592cc7c-a803-4ae8-b0de-7b969c4b04b3" status: 404 len: 62 microversion: 2.1 time: 0.049957 May 14 21:20:11.229651 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1222/2609] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:11 2022] DELETE /compute/v2.1/images/d592cc7c-a803-4ae8-b0de-7b969c4b04b3 => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:20:11.463783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:11.471414 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7af72ca6-fcb6-496e-8553-b45d6b41592e tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1315 microversion: 2.1 time: 0.305382 May 14 21:20:11.472165 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1388/2610] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:11 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:11.936010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-37631f5f-8376-4b29-8968-72daf374edba req-9b39f896-05f4-4fac-bfd0-0ee635160078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd12aad-4b1b-4433-a46d-66a5d3fa7862", "name": "network-vif-deleted", "tag": "1aef7905-067e-45bd-9e0e-044b18eaa72b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:11.952774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-37631f5f-8376-4b29-8968-72daf374edba req-9b39f896-05f4-4fac-bfd0-0ee635160078 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:11.953522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-37631f5f-8376-4b29-8968-72daf374edba req-9b39f896-05f4-4fac-bfd0-0ee635160078 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:11.986552 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-37631f5f-8376-4b29-8968-72daf374edba req-9b39f896-05f4-4fac-bfd0-0ee635160078 service nova] Creating event network-vif-deleted:1aef7905-067e-45bd-9e0e-044b18eaa72b for instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 on nch2-master-1 May 14 21:20:11.992632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:11.998128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:12.021393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-37631f5f-8376-4b29-8968-72daf374edba req-9b39f896-05f4-4fac-bfd0-0ee635160078 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091892 May 14 21:20:12.022177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.037507 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1223/2611] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:12.037876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.037876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.037876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.043718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:12.046205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 HTTP/1.1 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b2e74105-d641-42cc-8282-4c6d13ec0581'} May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:20:12.067891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9fd5ace6-f217-49b5-8429-45048c468371 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 404 len: 111 microversion: 2.1 time: 0.086228 May 14 21:20:12.073889 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1389/2612] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:11 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:12.076471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.077609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.079398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.081381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.139780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8569dfcf-40e3-48be-8d10-ee32c6f7ab23 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:12.140681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8569dfcf-40e3-48be-8d10-ee32c6f7ab23 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:12.387080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8569dfcf-40e3-48be-8d10-ee32c6f7ab23 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:12.398268 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8569dfcf-40e3-48be-8d10-ee32c6f7ab23 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1222 microversion: 2.1 time: 0.262948 May 14 21:20:12.410371 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1390/2613] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:12 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1222 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:12.416993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:12.418280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:12.428330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.428796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.429842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.430507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.490240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.491313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.492531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lazy-loading 'fault' on Instance uuid 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:20:12.595904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:12.607271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:12.609920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:12.615023 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba5b35fa-3f3f-44d3-ae8e-234e12dd962d tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 200 len: 1351 microversion: 2.25 time: 0.201857 May 14 21:20:12.615665 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1391/2614] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:12 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:20:12.625104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:12.626126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:12.641115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.641969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.644103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.644959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.669805 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581/os-volume_attachments HTTP/1.1 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': 'b2e74105-d641-42cc-8282-4c6d13ec0581'} May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:20:12.678050 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0dfe711d-fae8-4acb-8d2e-49f21d1d0430 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063380 May 14 21:20:12.685564 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1392/2615] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:20:12 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:12.689723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:12.689723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:12.694982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.695751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.696818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:12.697337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:12.864953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:12.877618 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd9c76b2-e4b3-48a1-a66a-dd5f074cb88e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.849083 May 14 21:20:12.878801 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1224/2616] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:12 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:13.005416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-617453778", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3bdbef8a-a684-458d-bfe2-b4f322a15d2e"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:13.048491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:13.079981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b61cd762-04e2-4946-9e44-072bcb0d2900 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1502 microversion: 2.1 time: 0.398346 May 14 21:20:13.092937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] validate_networks() for [('3bdbef8a-a684-458d-bfe2-b4f322a15d2e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:20:13.098966 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1393/2617] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:12 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1502 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:13.107015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1481639373"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:13.108088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:13.119958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:13.123092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:13.129728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:13.133540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:13.419976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.network.security_group_api [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Adding security group a30d7a86-b7fa-4547-8f0b-cbe0fcf1f5ef to port 37039dca-7f50-4abf-b9c9-024d3e2f3d10 May 14 21:20:13.764285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:20:13.765366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:20:13.766179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:20:13.767005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:20:13.767626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:20:13.779408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:13.780687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:13.781850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:13.782479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:13.808317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:13.817109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for user 71080496c33c4e2c8b2e16b950f0b9ea and project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:13.835506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:20:13.838699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: d53680f2-134e-4b0b-9fe3-c669b62e4c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:20:14.077682 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dc06af10-1168-48e4-a75d-dab2bd148ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.093154 May 14 21:20:14.083452 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1225/2618] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:20:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:20:14.095297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:14.100142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:14.133111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.133111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.133644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.136385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.308718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:14.317751 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6ea3e6b-705e-409f-8ae6-ad6e495d1d02 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1282 microversion: 2.1 time: 0.232806 May 14 21:20:14.318638 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1226/2619] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:14 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:14.324804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:14.325722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 3cd12aad-4b1b-4433-a46d-66a5d3fa7862] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:14.337554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.338449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.340977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.341621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.375256 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] HTTP exception thrown: Instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 could not be found. May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Request method failure captured: May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 HTTP/1.1 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvSCxyaZ3qxNvPjEfuyrbRAKJAep6VG3LxiZxF_YBBjAautUxDcP_sI_mnGzTx_iemmz6tzrXXM6pdxlzh5G2y4GUS2tWKaGAzEkN-SnaMeL61G0HL6NRPW72m0YLR4jaZRX_6puFOPzAvAweMEmxcY4_A9adNXp7u9g4c7z8ZWmhs May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.25 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74bb7b020fae4bcaa3a440acc60c7a1d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cfcb989a491440b3bf74ddc055ee14d3 May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 could not be found. May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3cd12aad-4b1b-4433-a46d-66a5d3fa7862'} May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 could not be found. May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 could not be found. May 14 21:20:14.386029 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 could not be found. May 14 21:20:14.391633 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:14.395977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Returning 404 to user: Instance 3cd12aad-4b1b-4433-a46d-66a5d3fa7862 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:14.400920 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d70c8ea6-2bf8-41ce-b04a-f56b33982121 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862" status: 404 len: 111 microversion: 2.25 time: 0.077093 May 14 21:20:14.400920 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1227/2620] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:14 2022] GET /compute/v2.1/servers/3cd12aad-4b1b-4433-a46d-66a5d3fa7862 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:20:14.405263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:14.406547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:14.413652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.414436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.415678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.416611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.708684 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-634f00fd-f1c5-4e94-a98c-f0a0c716f8a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e/action" status: 202 len: 0 microversion: 2.1 time: 1.607945 May 14 21:20:14.709634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1394/2621] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:13 2022] POST /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e/action => generated 0 bytes in 1610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:14.717481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-283a399b-f80c-4e19-9f02-2d5946e493e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:14.718137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-283a399b-f80c-4e19-9f02-2d5946e493e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: d53680f2-134e-4b0b-9fe3-c669b62e4c30] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:14.836474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:14.846994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-283a399b-f80c-4e19-9f02-2d5946e493e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:14.848539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5a0d45e8-870e-41bf-a3d0-bb82f2890dd4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.449198 May 14 21:20:14.849322 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1228/2622] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:14 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:14.857196 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-283a399b-f80c-4e19-9f02-2d5946e493e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30" status: 200 len: 1214 microversion: 2.1 time: 0.146126 May 14 21:20:14.859086 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1395/2623] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:14 2022] GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 => generated 1214 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:14.868280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:14.872303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:14.885817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1956154409"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:14.886380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:14.889147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.890665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.892490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.893767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.909032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.918243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.918972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:14.919921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:14.957557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:20:15.214876 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.network.security_group_api [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Adding security group 685d0bd1-3cd2-46fd-901d-30d0e69352aa to port 37039dca-7f50-4abf-b9c9-024d3e2f3d10 May 14 21:20:15.385299 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d5deb67b-8db4-48d5-b752-d85875691dd6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 204 len: 0 microversion: 2.25 time: 0.532446 May 14 21:20:15.387118 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1229/2624] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:14 2022] DELETE /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:20:15.400841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5b270a3e-871f-4244-94cd-c5f0e2c1082c req-e9d17ea6-81ac-4e6d-be41-1e3ed41eb775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa76855-e975-43d4-96d6-c1c97823573e", "tag": "37039dca-7f50-4abf-b9c9-024d3e2f3d10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:15.415883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5b270a3e-871f-4244-94cd-c5f0e2c1082c req-e9d17ea6-81ac-4e6d-be41-1e3ed41eb775 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:15.416888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5b270a3e-871f-4244-94cd-c5f0e2c1082c req-e9d17ea6-81ac-4e6d-be41-1e3ed41eb775 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:15.459564 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5b270a3e-871f-4244-94cd-c5f0e2c1082c req-e9d17ea6-81ac-4e6d-be41-1e3ed41eb775 service nova] Creating event network-changed:37039dca-7f50-4abf-b9c9-024d3e2f3d10 for instance bfa76855-e975-43d4-96d6-c1c97823573e on nch1-master-1 May 14 21:20:15.470728 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5b270a3e-871f-4244-94cd-c5f0e2c1082c req-e9d17ea6-81ac-4e6d-be41-1e3ed41eb775 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081648 May 14 21:20:15.474428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1230/2625] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:15.490840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:15.492019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: d53680f2-134e-4b0b-9fe3-c669b62e4c30] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:15.514761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: d53680f2-134e-4b0b-9fe3-c669b62e4c30] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:20:15.697831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:15.698458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:15.750361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:15.751098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:15.755741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'flavor' on Instance uuid d53680f2-134e-4b0b-9fe3-c669b62e4c30 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:20:15.770447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'system_metadata' on Instance uuid d53680f2-134e-4b0b-9fe3-c669b62e4c30 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:20:15.844231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'metadata' on Instance uuid d53680f2-134e-4b0b-9fe3-c669b62e4c30 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:20:16.075696 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-784840ae-d175-4d1f-b92e-12062181bf7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e/action" status: 202 len: 0 microversion: 2.1 time: 1.210669 May 14 21:20:16.077005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1396/2626] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:14 2022] POST /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e/action => generated 0 bytes in 1217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:16.169913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.170684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.599341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-64f93c5f-de47-485f-a2b2-8b6eeb13075e tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:16.600950 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:20:16.600950 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:20:16.602310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64f93c5f-de47-485f-a2b2-8b6eeb13075e tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.603175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64f93c5f-de47-485f-a2b2-8b6eeb13075e tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.604232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64f93c5f-de47-485f-a2b2-8b6eeb13075e tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.604764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64f93c5f-de47-485f-a2b2-8b6eeb13075e tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.640024 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-64f93c5f-de47-485f-a2b2-8b6eeb13075e tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.558963 May 14 21:20:16.640896 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1397/2627] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:20:16 2022] GET /compute/v2.1/os-services => generated 947 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:16.646851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:16.652500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:16.655111 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.scheduler.client.report [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Deleted allocations for instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 May 14 21:20:16.656549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.657259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.658374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.660299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.758603 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a58a8c41-932b-43fd-a6e8-19b4970e4637 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30" status: 204 len: 0 microversion: 2.1 time: 1.284289 May 14 21:20:16.759598 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1231/2628] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:20:15 2022] DELETE /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 => generated 0 bytes in 1286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:20:16.769729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:16.771257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:16.781490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.782269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.785527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.786508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.827810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:16.838814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a1bfbd79-650e-4be6-ac88-f516b843d39b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1322 microversion: 2.1 time: 0.196631 May 14 21:20:16.840239 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1398/2629] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:16 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:16.913391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-312d0142-fa82-4aa4-a9b8-c86cd602eddd tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Action: 'create', calling method: .version_select at 0x7fb1a77c1e50>, body: {"keypair": {"name": "tempest-keypair-1350651561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjbJGZqOjO4422ri1lZ5WyFU5RZCy6eTLgbXYwr8kVmm+Zt6tOXGSeIbswJ9p/HYVBYE8A/bekYODYESH8O6SLqN6H23PjIZTY6+Ok1HbQvldtbskn2ya1h6ffB/7No0A=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:16.925535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:16.951996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:16.954026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:16.955936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4621ed1-df01-4267-9b6e-9e87e89b606c tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 200 len: 1505 microversion: 2.25 time: 0.193825 May 14 21:20:16.956793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1232/2630] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:16 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:20:16.961464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-312d0142-fa82-4aa4-a9b8-c86cd602eddd tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:16.964504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:16.965396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:16.968276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-312d0142-fa82-4aa4-a9b8-c86cd602eddd tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for user 79454ddcd2be44858ebeec32e97eed54 and project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:16.975278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.977182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:16.978549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:16.979238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.076109 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-312d0142-fa82-4aa4-a9b8-c86cd602eddd tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.232394 May 14 21:20:17.076827 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1399/2631] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:20:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:17.082603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0df7b1cb-df0d-4dce-8cf4-fc283d833c0c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:17.083315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0df7b1cb-df0d-4dce-8cf4-fc283d833c0c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:17.089962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0df7b1cb-df0d-4dce-8cf4-fc283d833c0c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.090431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0df7b1cb-df0d-4dce-8cf4-fc283d833c0c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.091298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0df7b1cb-df0d-4dce-8cf4-fc283d833c0c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.091800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0df7b1cb-df0d-4dce-8cf4-fc283d833c0c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.261164 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0df7b1cb-df0d-4dce-8cf4-fc283d833c0c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.183197 May 14 21:20:17.263457 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1400/2632] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:20:17 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e/os-security-groups => generated 1157 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:17.274523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f4a5d55c-d545-4dfe-8007-e1a1a7b765df tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:17.276572 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:20:17.276572 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:20:17.278779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4a5d55c-d545-4dfe-8007-e1a1a7b765df tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.279596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4a5d55c-d545-4dfe-8007-e1a1a7b765df tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.280489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4a5d55c-d545-4dfe-8007-e1a1a7b765df tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.280940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4a5d55c-d545-4dfe-8007-e1a1a7b765df tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.303216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:17.305813 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f4a5d55c-d545-4dfe-8007-e1a1a7b765df tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.038718 May 14 21:20:17.306608 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1401/2633] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:20:17 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:17.311801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:17.312641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: d53680f2-134e-4b0b-9fe3-c669b62e4c30] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:17.320072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.320425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6e7b3155-369b-4475-b50a-93a9a1e92240 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.361302 May 14 21:20:17.320637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.321108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1233/2634] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:16 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:17.321313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.321939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.333596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-90e8e7fd-5826-4275-a5f2-3b3e2eb1f898 req-ecc944e3-b83a-414a-b968-3f79dd500876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1490939f-5892-4d71-8262-69f0148d55d2", "name": "network-vif-deleted", "tag": "0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:17.350402 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 HTTP/1.1 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd53680f2-134e-4b0b-9fe3-c669b62e4c30'} May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:17.352094 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:17.358723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:17.359575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90e8e7fd-5826-4275-a5f2-3b3e2eb1f898 req-ecc944e3-b83a-414a-b968-3f79dd500876 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.359701 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8e4c72da-608e-4f67-9568-4e7aa62effb5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30" status: 404 len: 111 microversion: 2.1 time: 0.045741 May 14 21:20:17.359701 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1402/2635] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:17 2022] GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:17.359917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90e8e7fd-5826-4275-a5f2-3b3e2eb1f898 req-ecc944e3-b83a-414a-b968-3f79dd500876 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.371464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02d7b6a0-fe88-4da8-b053-c1e3d190efc1 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1a783d430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:17.379723 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-90e8e7fd-5826-4275-a5f2-3b3e2eb1f898 req-ecc944e3-b83a-414a-b968-3f79dd500876 service nova] Creating event network-vif-deleted:0dbf4b9f-2e79-4c9c-8c19-f29ec6a6b720 for instance 1490939f-5892-4d71-8262-69f0148d55d2 on nch2-master-1 May 14 21:20:17.387251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-90e8e7fd-5826-4275-a5f2-3b3e2eb1f898 req-ecc944e3-b83a-414a-b968-3f79dd500876 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063928 May 14 21:20:17.388164 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1234/2636] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:17.398460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d9205a5-6e75-486e-8316-5eb9f43f5dba tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1a7e7b700>, body: {"security_group": {"name": " tempest-securitygroup -1017876984 ", "description": "tempest-description-222141846"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:17.401596 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02d7b6a0-fe88-4da8-b053-c1e3d190efc1 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs/tempest-keypair-1350651561" status: 200 len: 498 microversion: 2.1 time: 0.036401 May 14 21:20:17.402560 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1403/2637] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:20:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1350651561 => generated 498 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:17.412974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-004c4e54-c8e8-4545-beeb-43f82160e07f tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:17.414241 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:20:17.414241 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:20:17.415665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-004c4e54-c8e8-4545-beeb-43f82160e07f tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.416163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-004c4e54-c8e8-4545-beeb-43f82160e07f tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.417043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-004c4e54-c8e8-4545-beeb-43f82160e07f tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.418089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-004c4e54-c8e8-4545-beeb-43f82160e07f tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.447858 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-004c4e54-c8e8-4545-beeb-43f82160e07f tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.043368 May 14 21:20:17.448477 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1404/2638] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:20:17 2022] GET /compute/v2.1/os-services => generated 947 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:17.460782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8bb657f5-9a0e-44aa-9647-238ded149312 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1a77e6430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:17.538458 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8bb657f5-9a0e-44aa-9647-238ded149312 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350651561" status: 202 len: 0 microversion: 2.1 time: 0.088690 May 14 21:20:17.539305 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1405/2639] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:20:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350651561 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:17.550809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e3dd5885-df11-4b76-a55e-27bd3686d9c3 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:17.552398 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:20:17.552398 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:20:17.553655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3dd5885-df11-4b76-a55e-27bd3686d9c3 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.554121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3dd5885-df11-4b76-a55e-27bd3686d9c3 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.554920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3dd5885-df11-4b76-a55e-27bd3686d9c3 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.555407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3dd5885-df11-4b76-a55e-27bd3686d9c3 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.579987 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e3dd5885-df11-4b76-a55e-27bd3686d9c3 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.033212 May 14 21:20:17.587058 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1406/2640] 10.222.0.52 () {58 vars in 1195 bytes} [Sat May 14 21:20:17 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:17.587058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-37dec1a2-f295-4784-a1c3-516a7578a3fa req-40e5f7c6-3261-4d5e-a82c-3b43da8783f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfa76855-e975-43d4-96d6-c1c97823573e", "tag": "37039dca-7f50-4abf-b9c9-024d3e2f3d10"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:17.596156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-37dec1a2-f295-4784-a1c3-516a7578a3fa req-40e5f7c6-3261-4d5e-a82c-3b43da8783f0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:17.596701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-37dec1a2-f295-4784-a1c3-516a7578a3fa req-40e5f7c6-3261-4d5e-a82c-3b43da8783f0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:17.609442 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-37dec1a2-f295-4784-a1c3-516a7578a3fa req-40e5f7c6-3261-4d5e-a82c-3b43da8783f0 service nova] Creating event network-changed:37039dca-7f50-4abf-b9c9-024d3e2f3d10 for instance bfa76855-e975-43d4-96d6-c1c97823573e on nch1-master-1 May 14 21:20:17.614494 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-37dec1a2-f295-4784-a1c3-516a7578a3fa req-40e5f7c6-3261-4d5e-a82c-3b43da8783f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031773 May 14 21:20:17.615126 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1407/2641] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:17.620310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1754905396", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3bdbef8a-a684-458d-bfe2-b4f322a15d2e"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:17.679064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] validate_networks() for [('3bdbef8a-a684-458d-bfe2-b4f322a15d2e', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:20:17.929392 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d9205a5-6e75-486e-8316-5eb9f43f5dba tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.538949 May 14 21:20:17.936644 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1235/2642] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:17 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:17.936644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b951c706-6867-4765-9c60-8f1db9ace4ae tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Action: 'create', calling method: .version_select at 0x7fb1a784cc10>, body: {"keypair": {"name": "tempest-keypair-1964138010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOINwzCg8lO3xMS04y62zIHxlbL+kTYOPl8EW9IS6Gzkd/ZiXU32ke3237K/zUCn+3ByegW5sj1GFS84lPYhuXrYENQpoNdd+EfZ2K0zj6Y1ifHSu+a1Ci0Y6YNLPRLV5A=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:17.952139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b951c706-6867-4765-9c60-8f1db9ace4ae tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:17.958677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b951c706-6867-4765-9c60-8f1db9ace4ae tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for user 79454ddcd2be44858ebeec32e97eed54 and project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:18.069325 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b951c706-6867-4765-9c60-8f1db9ace4ae tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137240 May 14 21:20:18.070795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1236/2643] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:20:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:18.079713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec2e0d2a-44ce-4786-8301-7a8e8f1a1ead tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.083106 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:20:18.083106 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:20:18.085508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec2e0d2a-44ce-4786-8301-7a8e8f1a1ead tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.086967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec2e0d2a-44ce-4786-8301-7a8e8f1a1ead tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.089624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec2e0d2a-44ce-4786-8301-7a8e8f1a1ead tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.090409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec2e0d2a-44ce-4786-8301-7a8e8f1a1ead tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.118846 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec2e0d2a-44ce-4786-8301-7a8e8f1a1ead tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.046758 May 14 21:20:18.128539 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1237/2644] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:20:18 2022] GET /compute/v2.1/os-services => generated 947 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:18.129937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.130730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:18.137422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.137880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.138665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.139376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.347790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:20:18.352453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:20:18.352453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:20:18.352453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:20:18.352453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:20:18.363721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:18.364242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.364889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.366042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.366673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.377018 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc22eced-f1c8-41f0-a1ff-52a0543041d0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1322 microversion: 2.1 time: 0.251610 May 14 21:20:18.378184 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1238/2645] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:18 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:18.388178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0aad2a6-dc8c-4dc0-b6d6-5534d1f5e493 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7e2dee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.390597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:18.401833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for user 71080496c33c4e2c8b2e16b950f0b9ea and project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:18.434188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:20:18.438096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:20:18.490403 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0aad2a6-dc8c-4dc0-b6d6-5534d1f5e493 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd" status: 200 len: 223 microversion: 2.1 time: 0.111151 May 14 21:20:18.491043 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1239/2646] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:20:18 2022] GET /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd => generated 223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:18.495986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.496886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 1490939f-5892-4d71-8262-69f0148d55d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:18.503623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.504062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.504859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.505311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.519801 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] HTTP exception thrown: Instance 1490939f-5892-4d71-8262-69f0148d55d2 could not be found. May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Request method failure captured: May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 HTTP/1.1 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBvSCxyaZ3qxNvPjEfuyrbRAKJAep6VG3LxiZxF_YBBjAautUxDcP_sI_mnGzTx_iemmz6tzrXXM6pdxlzh5G2y4GUS2tWKaGAzEkN-SnaMeL61G0HL6NRPW72m0YLR4jaZRX_6puFOPzAvAweMEmxcY4_A9adNXp7u9g4c7z8ZWmhs May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.25 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74bb7b020fae4bcaa3a440acc60c7a1d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cfcb989a491440b3bf74ddc055ee14d3 May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1490939f-5892-4d71-8262-69f0148d55d2 could not be found. May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1490939f-5892-4d71-8262-69f0148d55d2'} May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1490939f-5892-4d71-8262-69f0148d55d2 could not be found. May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1490939f-5892-4d71-8262-69f0148d55d2 could not be found. May 14 21:20:18.523305 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1490939f-5892-4d71-8262-69f0148d55d2 could not be found. May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Returning 404 to user: Instance 1490939f-5892-4d71-8262-69f0148d55d2 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-63cf5066-6468-41fa-beec-11a1dbb599b9 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2" status: 404 len: 111 microversion: 2.25 time: 0.032815 May 14 21:20:18.529200 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1240/2647] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:18 2022] GET /compute/v2.1/servers/1490939f-5892-4d71-8262-69f0148d55d2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:20:18.531444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-90e1c8b0-2e19-48f6-8cad-a6976f5ec4b9 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1a7dca040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.572708 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-18368c45-ee20-4c82-bfc5-3523ad0d4e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956265 May 14 21:20:18.573362 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1408/2648] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:20:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:20:18.577756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d4187d97-1bbe-4793-a23d-2a970f57c736 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.579710 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:20:18.579710 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:20:18.580977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4187d97-1bbe-4793-a23d-2a970f57c736 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.581421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4187d97-1bbe-4793-a23d-2a970f57c736 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.582232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4187d97-1bbe-4793-a23d-2a970f57c736 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.582670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4187d97-1bbe-4793-a23d-2a970f57c736 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.607815 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d4187d97-1bbe-4793-a23d-2a970f57c736 tempest-ServicesAdminNegativeTestJSON-1645377770 tempest-ServicesAdminNegativeTestJSON-1645377770-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.033354 May 14 21:20:18.608516 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1409/2649] 10.222.0.52 () {58 vars in 1197 bytes} [Sat May 14 21:20:18 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:18.613610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.614225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:18.620427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.620889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.621689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.622134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.660517 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-90e1c8b0-2e19-48f6-8cad-a6976f5ec4b9 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964138010" status: 202 len: 0 microversion: 2.1 time: 0.123815 May 14 21:20:18.660517 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1241/2650] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:20:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964138010 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:18.660517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dbeb4534-55e3-4a98-9ee9-0c430ea19e97 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7e69430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.771984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:18.781447 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d48ea65-ff12-44f3-8251-3851d55ae32b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1510 microversion: 2.1 time: 0.172018 May 14 21:20:18.782032 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1410/2651] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:18 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:18.787963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.788475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:18.794791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.795260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.796084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:18.796531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:18.824374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:20:18.991657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dbeb4534-55e3-4a98-9ee9-0c430ea19e97 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd" status: 202 len: 0 microversion: 2.1 time: 0.339136 May 14 21:20:18.992330 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1242/2652] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:18 2022] DELETE /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:18.997482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51f7ab96-efbd-4a47-9546-ca035e582059 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:18.998140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51f7ab96-efbd-4a47-9546-ca035e582059 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:19.055884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-51f7ab96-efbd-4a47-9546-ca035e582059 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:19.063143 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-51f7ab96-efbd-4a47-9546-ca035e582059 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1215 microversion: 2.1 time: 0.069499 May 14 21:20:19.073293 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1243/2653] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:18 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:19.186272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58247ec1-2a3f-41a2-bf8f-d34408f62286 tempest-ServicesAdminNegativeTestJSON-449020259 tempest-ServicesAdminNegativeTestJSON-449020259-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:19.187581 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:20:19.187581 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:20:19.188676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58247ec1-2a3f-41a2-bf8f-d34408f62286 tempest-ServicesAdminNegativeTestJSON-449020259 tempest-ServicesAdminNegativeTestJSON-449020259-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '864bf93bab484c59baf94bb474d22b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86e98defef1b46aca7b944826148ce8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58247ec1-2a3f-41a2-bf8f-d34408f62286 tempest-ServicesAdminNegativeTestJSON-449020259 tempest-ServicesAdminNegativeTestJSON-449020259-project] Request method failure captured: May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-services HTTP/1.1 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0NmyhYV9-cyk7RgyPbAbM3LccI3Y8G0xy4hClWyHkwANCOa-NPQCAUsF8vDLlANdqG6zi3c8jSuNBXWKBCjzUkDn1w_s1OQemSm1MVxwoPfwWez6Ch5vu5FoQq16wHm3tmerabxoC2N_hF8kAKl5-ND_WFjZXv6nxB9mnaik1e8FQ May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 86e98defef1b46aca7b944826148ce8b May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-449020259 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86e98defef1b46aca7b944826148ce8b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86e98defef1b46aca7b944826148ce8b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86e98defef1b46aca7b944826148ce8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86e98defef1b46aca7b944826148ce8b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-449020259 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 86e98defef1b46aca7b944826148ce8b May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-449020259 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServicesAdminNegativeTestJSON-449020259-project May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 864bf93bab484c59baf94bb474d22b17 May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-449020259-project May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 14 21:20:19.191157 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58247ec1-2a3f-41a2-bf8f-d34408f62286 tempest-ServicesAdminNegativeTestJSON-449020259 tempest-ServicesAdminNegativeTestJSON-449020259-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58247ec1-2a3f-41a2-bf8f-d34408f62286 tempest-ServicesAdminNegativeTestJSON-449020259 tempest-ServicesAdminNegativeTestJSON-449020259-project] 10.222.0.52 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.127883 May 14 21:20:19.200700 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1244/2654] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:20:19 2022] GET /compute/v2.1/os-services => generated 112 bytes in 133 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:19.202242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a92a4d1-2724-4719-b83d-340252fc694e tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Action: 'create', calling method: .version_select at 0x7fb1a7e14a60>, body: {"keypair": {"name": "tempest-keypair-1613321499", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:19.216440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-4a92a4d1-2724-4719-b83d-340252fc694e tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:19.222822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-4a92a4d1-2724-4719-b83d-340252fc694e tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for user 79454ddcd2be44858ebeec32e97eed54 and project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:19.373328 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a92a4d1-2724-4719-b83d-340252fc694e tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.175336 May 14 21:20:19.374285 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1245/2655] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:20:19 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:19.381151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c18c7801-7140-4c76-98ab-ec7cb141a2d2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7e7b670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:19.407731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-c18c7801-7140-4c76-98ab-ec7cb141a2d2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:20:19.408435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-c18c7801-7140-4c76-98ab-ec7cb141a2d2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group c60240e5-e435-4363-af54-fd4f0e836afd not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:20:19.409095 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-c18c7801-7140-4c76-98ab-ec7cb141a2d2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:20:19.409095 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a27c277d-23b5-4200-a124-35f3d65e5ef6'] May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c18c7801-7140-4c76-98ab-ec7cb141a2d2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd HTTP/1.1 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a27c277d-23b5-4200-a124-35f3d65e5ef6'] May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'c60240e5-e435-4363-af54-fd4f0e836afd'} May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:20:19.410962 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27c277d-23b5-4200-a124-35f3d65e5ef6'] May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27c277d-23b5-4200-a124-35f3d65e5ef6'] May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27c277d-23b5-4200-a124-35f3d65e5ef6'] May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a27c277d-23b5-4200-a124-35f3d65e5ef6'] May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c18c7801-7140-4c76-98ab-ec7cb141a2d2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a27c277d-23b5-4200-a124-35f3d65e5ef6'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c18c7801-7140-4c76-98ab-ec7cb141a2d2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd" status: 404 len: 194 microversion: 2.1 time: 0.036444 May 14 21:20:19.418306 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1246/2656] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:20:19 2022] GET /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:19.421907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0ed2a87-e2e4-4bec-a83f-dcbed342119f tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1a7e2dee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:19.468415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bff01f63-f796-49dd-9eb5-b4a7622f5ec6 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "DELETE /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 204 len: 0 microversion: 2.25 time: 0.684575 May 14 21:20:19.469328 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1411/2657] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:20:18 2022] DELETE /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 0 bytes in 686 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:20:19.474812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:19.475563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:19.481462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:19.481921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:19.482699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:19.483146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:19.531620 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0ed2a87-e2e4-4bec-a83f-dcbed342119f tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613321499" status: 202 len: 0 microversion: 2.1 time: 0.116576 May 14 21:20:19.531620 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1247/2658] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:20:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1613321499 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:19.536549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0db34c55-7bdc-4074-bc9c-2d4084ca8a29 req-b839e6b5-3ec4-45a0-9d14-f0b00520bd92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f64224-2391-4126-8dcb-f009aa8a0612", "tag": "9bcc5800-f48b-4fc7-ac54-c5ae11983072"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:19.545341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0db34c55-7bdc-4074-bc9c-2d4084ca8a29 req-b839e6b5-3ec4-45a0-9d14-f0b00520bd92 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:19.545797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0db34c55-7bdc-4074-bc9c-2d4084ca8a29 req-b839e6b5-3ec4-45a0-9d14-f0b00520bd92 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:19.557538 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0db34c55-7bdc-4074-bc9c-2d4084ca8a29 req-b839e6b5-3ec4-45a0-9d14-f0b00520bd92 service nova] Creating event network-changed:9bcc5800-f48b-4fc7-ac54-c5ae11983072 for instance 65f64224-2391-4126-8dcb-f009aa8a0612 on nch1-master-1 May 14 21:20:19.563181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0db34c55-7bdc-4074-bc9c-2d4084ca8a29 req-b839e6b5-3ec4-45a0-9d14-f0b00520bd92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029950 May 14 21:20:19.563820 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1248/2659] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:19.573103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ede29eb2-0a56-4e6b-ab14-97cb1bcd2bca tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1a79203a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1972619963", "description": "tempest-description-405450600"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:19.634677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:19.643349 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0c8f25e-0601-4474-9052-ca6cec2dd90f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1322 microversion: 2.1 time: 0.172762 May 14 21:20:19.644044 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1412/2660] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:19 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:19.672319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:19.672946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:19.685765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:19.686305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:19.687188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:19.687712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:19.829575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:19.840919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:19.842434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:19.843652 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-11820d41-d78a-4691-b59b-e346c39f6c0b tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1563 microversion: 2.25 time: 0.198431 May 14 21:20:19.844404 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1413/2661] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:19 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1563 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:20:19.850176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7dc8125e-ff45-4143-b1e0-888f0530a238 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Action: 'create', calling method: .version_select at 0x7fb1a783d1f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1693315953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF83aq8rjZhlGJ51Ew7G/5f9NBIRgQi6m71HKP5bbimlgHU2uVqfo4Nia6n6zoOf1axefjfZgCtMPi7sbFxpG+nbyepa871Hjx44Hgxgmyq6Ue3f0rk6GN7EzNuQc04FMg=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:19.865974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7dc8125e-ff45-4143-b1e0-888f0530a238 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:19.871671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7dc8125e-ff45-4143-b1e0-888f0530a238 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for user 79454ddcd2be44858ebeec32e97eed54 and project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:19.971505 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7dc8125e-ff45-4143-b1e0-888f0530a238 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.125451 May 14 21:20:19.979127 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1414/2662] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:20:19 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:19.984071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:19.984954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:19.991247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:19.991748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:19.992535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:19.992980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.201794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:20.210087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce04fa87-04db-49cf-8f51-0477ab50e039 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1487 microversion: 2.1 time: 0.229842 May 14 21:20:20.211625 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1415/2663] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:19 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1487 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:20.216812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c46b2271-5f43-4e88-acbf-f0db60772055 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Action: 'create', calling method: .version_select at 0x7fb1a781c040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1518312857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAwRSxSfn999Sdh9qvz5Vb+bDMcqVVrWqrv6iTONdyGof/ZZoxU7EBxwI+Hv9CQet/P7wSnvQ4S07eUOSqKNBm9SaalNdLQOfwgHpRofTNYYVfq2k31JDlZn3AQDooYGfA=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:20.234600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c46b2271-5f43-4e88-acbf-f0db60772055 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:20.241081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c46b2271-5f43-4e88-acbf-f0db60772055 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for user 79454ddcd2be44858ebeec32e97eed54 and project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:20.359796 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ede29eb2-0a56-4e6b-ab14-97cb1bcd2bca tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.791018 May 14 21:20:20.360398 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1249/2664] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:20.381350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:20.381350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:20.390778 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c46b2271-5f43-4e88-acbf-f0db60772055 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.178190 May 14 21:20:20.407677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.408267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.409649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.410090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.419674 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1416/2665] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:20:20 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:20.425411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cf657ff-7093-4736-8fa1-66cfc68f9155 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:20.425894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5cf657ff-7093-4736-8fa1-66cfc68f9155 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:20.433581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cf657ff-7093-4736-8fa1-66cfc68f9155 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.435858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cf657ff-7093-4736-8fa1-66cfc68f9155 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.436410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cf657ff-7093-4736-8fa1-66cfc68f9155 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.436870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cf657ff-7093-4736-8fa1-66cfc68f9155 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.499835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5cf657ff-7093-4736-8fa1-66cfc68f9155 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 200 len: 172 microversion: 2.1 time: 0.078723 May 14 21:20:20.501039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1417/2666] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:20 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 172 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:20.508022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-781376e0-4c9d-4cde-bfad-e5cd1ea6aa08 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1a7774820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1344716690", "description": "tempest-description-1304815795"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:20.515436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:20.525186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d5e340c-8e7c-4646-9bcf-b1353e9f872f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1211 microversion: 2.1 time: 0.163522 May 14 21:20:20.525789 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1250/2667] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:20 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1211 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:20.530673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d4aca5d-de3c-4ac2-b902-0da73f7065dc tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Action: 'create', calling method: .version_select at 0x7fb1b4499ca0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-522143011", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4NZlciXAt5SD8xLbrWoU4GxsDu+kBzqAcrnNfH9gxEXIOXI8odexKi55KhrxHkmiLDI2QgD70K9axy86ZBnlxQ2Nih6LgWPnB9GYY8jkD+5gtd/XE7++F8RzY03hO2NQ=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:20.547415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5d4aca5d-de3c-4ac2-b902-0da73f7065dc tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:20.553780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5d4aca5d-de3c-4ac2-b902-0da73f7065dc tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Getting quotas for user 79454ddcd2be44858ebeec32e97eed54 and project b4708f1ec57540ffbf2076b94d3acd40. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:20.645010 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d4aca5d-de3c-4ac2-b902-0da73f7065dc tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.117821 May 14 21:20:20.645555 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1251/2668] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:20:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:20.650097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:20.650708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:20.659415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.659887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.660662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.661100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.864017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:20.872120 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec909093-1242-4407-b79f-5dd7f4513d96 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.225564 May 14 21:20:20.872707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1252/2669] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:20 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:20.886368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f8993030-97fc-475f-8b56-459654f50b2c tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1b40e53a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:20.888990 ncdv-master-1 devstack@n-api.service[130637]: WARNING oslo_db.sqlalchemy.utils [None req-f8993030-97fc-475f-8b56-459654f50b2c tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Unique keys not in sort_keys. The sorting order may be unstable. May 14 21:20:20.904383 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f8993030-97fc-475f-8b56-459654f50b2c tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.030536 May 14 21:20:20.908094 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1253/2670] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:20:20 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:20.913870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:20.914737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:20.926572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.927146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:20.928471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:20.929034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.057860 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-781376e0-4c9d-4cde-bfad-e5cd1ea6aa08 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.554120 May 14 21:20:21.058383 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1418/2671] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:20 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:21.062636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.070942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.071729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:21.074594 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7991f59e-d5fa-432a-891f-638d8bce7dc9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1322 microversion: 2.1 time: 0.164509 May 14 21:20:21.081629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.082115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.083258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.083373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.094389 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1254/2672] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:20 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:21.100032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.102075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:21.108796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.109530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.110306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.112014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.170537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.179904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.181702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cfcb989a491440b3bf74ddc055ee14d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bb7b020fae4bcaa3a440acc60c7a1d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.184989 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-823c9f20-3bcc-4444-8956-366ab608b0ef tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 200 len: 1346 microversion: 2.25 time: 0.117708 May 14 21:20:21.186099 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1419/2673] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:21 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 1346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:20:21.192080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee9de25c-618d-42ea-a198-4457678c0200 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1a781cb80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.282028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.289847 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d926c027-3137-45dd-8cbb-fae8bf139abf tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.194434 May 14 21:20:21.290434 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1255/2674] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:21 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:21.292910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee9de25c-618d-42ea-a198-4457678c0200 tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-522143011" status: 202 len: 0 microversion: 2.1 time: 0.105500 May 14 21:20:21.299188 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1420/2675] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-522143011 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:21.299395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-85e51e4a-ece3-45ac-a5b6-b1bc8249a998 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1a7e69ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-207803944", "description": "tempest-description-958940087"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:21.305776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.306413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:21.312900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.313361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.314142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.315097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.457283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.465120 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1aab9de-4ad7-4684-9a9a-f36244def590 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.163097 May 14 21:20:21.465769 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1421/2676] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:21 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:21.470473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-853e8dac-e54e-46cb-9692-1a5c5c1ab26c tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1a7774160>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.595975 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-853e8dac-e54e-46cb-9692-1a5c5c1ab26c tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1518312857" status: 202 len: 0 microversion: 2.1 time: 0.128749 May 14 21:20:21.597485 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1422/2677] 10.222.0.52 () {58 vars in 1277 bytes} [Sat May 14 21:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1518312857 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:21.602974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.603687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:21.610023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.610472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.611791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.612318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.754338 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-85e51e4a-ece3-45ac-a5b6-b1bc8249a998 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.462779 May 14 21:20:21.762609 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1256/2678] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:21 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:21.771007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.771671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:21.779375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.785018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.785018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.785018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.841083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.851665 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b190bf2-9203-4a2e-b554-f5c6ebc35c5a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.252885 May 14 21:20:21.866203 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1423/2679] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:21 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:21.872800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e25c1936-e56f-49e5-a342-a82824436a02 req-fd1fb548-fb16-433f-ad7d-8bc554c52a50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43996dfa-e6da-4600-a5f7-5b9bbb2f963f", "name": "network-vif-deleted", "tag": "293b2971-a322-40b2-bfb2-3a548a746cc9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:21.906834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:21.921578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e25c1936-e56f-49e5-a342-a82824436a02 req-fd1fb548-fb16-433f-ad7d-8bc554c52a50 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:21.925143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e25c1936-e56f-49e5-a342-a82824436a02 req-fd1fb548-fb16-433f-ad7d-8bc554c52a50 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:21.939683 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4fce92fe-ec4d-43e8-978a-30b101c60cf8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1267 microversion: 2.1 time: 0.170584 May 14 21:20:21.942990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1257/2680] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:21 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:21.956555 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e25c1936-e56f-49e5-a342-a82824436a02 req-fd1fb548-fb16-433f-ad7d-8bc554c52a50 service nova] Creating event network-vif-deleted:293b2971-a322-40b2-bfb2-3a548a746cc9 for instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f on nch2-master-1 May 14 21:20:21.966892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53c00c67-05ba-489a-87e2-b0b68a5ab3bf tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] Calling method '.version_select at 0x7fb1a7e2d280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:21.972485 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e25c1936-e56f-49e5-a342-a82824436a02 req-fd1fb548-fb16-433f-ad7d-8bc554c52a50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103445 May 14 21:20:21.973378 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1424/2681] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:21.980652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f1017e2f-e883-4a58-b560-006bd535093c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7f64c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:22.110471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53c00c67-05ba-489a-87e2-b0b68a5ab3bf tempest-KeyPairsV2TestJSON-186733274 tempest-KeyPairsV2TestJSON-186733274-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1693315953" status: 202 len: 0 microversion: 2.1 time: 0.164145 May 14 21:20:22.113608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1258/2682] 10.222.0.52 () {58 vars in 1277 bytes} [Sat May 14 21:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1693315953 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:22.127941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1223949089", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "5fb69a44-68f6-44d7-9bcb-ee9798387585"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:22.215093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] validate_networks() for [('5fb69a44-68f6-44d7-9bcb-ee9798387585', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:20:22.497884 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f1017e2f-e883-4a58-b560-006bd535093c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1832 microversion: 2.1 time: 0.522920 May 14 21:20:22.498511 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1425/2683] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:20:21 2022] GET /compute/v2.1/os-security-groups => generated 1832 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:22.504529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:22.505864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:22.513698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:22.514252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:22.515070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:22.515926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:22.724681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:22.734072 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d69d36de-49ae-4c76-9ba3-b0b04dcf4162 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1322 microversion: 2.1 time: 0.234271 May 14 21:20:22.737318 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1426/2684] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:22 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:22.740451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:22.741136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] [instance: 43996dfa-e6da-4600-a5f7-5b9bbb2f963f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:22.747680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:22.748363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:22.749143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:22.749592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:22.778401 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] HTTP exception thrown: Instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f could not be found. May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Request method failure captured: May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f HTTP/1.1 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBvSCxyaZ3qxNvPjEfuyrbRAKJAep6VG3LxiZxF_YBBjAautUxDcP_sI_mnGzTx_iemmz6tzrXXM6pdxlzh5G2y4GUS2tWKaGAzEkN-SnaMeL61G0HL6NRPW72m0YLR4jaZRX_6puFOPzAvAweMEmxcY4_A9adNXp7u9g4c7z8ZWmhs May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.25 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/74bb7b020fae4bcaa3a440acc60c7a1d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_74bb7b020fae4bcaa3a440acc60c7a1d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 74bb7b020fae4bcaa3a440acc60c7a1d May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cfcb989a491440b3bf74ddc055ee14d3 May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1811005538-project May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f could not be found. May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '43996dfa-e6da-4600-a5f7-5b9bbb2f963f'} May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f could not be found. May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f could not be found. May 14 21:20:22.779970 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f could not be found. May 14 21:20:22.785384 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:22.786954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] Returning 404 to user: Instance 43996dfa-e6da-4600-a5f7-5b9bbb2f963f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:22.788293 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c45ecec-5514-455f-9ef1-8fa6f2551d30 tempest-LiveAutoBlockMigrationV225Test-1811005538 tempest-LiveAutoBlockMigrationV225Test-1811005538-project] 10.222.0.52 "GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f" status: 404 len: 111 microversion: 2.25 time: 0.052126 May 14 21:20:22.789099 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1427/2685] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:20:22 2022] GET /compute/v2.1/servers/43996dfa-e6da-4600-a5f7-5b9bbb2f963f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:20:22.795063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9ee09535-c3e6-4a57-90ff-35fee1fd4125 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a77e33a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:23.237656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:20:23.238754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:20:23.239504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:20:23.245285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:20:23.245285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:20:23.257937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:23.258699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:23.259574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:23.260284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:23.280123 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9ee09535-c3e6-4a57-90ff-35fee1fd4125 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0" status: 202 len: 0 microversion: 2.1 time: 0.489500 May 14 21:20:23.284171 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1428/2686] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:22 2022] DELETE /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0 => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:23.289459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:23.290375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:23.302275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:23.303793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:23.306728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:23.307580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:23.310077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:23.314132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for user a42e0caa0878447f98544e74f767c7ca and project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:23.342410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:20:23.345519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:20:23.415427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:23.425242 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f17d1aac-a2bb-4b33-936c-ee557c164cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1273 microversion: 2.1 time: 0.139521 May 14 21:20:23.427467 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1429/2687] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:23 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:23.440489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5df3bb76-b6bb-4096-81b1-9dbc4eecbd34 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a772db80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:23.493696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-5df3bb76-b6bb-4096-81b1-9dbc4eecbd34 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:20:23.494677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-5df3bb76-b6bb-4096-81b1-9dbc4eecbd34 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group 65c4078c-4871-47bd-abc1-11099233faf0 not found {{(pid=130638) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:20:23.497125 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5df3bb76-b6bb-4096-81b1-9dbc4eecbd34 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:20:23.497125 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-fbf3ca65-a4af-4a13-8548-44c0aa853ef4'] May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5df3bb76-b6bb-4096-81b1-9dbc4eecbd34 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0 HTTP/1.1 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-fbf3ca65-a4af-4a13-8548-44c0aa853ef4'] May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '65c4078c-4871-47bd-abc1-11099233faf0'} May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:20:23.504590 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbf3ca65-a4af-4a13-8548-44c0aa853ef4'] May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbf3ca65-a4af-4a13-8548-44c0aa853ef4'] May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbf3ca65-a4af-4a13-8548-44c0aa853ef4'] May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fbf3ca65-a4af-4a13-8548-44c0aa853ef4'] May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5df3bb76-b6bb-4096-81b1-9dbc4eecbd34 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-fbf3ca65-a4af-4a13-8548-44c0aa853ef4'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5df3bb76-b6bb-4096-81b1-9dbc4eecbd34 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0" status: 404 len: 194 microversion: 2.1 time: 0.072148 May 14 21:20:23.509480 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1430/2688] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:20:23 2022] GET /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0 => generated 194 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:23.513390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6d4abf1-3d02-4b9f-8ef9-3574a631eb59 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a781ca60>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:23.551672 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b59da08e-2005-45a2-b4e8-cc563c7a68d7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.436020 May 14 21:20:23.557709 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1259/2689] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:20:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:20:23.563427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3af1d642-c65a-47ca-aafc-3e9c142ae678 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:23.565068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3af1d642-c65a-47ca-aafc-3e9c142ae678 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:23.840388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3af1d642-c65a-47ca-aafc-3e9c142ae678 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3af1d642-c65a-47ca-aafc-3e9c142ae678 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1215 microversion: 2.1 time: 0.288787 May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1260/2690] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:23 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1215 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:23.883513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:24.245311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:24.253360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ea2cc3d-7082-4cce-a624-2fb1f6bba709 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1322 microversion: 2.1 time: 0.402307 May 14 21:20:24.253928 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1261/2691] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:23 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:24.452685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:24.453726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:24.465650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:24.467000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:24.468172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:24.469718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:24.493307 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6d4abf1-3d02-4b9f-8ef9-3574a631eb59 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a" status: 202 len: 0 microversion: 2.1 time: 0.985651 May 14 21:20:24.494240 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1431/2692] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:23 2022] DELETE /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a => generated 0 bytes in 987 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:24.502590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3079d756-b6dd-4630-8faf-80a5847af163 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7fd7b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:24.579184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-3079d756-b6dd-4630-8faf-80a5847af163 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:20:24.580309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-3079d756-b6dd-4630-8faf-80a5847af163 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group f40374b1-5b1c-4455-b973-329385ac8a9a not found {{(pid=130638) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:20:24.581264 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-3079d756-b6dd-4630-8faf-80a5847af163 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:20:24.581264 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-ea32f508-3c59-4f27-a2b9-8e3e10577caa'] May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3079d756-b6dd-4630-8faf-80a5847af163 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a HTTP/1.1 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-ea32f508-3c59-4f27-a2b9-8e3e10577caa'] May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'f40374b1-5b1c-4455-b973-329385ac8a9a'} May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:20:24.583234 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea32f508-3c59-4f27-a2b9-8e3e10577caa'] May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea32f508-3c59-4f27-a2b9-8e3e10577caa'] May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea32f508-3c59-4f27-a2b9-8e3e10577caa'] May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ea32f508-3c59-4f27-a2b9-8e3e10577caa'] May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3079d756-b6dd-4630-8faf-80a5847af163 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-ea32f508-3c59-4f27-a2b9-8e3e10577caa'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3079d756-b6dd-4630-8faf-80a5847af163 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a" status: 404 len: 194 microversion: 2.1 time: 0.086879 May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1432/2693] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:20:24 2022] GET /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ffa2eab2-b599-448b-8b66-11791a876f6a req-a4fecb47-6d26-4464-882a-30ed9ff2db30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f64224-2391-4126-8dcb-f009aa8a0612", "name": "network-vif-plugged", "status": "completed", "tag": "9bcc5800-f48b-4fc7-ac54-c5ae11983072"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:24.910286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ffa2eab2-b599-448b-8b66-11791a876f6a req-a4fecb47-6d26-4464-882a-30ed9ff2db30 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:24.914107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ffa2eab2-b599-448b-8b66-11791a876f6a req-a4fecb47-6d26-4464-882a-30ed9ff2db30 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:24.914107 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ffa2eab2-b599-448b-8b66-11791a876f6a req-a4fecb47-6d26-4464-882a-30ed9ff2db30 service nova] Creating event network-vif-plugged:9bcc5800-f48b-4fc7-ac54-c5ae11983072 for instance 65f64224-2391-4126-8dcb-f009aa8a0612 on nch1-master-1 May 14 21:20:24.914107 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ffa2eab2-b599-448b-8b66-11791a876f6a req-a4fecb47-6d26-4464-882a-30ed9ff2db30 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049034 May 14 21:20:24.914107 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1433/2694] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:24.914107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4be6de04-a6a5-4523-b263-f7bbdc2ed9dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7e09dc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:24.915112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:24.915112 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-354aa99e-81ce-48f6-a68a-de4428e4af67 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.452707 May 14 21:20:24.915112 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1262/2695] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:24 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:24.915112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-16741929-6aa1-4ee1-86db-96dc9250ea9c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:24.915112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16741929-6aa1-4ee1-86db-96dc9250ea9c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:24.991230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-16741929-6aa1-4ee1-86db-96dc9250ea9c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:24.998366 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-16741929-6aa1-4ee1-86db-96dc9250ea9c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1215 microversion: 2.1 time: 0.094466 May 14 21:20:24.998945 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1263/2696] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:24 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:25.092375 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4be6de04-a6a5-4523-b263-f7bbdc2ed9dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019" status: 202 len: 0 microversion: 2.1 time: 0.447638 May 14 21:20:25.101410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c8296e8-2111-48b9-8763-199514eeebe1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a78ef670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:25.103586 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1434/2697] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:24 2022] DELETE /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:25.149144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-2c8296e8-2111-48b9-8763-199514eeebe1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:20:25.149855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-2c8296e8-2111-48b9-8763-199514eeebe1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group 9734e2f5-5b5f-414d-914a-632514716019 not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:20:25.150415 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2c8296e8-2111-48b9-8763-199514eeebe1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:20:25.150415 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-3a0f90af-f205-4f88-9db2-c7f7d557a994'] May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c8296e8-2111-48b9-8763-199514eeebe1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019 HTTP/1.1 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-3a0f90af-f205-4f88-9db2-c7f7d557a994'] May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '9734e2f5-5b5f-414d-914a-632514716019'} May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:20:25.152626 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a0f90af-f205-4f88-9db2-c7f7d557a994'] May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a0f90af-f205-4f88-9db2-c7f7d557a994'] May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a0f90af-f205-4f88-9db2-c7f7d557a994'] May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3a0f90af-f205-4f88-9db2-c7f7d557a994'] May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c8296e8-2111-48b9-8763-199514eeebe1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-3a0f90af-f205-4f88-9db2-c7f7d557a994'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2c8296e8-2111-48b9-8763-199514eeebe1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019" status: 404 len: 194 microversion: 2.1 time: 0.056533 May 14 21:20:25.155907 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1264/2698] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:20:25 2022] GET /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019 => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:20:25.166179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a9c32b01-b1d1-4318-8ff5-200b355af4d1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a771fb80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:25.272542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:25.273744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:25.280802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:25.282316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:25.283728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:25.286689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:25.465224 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a9c32b01-b1d1-4318-8ff5-200b355af4d1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.302380 May 14 21:20:25.468937 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1435/2699] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:20:25 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:25.481204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fc326808-9882-4409-8da4-882ee90ad7bf tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1b98c8d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1175122942", "description": "tempest-description-1987363786"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:25.669522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:25.679405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-387a4c14-0e42-494a-a853-4cf025adc4ed tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1322 microversion: 2.1 time: 0.412675 May 14 21:20:25.680598 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1265/2700] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:25 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:25.913837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:25.930549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:25.937793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:25.938367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:25.939161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:25.940278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:26.066712 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fc326808-9882-4409-8da4-882ee90ad7bf tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.589268 May 14 21:20:26.067316 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1436/2701] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:25 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:26.072602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:26.073550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:26.081922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:26.082582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:26.086763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:26.087222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:26.162782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:26.181270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:26.186838 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-25a6d825-bf94-4ab0-b66f-4fd61dff4391 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.276927 May 14 21:20:26.194593 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1266/2702] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:25 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:26.209721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-69ff417d-cd97-4231-ade0-57e426e68cc6 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1a79241f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1787458492", "description": "tempest-description-2055764829"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:26.212412 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c519b4f-b6bb-4e4f-925b-ef2d3b487e2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1267 microversion: 2.1 time: 0.143702 May 14 21:20:26.225166 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1437/2703] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:26 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:26.701183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:26.701818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:26.713019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:26.713547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:26.714435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:26.714946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:27.029256 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-69ff417d-cd97-4231-ade0-57e426e68cc6 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.831879 May 14 21:20:27.030283 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1267/2704] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:26 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:27.036364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e389be24-4a66-4040-883c-ca8dffcc5016 req-a3f70cb9-6cd1-45f5-a0bc-bf420bf18392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fee5556-bd76-4312-b8c9-07955c04e89c", "tag": "422ed31c-2aa9-426e-9c5a-eba8bee8202d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:27.060962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e389be24-4a66-4040-883c-ca8dffcc5016 req-a3f70cb9-6cd1-45f5-a0bc-bf420bf18392 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:27.062821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e389be24-4a66-4040-883c-ca8dffcc5016 req-a3f70cb9-6cd1-45f5-a0bc-bf420bf18392 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:27.085054 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e389be24-4a66-4040-883c-ca8dffcc5016 req-a3f70cb9-6cd1-45f5-a0bc-bf420bf18392 service nova] Creating event network-changed:422ed31c-2aa9-426e-9c5a-eba8bee8202d for instance 1fee5556-bd76-4312-b8c9-07955c04e89c on nch2-master-1 May 14 21:20:27.091546 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e389be24-4a66-4040-883c-ca8dffcc5016 req-a3f70cb9-6cd1-45f5-a0bc-bf420bf18392 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058952 May 14 21:20:27.092811 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1268/2705] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:27.164908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-305636083", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "40fe4e54-7ec0-4751-90cd-3564b5d09a77"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:27.234648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] validate_networks() for [('40fe4e54-7ec0-4751-90cd-3564b5d09a77', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:20:27.467467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:27.476798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b249dde-4e19-4d3f-8c5a-b27ba9632699 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1517 microversion: 2.1 time: 0.783398 May 14 21:20:27.477397 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1438/2706] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:26 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1517 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:27.491341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:27.492151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:27.510219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:27.510678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:27.511463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:27.511935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:27.952256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:27.964814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7e7444da-c43a-43e6-a00a-e38d8d927d56 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.480490 May 14 21:20:27.965857 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1439/2707] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:27 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:27.973380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:27.974256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:27.983974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:27.984721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:27.988169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:27.988876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.090203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:28.099729 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0dcbc3d8-4bef-4765-ae01-0ece817c0b6e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1273 microversion: 2.1 time: 0.130984 May 14 21:20:28.099729 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1440/2708] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:27 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:28.105202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:28.106210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:28.113183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.113846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.114789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.115401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.146875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lazy-loading 'flavor' on Instance uuid 65f64224-2391-4126-8dcb-f009aa8a0612 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:20:28.183630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:20:28.184579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:20:28.185213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:20:28.185839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:20:28.187131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:20:28.213118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.215441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.216569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.217202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.248402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Getting quotas for project 62ef4614a33040a7b0ae010a6b1c7fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:28.258233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Getting quotas for user 985e9f2f783e4a329e9a4c100a06134c and project 62ef4614a33040a7b0ae010a6b1c7fb1. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:28.276452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:20:28.287961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:20:28.499138 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d340e567-2083-447f-9162-ae76caa27781 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.342457 May 14 21:20:28.501683 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1269/2709] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:20:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:20:28.512989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f38251f-7947-4737-8c71-f55914771035 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:28.514135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f38251f-7947-4737-8c71-f55914771035 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:28.623779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6f38251f-7947-4737-8c71-f55914771035 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:28.630577 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f38251f-7947-4737-8c71-f55914771035 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1215 microversion: 2.1 time: 0.121742 May 14 21:20:28.634165 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1270/2710] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:28 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1215 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:28.673045 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6fab886-165d-41e2-a364-e5209108ef9a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action" status: 200 len: 32 microversion: 2.1 time: 0.571802 May 14 21:20:28.674429 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1441/2711] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:28 2022] POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action => generated 32 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:28.697850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:28.704296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:28.726305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.727033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.728399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.730962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.985694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:28.986622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:28.996001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.996463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:28.997260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:28.997711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:29.286873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:29.305460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33e216d1-114a-420f-8590-e70c3416483f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.324804 May 14 21:20:29.315308 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1442/2712] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:28 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:29.320488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:29.321114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:29.330780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:29.331501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:29.332445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:29.332887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:29.476203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:29.511001 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c83e5b3c-5608-4d6a-aa93-d9adb199df50 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.824684 May 14 21:20:29.515872 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1271/2713] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:28 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:29.714094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:29.723390 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3fff03f5-a9c0-4eb2-9911-7a94e7354857 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.406878 May 14 21:20:29.728430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1443/2714] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:29 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:29.734929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-851c675a-472d-44d4-b6a6-66bdc956abf8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:29.739542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-851c675a-472d-44d4-b6a6-66bdc956abf8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:29.790100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-663ff9ff-ca04-4588-bd5b-7cbe6d91be08 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a7e1a3a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1005464565", "description": "tempest-description-1636504546"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:29.871894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-851c675a-472d-44d4-b6a6-66bdc956abf8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:29.882530 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-851c675a-472d-44d4-b6a6-66bdc956abf8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1215 microversion: 2.1 time: 0.151568 May 14 21:20:29.893578 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1444/2715] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:29 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:30.322362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:30.322967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:30.331388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:30.331871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:30.332813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:30.333258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:30.560284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:30.572261 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-11e471e9-5311-4b4b-b978-605acdf7d0ca tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.253478 May 14 21:20:30.573345 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1445/2716] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:30 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:30.588335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:30.589212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:30.605140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:30.605140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:30.606048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:30.607400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:30.713742 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-663ff9ff-ca04-4588-bd5b-7cbe6d91be08 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.192939 May 14 21:20:30.714847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1272/2717] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:29 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:30.730139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bce4251d-701a-426a-9061-89a1844df7c1 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a79b7e50>, body: {"security_group_rule": {"parent_group_id": "055f9019-1d0f-46df-a708-2f35bb4be368", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:30.815789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:30.824080 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1def6902-5be8-42ac-9e73-744b1ed37c32 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.248403 May 14 21:20:30.824846 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1446/2718] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:30 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:30.830943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:30.837323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:30.855693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:30.859178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:30.862649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:30.863119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:31.156772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:31.171844 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b5d17cca-0373-4beb-940f-3e7fdba5871c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.345615 May 14 21:20:31.175434 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1447/2719] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:30 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:31.203076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:31.204156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:31.220901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:31.224419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:31.225482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:31.226053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:31.426621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:31.437441 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89a9815b-44ce-4c06-827b-036f31398a74 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1267 microversion: 2.1 time: 0.260839 May 14 21:20:31.451203 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1448/2720] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:31 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:31.497899 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bce4251d-701a-426a-9061-89a1844df7c1 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.770633 May 14 21:20:31.497899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1273/2721] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:20:30 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:31.510451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2791b363-87c4-4c7c-a217-1133faa8ddb0 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a77e33a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-320336381", "description": "tempest-description-130865652"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:31.591445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:31.592119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:31.600733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:31.601697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:31.603163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:31.603842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:31.785594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:31.795408 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cadf2cea-62ff-4b3d-b025-7b30b2ff115a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.209545 May 14 21:20:31.796705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1274/2722] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:31 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:31.801976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-415f36d8-ca0f-4aad-938b-07de789c821c req-91887db0-5002-4a3f-9ba6-756a575dd5a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6b381c3-d53d-4d16-8783-5b095927537a", "tag": "0fd1ba02-b29d-4826-b8f2-bebee3a5e344"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:31.828487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-415f36d8-ca0f-4aad-938b-07de789c821c req-91887db0-5002-4a3f-9ba6-756a575dd5a3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:31.829177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-415f36d8-ca0f-4aad-938b-07de789c821c req-91887db0-5002-4a3f-9ba6-756a575dd5a3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:31.855459 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-415f36d8-ca0f-4aad-938b-07de789c821c req-91887db0-5002-4a3f-9ba6-756a575dd5a3 service nova] Creating event network-changed:0fd1ba02-b29d-4826-b8f2-bebee3a5e344 for instance e6b381c3-d53d-4d16-8783-5b095927537a on nch2-master-1 May 14 21:20:31.861033 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-415f36d8-ca0f-4aad-938b-07de789c821c req-91887db0-5002-4a3f-9ba6-756a575dd5a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062783 May 14 21:20:31.873483 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1275/2723] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:31.881158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:31.882074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:31.891090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:31.891924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:31.892920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:31.893482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:32.314005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:32.319434 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cf3e6b21-13e9-4284-a30b-32c05bd5c0ee tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.446464 May 14 21:20:32.328947 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1276/2724] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:31 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:32.336840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:32.336840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:32.344533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:32.345351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:32.346353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:32.347029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:32.402930 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2791b363-87c4-4c7c-a217-1133faa8ddb0 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.896735 May 14 21:20:32.403625 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1449/2725] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:31 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:32.415092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2ca858d-e7f0-411f-927d-080c2aa95d31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1b97a7d30>, body: {"security_group_rule": {"parent_group_id": "40d42a7b-566a-4e99-b138-4ef67e081e9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:32.833955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:32.859581 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60e686bb-dbf5-42ac-b10d-fcdc03af3273 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.528616 May 14 21:20:32.862591 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1277/2726] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:32 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:32.877155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:32.878417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:32.899141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:32.899657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:32.902495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:32.903144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:33.009764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:33.019512 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0bfc0c0e-0bf4-497b-ae00-fe55c6fefa85 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1273 microversion: 2.1 time: 0.155541 May 14 21:20:33.023897 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1278/2727] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:32 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1273 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:33.038172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:33.039833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:33.050641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:33.052187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:33.056077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:33.056726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:33.288289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:33.298164 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d55e310-59d0-4257-a926-aa8e4ed0dfec tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.272988 May 14 21:20:33.311217 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1279/2728] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:33 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:33.344754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:33.346427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:33.355142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:33.356586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:33.357732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:33.360898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:33.669487 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f2ca858d-e7f0-411f-927d-080c2aa95d31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.258420 May 14 21:20:33.672977 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1450/2729] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:20:32 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:33.685631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e75ebb2f-f972-470b-b9c0-21bfeea74b66 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a7d32940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-410035791", "description": "tempest-description-1112375564"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:34.081057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:34.090251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-89673df4-efca-455c-bd05-e41957f801c9 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.752178 May 14 21:20:34.101635 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1280/2730] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:33 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:34.106969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:34.107622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:34.115939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:34.116693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:34.117924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:34.118569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:34.367184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e75ebb2f-f972-470b-b9c0-21bfeea74b66 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.687708 May 14 21:20:34.369211 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1451/2731] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:20:34.381296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:34.382221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:34.389595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:34.390060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:34.391325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:34.393587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:34.398502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:34.409823 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5f8d0700-d31c-4c6a-ad35-d96bda8f67e8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.306734 May 14 21:20:34.410438 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1281/2732] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:34 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:34.415159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:34.415743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:34.431300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:34.431792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:34.432594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:34.433202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:34.746850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:34.756350 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-38b60297-98e2-46e9-aae1-80ff32c44e98 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1315 microversion: 2.1 time: 0.385078 May 14 21:20:34.760772 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1452/2733] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:34 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:34.765816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-622bec5e-59fe-4e18-9a20-5c1b199d7c43 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1b469eee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-67951059", "description": "tempest-description-1448977540"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:34.794087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:34.807205 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-74a86a1e-8704-4330-a088-e248e1ffff0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.395071 May 14 21:20:34.818474 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1282/2734] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:34 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:35.112121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:35.113530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:35.140824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:35.147731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:35.150775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:35.152659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:35.364258 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-622bec5e-59fe-4e18-9a20-5c1b199d7c43 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.597569 May 14 21:20:35.365294 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1453/2735] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:34 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:35.380556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-dfbb0ac3-6cee-4f77-ac82-8c725098b6f5 req-235c5e68-b319-4fb0-a454-56a4a86a77bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fee5556-bd76-4312-b8c9-07955c04e89c", "name": "network-vif-plugged", "status": "completed", "tag": "422ed31c-2aa9-426e-9c5a-eba8bee8202d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:35.395981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-dfbb0ac3-6cee-4f77-ac82-8c725098b6f5 req-235c5e68-b319-4fb0-a454-56a4a86a77bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:35.397631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-dfbb0ac3-6cee-4f77-ac82-8c725098b6f5 req-235c5e68-b319-4fb0-a454-56a4a86a77bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:35.413213 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-dfbb0ac3-6cee-4f77-ac82-8c725098b6f5 req-235c5e68-b319-4fb0-a454-56a4a86a77bd service nova] Creating event network-vif-plugged:422ed31c-2aa9-426e-9c5a-eba8bee8202d for instance 1fee5556-bd76-4312-b8c9-07955c04e89c on nch2-master-1 May 14 21:20:35.434718 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-dfbb0ac3-6cee-4f77-ac82-8c725098b6f5 req-235c5e68-b319-4fb0-a454-56a4a86a77bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051820 May 14 21:20:35.436031 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1454/2736] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:35.449370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-56d70a98-0b2f-4ec8-b19a-995a222df668 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a781cdc0>, body: {"security_group_rule": {"parent_group_id": "7432dc77-2703-4d48-83e7-1a3abfc1478b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "4b81681c-1790-43c2-8e87-d4b3c4e53596"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:35.658793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:35.673561 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f2061c71-dfba-4482-a883-9a1f69975fe4 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.567733 May 14 21:20:35.680086 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1283/2737] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:35 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:35.702206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:35.702864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:35.713882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:35.714513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:35.716006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:35.716600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:36.021358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:36.029075 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-757f8cab-4731-4a9e-8472-b43cc6ae33d8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.348752 May 14 21:20:36.033108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1284/2738] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:35 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:36.041772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:36.044396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:36.054987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:36.055678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:36.056535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:36.057135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:36.175512 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-56d70a98-0b2f-4ec8-b19a-995a222df668 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 329 microversion: 2.1 time: 0.737527 May 14 21:20:36.176297 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1455/2739] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:20:35 2022] POST /compute/v2.1/os-security-group-rules => generated 329 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:36.188546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:36.189634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:36.196757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:36.197435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:36.198439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:36.199039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:36.265296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:36.277256 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ca3d4b4-7d74-4ee5-bbf4-eb79a5f142cd tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1315 microversion: 2.1 time: 0.242679 May 14 21:20:36.279166 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1285/2740] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:36 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:36.292757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8cd0cc65-7910-40a5-a901-e6c4af916418 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a7dcaf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1555621471", "description": "tempest-description-445046491"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:36.466476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:36.484267 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6b140e4a-8abb-45b6-87fa-7d4b007ad8e2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1315 microversion: 2.1 time: 0.299018 May 14 21:20:36.486443 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1456/2741] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:36 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:36.492683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4a631547-0c26-46f6-bd0f-306e8dc3fd4b req-31960f07-841b-4e8b-a6ac-989cf1d7a1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b02897-2456-45a3-b096-cc5949058685", "tag": "33de3621-b7e7-4fcf-a36c-4dad3848229d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:36.504047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4a631547-0c26-46f6-bd0f-306e8dc3fd4b req-31960f07-841b-4e8b-a6ac-989cf1d7a1b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:36.504468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4a631547-0c26-46f6-bd0f-306e8dc3fd4b req-31960f07-841b-4e8b-a6ac-989cf1d7a1b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:36.520843 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4a631547-0c26-46f6-bd0f-306e8dc3fd4b req-31960f07-841b-4e8b-a6ac-989cf1d7a1b7 service nova] Creating event network-changed:33de3621-b7e7-4fcf-a36c-4dad3848229d for instance 58b02897-2456-45a3-b096-cc5949058685 on nch1-master-1 May 14 21:20:36.527460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4a631547-0c26-46f6-bd0f-306e8dc3fd4b req-31960f07-841b-4e8b-a6ac-989cf1d7a1b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039553 May 14 21:20:36.528712 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1457/2742] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:36.695378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:36.696150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:36.708885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:36.709551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:36.710175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:36.710624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.013483 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8cd0cc65-7910-40a5-a901-e6c4af916418 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.732448 May 14 21:20:37.014490 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1286/2743] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:36 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:37.026343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78cd6aeb-636e-4e05-9a8f-9baf54e653ac tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a7a67b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-714413818", "description": "tempest-description-1052304915"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:37.074575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:37.101231 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2dd7a0ad-be2b-4e41-81fc-0397e24f426c tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.400528 May 14 21:20:37.111984 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1458/2744] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:36 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:37.131531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:37.133439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:37.161678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.162298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.163150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.163694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.468784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:37.489836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae98cf22-4d8c-4629-a41e-4aa953e87fb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.374534 May 14 21:20:37.494048 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1459/2745] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:37 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:37.501329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:37.505246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:37.522900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.522900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.523888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.525338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.631692 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78cd6aeb-636e-4e05-9a8f-9baf54e653ac tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.608879 May 14 21:20:37.632605 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1287/2746] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:37 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:20:37.639098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:37.639761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:37.652345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.652800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.656636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.663611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.842681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:37.852398 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c4ede83-4815-4e5c-9172-194d47466572 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1315 microversion: 2.1 time: 0.358509 May 14 21:20:37.856498 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1460/2747] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:37 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:37.866601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68d2415e-12c1-4f52-8f53-5e32fb100d4c tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a794d550>, body: {"security_group_rule": {"parent_group_id": "5fee247f-bdd7-4735-a8a7-80f3ec1152d3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "326019e8-6f6a-466c-8d6f-c016920ce9ad"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:37.961103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:37.969962 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-490f6002-68c1-42ec-bd11-f90d589a0518 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1502 microversion: 2.1 time: 0.335868 May 14 21:20:37.971225 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1288/2748] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:37 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1502 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:37.990145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45793c7a-6530-41b3-9d12-a778ccffe220 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:37.990704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45793c7a-6530-41b3-9d12-a778ccffe220 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:37.997330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45793c7a-6530-41b3-9d12-a778ccffe220 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.997784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45793c7a-6530-41b3-9d12-a778ccffe220 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:37.998565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45793c7a-6530-41b3-9d12-a778ccffe220 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:37.999004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45793c7a-6530-41b3-9d12-a778ccffe220 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:38.342588 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45793c7a-6530-41b3-9d12-a778ccffe220 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c/action" status: 202 len: 0 microversion: 2.1 time: 0.356378 May 14 21:20:38.343337 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1289/2749] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:37 2022] POST /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:20:38.351099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:38.352005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:38.359274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:38.359775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:38.360559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:38.362478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:38.541881 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68d2415e-12c1-4f52-8f53-5e32fb100d4c tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.682807 May 14 21:20:38.543465 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1461/2750] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:20:37 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:38.551659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:38.558556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:38.579626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:38.590585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:38.593706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:38.594502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:38.736897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:38.749312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a5a57e2-9743-4ffc-9b94-65b5fcf08a2d tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.403278 May 14 21:20:38.761734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1290/2751] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:38 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:38.777142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:38.777971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:38.791009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:38.791543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:38.792322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:38.796236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:38.994035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:39.005450 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a6e9c8b0-99f5-4978-88b6-81018880485f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1507 microversion: 2.1 time: 0.460329 May 14 21:20:39.006703 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1462/2752] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:38 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1507 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:39.013465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7cdcdf00-9269-4f7c-bd9f-f7490413489c tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a7e09040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:39.153047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:39.167614 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-acd25e82-50eb-481b-bf66-db525f2f2963 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.403729 May 14 21:20:39.168239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1291/2753] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:38 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:39.179373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:39.180532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:39.195997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:39.195997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:39.195997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:39.196492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:39.528522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:39.542071 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2ac00088-4c11-4f32-b437-22dc0b525cc5 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1315 microversion: 2.1 time: 0.372655 May 14 21:20:39.542873 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1292/2754] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:39 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:39.547957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-3e632acb-b67b-4099-b1ee-d8fa6b81ef5f req-c962ae2c-e646-484f-baed-f88ecca74c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b381c3-d53d-4d16-8783-5b095927537a", "name": "network-vif-plugged", "status": "completed", "tag": "0fd1ba02-b29d-4826-b8f2-bebee3a5e344"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:39.558291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3e632acb-b67b-4099-b1ee-d8fa6b81ef5f req-c962ae2c-e646-484f-baed-f88ecca74c4a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:39.558749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3e632acb-b67b-4099-b1ee-d8fa6b81ef5f req-c962ae2c-e646-484f-baed-f88ecca74c4a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:39.573305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-3e632acb-b67b-4099-b1ee-d8fa6b81ef5f req-c962ae2c-e646-484f-baed-f88ecca74c4a service nova] Creating event network-vif-plugged:0fd1ba02-b29d-4826-b8f2-bebee3a5e344 for instance e6b381c3-d53d-4d16-8783-5b095927537a on nch2-master-1 May 14 21:20:39.578461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-3e632acb-b67b-4099-b1ee-d8fa6b81ef5f req-c962ae2c-e646-484f-baed-f88ecca74c4a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 May 14 21:20:39.579077 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1293/2755] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:39.609697 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7cdcdf00-9269-4f7c-bd9f-f7490413489c tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/326019e8-6f6a-466c-8d6f-c016920ce9ad" status: 202 len: 0 microversion: 2.1 time: 0.601151 May 14 21:20:39.610674 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1463/2756] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:39 2022] DELETE /compute/v2.1/os-security-groups/326019e8-6f6a-466c-8d6f-c016920ce9ad => generated 0 bytes in 603 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:39.622132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5945da9-f637-4622-accb-d461fac02b84 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1b41335e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:39.769611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:39.770548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:39.779601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:39.780470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:39.782095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:39.782927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:39.857752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5945da9-f637-4622-accb-d461fac02b84 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/5fee247f-bdd7-4735-a8a7-80f3ec1152d3" status: 200 len: 247 microversion: 2.1 time: 0.238589 May 14 21:20:39.857752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1294/2757] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:20:39 2022] GET /compute/v2.1/os-security-groups/5fee247f-bdd7-4735-a8a7-80f3ec1152d3 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:39.870055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-784a00f8-12d2-482b-8584-c4bd03cfebda tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a7e14af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-310941987", "description": "tempest-description-1043499920"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:40.035696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:40.046179 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6f9cfdb-10ab-405e-b78b-9a8dadfe1374 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.283168 May 14 21:20:40.057875 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1464/2758] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:39 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:40.063500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:40.067103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:40.072613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.073343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:40.074346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.075175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:40.241194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:40.256995 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8abcbd5f-7659-4adc-acd2-f11626f42918 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1487 microversion: 2.1 time: 0.197496 May 14 21:20:40.258858 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1465/2759] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:40 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1487 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:40.270632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:40.271773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:40.278466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.279081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:40.279964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.280494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:40.449544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-784a00f8-12d2-482b-8584-c4bd03cfebda tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.583951 May 14 21:20:40.450473 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1295/2760] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:20:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:40.457759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:40.458583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:40.479184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.479679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:40.480484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.480934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:40.519062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:20:40.565724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:40.575917 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dfcde2a5-d664-4bba-bd2d-1f0af87f62e5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1315 microversion: 2.1 time: 0.313762 May 14 21:20:40.585849 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1466/2761] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:40 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:40.585849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70b0116e-a712-4355-a899-2b6b5cee398c tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a771f040>, body: {"security_group_rule": {"parent_group_id": "f0a50c26-f682-4aad-86b3-c3d546aff5e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:40.947104 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09b1dab6-8a59-41c1-a741-fb478f502525 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 204 len: 0 microversion: 2.1 time: 0.494648 May 14 21:20:40.948332 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1296/2762] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:20:40 2022] DELETE /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:20:40.954702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:40.955431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:40.974126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.975457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:40.977343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:40.977793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:41.123813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:41.132183 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d52bf187-7920-458f-8081-9acc2c7074b1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1315 microversion: 2.1 time: 0.182691 May 14 21:20:41.132754 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1297/2763] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:40 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:41.137450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:41.138088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:41.144283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:41.144748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:41.145523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:41.145967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:41.208963 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70b0116e-a712-4355-a899-2b6b5cee398c tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.629840 May 14 21:20:41.210231 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1467/2764] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:20:40 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:41.218807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:41.219628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:41.226274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:41.226734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:41.227547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:41.228000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:41.401460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:41.410760 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5c5eb4b2-a4dc-4c84-a10b-7eb91131cd62 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.199219 May 14 21:20:41.411361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1468/2765] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:41 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:41.416874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d3d28ef-c1bb-49f2-90e3-b087908f68a1 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Action: 'create', calling method: .version_select at 0x7fb1a77e6ee0>, body: {"security_group_rule": {"parent_group_id": "f0a50c26-f682-4aad-86b3-c3d546aff5e1", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:41.753696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:41.765838 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9a088fdb-0c07-4dec-af3f-1970b69bc59b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1493 microversion: 2.1 time: 0.631804 May 14 21:20:41.777681 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1298/2766] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:41 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1493 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:41.784592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:41.785439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:41.793672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:41.794414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:41.795427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:41.796068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.057606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:42.069454 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e233d9c-beef-4f3f-a19f-10201201e180 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1503 microversion: 2.1 time: 0.289834 May 14 21:20:42.071259 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1299/2767] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:41 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1503 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:42.088146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0cd7be51-c4fd-4cde-ab68-8bb490ae5bd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:42.089910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0cd7be51-c4fd-4cde-ab68-8bb490ae5bd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:42.097031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd7be51-c4fd-4cde-ab68-8bb490ae5bd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.097747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd7be51-c4fd-4cde-ab68-8bb490ae5bd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.098845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd7be51-c4fd-4cde-ab68-8bb490ae5bd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.099959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd7be51-c4fd-4cde-ab68-8bb490ae5bd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.103042 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d3d28ef-c1bb-49f2-90e3-b087908f68a1 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.690409 May 14 21:20:42.109568 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1469/2768] 10.222.0.52 () {60 vars in 1194 bytes} [Sat May 14 21:20:41 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:42.115499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-20f4f87c-e401-44de-ac1d-2d31c14053f5 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a796cca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:42.193483 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0cd7be51-c4fd-4cde-ab68-8bb490ae5bd5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.110423 May 14 21:20:42.195553 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1300/2769] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:42 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 21:20:42.203532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:42.208190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:42.212863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.213493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.214394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.215061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.224669 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-20f4f87c-e401-44de-ac1d-2d31c14053f5 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/f0a50c26-f682-4aad-86b3-c3d546aff5e1" status: 200 len: 664 microversion: 2.1 time: 0.113052 May 14 21:20:42.233480 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1470/2770] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:20:42 2022] GET /compute/v2.1/os-security-groups/f0a50c26-f682-4aad-86b3-c3d546aff5e1 => generated 664 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:42.239209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-deeedcc0-c89c-4e9f-af69-72575a2167aa req-6716ac7d-5d59-48d8-9d54-5e90a6bce1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b02897-2456-45a3-b096-cc5949058685", "name": "network-vif-plugged", "status": "completed", "tag": "33de3621-b7e7-4fcf-a36c-4dad3848229d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:42.249912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-deeedcc0-c89c-4e9f-af69-72575a2167aa req-6716ac7d-5d59-48d8-9d54-5e90a6bce1a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.250448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-deeedcc0-c89c-4e9f-af69-72575a2167aa req-6716ac7d-5d59-48d8-9d54-5e90a6bce1a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.265409 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-deeedcc0-c89c-4e9f-af69-72575a2167aa req-6716ac7d-5d59-48d8-9d54-5e90a6bce1a4 service nova] Creating event network-vif-plugged:33de3621-b7e7-4fcf-a36c-4dad3848229d for instance 58b02897-2456-45a3-b096-cc5949058685 on nch1-master-1 May 14 21:20:42.289197 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-deeedcc0-c89c-4e9f-af69-72575a2167aa req-6716ac7d-5d59-48d8-9d54-5e90a6bce1a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042972 May 14 21:20:42.295248 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1471/2771] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:42.309890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-45578484-d8e5-4133-9847-59dea9658bdc tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a794d9d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:42.615855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:42.624841 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-866e6ca0-674b-4327-b8fc-f4c77c444ef2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1315 microversion: 2.1 time: 0.428319 May 14 21:20:42.625579 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1301/2772] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:42 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:42.632138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:42.632749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:42.642985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.643442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.644260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.644701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.660541 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-45578484-d8e5-4133-9847-59dea9658bdc tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-group-rules/8f19c0c1-d16c-4555-963f-2114b4030ca1" status: 202 len: 0 microversion: 2.1 time: 0.363634 May 14 21:20:42.662101 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1472/2773] 10.222.0.52 () {58 vars in 1286 bytes} [Sat May 14 21:20:42 2022] DELETE /compute/v2.1/os-security-group-rules/8f19c0c1-d16c-4555-963f-2114b4030ca1 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:42.681697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e74c225-b3a3-4f22-932d-17e2058e8833 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a796c700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:42.952981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:42.965844 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-736331cb-9f93-45af-bb21-fb10c3e739fb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.338134 May 14 21:20:42.967534 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1302/2774] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:42 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:42.973956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:42.974917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:42.990755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.993140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:42.994870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:42.995575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:43.224579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:43.232854 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4049fe4d-7ad3-4fe6-96d0-6c6669bf9e51 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1493 microversion: 2.1 time: 0.264092 May 14 21:20:43.233764 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1303/2775] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:42 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1493 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:43.239640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c4f6bb28-e9af-4372-9102-3dc203759378 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:43.241058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4f6bb28-e9af-4372-9102-3dc203759378 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:43.248085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4f6bb28-e9af-4372-9102-3dc203759378 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:43.248618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4f6bb28-e9af-4372-9102-3dc203759378 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:43.249478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4f6bb28-e9af-4372-9102-3dc203759378 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:43.249995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4f6bb28-e9af-4372-9102-3dc203759378 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:43.292112 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c4f6bb28-e9af-4372-9102-3dc203759378 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.056492 May 14 21:20:43.293109 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1304/2776] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:43 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:43.502192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-605491ed-99ff-4c2e-9855-72065295f63c req-970ee28e-c833-4e47-a768-3b84f6d32648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fee5556-bd76-4312-b8c9-07955c04e89c", "name": "network-vif-deleted", "tag": "422ed31c-2aa9-426e-9c5a-eba8bee8202d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:43.512982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-605491ed-99ff-4c2e-9855-72065295f63c req-970ee28e-c833-4e47-a768-3b84f6d32648 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:43.513680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-605491ed-99ff-4c2e-9855-72065295f63c req-970ee28e-c833-4e47-a768-3b84f6d32648 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:43.527798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-605491ed-99ff-4c2e-9855-72065295f63c req-970ee28e-c833-4e47-a768-3b84f6d32648 service nova] Creating event network-vif-deleted:422ed31c-2aa9-426e-9c5a-eba8bee8202d for instance 1fee5556-bd76-4312-b8c9-07955c04e89c on nch2-master-1 May 14 21:20:43.534403 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-605491ed-99ff-4c2e-9855-72065295f63c req-970ee28e-c833-4e47-a768-3b84f6d32648 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037143 May 14 21:20:43.535232 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1305/2777] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:43.652916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:43.658019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:43.666158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:43.666618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:43.667412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:43.667883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:43.699271 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e74c225-b3a3-4f22-932d-17e2058e8833 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f0a50c26-f682-4aad-86b3-c3d546aff5e1" status: 202 len: 0 microversion: 2.1 time: 1.028964 May 14 21:20:43.700538 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1473/2778] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:42 2022] DELETE /compute/v2.1/os-security-groups/f0a50c26-f682-4aad-86b3-c3d546aff5e1 => generated 0 bytes in 1031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:43.709129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9d7c2ba-d12b-4cc8-858a-16dfd9bd9f31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a771fe50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:43.760901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-d9d7c2ba-d12b-4cc8-858a-16dfd9bd9f31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:20:43.761510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-d9d7c2ba-d12b-4cc8-858a-16dfd9bd9f31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Neutron security group 326019e8-6f6a-466c-8d6f-c016920ce9ad not found {{(pid=130638) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:20:43.762263 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d9d7c2ba-d12b-4cc8-858a-16dfd9bd9f31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] HTTP exception thrown: Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist May 14 21:20:43.762263 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-75bd12e5-1634-4114-8356-50a64afb28f0'] May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9d7c2ba-d12b-4cc8-858a-16dfd9bd9f31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Request method failure captured: May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-groups/326019e8-6f6a-466c-8d6f-c016920ce9ad HTTP/1.1 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB0ddLF1jHmiZL6EVGH0z37UhLCH78CtxUr9NJnqEDufs1AQhSC7Rqk2JunVj1msomEowrlDBBdC044Z6ANTgJfV7Bq8PiSg2vSfa4N3CeiRtRc4SXTZai90v096yWo2sIUBZZ8UKP4v3KMWPoShUhS9XeZD-mdjpJmO7qC_z8FJfMk May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 040d1a9c0d014b1697cfa93771ebfefa May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1522486720 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/040d1a9c0d014b1697cfa93771ebfefa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/040d1a9c0d014b1697cfa93771ebfefa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/040d1a9c0d014b1697cfa93771ebfefa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_040d1a9c0d014b1697cfa93771ebfefa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1522486720 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 040d1a9c0d014b1697cfa93771ebfefa May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1522486720 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupRulesTestJSON-1522486720-project May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: fc192a867aa243259c5c2722f8f8f304 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1522486720-project May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-75bd12e5-1634-4114-8356-50a64afb28f0'] May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '326019e8-6f6a-466c-8d6f-c016920ce9ad'} May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:20:43.764534 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bd12e5-1634-4114-8356-50a64afb28f0'] May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bd12e5-1634-4114-8356-50a64afb28f0'] May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bd12e5-1634-4114-8356-50a64afb28f0'] May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-75bd12e5-1634-4114-8356-50a64afb28f0'] May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9d7c2ba-d12b-4cc8-858a-16dfd9bd9f31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Returning 404 to user: Security group 326019e8-6f6a-466c-8d6f-c016920ce9ad does not exist May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-75bd12e5-1634-4114-8356-50a64afb28f0'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d9d7c2ba-d12b-4cc8-858a-16dfd9bd9f31 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/326019e8-6f6a-466c-8d6f-c016920ce9ad" status: 404 len: 194 microversion: 2.1 time: 0.061881 May 14 21:20:43.770242 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1474/2779] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:43 2022] DELETE /compute/v2.1/os-security-groups/326019e8-6f6a-466c-8d6f-c016920ce9ad => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:43.779000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58d6b363-4fe5-433b-b48e-c01033071562 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a78233a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:43.895968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:43.904596 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d29741cd-7d32-4c8d-b704-7a4d9c4a1396 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1315 microversion: 2.1 time: 0.265686 May 14 21:20:43.905407 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1306/2780] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:43 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:43.988131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:43.988770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:44.009702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.011025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.011887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.012342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.215131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:44.224224 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f3d94ba-c36c-402d-b069-5af9c17e742b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.244735 May 14 21:20:44.224822 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1307/2781] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:43 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:44.250588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:44.251410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:44.258087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.258541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.259314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.259928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.299616 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58d6b363-4fe5-433b-b48e-c01033071562 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/5fee247f-bdd7-4735-a8a7-80f3ec1152d3" status: 202 len: 0 microversion: 2.1 time: 0.522327 May 14 21:20:44.300487 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1475/2782] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:43 2022] DELETE /compute/v2.1/os-security-groups/5fee247f-bdd7-4735-a8a7-80f3ec1152d3 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:44.308846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-161cbb73-0e57-4444-b188-767f710daf2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:44.310228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-161cbb73-0e57-4444-b188-767f710daf2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:44.318445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-161cbb73-0e57-4444-b188-767f710daf2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.319256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-161cbb73-0e57-4444-b188-767f710daf2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.320347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-161cbb73-0e57-4444-b188-767f710daf2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.321048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-161cbb73-0e57-4444-b188-767f710daf2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.321222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.321655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.322441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'fault' on Instance uuid 1fee5556-bd76-4312-b8c9-07955c04e89c {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:20:44.365075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-161cbb73-0e57-4444-b188-767f710daf2a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.060111 May 14 21:20:44.368885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1476/2783] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:44 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:44.371958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:44.383363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2118ff27-d6c9-449f-9f54-9e5bc09495be tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 200 len: 1305 microversion: 2.1 time: 0.135737 May 14 21:20:44.388249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e853dd9-dc23-42a6-b899-e63d130d0f2a tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a796c430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:44.393251 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1308/2784] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:44 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 1305 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:44.827869 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e853dd9-dc23-42a6-b899-e63d130d0f2a tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/4b81681c-1790-43c2-8e87-d4b3c4e53596" status: 202 len: 0 microversion: 2.1 time: 0.457328 May 14 21:20:44.829369 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1477/2785] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:44 2022] DELETE /compute/v2.1/os-security-groups/4b81681c-1790-43c2-8e87-d4b3c4e53596 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:44.837736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa9598d8-6c4d-413b-b1e9-211e1cfcc3a1 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a7924dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:44.926799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:44.927910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:44.935217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.935704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:44.936501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:44.936948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.167446 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa9598d8-6c4d-413b-b1e9-211e1cfcc3a1 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/7432dc77-2703-4d48-83e7-1a3abfc1478b" status: 202 len: 0 microversion: 2.1 time: 0.333582 May 14 21:20:45.172323 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1309/2786] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:44 2022] DELETE /compute/v2.1/os-security-groups/7432dc77-2703-4d48-83e7-1a3abfc1478b => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:45.180178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-29d3c5c3-e5fb-4781-9dee-237d9302d13b tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a78f2d30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:45.257119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:45.268388 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c59b47f-6406-46ec-b09c-789d162b9046 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1503 microversion: 2.1 time: 0.346001 May 14 21:20:45.279572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1478/2787] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:44 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:45.279572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:45.279572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:45.286601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.287118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.287978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.288481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.513890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:45.523471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b29aefb7-6051-4c97-9c54-f19be4688845 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.252415 May 14 21:20:45.524114 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1479/2788] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:45 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:45.528762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1175122942"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:45.529312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:45.539973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.540438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.541241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.541695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.582017 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-29d3c5c3-e5fb-4781-9dee-237d9302d13b tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/40d42a7b-566a-4e99-b138-4ef67e081e9d" status: 202 len: 0 microversion: 2.1 time: 0.406334 May 14 21:20:45.586544 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1310/2789] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:45 2022] DELETE /compute/v2.1/os-security-groups/40d42a7b-566a-4e99-b138-4ef67e081e9d => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:45.591768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-38ac5b94-0c46-4d1e-8ecc-e6c4bb41ed6d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:45.592739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38ac5b94-0c46-4d1e-8ecc-e6c4bb41ed6d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:45.609322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38ac5b94-0c46-4d1e-8ecc-e6c4bb41ed6d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.609322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38ac5b94-0c46-4d1e-8ecc-e6c4bb41ed6d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.609759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38ac5b94-0c46-4d1e-8ecc-e6c4bb41ed6d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.610218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38ac5b94-0c46-4d1e-8ecc-e6c4bb41ed6d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.655669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-38ac5b94-0c46-4d1e-8ecc-e6c4bb41ed6d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.067629 May 14 21:20:45.656358 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1311/2790] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:45 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:45.662182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:45.662905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:45.670526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.677576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.677576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:45.677576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:45.688349 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c HTTP/1.1 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1fee5556-bd76-4312-b8c9-07955c04e89c'} May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:45.691216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:45.694505 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:45.694505 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:45.694505 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:45.694505 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:45.694505 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:45.694505 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:20:45.694505 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:20:45.696353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:45.701446 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0daf2362-93dc-480a-8ec9-f375c8ed9c22 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 404 len: 111 microversion: 2.1 time: 0.039580 May 14 21:20:45.701446 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1312/2791] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:45 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:20:45.705865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa818527-d449-42cc-977d-9050d48fb0d4 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] Calling method '.version_select at 0x7fb1a7924a60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:45.759571 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.network.security_group_api [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Adding security group f7460102-161b-4ffe-a944-5f0d4fafae9b to port 33de3621-b7e7-4fcf-a36c-4dad3848229d May 14 21:20:46.096236 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa818527-d449-42cc-977d-9050d48fb0d4 tempest-SecurityGroupRulesTestJSON-1522486720 tempest-SecurityGroupRulesTestJSON-1522486720-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/055f9019-1d0f-46df-a708-2f35bb4be368" status: 202 len: 0 microversion: 2.1 time: 0.394865 May 14 21:20:46.097152 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1313/2792] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:45 2022] DELETE /compute/v2.1/os-security-groups/055f9019-1d0f-46df-a708-2f35bb4be368 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:46.104882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1390672332", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3bdbef8a-a684-458d-bfe2-b4f322a15d2e"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:46.173988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] validate_networks() for [('3bdbef8a-a684-458d-bfe2-b4f322a15d2e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:20:46.623613 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ea71660-c930-4272-8f93-d1f3c18df80c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685/action" status: 202 len: 0 microversion: 2.1 time: 1.096892 May 14 21:20:46.624055 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1480/2793] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:45 2022] POST /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685/action => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:46.637706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:46.639627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:46.654392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:46.655794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:46.658143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:46.659426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:46.937973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:46.946981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8595fa35-aaae-4e78-888d-3dbc0fc64150 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.321045 May 14 21:20:46.958093 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1481/2794] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:46 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:46.961097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:20:46.961519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:20:46.961998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:20:46.962411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:20:46.964356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5968e6e4-c52b-4286-925b-1f1a9dc9b772 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a77021f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:46.966595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:20:46.994215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:46.994676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:46.995511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:46.995944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:47.049237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:47.062361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for user 71080496c33c4e2c8b2e16b950f0b9ea and project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:47.082121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:20:47.085272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-5968e6e4-c52b-4286-925b-1f1a9dc9b772 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use.", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5968e6e4-c52b-4286-925b-1f1a9dc9b772 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use. May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c3cec54b-ac8c-4c28-a5ce-083329256d15'] May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5968e6e4-c52b-4286-925b-1f1a9dc9b772 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b HTTP/1.1 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: exception: Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use. May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c3cec54b-ac8c-4c28-a5ce-083329256d15'] May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'f7460102-161b-4ffe-a944-5f0d4fafae9b'} May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:20:47.116152 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use. May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3cec54b-ac8c-4c28-a5ce-083329256d15'] May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use. May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3cec54b-ac8c-4c28-a5ce-083329256d15'] May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use. May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3cec54b-ac8c-4c28-a5ce-083329256d15'] May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use. May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c3cec54b-ac8c-4c28-a5ce-083329256d15'] May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5968e6e4-c52b-4286-925b-1f1a9dc9b772 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 400 to user: Security Group f7460102-161b-4ffe-a944-5f0d4fafae9b in use. May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c3cec54b-ac8c-4c28-a5ce-083329256d15'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5968e6e4-c52b-4286-925b-1f1a9dc9b772 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b" status: 400 len: 185 microversion: 2.1 time: 0.157435 May 14 21:20:47.119441 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1482/2795] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:46 2022] DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b => generated 185 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:20:47.123052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d9af40a8-ed3d-49ae-9167-b5770fa94019 req-c5736b11-3b8f-41f9-933f-7d0d4e45a57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b02897-2456-45a3-b096-cc5949058685", "tag": "33de3621-b7e7-4fcf-a36c-4dad3848229d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:47.131881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d9af40a8-ed3d-49ae-9167-b5770fa94019 req-c5736b11-3b8f-41f9-933f-7d0d4e45a57a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:47.132337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d9af40a8-ed3d-49ae-9167-b5770fa94019 req-c5736b11-3b8f-41f9-933f-7d0d4e45a57a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:47.163867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d9af40a8-ed3d-49ae-9167-b5770fa94019 req-c5736b11-3b8f-41f9-933f-7d0d4e45a57a service nova] Creating event network-changed:33de3621-b7e7-4fcf-a36c-4dad3848229d for instance 58b02897-2456-45a3-b096-cc5949058685 on nch1-master-1 May 14 21:20:47.171105 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d9af40a8-ed3d-49ae-9167-b5770fa94019 req-c5736b11-3b8f-41f9-933f-7d0d4e45a57a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052591 May 14 21:20:47.172552 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1483/2796] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:47.181301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2642e2f4-c335-472e-a15f-ef6954399942 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:47.182780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2642e2f4-c335-472e-a15f-ef6954399942 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:47.205620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2642e2f4-c335-472e-a15f-ef6954399942 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:47.206357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2642e2f4-c335-472e-a15f-ef6954399942 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:47.207716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2642e2f4-c335-472e-a15f-ef6954399942 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:47.208491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2642e2f4-c335-472e-a15f-ef6954399942 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:47.266451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba6452b9-1f3b-4359-ac8e-fd3ed3ed5a30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165456 May 14 21:20:47.277702 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2642e2f4-c335-472e-a15f-ef6954399942 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.101594 May 14 21:20:47.281618 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1484/2797] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:47 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:47.286130 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1314/2798] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:20:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:20:47.296760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-641dc803-b2f6-46a9-a90a-419f9f1c2904 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:47.300599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-641dc803-b2f6-46a9-a90a-419f9f1c2904 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:47.313100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-641dc803-b2f6-46a9-a90a-419f9f1c2904 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:47.316836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-641dc803-b2f6-46a9-a90a-419f9f1c2904 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:47.317929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-641dc803-b2f6-46a9-a90a-419f9f1c2904 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:47.318729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-641dc803-b2f6-46a9-a90a-419f9f1c2904 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:47.652455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-944325607", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:47.767736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] validate_networks() for None {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:20:47.946832 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-641dc803-b2f6-46a9-a90a-419f9f1c2904 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685/action" status: 202 len: 0 microversion: 2.1 time: 0.658799 May 14 21:20:47.948018 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1315/2799] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:47 2022] POST /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:47.974932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-30f52ce2-3894-4f23-a704-35fb67550c0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:47.978817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-30f52ce2-3894-4f23-a704-35fb67550c0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:48.165724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:20:48.166262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:20:48.167005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:20:48.167653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:20:48.168178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:20:48.180935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.181706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.182776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.183444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.204544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Getting quotas for project 236a7e87d3af4de2a0ef55f9cbd9dd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:20:48.211632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Getting quotas for user 38106105b3a2426a9b4af14185a80031 and project 236a7e87d3af4de2a0ef55f9cbd9dd7a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:20:48.241385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:20:48.252413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:20:48.267450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-30f52ce2-3894-4f23-a704-35fb67550c0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:48.275249 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-30f52ce2-3894-4f23-a704-35fb67550c0f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1215 microversion: 2.1 time: 0.325807 May 14 21:20:48.279081 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1316/2800] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:47 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1215 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:48.291775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:48.292409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:48.320152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.320911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.322386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.327125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.483011 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e3f204f4-dc8c-4a05-ae29-7f78db524662 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197072 May 14 21:20:48.483988 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1485/2801] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:20:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:20:48.490902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:48.491985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:48.500657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.503101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.507723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.507723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.670551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:48.684642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9c236b1b-cb31-42a3-9126-a1ceb102beda tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1574 microversion: 2.1 time: 0.404258 May 14 21:20:48.706939 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1317/2802] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:48 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1574 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:48.742740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2cb139b-615a-4c43-96ca-f91b888c2bb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:48.748351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2cb139b-615a-4c43-96ca-f91b888c2bb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:48.765789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2cb139b-615a-4c43-96ca-f91b888c2bb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.765789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2cb139b-615a-4c43-96ca-f91b888c2bb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.781678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2cb139b-615a-4c43-96ca-f91b888c2bb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:48.782713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2cb139b-615a-4c43-96ca-f91b888c2bb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:48.871903 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2cb139b-615a-4c43-96ca-f91b888c2bb6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.159332 May 14 21:20:48.872573 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1318/2803] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:48 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:48.883454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:48.888528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6d31e9af-bff2-4795-9392-3bcfaaf36593 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:48.888528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6d31e9af-bff2-4795-9392-3bcfaaf36593 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:48.894181 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8649117c-f73a-4b62-b513-a5f15814e29e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.408971 May 14 21:20:48.902567 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1486/2804] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:48 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:49.025002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6d31e9af-bff2-4795-9392-3bcfaaf36593 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:49.049442 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6d31e9af-bff2-4795-9392-3bcfaaf36593 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1222 microversion: 2.1 time: 0.175462 May 14 21:20:49.050530 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1319/2805] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:48 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1222 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:49.301296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:49.302379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:49.310492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:49.311367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:49.311768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:49.312245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:49.427977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:49.451229 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97a127e6-fdf3-41da-9cba-9533036f783a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1219 microversion: 2.1 time: 0.154215 May 14 21:20:49.463016 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1487/2806] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:49 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:49.705128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:49.705957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:49.730062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:49.732288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:49.735587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:49.739247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:49.900700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0d8b977-d1d7-49dc-af7f-df377d36274e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:49.900700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0d8b977-d1d7-49dc-af7f-df377d36274e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:49.906982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d8b977-d1d7-49dc-af7f-df377d36274e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:49.910170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d8b977-d1d7-49dc-af7f-df377d36274e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:49.912436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d8b977-d1d7-49dc-af7f-df377d36274e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:49.915083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d8b977-d1d7-49dc-af7f-df377d36274e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:50.018885 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0d8b977-d1d7-49dc-af7f-df377d36274e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.138790 May 14 21:20:50.027024 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1488/2807] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:49 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:50.038208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:50.038208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:50.046616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:50.047332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:50.048927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:50.049582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:50.138867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:50.150276 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83b762fa-cd59-4e13-915c-a2f9c8a36246 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1574 microversion: 2.1 time: 0.450935 May 14 21:20:50.160946 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1320/2808] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:49 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1574 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:50.170815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fadae567-00e1-4bc3-9352-62eef9dd6db1 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:50.176446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fadae567-00e1-4bc3-9352-62eef9dd6db1 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:50.384441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fadae567-00e1-4bc3-9352-62eef9dd6db1 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:50.442186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fadae567-00e1-4bc3-9352-62eef9dd6db1 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1222 microversion: 2.1 time: 0.283505 May 14 21:20:50.445112 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1321/2809] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:50 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1222 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:50.486354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:50.486354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:50.497245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:50.497245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:50.497245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:50.497245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:50.695689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:50.708054 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d8c86c1-0131-41dc-a53e-41966032cfc5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1267 microversion: 2.1 time: 0.241393 May 14 21:20:50.709238 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1322/2810] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:50 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1267 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:50.775363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:50.819769 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-192ed719-12ea-4463-8fcc-b70f27394ced tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.780329 May 14 21:20:50.819769 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1489/2811] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:50 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:51.036189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3a1590e-9322-40fa-8790-0915cc3283fb tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:51.037421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b3a1590e-9322-40fa-8790-0915cc3283fb tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:51.050945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3a1590e-9322-40fa-8790-0915cc3283fb tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.052405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3a1590e-9322-40fa-8790-0915cc3283fb tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.062795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3a1590e-9322-40fa-8790-0915cc3283fb tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.062795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3a1590e-9322-40fa-8790-0915cc3283fb tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.174863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:51.176321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:51.210722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.217666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.222075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.226183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.245191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b3a1590e-9322-40fa-8790-0915cc3283fb tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.213206 May 14 21:20:51.258608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1323/2812] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:51 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:51.461799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:51.463161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:51.492788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.497067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.497067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.497067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.648844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:51.654246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:51.660426 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-984fcc81-706f-477d-996e-aeeb378fcd3c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1579 microversion: 2.1 time: 0.490429 May 14 21:20:51.663057 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1490/2813] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:51 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1579 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:51.679818 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82dbb27e-47f8-4119-98f2-caa2aa655856 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1218 microversion: 2.1 time: 0.223655 May 14 21:20:51.680731 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1324/2814] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:51 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1218 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:51.726646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:51.727235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:51.734259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.741635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.741635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.741635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.859898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:51.861727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:51.883548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:51.898775 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-207fa0da-9bd3-4e50-8103-eff44f2fbd7b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1273 microversion: 2.1 time: 0.172966 May 14 21:20:51.908460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.911815 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1491/2815] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:51 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1273 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:51.911945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:51.911945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:51.911945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:52.265979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9ce35c70-7765-472d-941f-c60c5de5766f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:52.273323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9ce35c70-7765-472d-941f-c60c5de5766f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:52.279737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ce35c70-7765-472d-941f-c60c5de5766f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:52.280732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ce35c70-7765-472d-941f-c60c5de5766f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:52.282768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ce35c70-7765-472d-941f-c60c5de5766f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:52.283865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ce35c70-7765-472d-941f-c60c5de5766f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:52.371681 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9ce35c70-7765-472d-941f-c60c5de5766f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 14 microversion: 2.1 time: 0.110817 May 14 21:20:52.372596 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1492/2816] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:52 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:20:52.695076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:52.708305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c7567cf7-8e27-4e1a-a0e5-445c73403430 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.882945 May 14 21:20:52.710751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1325/2817] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:51 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:52.713900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:52.721921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:52.727194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:52.728159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:52.738240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:52.738682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:52.739504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:52.744623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:52.777601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:52.780448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:52.784146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:52.788226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.016193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:53.029398 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b21e2e0c-14a4-4b34-b14d-fe8c8d0fce43 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1282 microversion: 2.1 time: 0.315855 May 14 21:20:53.030262 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1326/2818] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:52 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1282 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:53.037098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:53.040100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:53.049935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.051432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.052481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.054291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.094738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:53.102771 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e1b82335-2d1f-4e01-80ae-456df133cfe7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1572 microversion: 2.1 time: 0.427070 May 14 21:20:53.111770 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1493/2819] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:52 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1572 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:20:53.121283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1787458492"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:53.122577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:53.129261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.130075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.130499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.131115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.215828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:53.229623 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c3cd6d4-d406-4b52-a304-4dc5d4f54bdc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1273 microversion: 2.1 time: 0.197823 May 14 21:20:53.230971 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1327/2820] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:53 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:53.375151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.network.security_group_api [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Adding security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 to port 33de3621-b7e7-4fcf-a36c-4dad3848229d May 14 21:20:53.384625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-02673767-9897-461d-b27b-511cda655271 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:53.386260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-02673767-9897-461d-b27b-511cda655271 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:53.394737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02673767-9897-461d-b27b-511cda655271 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.395585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02673767-9897-461d-b27b-511cda655271 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.396630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02673767-9897-461d-b27b-511cda655271 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.397273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02673767-9897-461d-b27b-511cda655271 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.458207 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-02673767-9897-461d-b27b-511cda655271 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action" status: 200 len: 8207 microversion: 2.1 time: 0.076089 May 14 21:20:53.460836 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1328/2821] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:53 2022] POST /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a/action => generated 8207 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:53.470714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:53.471896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:53.480118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.481038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.482050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.482774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.809896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:53.820880 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b609afcf-0c29-42d8-a0a8-bc30b54e0eb5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.355850 May 14 21:20:53.831525 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1329/2822] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:53 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:53.849133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:53.849594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:53.856590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.856811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:53.857665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:53.858112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:54.227038 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b3f904f6-922a-4047-8685-8587c61cfe7b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685/action" status: 202 len: 0 microversion: 2.1 time: 1.110621 May 14 21:20:54.231948 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1494/2823] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:53 2022] POST /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685/action => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:54.237185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:54.238161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:54.256652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:54.265984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:54.266123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:54.267250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:54.576760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:54.591553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:54.597542 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01d7c8c7-a0eb-46ee-8f6a-5cb944e5be73 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 0.764791 May 14 21:20:54.598395 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1330/2824] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:53 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:54.600676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7864a3a1-b1af-4e81-9884-b881997c79fe tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.367398 May 14 21:20:54.604149 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1495/2825] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:54 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:54.608724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:54.609437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:54.615234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59cb6808-fd99-454c-acc8-1fc2865f6471 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7815d30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:54.619727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:54.620530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:54.621928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:54.622522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:54.813767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:54.834210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f2708a38-c8c2-4a9d-8abd-43062b1fcfda tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1280 microversion: 2.1 time: 0.233677 May 14 21:20:54.835753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1331/2826] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:54 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:54.870337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e3d7f9d4-4cca-4fd3-a754-8b6647d242a6 req-cc61def5-fc2c-48db-a57d-aa263244dca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b02897-2456-45a3-b096-cc5949058685", "tag": "33de3621-b7e7-4fcf-a36c-4dad3848229d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:54.902821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e3d7f9d4-4cca-4fd3-a754-8b6647d242a6 req-cc61def5-fc2c-48db-a57d-aa263244dca5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:54.908599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e3d7f9d4-4cca-4fd3-a754-8b6647d242a6 req-cc61def5-fc2c-48db-a57d-aa263244dca5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:54.951927 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e3d7f9d4-4cca-4fd3-a754-8b6647d242a6 req-cc61def5-fc2c-48db-a57d-aa263244dca5 service nova] Creating event network-changed:33de3621-b7e7-4fcf-a36c-4dad3848229d for instance 58b02897-2456-45a3-b096-cc5949058685 on nch1-master-1 May 14 21:20:54.962201 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e3d7f9d4-4cca-4fd3-a754-8b6647d242a6 req-cc61def5-fc2c-48db-a57d-aa263244dca5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107513 May 14 21:20:54.965496 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1332/2827] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:54.989858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:54.990650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:55.000252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:55.002350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:55.003348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:55.003999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:55.044580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-59cb6808-fd99-454c-acc8-1fc2865f6471 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use.", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:20:55.045638 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-59cb6808-fd99-454c-acc8-1fc2865f6471 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use. May 14 21:20:55.045638 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c14a0308-b74d-4f30-b1a2-61dc591217d7'] May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59cb6808-fd99-454c-acc8-1fc2865f6471 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3 HTTP/1.1 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: exception: Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use. May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c14a0308-b74d-4f30-b1a2-61dc591217d7'] May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1291bfc2-7954-40b9-a5da-7db4a62440c3'} May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:20:55.051262 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use. May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14a0308-b74d-4f30-b1a2-61dc591217d7'] May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use. May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14a0308-b74d-4f30-b1a2-61dc591217d7'] May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use. May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14a0308-b74d-4f30-b1a2-61dc591217d7'] May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use. May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c14a0308-b74d-4f30-b1a2-61dc591217d7'] May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59cb6808-fd99-454c-acc8-1fc2865f6471 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 400 to user: Security Group 1291bfc2-7954-40b9-a5da-7db4a62440c3 in use. May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-c14a0308-b74d-4f30-b1a2-61dc591217d7'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-59cb6808-fd99-454c-acc8-1fc2865f6471 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3" status: 400 len: 185 microversion: 2.1 time: 0.448824 May 14 21:20:55.062602 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1496/2828] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:20:54 2022] DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3 => generated 185 bytes in 451 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:20:55.069463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:55.069463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:55.095219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:55.096085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:55.097602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:55.098747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:55.614122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:55.623989 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2b6dc7df-ce50-432a-8359-387708a4f265 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.559072 May 14 21:20:55.630760 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1497/2829] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:55 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:55.638810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:55.639346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:55.650959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:55.657017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:55.657017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:55.657017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:55.693269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:20:56.037392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:56.049294 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b1f7c9ed-f449-418a-812d-a94af9e9133f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1315 microversion: 2.1 time: 1.080118 May 14 21:20:56.061221 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1333/2830] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:54 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1315 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:56.066969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:56.067640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:56.077524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:56.080617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:56.082436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:56.084458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:56.348853 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-36317ad4-4906-4d16-92e9-ef57f0b8ade9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 204 len: 0 microversion: 2.1 time: 0.716508 May 14 21:20:56.350337 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1498/2831] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:20:55 2022] DELETE /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 0 bytes in 718 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:20:56.359628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:56.361767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:56.389061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:56.389541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:56.390429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:56.390887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:56.754812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:56.766724 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c950d793-5650-4378-83ad-b7baa14bb75a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.414789 May 14 21:20:56.774654 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1499/2832] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:56 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:56.790866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:56.791546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:56.802089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:56.807452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:56.807452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:56.807452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:57.193154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:57.209863 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7ff1cea4-e3c7-4aaa-b832-660d942d818c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.424881 May 14 21:20:57.212365 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1500/2833] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:56 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:57.220867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-34d72ace-4fab-414e-8476-cd18a411b7f5 req-d8169187-0dd9-424f-a921-cfa0eb6abe5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21fc6710-88a8-420b-b6cd-901e9eef71dc", "tag": "2b63bcfc-9138-40aa-b6dd-b137c15d0bbe"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:57.248981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-34d72ace-4fab-414e-8476-cd18a411b7f5 req-d8169187-0dd9-424f-a921-cfa0eb6abe5e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:57.248981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-34d72ace-4fab-414e-8476-cd18a411b7f5 req-d8169187-0dd9-424f-a921-cfa0eb6abe5e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:57.292339 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-34d72ace-4fab-414e-8476-cd18a411b7f5 req-d8169187-0dd9-424f-a921-cfa0eb6abe5e service nova] Creating event network-changed:2b63bcfc-9138-40aa-b6dd-b137c15d0bbe for instance 21fc6710-88a8-420b-b6cd-901e9eef71dc on nch2-master-1 May 14 21:20:57.304216 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-34d72ace-4fab-414e-8476-cd18a411b7f5 req-d8169187-0dd9-424f-a921-cfa0eb6abe5e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088645 May 14 21:20:57.305116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:57.308403 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1501/2834] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:57.326220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:57.326220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:57.334370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99ccd59e-5b06-4608-878c-157b946f813a tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 1.269779 May 14 21:20:57.339163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:57.340919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:57.342072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:57.342729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:57.361798 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1334/2835] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:56 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:57.373583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:57.374173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:57.405538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:57.406336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:57.414449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:57.414449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:57.703681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Locking {{(pid=130637) lock /opt/stack/nova/nova/compute/api.py:4700}} May 14 21:20:58.062539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-920fa626-4761-4859-ab34-cbc4db592f80 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.697412 May 14 21:20:58.069259 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1335/2836] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:57 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:20:58.076870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:58.083974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:58.105702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.121223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:58.123997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.124875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:58.440452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:58.453203 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-62a1976f-fc64-4bce-87cd-cbf68e6c580d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1647 microversion: 2.1 time: 1.141941 May 14 21:20:58.470287 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1502/2837] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:57 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1647 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:58.489711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:58.490183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:58.519110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:58.528052 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87041fa5-a468-4026-96f0-f4db42baabfe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1315 microversion: 2.1 time: 0.457133 May 14 21:20:58.528942 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1336/2838] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:58 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:58.537976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.538451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:58.539272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.546004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:58.558207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:58.558207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:58.581574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.582050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:58.589117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.602482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:58.903218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:58.915851 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-05df3e68-9268-42f2-8559-f2c4a10d603c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.385492 May 14 21:20:58.936864 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1337/2839] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:58 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:58.945996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:20:58.950218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:20:58.971317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ade41a3-c5b5-43ec-8213-6499535d232e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.500673 May 14 21:20:58.972612 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1503/2840] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:58 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:20:58.973511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:58.988917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-48d05273-c3d2-48b4-b17e-5ce22a1adaa5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:58.991310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.993843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:58.994971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:58.995635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:59.004926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48d05273-c3d2-48b4-b17e-5ce22a1adaa5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:59.008969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48d05273-c3d2-48b4-b17e-5ce22a1adaa5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:59.130496 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-48d05273-c3d2-48b4-b17e-5ce22a1adaa5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] HTTP exception thrown: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f is locked May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-48d05273-c3d2-48b4-b17e-5ce22a1adaa5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Request method failure captured: May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action HTTP/1.1 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 15 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBxdQLyUXipdOs58tsX3ys7eUbGjDiSSYt_fXNeAeCW_o6z5ZETYif8XSUovghyEvodaTLuhKXDis9kPqLil9CjOGGR8wiGPdJRcCEBLsDFw2kX6XwAAfapme4UIgBFp9hMAIehUEC8AC9ze5SDL01BeK5x4aJALaKQS_i06ePj8WBQ May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a924ca59a9ac44cf96e53be012a43af1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerActionsTestJSON-1228353313 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerActionsTestJSON-1228353313-project May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a42e0caa0878447f98544e74f767c7ca May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerActionsTestJSON-1228353313-project May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: {"os-stop": {}} May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f is locked May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'c355e95c-4110-4a0c-aa91-b881f09e9e1f', 'body': {'os-stop': {}}} May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f is locked May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f is locked May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f is locked May 14 21:20:59.139536 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:20:59.143850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-48d05273-c3d2-48b4-b17e-5ce22a1adaa5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Returning 409 to user: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f is locked {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:20:59.143850 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-48d05273-c3d2-48b4-b17e-5ce22a1adaa5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 409 len: 107 microversion: 2.1 time: 0.156837 May 14 21:20:59.143850 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1504/2841] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:58 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 107 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 14 21:20:59.152529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:59.153095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:20:59.160252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:59.160716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:59.161631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:59.162081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:59.569909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Unlocking {{(pid=130638) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 14 21:20:59.873044 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f56157cf-8848-4812-9ae1-aa06ea6a4b77 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.724895 May 14 21:20:59.873617 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1505/2842] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:20:59 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:20:59.880977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-f5789c6e-ff0a-4b14-b674-bdedc0446f38 req-a0869148-5a49-4890-8748-4365a87a683a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98f86a76-2dbd-4c5d-832c-502a0d21cb55", "tag": "07597990-aa56-4f31-a05a-4c5cd3822862"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:20:59.914123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f5789c6e-ff0a-4b14-b674-bdedc0446f38 req-a0869148-5a49-4890-8748-4365a87a683a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:20:59.915020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f5789c6e-ff0a-4b14-b674-bdedc0446f38 req-a0869148-5a49-4890-8748-4365a87a683a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:20:59.958261 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-f5789c6e-ff0a-4b14-b674-bdedc0446f38 req-a0869148-5a49-4890-8748-4365a87a683a service nova] Creating event network-changed:07597990-aa56-4f31-a05a-4c5cd3822862 for instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 on nch2-master-1 May 14 21:20:59.988918 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-f5789c6e-ff0a-4b14-b674-bdedc0446f38 req-a0869148-5a49-4890-8748-4365a87a683a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113947 May 14 21:20:59.992146 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1506/2843] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:20:59.998429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:00.008553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:00.008553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.010645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.011931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.012586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.306482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:00.318500 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c9de225-4f04-4668-97e9-f8156b5040dc tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1647 microversion: 2.1 time: 0.320400 May 14 21:21:00.318500 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1507/2844] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:59 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1647 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:00.336003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:00.343553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:00.347753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.348229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.349030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.349490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.479578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:00.494545 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa265ced-8b7e-4b4a-ac06-60c8fcc531d3 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1523 microversion: 2.1 time: 1.552375 May 14 21:21:00.495799 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1338/2845] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:20:58 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1523 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:00.503611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83fcf8a4-b173-4d71-817e-4f59328714c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:00.512347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83fcf8a4-b173-4d71-817e-4f59328714c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.513351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83fcf8a4-b173-4d71-817e-4f59328714c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.628588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83fcf8a4-b173-4d71-817e-4f59328714c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Going to try to stop instance {{(pid=130637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:21:00.738426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:00.770857 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd9b60d5-78cc-44f7-b963-a3a0fa0217ab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1315 microversion: 2.1 time: 0.445913 May 14 21:21:00.772248 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1508/2846] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:00 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:00.782404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:00.786384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:00.800987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.801454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.803807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.805579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.940934 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83fcf8a4-b173-4d71-817e-4f59328714c2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.443533 May 14 21:21:00.946285 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1339/2847] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:00 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:00.968796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:00.971335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:00.984687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.991458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:00.993526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:00.994667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:01.178307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:01.210218 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f0e1c078-ed06-4905-8eca-85096c1345ac tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.429670 May 14 21:21:01.210218 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1509/2848] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:00 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:01.335656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:01.338397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:01.345737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:01.346826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:01.348253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:01.348962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:01.364005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:01.376150 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2fcfa34d-7137-4d93-96ee-ef1a649604df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.424979 May 14 21:21:01.376819 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1340/2849] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:00 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:01.421564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:01.422606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:01.423135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lazy-loading 'fault' on Instance uuid 58b02897-2456-45a3-b096-cc5949058685 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:21:01.481429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:01.490969 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f15a9b13-5113-4fe5-bcdc-a3d9cf217573 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 200 len: 1305 microversion: 2.1 time: 0.159271 May 14 21:21:01.501418 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1510/2850] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:01 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 1305 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:01.517143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:01.518633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:01.528437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:01.529722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:01.530820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:01.531519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:01.688356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:01.696919 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64122fa7-5042-4923-aaf1-316c8ee0f33b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1503 microversion: 2.1 time: 0.184207 May 14 21:21:01.708422 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1341/2851] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:01 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:01.717830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6696134f-0d5d-45f6-a80d-7b4c11455886 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'create', calling method: .version_select at 0x7fb1a78d7c10>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-532943841", "description": "tempest-description-523538018"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:01.791088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:01.792114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:01.800544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:01.801386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:01.802886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:01.810490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.019847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:02.030495 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27f15860-90fd-4a57-b63b-6cae772b1e61 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1315 microversion: 2.1 time: 0.244182 May 14 21:21:02.043786 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1342/2852] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:01 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:02.176718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0f4b2e8b-a87b-421b-8993-1089549d49c3 req-765da022-f150-407e-ae6d-be54fc7d15b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b02897-2456-45a3-b096-cc5949058685", "name": "network-vif-deleted", "tag": "33de3621-b7e7-4fcf-a36c-4dad3848229d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:02.186992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0f4b2e8b-a87b-421b-8993-1089549d49c3 req-765da022-f150-407e-ae6d-be54fc7d15b2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.187604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0f4b2e8b-a87b-421b-8993-1089549d49c3 req-765da022-f150-407e-ae6d-be54fc7d15b2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.205892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0f4b2e8b-a87b-421b-8993-1089549d49c3 req-765da022-f150-407e-ae6d-be54fc7d15b2 service nova] Creating event network-vif-deleted:33de3621-b7e7-4fcf-a36c-4dad3848229d for instance 58b02897-2456-45a3-b096-cc5949058685 on nch1-master-1 May 14 21:21:02.213297 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0f4b2e8b-a87b-421b-8993-1089549d49c3 req-765da022-f150-407e-ae6d-be54fc7d15b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041458 May 14 21:21:02.224201 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1343/2853] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:02.232540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:02.233558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:02.242340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.242904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.243843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.244652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.408307 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6696134f-0d5d-45f6-a80d-7b4c11455886 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.696341 May 14 21:21:02.410001 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1511/2854] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:21:01 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:02.416114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:02.416952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:02.431520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.432005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.432815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.433254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.511667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:02.531295 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f7a4474-0871-467c-8e6d-309d516442a4 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.305042 May 14 21:21:02.535776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1344/2855] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:02 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:02.549340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-532943841"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:02.550273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:02.565072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.565830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.568233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.571007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.938776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:02.950120 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9bca8e96-19eb-4769-aef2-ea2eaf5026af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.538674 May 14 21:21:02.963343 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1512/2856] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:02 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:02.976788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:02.977520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:02.991652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.992117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:02.992923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:02.995339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:03.030410 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 HTTP/1.1 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '58b02897-2456-45a3-b096-cc5949058685'} May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:03.039958 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:03.044273 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:03.044273 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:03.044273 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:03.044273 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:03.044273 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:03.044273 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:03.044273 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:03.046331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:03.049087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-656df799-75be-4d53-a375-9b0c82c9709d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 404 len: 111 microversion: 2.1 time: 0.084191 May 14 21:21:03.050287 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1513/2857] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:02 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:03.055719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:03.056620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:03.067211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:03.067717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:03.068851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:03.069536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:03.229888 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.network.security_group_api [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Adding security group f542b489-4d4e-416a-99ad-2e7e66a25dd4 to port 9bcc5800-f48b-4fc7-ac54-c5ae11983072 May 14 21:21:03.278648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:03.288151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3017a7f8-b79b-4fca-8560-083611e460b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1315 microversion: 2.1 time: 0.236556 May 14 21:21:03.289643 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1514/2858] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:03 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:03.296685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84ceb11f-cb0a-4b28-8fbc-35b5940cb544 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7815430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:03.613962 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84ceb11f-cb0a-4b28-8fbc-35b5940cb544 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b" status: 202 len: 0 microversion: 2.1 time: 0.319260 May 14 21:21:03.613962 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1515/2859] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:03 2022] DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:03.774900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2f6ca4e-f2b5-4acd-88b3-5b7fcd447400 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Action: 'create', calling method: .version_select at 0x7fb1b98cd790>, body: {"keypair": {"name": "tempest-keypair-616671604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLskQJl9tPZ7J+Jr7ngb1B1uJxCNlYr7RfOhQopqRxt7+gKhUugPQGrIzWSZ3YXUSa/HSI9e/g7St1rLx4e//6JrkK2i21FP8IwMWgpb+E114Foels9TEy9Qiv1s+Y+ytw=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:03.803355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b2f6ca4e-f2b5-4acd-88b3-5b7fcd447400 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Getting quotas for project ba969692dac24c5bab4062ca210bef43. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:21:03.812663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b2f6ca4e-f2b5-4acd-88b3-5b7fcd447400 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Getting quotas for user b54f1f777ca2448bb3ba65643cfcb530 and project ba969692dac24c5bab4062ca210bef43. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:21:03.920884 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2f6ca4e-f2b5-4acd-88b3-5b7fcd447400 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.308658 May 14 21:21:03.921949 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1516/2860] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:21:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:03.940679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:03.945653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:03.962383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:03.964299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:03.965479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:03.967677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:04.206511 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-389a4655-f5cc-4c74-bf5e-fd40228d1058 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action" status: 202 len: 0 microversion: 2.1 time: 1.664036 May 14 21:21:04.206511 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1345/2861] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:02 2022] POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action => generated 0 bytes in 1665 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:04.214400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28af509d-0842-4bac-a173-29505309c756 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7924c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:04.343775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:04.356116 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8eeaf888-7aab-477d-b572-bb341f93f15e tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.431787 May 14 21:21:04.369385 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1517/2862] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:03 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:04.383702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:04.384661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:04.394378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:04.394966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:04.396085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:04.397236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:04.645150 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28af509d-0842-4bac-a173-29505309c756 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3" status: 202 len: 0 microversion: 2.1 time: 0.436244 May 14 21:21:04.649514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1346/2863] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:04 2022] DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:04.651758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-532943841"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:04.652358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:04.666363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:04.679510 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e091ac2-72d7-4fb1-a1f7-db8d8673d282 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.308074 May 14 21:21:04.685630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:04.690322 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1518/2864] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:04 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:04.693663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:04.694717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:04.695708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:04.696252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8017882a-9e7c-4e72-a02c-5e5504172fc3 req-17a938a6-cdbb-41be-8e75-a468cb85ed08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f64224-2391-4126-8dcb-f009aa8a0612", "tag": "9bcc5800-f48b-4fc7-ac54-c5ae11983072"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:04.708365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8017882a-9e7c-4e72-a02c-5e5504172fc3 req-17a938a6-cdbb-41be-8e75-a468cb85ed08 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:04.709058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8017882a-9e7c-4e72-a02c-5e5504172fc3 req-17a938a6-cdbb-41be-8e75-a468cb85ed08 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:04.725453 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8017882a-9e7c-4e72-a02c-5e5504172fc3 req-17a938a6-cdbb-41be-8e75-a468cb85ed08 service nova] Creating event network-changed:9bcc5800-f48b-4fc7-ac54-c5ae11983072 for instance 65f64224-2391-4126-8dcb-f009aa8a0612 on nch1-master-1 May 14 21:21:04.740099 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8017882a-9e7c-4e72-a02c-5e5504172fc3 req-17a938a6-cdbb-41be-8e75-a468cb85ed08 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048159 May 14 21:21:04.741400 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1519/2865] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:04.747663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:04.748698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:04.757865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:04.758741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:04.759913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:04.760886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:05.017458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:05.032899 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6780a3b2-015c-4b91-8bb2-e8b6c4bc02bd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1315 microversion: 2.1 time: 0.289838 May 14 21:21:05.033500 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1520/2866] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:04 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:05.042695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5891bc4-f3ef-410b-adf9-a8cadd7e3ded tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'create', calling method: .version_select at 0x7fb1a7828dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2104762123", "description": "tempest-description-1074143169"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:05.383663 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.network.security_group_api [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Removing security group f542b489-4d4e-416a-99ad-2e7e66a25dd4 from port 9bcc5800-f48b-4fc7-ac54-c5ae11983072 May 14 21:21:05.599862 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5891bc4-f3ef-410b-adf9-a8cadd7e3ded tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.565084 May 14 21:21:05.600474 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1521/2867] 10.222.0.52 () {60 vars in 1179 bytes} [Sat May 14 21:21:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:05.612068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:05.612965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:05.638272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:05.639557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:05.642252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:05.643341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:06.020007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:06.053613 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-336b08fb-b2ad-4c28-a1d1-9ef32d6ecb55 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.435447 May 14 21:21:06.057408 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1522/2868] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:05 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:06.071184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-80e532c2-eaa1-40df-93a7-3b78a18b6ce6 req-9e43c0f1-716e-4418-ab04-41563edaad1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fc6710-88a8-420b-b6cd-901e9eef71dc", "name": "network-vif-plugged", "status": "completed", "tag": "2b63bcfc-9138-40aa-b6dd-b137c15d0bbe"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:06.110263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-80e532c2-eaa1-40df-93a7-3b78a18b6ce6 req-9e43c0f1-716e-4418-ab04-41563edaad1c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:06.115240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-80e532c2-eaa1-40df-93a7-3b78a18b6ce6 req-9e43c0f1-716e-4418-ab04-41563edaad1c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:06.169165 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-80e532c2-eaa1-40df-93a7-3b78a18b6ce6 req-9e43c0f1-716e-4418-ab04-41563edaad1c service nova] Creating event network-vif-plugged:2b63bcfc-9138-40aa-b6dd-b137c15d0bbe for instance 21fc6710-88a8-420b-b6cd-901e9eef71dc on nch2-master-1 May 14 21:21:06.190327 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-80e532c2-eaa1-40df-93a7-3b78a18b6ce6 req-9e43c0f1-716e-4418-ab04-41563edaad1c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129037 May 14 21:21:06.190971 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1523/2869] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:06.202548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-545ae08e-5db4-44af-acab-40dded794528 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Action: 'update', calling method: .version_select at 0x7fb1a7ba5e50>, body: {"security_group": {"name": "tempest-sg-hth-740843130", "description": "tempest-description-hth-768749336"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:06.412920 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2c0e2ccd-cb7e-4393-8546-34450bb5edbc tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action" status: 202 len: 0 microversion: 2.1 time: 1.766019 May 14 21:21:06.418123 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1347/2870] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:04 2022] POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action => generated 0 bytes in 1772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:06.424268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:06.428525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:06.452093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:06.452825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:06.455166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:06.459025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:06.571639 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-545ae08e-5db4-44af-acab-40dded794528 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "PUT /compute/v2.1/os-security-groups/e60884e7-d75a-4bb1-b6f9-93ccfbc40b4a" status: 200 len: 216 microversion: 2.1 time: 0.372633 May 14 21:21:06.572369 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1524/2871] 10.222.0.52 () {60 vars in 1289 bytes} [Sat May 14 21:21:06 2022] PUT /compute/v2.1/os-security-groups/e60884e7-d75a-4bb1-b6f9-93ccfbc40b4a => generated 216 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:06.582650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:06.584139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:06.607382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:06.612829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:06.613994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:06.614694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:06.744997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:06.764026 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-15e1f6f5-9629-4d87-98c6-ae7e424ffe19 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.343308 May 14 21:21:06.766819 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1348/2872] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:06 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:06.803228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44c2a4db-00bf-4493-9c2b-4cd2d93b5302 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'create', calling method: .version_select at 0x7fb1a7607dc0>, body: {"pool": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:07.152855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:07.165639 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b2f901f-c033-41df-ab8e-ab05c4f3e41b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1315 microversion: 2.1 time: 0.591899 May 14 21:21:07.168174 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1525/2873] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:06 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:07.175114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6a24703-b868-4dbd-a2f1-86ee477dc872 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7ba5820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:07.312265 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6a24703-b868-4dbd-a2f1-86ee477dc872 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/os-security-groups/e60884e7-d75a-4bb1-b6f9-93ccfbc40b4a" status: 200 len: 216 microversion: 2.1 time: 0.141732 May 14 21:21:07.314359 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1526/2874] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:21:07 2022] GET /compute/v2.1/os-security-groups/e60884e7-d75a-4bb1-b6f9-93ccfbc40b4a => generated 216 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:07.321477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d71a5753-b0c2-4521-98c0-7f7d8c614fe5 req-df86a87b-84ae-4a73-b01c-2a27be0a765b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f64224-2391-4126-8dcb-f009aa8a0612", "tag": "9bcc5800-f48b-4fc7-ac54-c5ae11983072"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:07.344543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d71a5753-b0c2-4521-98c0-7f7d8c614fe5 req-df86a87b-84ae-4a73-b01c-2a27be0a765b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:07.347805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d71a5753-b0c2-4521-98c0-7f7d8c614fe5 req-df86a87b-84ae-4a73-b01c-2a27be0a765b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:07.389182 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d71a5753-b0c2-4521-98c0-7f7d8c614fe5 req-df86a87b-84ae-4a73-b01c-2a27be0a765b service nova] Creating event network-changed:9bcc5800-f48b-4fc7-ac54-c5ae11983072 for instance 65f64224-2391-4126-8dcb-f009aa8a0612 on nch1-master-1 May 14 21:21:07.402816 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d71a5753-b0c2-4521-98c0-7f7d8c614fe5 req-df86a87b-84ae-4a73-b01c-2a27be0a765b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085709 May 14 21:21:07.405407 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1527/2875] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:07.419955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:07.425051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:07.441630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:07.444734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:07.447394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:07.448145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:07.856859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:07.891259 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac0726ea-6347-4bb2-bc96-5a8142cb90f2 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.483679 May 14 21:21:07.901042 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1528/2876] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:07 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:07.937017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6a5ab26-7118-4c43-b881-7c5b95ec80a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a78d7940>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:08.666327 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6a5ab26-7118-4c43-b881-7c5b95ec80a1 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/e60884e7-d75a-4bb1-b6f9-93ccfbc40b4a" status: 202 len: 0 microversion: 2.1 time: 0.760545 May 14 21:21:08.669362 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1529/2877] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:07 2022] DELETE /compute/v2.1/os-security-groups/e60884e7-d75a-4bb1-b6f9-93ccfbc40b4a => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:08.676958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:08.677890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:08.686744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:08.688224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:08.688599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:08.689194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:08.890598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:08.890598 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-138f0769-959f-4bb2-90bc-24e0b42b0f4c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.198245 May 14 21:21:08.890598 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1530/2878] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:08 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:08.890598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:08.890598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:08.890598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:08.891990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:08.892485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:08.893174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.194525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:09.203441 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9236778a-8d62-4265-973e-558e2091bcc7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1503 microversion: 2.1 time: 0.332844 May 14 21:21:09.204081 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1531/2879] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:08 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:09.213987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-840799bd-12e4-4700-822c-af5cf11d1fdc req-e4e57056-b502-42d8-98cb-ed60a66fb646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f86a76-2dbd-4c5d-832c-502a0d21cb55", "name": "network-vif-plugged", "status": "completed", "tag": "07597990-aa56-4f31-a05a-4c5cd3822862"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:09.246827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-840799bd-12e4-4700-822c-af5cf11d1fdc req-e4e57056-b502-42d8-98cb-ed60a66fb646 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:09.247961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-840799bd-12e4-4700-822c-af5cf11d1fdc req-e4e57056-b502-42d8-98cb-ed60a66fb646 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.283206 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-840799bd-12e4-4700-822c-af5cf11d1fdc req-e4e57056-b502-42d8-98cb-ed60a66fb646 service nova] Creating event network-vif-plugged:07597990-aa56-4f31-a05a-4c5cd3822862 for instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 on nch2-master-1 May 14 21:21:09.289137 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-840799bd-12e4-4700-822c-af5cf11d1fdc req-e4e57056-b502-42d8-98cb-ed60a66fb646 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081136 May 14 21:21:09.290177 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1532/2880] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:09.303188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:09.304250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:09.311099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:09.311925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.313777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:09.315621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.338328 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 HTTP/1.1 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '58b02897-2456-45a3-b096-cc5949058685'} May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:21:09.340100 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:09.345268 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa85fee1-61ab-4cb6-8429-2a5a131f55f2 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 404 len: 111 microversion: 2.1 time: 0.044539 May 14 21:21:09.346068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1533/2881] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:21:09 2022] DELETE /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:09.350391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:09.351196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:09.357911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:09.358380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.359176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:09.359702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.569312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:09.585399 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-91c6dc21-8950-42bf-a208-53dab1404395 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1322 microversion: 2.1 time: 0.238579 May 14 21:21:09.591464 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1534/2882] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:09 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:09.604640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:09.609957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:09.621661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:09.622224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.623264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:09.623946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:09.655195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'flavor' on Instance uuid 21fc6710-88a8-420b-b6cd-901e9eef71dc {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:21:10.275608 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44c2a4db-00bf-4493-9c2b-4cd2d93b5302 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.485425 May 14 21:21:10.276906 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1349/2883] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:21:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:10.287177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-322220972", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "5df698dd-e8d1-426b-966f-f4f6c6bf9ce7"}], "security_groups": [{"name": "tempest-securitygroup--404268431"}], "key_name": "tempest-keypair-616671604", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:10.336197 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-90cece3a-fbf9-4c23-a91f-f04239679960 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc/action" status: 202 len: 0 microversion: 2.1 time: 0.743003 May 14 21:21:10.337298 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1535/2884] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:09 2022] POST /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc/action => generated 0 bytes in 745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:10.342658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:10.343558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: 58b02897-2456-45a3-b096-cc5949058685] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:10.350626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:10.351291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:10.352349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:10.353041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:10.391461 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 HTTP/1.1 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '58b02897-2456-45a3-b096-cc5949058685'} May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:10.395891 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:10.401613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Instance 58b02897-2456-45a3-b096-cc5949058685 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:10.403673 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0da30fb2-4329-4806-9509-132949fde96c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685" status: 404 len: 111 microversion: 2.1 time: 0.057778 May 14 21:21:10.405198 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1536/2885] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:10 2022] GET /compute/v2.1/servers/58b02897-2456-45a3-b096-cc5949058685 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:10.411248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:10.412370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:10.421819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:10.424630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:10.424630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:10.424630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:10.480988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] validate_networks() for [('5df698dd-e8d1-426b-966f-f4f6c6bf9ce7', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:21:10.606810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:10.621399 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5c65a45d-8dbb-48b3-9560-5f026d3a3cbc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.214925 May 14 21:21:10.623285 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1537/2886] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:10 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:10.629394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.186"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:10.630627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:10.639772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:10.640306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:10.642371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:10.642885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:10.685755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Acquired lock "refresh_cache-65f64224-2391-4126-8dcb-f009aa8a0612" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:21:11.044492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Getting quotas for project ba969692dac24c5bab4062ca210bef43. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:21:11.054593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Getting quotas for user b54f1f777ca2448bb3ba65643cfcb530 and project ba969692dac24c5bab4062ca210bef43. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:21:11.074284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:21:11.074958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:21:11.075728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:21:11.076721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:21:11.077372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:21:11.089736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:11.090490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:11.091684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:11.092405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:11.114909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Getting quotas for project ba969692dac24c5bab4062ca210bef43. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:21:11.123003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Getting quotas for user b54f1f777ca2448bb3ba65643cfcb530 and project ba969692dac24c5bab4062ca210bef43. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:21:11.141090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:21:11.144177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:21:11.334804 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f6ac248-eaf9-4462-9c1a-60bbe03d5636 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.056452 May 14 21:21:11.341385 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1350/2887] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:21:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:21:11.346767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:11.347621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:11.357517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:11.358277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:11.359217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:11.360378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:11.606170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:11.616923 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8e323478-b3fb-4603-afca-cab00fae1170 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.273730 May 14 21:21:11.627878 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1351/2888] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:11 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:11.627878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9946d2e5-4845-4c01-93e1-d7f2861cc352 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7d821f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:11.653369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-9946d2e5-4845-4c01-93e1-d7f2861cc352 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:21:11.653986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-9946d2e5-4845-4c01-93e1-d7f2861cc352 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:21:11.654519 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9946d2e5-4845-4c01-93e1-d7f2861cc352 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist May 14 21:21:11.654519 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-14723526-18ed-4b4c-8501-de8d2fc2bd95'] May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9946d2e5-4845-4c01-93e1-d7f2861cc352 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3 HTTP/1.1 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-14723526-18ed-4b4c-8501-de8d2fc2bd95'] May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1291bfc2-7954-40b9-a5da-7db4a62440c3'} May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:21:11.665347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14723526-18ed-4b4c-8501-de8d2fc2bd95'] May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14723526-18ed-4b4c-8501-de8d2fc2bd95'] May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14723526-18ed-4b4c-8501-de8d2fc2bd95'] May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14723526-18ed-4b4c-8501-de8d2fc2bd95'] May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9946d2e5-4845-4c01-93e1-d7f2861cc352 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group 1291bfc2-7954-40b9-a5da-7db4a62440c3 does not exist May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-14723526-18ed-4b4c-8501-de8d2fc2bd95'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:11.669259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9946d2e5-4845-4c01-93e1-d7f2861cc352 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3" status: 404 len: 194 microversion: 2.1 time: 0.049781 May 14 21:21:11.674877 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1352/2889] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:11 2022] DELETE /compute/v2.1/os-security-groups/1291bfc2-7954-40b9-a5da-7db4a62440c3 => generated 194 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:11.679228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:11.679883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:11.689399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:11.690074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:11.690908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:11.691356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:11.878553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:11.898832 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7615ea42-19b0-4f72-8b48-76ba3a6f9d1d tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1472 microversion: 2.1 time: 0.224831 May 14 21:21:11.912639 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1353/2890] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:11 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1472 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:11.918123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-864fbc4c-0d85-4aed-a7bf-ea448dafe783 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:11.919014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-864fbc4c-0d85-4aed-a7bf-ea448dafe783 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:11.984886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-864fbc4c-0d85-4aed-a7bf-ea448dafe783 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:11.994636 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-864fbc4c-0d85-4aed-a7bf-ea448dafe783 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1276 microversion: 2.1 time: 0.080579 May 14 21:21:11.995509 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1354/2891] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:11 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1276 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:12.000590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:12.001211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:12.009222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:12.009835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:12.010876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:12.011646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:12.202959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:12.212315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-080df656-a952-488f-982e-183d386cc955 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1657 microversion: 2.1 time: 0.215558 May 14 21:21:12.213269 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1355/2892] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:11 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1657 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:12.218103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2938f4b0-38d0-46f2-8c04-b0906e8edba0 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a702b5e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:12.243214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-2938f4b0-38d0-46f2-8c04-b0906e8edba0 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:21:12.243214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-2938f4b0-38d0-46f2-8c04-b0906e8edba0 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group f7460102-161b-4ffe-a944-5f0d4fafae9b not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:21:12.243559 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2938f4b0-38d0-46f2-8c04-b0906e8edba0 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist May 14 21:21:12.243559 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-8f8a480a-5bf9-4195-a0e8-91bd5ba49939'] May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2938f4b0-38d0-46f2-8c04-b0906e8edba0 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b HTTP/1.1 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-8f8a480a-5bf9-4195-a0e8-91bd5ba49939'] May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'f7460102-161b-4ffe-a944-5f0d4fafae9b'} May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:21:12.245748 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8a480a-5bf9-4195-a0e8-91bd5ba49939'] May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8a480a-5bf9-4195-a0e8-91bd5ba49939'] May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8a480a-5bf9-4195-a0e8-91bd5ba49939'] May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f8a480a-5bf9-4195-a0e8-91bd5ba49939'] May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2938f4b0-38d0-46f2-8c04-b0906e8edba0 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group f7460102-161b-4ffe-a944-5f0d4fafae9b does not exist May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-8f8a480a-5bf9-4195-a0e8-91bd5ba49939'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2938f4b0-38d0-46f2-8c04-b0906e8edba0 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b" status: 404 len: 194 microversion: 2.1 time: 0.032999 May 14 21:21:12.252728 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1356/2893] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:12 2022] DELETE /compute/v2.1/os-security-groups/f7460102-161b-4ffe-a944-5f0d4fafae9b => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:12.256777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:12.257274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:12.267125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:12.267641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:12.269207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:12.269653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:12.296191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Request method failure captured: May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55/diagnostics HTTP/1.1 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0tUhytKeJX6xjUOnRuHu70ha8f99phhGwlb71mdeLr92hkTHlSWStJzXRbOOHzvI0o1vAVsV0uUQY5TNUWmSR01hW9LufJ__GqOxzzUegJ2aW9eGsNst09DWHqGG0LWuO5ebfRXTcnGXI1cFgmbKwW8ynel-gAQHR86tyImoYlQlY May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 236a7e87d3af4de2a0ef55f9cbd9dd7a May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-83012434 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/236a7e87d3af4de2a0ef55f9cbd9dd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/236a7e87d3af4de2a0ef55f9cbd9dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/236a7e87d3af4de2a0ef55f9cbd9dd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_236a7e87d3af4de2a0ef55f9cbd9dd7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-83012434 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 236a7e87d3af4de2a0ef55f9cbd9dd7a May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-83012434 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerDiagnosticsNegativeTest-83012434-project May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 38106105b3a2426a9b4af14185a80031 May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-83012434-project May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'server_id': '98f86a76-2dbd-4c5d-832c-502a0d21cb55'} May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.force_reraise() May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise self.value May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.enforce( May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.326446 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:12.330758 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ced9de21-2c77-4906-afbe-c16009bbda8c tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.080280 May 14 21:21:12.331230 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1357/2894] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:12 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55/diagnostics => generated 117 bytes in 83 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:12.342579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbeea4da-a79a-4a97-9a54-08d03b3aeb9b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:12.356847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbeea4da-a79a-4a97-9a54-08d03b3aeb9b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:12.359994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbeea4da-a79a-4a97-9a54-08d03b3aeb9b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:12.400045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fbeea4da-a79a-4a97-9a54-08d03b3aeb9b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Going to try to start instance {{(pid=130637) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 21:21:12.697503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Building network info cache for instance {{(pid=130638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:21:12.943615 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbeea4da-a79a-4a97-9a54-08d03b3aeb9b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.610769 May 14 21:21:12.944386 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1358/2895] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:12 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 613 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:12.959024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b84707a-de60-4b5c-9d13-7b98dcaa96f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7dcad30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:13.021213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG neutronclient.v2_0.client [None req-3b84707a-de60-4b5c-9d13-7b98dcaa96f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist", "detail": ""}} {{(pid=130637) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:21:13.021213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.security_group_api [None req-3b84707a-de60-4b5c-9d13-7b98dcaa96f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group 9734e2f5-5b5f-414d-914a-632514716019 not found {{(pid=130637) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:21:13.021213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-3b84707a-de60-4b5c-9d13-7b98dcaa96f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:21:13.021213 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a98faacb-11f3-434a-b759-64578f75945a'] May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b84707a-de60-4b5c-9d13-7b98dcaa96f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019 HTTP/1.1 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: exception: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a98faacb-11f3-434a-b759-64578f75945a'] May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '9734e2f5-5b5f-414d-914a-632514716019'} May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:21:13.024599 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a98faacb-11f3-434a-b759-64578f75945a'] May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a98faacb-11f3-434a-b759-64578f75945a'] May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a98faacb-11f3-434a-b759-64578f75945a'] May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a98faacb-11f3-434a-b759-64578f75945a'] May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b84707a-de60-4b5c-9d13-7b98dcaa96f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group 9734e2f5-5b5f-414d-914a-632514716019 does not exist May 14 21:21:13.028636 ncdv-master-1 devstack@n-api.service[130637]: Neutron server returns request_ids: ['req-a98faacb-11f3-434a-b759-64578f75945a'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:13.032163 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b84707a-de60-4b5c-9d13-7b98dcaa96f8 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019" status: 404 len: 194 microversion: 2.1 time: 0.082150 May 14 21:21:13.032163 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1359/2896] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:12 2022] DELETE /compute/v2.1/os-security-groups/9734e2f5-5b5f-414d-914a-632514716019 => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:13.037194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:13.037951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:13.045458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:13.046038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:13.050076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:13.050076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:13.082359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:21:13.586245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Updating instance_info_cache with network_info: [{"id": "9bcc5800-f48b-4fc7-ac54-c5ae11983072", "address": "fa:16:3e:31:80:2b", "network": {"id": "b1539874-6ea7-49e4-8f22-60e0ae9b0c3a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-759282147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d272971274514577b827dd8ac81c9e58", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bcc5800-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:21:13.603327 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2809bc7e-fd30-4c07-bbca-d5a59c74c1c9 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "DELETE /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 204 len: 0 microversion: 2.1 time: 0.569643 May 14 21:21:13.605594 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1360/2897] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:21:13 2022] DELETE /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:21:13.613266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:13.620453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:13.638324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:13.638786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:13.639654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:13.640249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:13.689515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Releasing lock "refresh_cache-65f64224-2391-4126-8dcb-f009aa8a0612" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:21:13.690416 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d274e7c-eba4-4a39-9afb-346b06c08b05 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action" status: 202 len: 0 microversion: 2.1 time: 3.066076 May 14 21:21:13.691048 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1538/2898] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:10 2022] POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action => generated 0 bytes in 3067 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:21:13.696745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4435b6cf-9f47-48d9-b24f-0c1d81fa4548 req-c2d006a1-f69a-4293-bd01-75c349da6ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f64224-2391-4126-8dcb-f009aa8a0612", "tag": "9bcc5800-f48b-4fc7-ac54-c5ae11983072"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:13.720549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4435b6cf-9f47-48d9-b24f-0c1d81fa4548 req-c2d006a1-f69a-4293-bd01-75c349da6ac0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:13.732279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4435b6cf-9f47-48d9-b24f-0c1d81fa4548 req-c2d006a1-f69a-4293-bd01-75c349da6ac0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:13.759667 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4435b6cf-9f47-48d9-b24f-0c1d81fa4548 req-c2d006a1-f69a-4293-bd01-75c349da6ac0 service nova] Creating event network-changed:9bcc5800-f48b-4fc7-ac54-c5ae11983072 for instance 65f64224-2391-4126-8dcb-f009aa8a0612 on nch1-master-1 May 14 21:21:13.773346 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4435b6cf-9f47-48d9-b24f-0c1d81fa4548 req-c2d006a1-f69a-4293-bd01-75c349da6ac0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078381 May 14 21:21:13.774245 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1539/2899] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:13.812705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:13.816487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:13.835828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:13.836512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:13.837745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:13.838642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:13.990301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:13.999825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18c79342-6dc2-4514-adee-ae105666f43d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.392568 May 14 21:21:14.001689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1361/2900] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:13 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:14.012058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:14.014623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:14.024316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.025490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.026459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.027075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.076415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:14.092556 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef9a1215-088f-476e-9d1d-cc73b8d5a690 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1666 microversion: 2.1 time: 0.314410 May 14 21:21:14.104155 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1540/2901] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:13 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1666 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:14.117845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e568b478-da15-4607-a2b0-2d86eefec7e7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a795b9d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:14.144503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-e568b478-da15-4607-a2b0-2d86eefec7e7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:21:14.145772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-e568b478-da15-4607-a2b0-2d86eefec7e7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group f40374b1-5b1c-4455-b973-329385ac8a9a not found {{(pid=130638) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:21:14.146637 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-e568b478-da15-4607-a2b0-2d86eefec7e7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:21:14.146637 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-a073a3b8-e348-41f8-8db6-0be93b124777'] May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e568b478-da15-4607-a2b0-2d86eefec7e7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a HTTP/1.1 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-a073a3b8-e348-41f8-8db6-0be93b124777'] May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'f40374b1-5b1c-4455-b973-329385ac8a9a'} May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:21:14.148932 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a073a3b8-e348-41f8-8db6-0be93b124777'] May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a073a3b8-e348-41f8-8db6-0be93b124777'] May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a073a3b8-e348-41f8-8db6-0be93b124777'] May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a073a3b8-e348-41f8-8db6-0be93b124777'] May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e568b478-da15-4607-a2b0-2d86eefec7e7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group f40374b1-5b1c-4455-b973-329385ac8a9a does not exist May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-a073a3b8-e348-41f8-8db6-0be93b124777'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e568b478-da15-4607-a2b0-2d86eefec7e7 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a" status: 404 len: 194 microversion: 2.1 time: 0.044803 May 14 21:21:14.160743 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1541/2902] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:14 2022] DELETE /compute/v2.1/os-security-groups/f40374b1-5b1c-4455-b973-329385ac8a9a => generated 194 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:14.163693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:14.163693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:14.177762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:14.190892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4dad3685-206a-4238-8e85-61d924b240d1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1328 microversion: 2.1 time: 0.187962 May 14 21:21:14.195741 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1362/2903] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:14 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1328 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:14.198482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.198949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.205778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.186"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:14.207896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.208620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.374615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:14.386299 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a63a0c05-d408-4126-823f-6b7c2f33a899 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1478 microversion: 2.1 time: 0.233636 May 14 21:21:14.387535 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1542/2904] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:14 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1478 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:14.394481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a603746-1431-43ab-8137-05756868d74b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7fd7700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:14.442543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-0a603746-1431-43ab-8137-05756868d74b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:21:14.443334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-0a603746-1431-43ab-8137-05756868d74b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group 65c4078c-4871-47bd-abc1-11099233faf0 not found {{(pid=130638) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:21:14.444053 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0a603746-1431-43ab-8137-05756868d74b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:21:14.444053 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-4ce63199-a79c-4a8c-8aff-6c31d0c31f30'] May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a603746-1431-43ab-8137-05756868d74b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0 HTTP/1.1 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-4ce63199-a79c-4a8c-8aff-6c31d0c31f30'] May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '65c4078c-4871-47bd-abc1-11099233faf0'} May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:21:14.445898 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce63199-a79c-4a8c-8aff-6c31d0c31f30'] May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce63199-a79c-4a8c-8aff-6c31d0c31f30'] May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce63199-a79c-4a8c-8aff-6c31d0c31f30'] May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ce63199-a79c-4a8c-8aff-6c31d0c31f30'] May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a603746-1431-43ab-8137-05756868d74b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group 65c4078c-4871-47bd-abc1-11099233faf0 does not exist May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-4ce63199-a79c-4a8c-8aff-6c31d0c31f30'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0a603746-1431-43ab-8137-05756868d74b tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0" status: 404 len: 194 microversion: 2.1 time: 0.058221 May 14 21:21:14.450082 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1543/2905] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:14 2022] DELETE /compute/v2.1/os-security-groups/65c4078c-4871-47bd-abc1-11099233faf0 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:14.458241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf7059bd-8bec-430c-92ed-617c3b18f82c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1b970ed30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:14.462789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:14.469333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.469797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.470583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.471023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.492098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-cf7059bd-8bec-430c-92ed-617c3b18f82c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:21:14.492772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-cf7059bd-8bec-430c-92ed-617c3b18f82c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Neutron security group c60240e5-e435-4363-af54-fd4f0e836afd not found {{(pid=130638) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 14 21:21:14.493305 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-cf7059bd-8bec-430c-92ed-617c3b18f82c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:21:14.493305 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-46b092aa-786b-4569-80ff-ea275e884041'] May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf7059bd-8bec-430c-92ed-617c3b18f82c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd HTTP/1.1 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: exception: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-46b092aa-786b-4569-80ff-ea275e884041'] May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'c60240e5-e435-4363-af54-fd4f0e836afd'} May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:21:14.499424 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b092aa-786b-4569-80ff-ea275e884041'] May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b092aa-786b-4569-80ff-ea275e884041'] May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b092aa-786b-4569-80ff-ea275e884041'] May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-46b092aa-786b-4569-80ff-ea275e884041'] May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf7059bd-8bec-430c-92ed-617c3b18f82c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Security group c60240e5-e435-4363-af54-fd4f0e836afd does not exist May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: Neutron server returns request_ids: ['req-46b092aa-786b-4569-80ff-ea275e884041'] {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:14.506019 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf7059bd-8bec-430c-92ed-617c3b18f82c tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd" status: 404 len: 194 microversion: 2.1 time: 0.049863 May 14 21:21:14.508665 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1544/2906] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:14 2022] DELETE /compute/v2.1/os-security-groups/c60240e5-e435-4363-af54-fd4f0e836afd => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:14.517335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:14.518712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:14.530351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.530833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.533617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:14.534076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:14.568137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:21:15.034715 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c4f34df-0317-47f9-90da-0b267cc6fec9 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 204 len: 0 microversion: 2.1 time: 0.521538 May 14 21:21:15.036610 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1545/2907] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:21:14 2022] DELETE /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:21:15.042591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:15.045898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:15.058035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:15.058986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:15.060236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:15.064086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:15.118616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Acquired lock "refresh_cache-65f64224-2391-4126-8dcb-f009aa8a0612" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:21:15.419318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:15.432478 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-17c15416-2526-45da-ab6b-dadd93b72588 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.393722 May 14 21:21:15.433408 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1546/2908] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:15 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:15.444445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:15.445070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:15.455098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:15.457596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:15.461757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:15.462964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:15.797769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:15.806745 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58a8b7a7-a77d-439f-89a3-1009448abc4d tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1646 microversion: 2.1 time: 0.372250 May 14 21:21:15.807546 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1547/2909] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:15 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1646 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:15.824268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:15.825112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:15.832593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:15.833297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:15.834233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:15.834814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:16.189474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:16.211807 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0aed8dc-57b8-4575-915d-395be0fb7cba tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1666 microversion: 2.1 time: 0.392947 May 14 21:21:16.219096 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1548/2910] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:15 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1666 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:16.235125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:16.235870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:16.245254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:16.246530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:16.247510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:16.248112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:16.522787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:16.532728 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c293f321-233f-4b3c-9668-1fa25c7bcbd9 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1413 microversion: 2.1 time: 0.308832 May 14 21:21:16.550052 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1549/2911] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:16 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1413 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:16.555187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:16.556005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:16.569420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:16.577469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:16.579729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:16.580331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:16.957912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:16.972522 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-763988ca-b77a-4e1b-8099-22b4cda91e89 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1478 microversion: 2.1 time: 0.420283 May 14 21:21:16.983605 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1550/2912] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:16 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1478 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:16.987862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:16.989927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:17.012271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:17.013419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:17.015402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:17.021404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:17.363633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:17.371581 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d288345-8add-4b45-8170-d12715325d89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.393691 May 14 21:21:17.372751 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1551/2913] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:16 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:17.386964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:17.387983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:17.396970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:17.396970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:17.396970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:17.396970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:17.515291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Building network info cache for instance {{(pid=130637) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:21:17.832693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70751bc6-aa23-4e0b-b45d-a0a3090e12ad tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1646 microversion: 2.1 time: 0.491019 May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1552/2914] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:17 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1646 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c899e9cb-76c5-4290-a4ce-b0d95f23b893 req-123b555e-83d6-45f6-b73a-eeb5a50fe35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98f86a76-2dbd-4c5d-832c-502a0d21cb55", "name": "network-vif-deleted", "tag": "07597990-aa56-4f31-a05a-4c5cd3822862"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c899e9cb-76c5-4290-a4ce-b0d95f23b893 req-123b555e-83d6-45f6-b73a-eeb5a50fe35f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c899e9cb-76c5-4290-a4ce-b0d95f23b893 req-123b555e-83d6-45f6-b73a-eeb5a50fe35f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c899e9cb-76c5-4290-a4ce-b0d95f23b893 req-123b555e-83d6-45f6-b73a-eeb5a50fe35f service nova] Creating event network-vif-deleted:07597990-aa56-4f31-a05a-4c5cd3822862 for instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 on nch2-master-1 May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c899e9cb-76c5-4290-a4ce-b0d95f23b893 req-123b555e-83d6-45f6-b73a-eeb5a50fe35f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039014 May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1553/2915] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:17.950409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.128186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:18.142941 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-107892cc-c6c8-482b-af28-4ac9efbab08d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.232167 May 14 21:21:18.144224 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1554/2916] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:17 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:18.161569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:18.162522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:18.169990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.170517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.171313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.172825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.483526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:18.489657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Updating instance_info_cache with network_info: [{"id": "9bcc5800-f48b-4fc7-ac54-c5ae11983072", "address": "fa:16:3e:31:80:2b", "network": {"id": "b1539874-6ea7-49e4-8f22-60e0ae9b0c3a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-759282147-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d272971274514577b827dd8ac81c9e58", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9bcc5800-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:21:18.494456 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8a013cf6-d82c-40a7-9c8a-26f92c031dcf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1401 microversion: 2.1 time: 0.336734 May 14 21:21:18.495047 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1555/2917] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:18 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1401 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:18.511200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:18.511200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:18.516369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.516831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.518173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.518622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.617377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.617860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.618339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lazy-loading 'fault' on Instance uuid 98f86a76-2dbd-4c5d-832c-502a0d21cb55 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:21:18.643527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Releasing lock "refresh_cache-65f64224-2391-4126-8dcb-f009aa8a0612" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:21:18.644524 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e62087a-235b-4cdd-b606-505b52282584 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action" status: 202 len: 0 microversion: 2.1 time: 4.447644 May 14 21:21:18.645299 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1363/2918] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:14 2022] POST /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612/action => generated 0 bytes in 4449 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:21:18.650888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:18.651873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:18.676274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.677170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.678695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.681595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.730518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38106105b3a2426a9b4af14185a80031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236a7e87d3af4de2a0ef55f9cbd9dd7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:18.757186 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1f224635-d9d2-4e4b-9192-1a8c9e878910 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 200 len: 1312 microversion: 2.1 time: 0.261043 May 14 21:21:18.767634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1556/2919] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:18 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 1312 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:18.777657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:18.782928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:18.803683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.804380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.805381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:18.806052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:18.992709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:19.006465 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb747f54-39c3-4717-ba13-5ef50b8f9888 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.359689 May 14 21:21:19.007685 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1364/2920] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:18 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:19.017974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-08f5476e-664d-40a6-bfc1-ad2f85c0ba6a req-de24938f-7e7a-4fbf-980b-88ddfcb80797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815ca298-48a6-4a6b-af6c-8bb68179a7ea", "tag": "32783b2c-8568-419c-979d-100fe44c3fb9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:19.037023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-08f5476e-664d-40a6-bfc1-ad2f85c0ba6a req-de24938f-7e7a-4fbf-980b-88ddfcb80797 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.038892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-08f5476e-664d-40a6-bfc1-ad2f85c0ba6a req-de24938f-7e7a-4fbf-980b-88ddfcb80797 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.059606 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-08f5476e-664d-40a6-bfc1-ad2f85c0ba6a req-de24938f-7e7a-4fbf-980b-88ddfcb80797 service nova] Creating event network-changed:32783b2c-8568-419c-979d-100fe44c3fb9 for instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea on nch1-master-1 May 14 21:21:19.066369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-08f5476e-664d-40a6-bfc1-ad2f85c0ba6a req-de24938f-7e7a-4fbf-980b-88ddfcb80797 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056062 May 14 21:21:19.070052 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1365/2921] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:19.075294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bae6b461-1968-4587-b2aa-20f004879da7 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '.version_select at 0x7fb1a70161f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:19.206672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:19.216779 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73b53868-87b7-4ca8-a67f-6dbb5816c29b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.446541 May 14 21:21:19.219878 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1557/2922] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:18 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:19.229159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:19.229847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:19.238115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.239048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.240031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.240673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.278615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.279164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.279833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lazy-loading 'fault' on Instance uuid bfa76855-e975-43d4-96d6-c1c97823573e {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:21:19.346891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985e9f2f783e4a329e9a4c100a06134c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ef4614a33040a7b0ae010a6b1c7fb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:19.356201 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9de87eba-e864-4fa5-997b-f2ea4f0dc202 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 200 len: 1305 microversion: 2.1 time: 0.134079 May 14 21:21:19.366130 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1558/2923] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:19 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:19.366130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:19.366130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:19.372059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.372517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.373310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.373751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.613108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Unlocking {{(pid=130638) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 14 21:21:19.813910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7112ccc2-8e41-4738-aa9d-4c4f3afe8fe3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.455479 May 14 21:21:19.814578 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1559/2924] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:19 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:19.821062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:19.821062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:19.826059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.826516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.827331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:19.827806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:19.958202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:19.965981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84f06f1f-616d-4fb4-bb2e-b1a888c60ece tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1401 microversion: 2.1 time: 0.150443 May 14 21:21:19.966586 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1560/2925] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:19 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1401 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:20.072793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66be5a89-6b74-4b9e-8ed2-4f25150f1aff tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Action: 'create', calling method: .version_select at 0x7fb1b96753a0>, body: {"keypair": {"name": "tempest-keypair-1437584933", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrZiTkK0McbmucSadjrseSbrUoUnEUNjJEbdLnxQNmIfNpJfFVnA8HEmpZFiP8/lES/WanL4gn7I97lx4hCrh/XxBhniciYFdvdDSShhd+lr0U3s1iTHQIGaKyp6WE9rw=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:20.088052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-66be5a89-6b74-4b9e-8ed2-4f25150f1aff tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Getting quotas for project 44c96286063c40ac948610903a50e98f. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:21:20.093243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-66be5a89-6b74-4b9e-8ed2-4f25150f1aff tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Getting quotas for user f2ef9ae6c6d24ba0b85fd8f41afb9c05 and project 44c96286063c40ac948610903a50e98f. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:21:20.130499 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bae6b461-1968-4587-b2aa-20f004879da7 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/92532511-cea7-4453-9604-6006161c2b19" status: 202 len: 0 microversion: 2.1 time: 1.059148 May 14 21:21:20.131161 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1366/2926] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:21:19 2022] DELETE /compute/v2.1/os-floating-ips/92532511-cea7-4453-9604-6006161c2b19 => generated 0 bytes in 1061 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:20.137072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:20.138122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] [instance: 98f86a76-2dbd-4c5d-832c-502a0d21cb55] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:20.145094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.145554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.146329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.146769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.160797 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] HTTP exception thrown: Instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 could not be found. May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Request method failure captured: May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 HTTP/1.1 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0tUhytKeJX6xjUOnRuHu70ha8f99phhGwlb71mdeLr92hkTHlSWStJzXRbOOHzvI0o1vAVsV0uUQY5TNUWmSR01hW9LufJ__GqOxzzUegJ2aW9eGsNst09DWHqGG0LWuO5ebfRXTcnGXI1cFgmbKwW8ynel-gAQHR86tyImoYlQlY May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 236a7e87d3af4de2a0ef55f9cbd9dd7a May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-83012434 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/236a7e87d3af4de2a0ef55f9cbd9dd7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/236a7e87d3af4de2a0ef55f9cbd9dd7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/236a7e87d3af4de2a0ef55f9cbd9dd7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_236a7e87d3af4de2a0ef55f9cbd9dd7a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-83012434 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 236a7e87d3af4de2a0ef55f9cbd9dd7a May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-83012434 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerDiagnosticsNegativeTest-83012434-project May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 38106105b3a2426a9b4af14185a80031 May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-83012434-project May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 could not be found. May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '98f86a76-2dbd-4c5d-832c-502a0d21cb55'} May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 could not be found. May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 could not be found. May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:20.162525 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 could not be found. May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] Returning 404 to user: Instance 98f86a76-2dbd-4c5d-832c-502a0d21cb55 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b6f0e336-d8da-466c-a500-d2bd33ab45b0 tempest-ServerDiagnosticsNegativeTest-83012434 tempest-ServerDiagnosticsNegativeTest-83012434-project] 10.222.0.52 "GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55" status: 404 len: 111 microversion: 2.1 time: 0.031656 May 14 21:21:20.166511 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1367/2927] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:20 2022] GET /compute/v2.1/servers/98f86a76-2dbd-4c5d-832c-502a0d21cb55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:20.169151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:20.169764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:20.176101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.180310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.180310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.180310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.195068 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66be5a89-6b74-4b9e-8ed2-4f25150f1aff tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226822 May 14 21:21:20.196254 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1561/2928] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:21:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:20.200970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-9a161056-edd9-4578-805d-ddc3128c1d70 req-b5d58465-b45a-4676-b22b-0040298fb74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f64224-2391-4126-8dcb-f009aa8a0612", "tag": "9bcc5800-f48b-4fc7-ac54-c5ae11983072"}, {"server_uuid": "bfa76855-e975-43d4-96d6-c1c97823573e", "name": "network-vif-deleted", "tag": "37039dca-7f50-4abf-b9c9-024d3e2f3d10"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:20.219737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9a161056-edd9-4578-805d-ddc3128c1d70 req-b5d58465-b45a-4676-b22b-0040298fb74e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.220331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9a161056-edd9-4578-805d-ddc3128c1d70 req-b5d58465-b45a-4676-b22b-0040298fb74e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.234779 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9a161056-edd9-4578-805d-ddc3128c1d70 req-b5d58465-b45a-4676-b22b-0040298fb74e service nova] Creating event network-changed:9bcc5800-f48b-4fc7-ac54-c5ae11983072 for instance 65f64224-2391-4126-8dcb-f009aa8a0612 on nch1-master-1 May 14 21:21:20.235668 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9a161056-edd9-4578-805d-ddc3128c1d70 req-b5d58465-b45a-4676-b22b-0040298fb74e service nova] Creating event network-vif-deleted:37039dca-7f50-4abf-b9c9-024d3e2f3d10 for instance bfa76855-e975-43d4-96d6-c1c97823573e on nch1-master-1 May 14 21:21:20.242459 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-9a161056-edd9-4578-805d-ddc3128c1d70 req-b5d58465-b45a-4676-b22b-0040298fb74e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044810 May 14 21:21:20.243262 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1562/2929] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:20.248508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e0eaa60-9a61-4b1f-8e0d-acb98a746f5b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '.version_select at 0x7fb1a71eb310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:20.319215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:20.327397 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9afeb71f-2e3c-4e3d-9dac-6b8a8c61484a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.161952 May 14 21:21:20.328959 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1368/2930] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:20 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:20.333733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:20.334517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:20.340970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.341435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.342220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.342666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.498284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:20.506952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03428d1d-669f-468d-a70f-af431c6dacda tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.176811 May 14 21:21:20.507584 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1369/2931] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:20 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:20.512673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:20.513279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:20.519824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.520299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.521077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.521525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.667290 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e0eaa60-9a61-4b1f-8e0d-acb98a746f5b tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/f542b489-4d4e-416a-99ad-2e7e66a25dd4" status: 202 len: 0 microversion: 2.1 time: 0.422619 May 14 21:21:20.671228 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1563/2932] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:20 2022] DELETE /compute/v2.1/os-security-groups/f542b489-4d4e-416a-99ad-2e7e66a25dd4 => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:20.679807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:20.680571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] [instance: bfa76855-e975-43d4-96d6-c1c97823573e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:20.687228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.688040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.688688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.689366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.706384 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] HTTP exception thrown: Instance bfa76855-e975-43d4-96d6-c1c97823573e could not be found. May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Request method failure captured: May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e HTTP/1.1 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBz6DWDJSUzsYXW0cmPTsmmidpaBHjHwarCzU_LeVLM8UrMXC-FtEp1vx0OLo2eLl7oggBEyAy97m9UCp3Za216FQF6vopjmBvBzxY2Yd3AIEzZxvQN9eOElrEorC2kCmYbakfkdTYUEe13t-A6qmhmKyQFese0W4aSwNA7zhByCFx0 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/62ef4614a33040a7b0ae010a6b1c7fb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_62ef4614a33040a7b0ae010a6b1c7fb1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 62ef4614a33040a7b0ae010a6b1c7fb1 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-485815566 May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 985e9f2f783e4a329e9a4c100a06134c May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-SecurityGroupsTestJSON-485815566-project May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance bfa76855-e975-43d4-96d6-c1c97823573e could not be found. May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'bfa76855-e975-43d4-96d6-c1c97823573e'} May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfa76855-e975-43d4-96d6-c1c97823573e could not be found. May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfa76855-e975-43d4-96d6-c1c97823573e could not be found. May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:20.708939 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:20.713225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:20.713225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:20.713225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:20.713225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:20.713225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:20.713225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfa76855-e975-43d4-96d6-c1c97823573e could not be found. May 14 21:21:20.713225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:21:20.714737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Returning 404 to user: Instance bfa76855-e975-43d4-96d6-c1c97823573e could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:20.715810 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7292845e-b608-469e-8e57-46a0b54b1671 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e" status: 404 len: 111 microversion: 2.1 time: 0.042689 May 14 21:21:20.720243 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1564/2933] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:20 2022] GET /compute/v2.1/servers/bfa76855-e975-43d4-96d6-c1c97823573e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:20.725859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:20.726626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:20.733288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.734944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.736080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:20.736690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:20.770111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:21:20.781539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:20.789082 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9db99f5d-73f8-4c2f-86f6-339656403ec5 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.280211 May 14 21:21:20.795203 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1370/2934] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:20 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:20.810907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-94ebad48-4c80-4b10-858a-570666f0c841 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a70161f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:21.103049 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7ab72853-d910-43e3-8aa0-fd236d96abdb tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "DELETE /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 204 len: 0 microversion: 2.1 time: 0.379813 May 14 21:21:21.108441 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1565/2935] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:21:20 2022] DELETE /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:21:21.115084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:21.115831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:21.124875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.124875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.124875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.124875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.276993 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-94ebad48-4c80-4b10-858a-570666f0c841 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/685d0bd1-3cd2-46fd-901d-30d0e69352aa" status: 202 len: 0 microversion: 2.1 time: 0.480383 May 14 21:21:21.277976 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1371/2936] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:20 2022] DELETE /compute/v2.1/os-security-groups/685d0bd1-3cd2-46fd-901d-30d0e69352aa => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:21.284635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:21.285271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:21.291740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.292211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.293003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.293445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.469877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:21.478059 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d4411c3-2253-4f7c-8519-d04aef9efa46 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1401 microversion: 2.1 time: 0.198807 May 14 21:21:21.479608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1372/2937] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:21 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1401 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:21.483391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:21.484786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:21.490936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.491358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.492196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.492641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.595295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:21.603704 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e67315e-fd6d-4b4b-a20e-ff41b545756f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.493183 May 14 21:21:21.604370 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1566/2938] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:21 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:21.611882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-404133bf-9b47-40c9-ae76-edf7de9dda87 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] Calling method '.version_select at 0x7fb1a7828dc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:21.642931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:21.650451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c12572e-5e22-490e-865c-91a9a445b5d1 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1509 microversion: 2.1 time: 0.170807 May 14 21:21:21.651038 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1373/2939] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:21 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:21.659999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:21.659999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:21.662087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.662546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.663666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.664136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.799566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:21.807364 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82233167-c01c-48bd-9d7d-844730c1cde3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.155299 May 14 21:21:21.808378 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1374/2940] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:21 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:21.813339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-059fa620-528f-495b-a68f-9132dee705ae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:21.814182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-059fa620-528f-495b-a68f-9132dee705ae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:21.820526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-059fa620-528f-495b-a68f-9132dee705ae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.820983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-059fa620-528f-495b-a68f-9132dee705ae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:21.821760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-059fa620-528f-495b-a68f-9132dee705ae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:21.824734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-059fa620-528f-495b-a68f-9132dee705ae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.095380 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-404133bf-9b47-40c9-ae76-edf7de9dda87 tempest-SecurityGroupsTestJSON-485815566 tempest-SecurityGroupsTestJSON-485815566-project] 10.222.0.52 "DELETE /compute/v2.1/os-security-groups/a30d7a86-b7fa-4547-8f0b-cbe0fcf1f5ef" status: 202 len: 0 microversion: 2.1 time: 0.489507 May 14 21:21:22.096062 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1567/2941] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:21:21 2022] DELETE /compute/v2.1/os-security-groups/a30d7a86-b7fa-4547-8f0b-cbe0fcf1f5ef => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:22.126732 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-059fa620-528f-495b-a68f-9132dee705ae tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.312619 May 14 21:21:22.132094 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1375/2942] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:21 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:22.136625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:22.137252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:22.148748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.148748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.149336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.149958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.376887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:22.384736 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7130c770-d7b5-438f-850d-4189d3a8b0a2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1675 microversion: 2.1 time: 0.252988 May 14 21:21:22.385801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1568/2943] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:22 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:22.502637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:22.507125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:22.519816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.520581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.521775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.523086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.668418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:22.669747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:22.679613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.680577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.681547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.682234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.729361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:22.738423 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-73bcaa5e-ef8b-44a8-9a27-72946cf2330d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1401 microversion: 2.1 time: 0.243979 May 14 21:21:22.739114 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1376/2944] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:22 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1401 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:22.825662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:22.826353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:22.833366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.835149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.835149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:22.835149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:22.975129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:22.983249 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2dcfcbcd-9090-4234-80f5-0c61366a7677 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.162219 May 14 21:21:22.983913 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1377/2945] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:22 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:23.086246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:23.096840 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1d2fa80e-51ff-4a6a-80bb-7e0bc259f77e tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1509 microversion: 2.1 time: 0.433082 May 14 21:21:23.098143 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1569/2946] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:22 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1509 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:23.402950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:23.403597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:23.411468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:23.412942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:23.412942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:23.413163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:23.580779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:23.589711 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f494c8e3-616d-4354-9567-33912f1566be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1655 microversion: 2.1 time: 0.190436 May 14 21:21:23.591448 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1378/2947] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:23 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1655 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:23.615806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6ae546b-1902-44a6-84c0-e77293b06017 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:23.616617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b6ae546b-1902-44a6-84c0-e77293b06017 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:23.622677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6ae546b-1902-44a6-84c0-e77293b06017 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:23.623167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6ae546b-1902-44a6-84c0-e77293b06017 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:23.624047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6ae546b-1902-44a6-84c0-e77293b06017 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:23.624429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6ae546b-1902-44a6-84c0-e77293b06017 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:23.757243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:23.758468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:23.766705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:23.769794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:23.769794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:23.769794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:23.884666 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6ae546b-1902-44a6-84c0-e77293b06017 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.267418 May 14 21:21:23.885189 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1570/2948] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:23 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:23.895828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1986495863", "imageRef": "47827471-1397-4c98-8d0d-bb814ac4f0c2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4c779a2a-d698-417c-a933-0b56110b8e36"}], "security_groups": [{"name": "tempest-securitygroup--519220923"}], "key_name": "tempest-keypair-1437584933", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:24.086090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] validate_networks() for [('4c779a2a-d698-417c-a933-0b56110b8e36', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:21:24.126626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:24.136277 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9099d8a7-33a5-41da-84f6-56c6cb3bcf41 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1401 microversion: 2.1 time: 0.383790 May 14 21:21:24.137593 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1379/2949] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:23 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1401 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:24.144904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:24.145542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:24.157054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.157545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.158350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.158798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.425916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:24.435048 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dcd75577-ec5c-4b67-b457-a479844b1431 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1662 microversion: 2.1 time: 0.296077 May 14 21:21:24.445198 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1380/2950] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:24 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1662 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:24.445198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:24.445198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:24.449046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.449516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.450485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.450978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.688457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:24.700278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ed615727-d4cd-42d1-9d61-29fe7bee23db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.263533 May 14 21:21:24.711995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1381/2951] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:24 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:24.720198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:24.723993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:24.728231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.728678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.729517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.729965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.779143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:21:24.779637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:21:24.780263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:21:24.781598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:21:24.782222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:21:24.795660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.797104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.798320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.799274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.822786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Getting quotas for project 44c96286063c40ac948610903a50e98f. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:21:24.828963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Getting quotas for user f2ef9ae6c6d24ba0b85fd8f41afb9c05 and project 44c96286063c40ac948610903a50e98f. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:21:24.841508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:21:24.843948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3b5b688171045d586128236e85aee0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd272971274514577b827dd8ac81c9e58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:24.846509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='47827471-1397-4c98-8d0d-bb814ac4f0c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:21:24.853789 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e81d6f0d-6bef-467b-88f3-53547eba624f tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 200 len: 1293 microversion: 2.1 time: 0.140540 May 14 21:21:24.854687 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1382/2952] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:24 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:24.860168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f49b8df8-8ca4-4bcb-8fe2-7d2f06efe20a req-e4c6ddd0-adbf-41c9-ba1e-d6bab677c566 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815ca298-48a6-4a6b-af6c-8bb68179a7ea", "name": "network-vif-plugged", "status": "completed", "tag": "32783b2c-8568-419c-979d-100fe44c3fb9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:24.868678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f49b8df8-8ca4-4bcb-8fe2-7d2f06efe20a req-e4c6ddd0-adbf-41c9-ba1e-d6bab677c566 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.869403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f49b8df8-8ca4-4bcb-8fe2-7d2f06efe20a req-e4c6ddd0-adbf-41c9-ba1e-d6bab677c566 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.880366 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f49b8df8-8ca4-4bcb-8fe2-7d2f06efe20a req-e4c6ddd0-adbf-41c9-ba1e-d6bab677c566 service nova] Creating event network-vif-plugged:32783b2c-8568-419c-979d-100fe44c3fb9 for instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea on nch1-master-1 May 14 21:21:24.885824 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f49b8df8-8ca4-4bcb-8fe2-7d2f06efe20a req-e4c6ddd0-adbf-41c9-ba1e-d6bab677c566 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029536 May 14 21:21:24.886427 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1383/2953] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:24.892157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8afe50d0-8c81-405e-b6c3-74c8327253cd req-a8ef26eb-3d71-45ad-a608-0114d5fed4e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f64224-2391-4126-8dcb-f009aa8a0612", "name": "network-vif-deleted", "tag": "9bcc5800-f48b-4fc7-ac54-c5ae11983072"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:24.900689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8afe50d0-8c81-405e-b6c3-74c8327253cd req-a8ef26eb-3d71-45ad-a608-0114d5fed4e8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:24.901085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8afe50d0-8c81-405e-b6c3-74c8327253cd req-a8ef26eb-3d71-45ad-a608-0114d5fed4e8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:24.913419 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8afe50d0-8c81-405e-b6c3-74c8327253cd req-a8ef26eb-3d71-45ad-a608-0114d5fed4e8 service nova] Creating event network-vif-deleted:9bcc5800-f48b-4fc7-ac54-c5ae11983072 for instance 65f64224-2391-4126-8dcb-f009aa8a0612 on nch1-master-1 May 14 21:21:24.920092 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8afe50d0-8c81-405e-b6c3-74c8327253cd req-a8ef26eb-3d71-45ad-a608-0114d5fed4e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031941 May 14 21:21:24.920706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1384/2954] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:25.116598 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b9aeae95-7af1-4e19-b3e0-c0da1f846cd5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.229269 May 14 21:21:25.117569 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1571/2955] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:21:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:21:25.128677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-17e7cbd0-0607-41c1-ad28-c15045744486 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:25.129724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-17e7cbd0-0607-41c1-ad28-c15045744486 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:25.154128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:25.154967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:25.162981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.163707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.164679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.165885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.239222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17e7cbd0-0607-41c1-ad28-c15045744486 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:25.246739 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-17e7cbd0-0607-41c1-ad28-c15045744486 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1246 microversion: 2.1 time: 0.123270 May 14 21:21:25.257891 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1385/2956] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:25 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1246 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:25.357937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:25.366834 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-34f91091-d29a-4f2a-a12d-0642f3170065 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1401 microversion: 2.1 time: 0.216615 May 14 21:21:25.375628 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1572/2957] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:25 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1401 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:25.453193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:25.454173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:25.461543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.462022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.462820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.463269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.708256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:25.710451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9456514-83f4-4056-b37c-5b5381424021 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.261575 May 14 21:21:25.711055 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1386/2958] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:25 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:25.729104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:25.729710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:25.729852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:25.748164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:25.748448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.748448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.748609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.748710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.748795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.748877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.748959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.748959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.875216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:25.899337 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e21ba4bc-199f-44b4-86d8-671a3256d82e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.172847 May 14 21:21:25.900825 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1387/2959] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:25 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:25.929497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:25.935631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] [instance: 65f64224-2391-4126-8dcb-f009aa8a0612] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:25.943127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:25.952462 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa721f58-41aa-43d5-8f7e-fb7a6957fcc1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.227177 May 14 21:21:25.954314 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1573/2960] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:25 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:25.956458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.956994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.958827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.959601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.960603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:25.961037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:25.968326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.969471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.971243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:25.973448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:25.977958 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] HTTP exception thrown: Instance 65f64224-2391-4126-8dcb-f009aa8a0612 could not be found. May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Request method failure captured: May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 HTTP/1.1 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0JIc58PfcWI8x0wpfcIOH247uBr1DCpV9f7roK4JYu63prcbHKNxLGFgjZtMzKVJcNPe0_Wm1gBXGGBt4YXxFDk3y09STpjLHf2yNIPZAOd8NnYcq1eu1hQ30vi5fc--VQyq2g638Y0Elh4qmtjYwkQghh6FDrRNGerqSEgsD9FjQ May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d272971274514577b827dd8ac81c9e58 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1917270842 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d272971274514577b827dd8ac81c9e58"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d272971274514577b827dd8ac81c9e58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d272971274514577b827dd8ac81c9e58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d272971274514577b827dd8ac81c9e58", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1917270842 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d272971274514577b827dd8ac81c9e58 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1917270842 May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueTestJSONUnderV235-1917270842-project May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b3b5b688171045d586128236e85aee0b May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1917270842-project May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 65f64224-2391-4126-8dcb-f009aa8a0612 could not be found. May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '65f64224-2391-4126-8dcb-f009aa8a0612'} May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f64224-2391-4126-8dcb-f009aa8a0612 could not be found. May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f64224-2391-4126-8dcb-f009aa8a0612 could not be found. May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:25.985348 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f64224-2391-4126-8dcb-f009aa8a0612 could not be found. May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] Returning 404 to user: Instance 65f64224-2391-4126-8dcb-f009aa8a0612 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-51814430-dc49-46a9-900f-effc3f9438e0 tempest-ServerRescueTestJSONUnderV235-1917270842 tempest-ServerRescueTestJSONUnderV235-1917270842-project] 10.222.0.52 "GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612" status: 404 len: 111 microversion: 2.1 time: 0.084147 May 14 21:21:25.988798 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1388/2961] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:25 2022] GET /compute/v2.1/servers/65f64224-2391-4126-8dcb-f009aa8a0612 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:21:26.274179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ddc71a80-de26-4c41-8c8e-d76ba59e0c8a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:26.280151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ddc71a80-de26-4c41-8c8e-d76ba59e0c8a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:26.285841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:26.320192 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a4f3427-1090-4f7c-b76d-4d00b3e1323c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.362335 May 14 21:21:26.322370 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1574/2962] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:25 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:26.341200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:26.342028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:26.352357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:26.352822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:26.355232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:26.356058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:26.468912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ddc71a80-de26-4c41-8c8e-d76ba59e0c8a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:26.480063 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ddc71a80-de26-4c41-8c8e-d76ba59e0c8a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1246 microversion: 2.1 time: 0.218553 May 14 21:21:26.497403 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1389/2963] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:26 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1246 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:26.503021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:26.503744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:26.512023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:26.515736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:26.515736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:26.515736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:26.651875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:26.674864 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65d52b4f-852c-41b7-8b91-7b8d4fdf81c6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.337195 May 14 21:21:26.684211 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1575/2964] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:26 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:26.699757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:26.700421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:26.707294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:26.707783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:26.708759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:26.709206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:26.835833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:26.845166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58439bc4-9b24-4e45-be8e-285cfe590cb1 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1401 microversion: 2.1 time: 0.346619 May 14 21:21:26.846078 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1390/2965] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:26 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1401 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:26.971714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:26.982347 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-42761d02-d5c3-4f05-9764-147bf5588e6c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.287370 May 14 21:21:26.991160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:26.991830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:26.995044 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1576/2966] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:26 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:27.001371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.002805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:27.004010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.004886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:27.012011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:27.018862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:27.020543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.021208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:27.022910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.023872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:27.229229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:27.237166 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a720d34d-f55e-4c9c-a671-451ab69cf5cd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.229539 May 14 21:21:27.237762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1577/2967] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:27 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:27.331360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:27.354615 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5834132d-3cf5-45ee-b0b8-a3642c0919f0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.386862 May 14 21:21:27.359185 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1391/2968] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:26 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:27.498624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:27.499224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:27.506092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.506544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:27.507314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.507795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:27.576784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:27.584515 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f047666-0213-416f-9828-22bfff6a4b33 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1242 microversion: 2.1 time: 0.090150 May 14 21:21:27.585097 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1578/2969] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:27 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:27.873406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:27.874040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:27.905241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.905241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:27.905241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:27.905241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:28.199438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:28.213068 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-573bf40c-76db-4207-8081-81207ddf2037 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1589 microversion: 2.1 time: 0.351902 May 14 21:21:28.214564 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1392/2970] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:27 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1589 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:28.232928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-40734c4f-c4d7-425b-9016-1b1b36520241 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:28.234388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-40734c4f-c4d7-425b-9016-1b1b36520241 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:28.243842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40734c4f-c4d7-425b-9016-1b1b36520241 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:28.244611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40734c4f-c4d7-425b-9016-1b1b36520241 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:28.251208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40734c4f-c4d7-425b-9016-1b1b36520241 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:28.251963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40734c4f-c4d7-425b-9016-1b1b36520241 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:28.373174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:28.373999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:28.381399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:28.382007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:28.382947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:28.383748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:28.649738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:28.661449 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6837c5f2-42b9-4a65-9425-493db432afd4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.290029 May 14 21:21:28.672311 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1393/2971] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:28 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:28.677186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:28.677946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:28.686019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:28.686611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:28.687682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:28.688864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:28.727033 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-40734c4f-c4d7-425b-9016-1b1b36520241 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.497376 May 14 21:21:28.732392 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1579/2972] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:21:28 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea/os-interface => generated 285 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:28.806389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:28.818876 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-06d7ef45-11f4-4ea1-916a-ccdb0cb4851c tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1316 microversion: 2.1 time: 0.148897 May 14 21:21:28.820730 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1394/2973] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:28 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:29.680199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:29.680895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:29.695526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:29.695993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:29.702166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:29.707795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:29.842400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:29.843719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:29.862403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:29.863332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:29.870442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:29.875167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:30.193052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:30.213872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-099d9c09-9f34-4e5b-b9d9-98fb836aa2df tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1304 microversion: 2.1 time: 0.377328 May 14 21:21:30.226541 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1395/2974] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:29 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1304 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:30.377447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:30.386839 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28619056-c04d-4252-8835-6167bd7950e8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.710723 May 14 21:21:30.388118 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1580/2975] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:29 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:31.234408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:31.236162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:31.251213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:31.256171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:31.258585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:31.259192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:31.413740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:31.439650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:31.439650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:31.442380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:31.442380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:31.443694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:31.788172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:31.788172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-84d70b9f-ef8b-4e1e-93c1-7712e66f5d05 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.437630 May 14 21:21:31.788172 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1396/2976] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:31 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:32.180242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:32.193253 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac24c961-3ab7-4e10-bed1-b86b05eeca12 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.790807 May 14 21:21:32.194112 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1581/2977] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:31 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:32.778951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:32.779997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:32.803417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:32.805179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:32.807565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:32.816573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:32.948423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:32.949204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:32.964081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:32.964293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:32.969439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:32.973515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:33.309346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:33.323520 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98382ab4-c409-4aa4-a3d8-edac6f7453c4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1589 microversion: 2.1 time: 0.379307 May 14 21:21:33.324440 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1582/2978] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:32 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1589 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:33.348328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e8a63b17-817c-40e1-8eed-9ff29dd9af58 req-3576892b-cc63-4b00-8145-09b7b15d29d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "815ca298-48a6-4a6b-af6c-8bb68179a7ea", "tag": "32783b2c-8568-419c-979d-100fe44c3fb9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:33.368218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e8a63b17-817c-40e1-8eed-9ff29dd9af58 req-3576892b-cc63-4b00-8145-09b7b15d29d0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:33.368652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e8a63b17-817c-40e1-8eed-9ff29dd9af58 req-3576892b-cc63-4b00-8145-09b7b15d29d0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:33.410918 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e8a63b17-817c-40e1-8eed-9ff29dd9af58 req-3576892b-cc63-4b00-8145-09b7b15d29d0 service nova] Creating event network-changed:32783b2c-8568-419c-979d-100fe44c3fb9 for instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea on nch1-master-1 May 14 21:21:33.422265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:33.427229 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e8a63b17-817c-40e1-8eed-9ff29dd9af58 req-3576892b-cc63-4b00-8145-09b7b15d29d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101525 May 14 21:21:33.428081 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1583/2979] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:33.443028 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ebd2e502-eec8-4195-8ab5-0028ba9da1d5 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.666979 May 14 21:21:33.447159 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1397/2980] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:32 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:33.454727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:33.458504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:33.475405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:33.476265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:33.477295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:33.477975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:34.463282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:34.464272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:34.484467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:34.484998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:34.485816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:34.486433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:34.606391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:34.615780 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f0d76166-010b-41f5-baa1-27eccab64f8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 1.185922 May 14 21:21:34.621476 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1584/2981] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:33 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:35.348195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1990524918", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8e297e8e-a72c-4f3a-94ba-1b9f264816b1"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:35.438864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:35.455142 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-67fabe35-9443-4389-a13a-dd6866a3528b tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.996719 May 14 21:21:35.455872 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1398/2982] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:34 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:35.490756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] validate_networks() for [('8e297e8e-a72c-4f3a-94ba-1b9f264816b1', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:21:35.646300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:35.646300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:35.646300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:35.646300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:35.652237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:35.652790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:36.230435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:21:36.231542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:21:36.232154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:21:36.232839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:21:36.233736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:21:36.270771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:36.275883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:36.276890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:36.279437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:36.339334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Getting quotas for project cabbde4fba484c6d83f6ae32716cf82b. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:21:36.371333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Getting quotas for user 07186d1e535e4de2ae6b8269ca10b4c6 and project cabbde4fba484c6d83f6ae32716cf82b. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:21:36.400431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:21:36.402851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:21:36.426683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:36.442565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c35f5181-0cae-4edd-a8f4-3cb0682dcaa0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.809855 May 14 21:21:36.443164 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1399/2983] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:35 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:36.460993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c1a3869f-53c6-4e62-a0aa-1165df2265fd req-f65570e2-8300-44ba-b525-4d629232646e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84301d5-4d42-4c89-869c-ace2104d47d2", "tag": "49711784-f5dd-4fdf-bf81-805e6683243c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:36.507036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c1a3869f-53c6-4e62-a0aa-1165df2265fd req-f65570e2-8300-44ba-b525-4d629232646e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:36.511791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c1a3869f-53c6-4e62-a0aa-1165df2265fd req-f65570e2-8300-44ba-b525-4d629232646e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:36.543033 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c1a3869f-53c6-4e62-a0aa-1165df2265fd req-f65570e2-8300-44ba-b525-4d629232646e service nova] Creating event network-changed:49711784-f5dd-4fdf-bf81-805e6683243c for instance a84301d5-4d42-4c89-869c-ace2104d47d2 on nch2-master-1 May 14 21:21:36.548154 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c1a3869f-53c6-4e62-a0aa-1165df2265fd req-f65570e2-8300-44ba-b525-4d629232646e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090767 May 14 21:21:36.549383 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1400/2984] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:36.555143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:36.556238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:36.564553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:36.565350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:36.566565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:36.567223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:36.678541 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-57282345-a7c3-4bcf-97ff-7c0c1c8586ce tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.746176 May 14 21:21:36.679945 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1585/2985] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:21:36.690563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1efc8eee-107e-4640-8c55-14db78f495b1 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:36.691578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1efc8eee-107e-4640-8c55-14db78f495b1 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:37.232865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:37.246293 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-30bd1787-321c-418e-bac1-bf9d6d316b8f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.695439 May 14 21:21:37.246898 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1401/2986] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:36 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:37.301849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1efc8eee-107e-4640-8c55-14db78f495b1 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:37.309432 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1efc8eee-107e-4640-8c55-14db78f495b1 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1218 microversion: 2.1 time: 0.623238 May 14 21:21:37.310260 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1586/2987] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:36 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1218 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:37.460515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:37.461686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:37.487821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:37.492858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:37.492858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:37.492858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:37.884733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:37.895319 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88517587-3875-42cc-a123-43986bbfd366 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.439486 May 14 21:21:37.903459 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1402/2988] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:37 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:38.264852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:38.266534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:38.275408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:38.276835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:38.278080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:38.278594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:38.335974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:38.344350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:38.361895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:38.364479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:38.365550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:38.367618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:38.539145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:38.553061 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4edd2a1-8c4f-4591-baa8-4ca91cb08f89 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.293114 May 14 21:21:38.555497 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1587/2989] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:38 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:38.914008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:38.915414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:38.925382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:38.925850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:38.940046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:38.940523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:39.309561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:39.319755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dcd4bbd4-085e-45d5-ab18-74a0a0015428 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1222 microversion: 2.1 time: 0.994875 May 14 21:21:39.322114 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1403/2990] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:38 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1222 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:39.322224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:39.333146 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edc8e16f-138b-4f3a-8f5c-1984da299c76 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.423960 May 14 21:21:39.335622 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1588/2991] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:38 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:39.431548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-27615658", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": "none"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:39.513061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:21:39.513488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:21:39.514166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:21:39.514734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:21:39.515624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:21:39.527767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:39.528714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:39.530064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:39.532129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:39.555219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Getting quotas for project d750e4cf6fab4bc4983f5f2f37a01ae6. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:21:39.562339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Getting quotas for user d59910b5e81045dc9ec13cded4cb41d5 and project d750e4cf6fab4bc4983f5f2f37a01ae6. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:21:39.574618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:39.575904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:39.588727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:21:39.592733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:39.593439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:39.594518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:21:39.595296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:39.597494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:39.929729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:39.939815 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-652b17b1-9c89-4f37-b32a-f521518ba0c3 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.371337 May 14 21:21:39.942660 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1589/2992] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:39 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:39.964536 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3c7871b-5bec-4979-83bf-e921001129c9 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.642015 May 14 21:21:39.976473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3637b3cf-ec54-46df-9892-7d8618e61c01 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:39.977492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3637b3cf-ec54-46df-9892-7d8618e61c01 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:39.982933 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1404/2993] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:21:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:21:40.079957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3637b3cf-ec54-46df-9892-7d8618e61c01 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:40.091728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3637b3cf-ec54-46df-9892-7d8618e61c01 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:40.099435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3637b3cf-ec54-46df-9892-7d8618e61c01 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:40.101005 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3637b3cf-ec54-46df-9892-7d8618e61c01 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1276 microversion: 2.57 time: 0.129096 May 14 21:21:40.101594 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1590/2994] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:39 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:40.337311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:40.337948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:40.352821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:40.356166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:40.356166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:40.356921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:40.357018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:40.357099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:40.371888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:40.372371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:40.375697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:40.376239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:40.518792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:40.530334 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d9695110-b53b-4d04-b610-1b52fb0060c5 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1288 microversion: 2.1 time: 0.196907 May 14 21:21:40.536831 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1405/2995] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:40 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1288 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:40.795958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:40.817293 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-30ca8e50-b24f-4885-b53b-7092686a3f10 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1509 microversion: 2.1 time: 0.467910 May 14 21:21:40.821089 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1591/2996] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:40 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1509 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:40.959228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:40.960503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:40.975360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:40.978285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:40.979423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:40.980858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:41.122845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac3a03d0-94d8-411f-bf9b-2db1b268a11f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:41.123705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac3a03d0-94d8-411f-bf9b-2db1b268a11f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:41.267643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:41.284491 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ee73563-dc20-4406-b35d-c78758bd19f4 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.328444 May 14 21:21:41.302519 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1406/2997] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:40 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:41.312583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac3a03d0-94d8-411f-bf9b-2db1b268a11f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:41.322732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac3a03d0-94d8-411f-bf9b-2db1b268a11f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:41.325139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac3a03d0-94d8-411f-bf9b-2db1b268a11f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:41.326416 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac3a03d0-94d8-411f-bf9b-2db1b268a11f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1276 microversion: 2.57 time: 0.209500 May 14 21:21:41.326926 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1592/2998] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:41 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1276 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:21:41.560358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:41.561041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:41.633124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:41.633124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:41.633124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:41.633124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:41.689890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:41.701752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c4801063-d080-4f7a-8672-82ea737fb0e8 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1276 microversion: 2.1 time: 0.153645 May 14 21:21:41.705204 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1407/2999] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:41 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:41.848924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:41.848924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:41.848924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:41.848924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:41.848924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:41.848924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:42.166136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:42.174713 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0484296b-6bfa-4e3d-aca4-e50061b8a29f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1530 microversion: 2.1 time: 0.341609 May 14 21:21:42.189057 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1593/3000] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:41 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1530 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:42.317505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:42.318419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:42.325855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:42.326566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:42.327807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:42.328565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:42.347163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c887bbe1-3b59-4710-8b83-2de247b8ccbb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:42.348088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c887bbe1-3b59-4710-8b83-2de247b8ccbb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:42.413490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c887bbe1-3b59-4710-8b83-2de247b8ccbb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:42.421881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c887bbe1-3b59-4710-8b83-2de247b8ccbb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:42.423735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c887bbe1-3b59-4710-8b83-2de247b8ccbb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:42.424878 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c887bbe1-3b59-4710-8b83-2de247b8ccbb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1276 microversion: 2.57 time: 0.082484 May 14 21:21:42.425448 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1594/3001] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:42 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1276 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:21:42.554838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:42.563928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ace1032-b3b4-47cf-8856-7594e0bc674e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.250313 May 14 21:21:42.565068 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1408/3002] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:42 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:42.723227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:42.724530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:42.734033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:42.735748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:42.737649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:42.738321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.196086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:43.207247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:43.207247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:43.208730 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a4459eb0-7fbf-4048-b4bd-9262480d211a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.488189 May 14 21:21:43.208730 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1595/3003] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:42 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:43.219810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:43.220395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.221518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:43.222182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.477392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:43.478032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:43.485196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:43.485729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.486916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:43.488001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.491003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:43.507184 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8b682ed4-efc4-4622-a747-c3654e459b6e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1530 microversion: 2.1 time: 0.314445 May 14 21:21:43.508861 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1409/3004] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:43 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1530 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:43.584659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:43.586549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:43.596447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:43.597661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.598733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:43.599564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.688346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:43.698247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:43.704750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:43.708910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f1b36af2-9013-482b-acf3-34f5104e387b tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1272 microversion: 2.57 time: 0.234089 May 14 21:21:43.709142 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1596/3005] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:43 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:21:43.725510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-470d8b8e-acb0-4de5-b6f8-ccdf5ae8fbb5 req-78424a52-df24-433c-b66c-6fe78ff0ba32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fc6710-88a8-420b-b6cd-901e9eef71dc", "name": "network-vif-plugged", "status": "completed", "tag": "2b63bcfc-9138-40aa-b6dd-b137c15d0bbe"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:43.740848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-470d8b8e-acb0-4de5-b6f8-ccdf5ae8fbb5 req-78424a52-df24-433c-b66c-6fe78ff0ba32 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:43.741749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-470d8b8e-acb0-4de5-b6f8-ccdf5ae8fbb5 req-78424a52-df24-433c-b66c-6fe78ff0ba32 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:43.763032 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-470d8b8e-acb0-4de5-b6f8-ccdf5ae8fbb5 req-78424a52-df24-433c-b66c-6fe78ff0ba32 service nova] Creating event network-vif-plugged:2b63bcfc-9138-40aa-b6dd-b137c15d0bbe for instance 21fc6710-88a8-420b-b6cd-901e9eef71dc on nch2-master-1 May 14 21:21:43.771930 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-470d8b8e-acb0-4de5-b6f8-ccdf5ae8fbb5 req-78424a52-df24-433c-b66c-6fe78ff0ba32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060997 May 14 21:21:43.773232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1597/3006] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:43.800273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:43.816668 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-042e5894-8231-4757-be7f-2bbdf5b60e85 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.238170 May 14 21:21:43.820543 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1410/3007] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:43 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:44.224352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:44.225897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:44.237123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.237609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.238481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.238927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.495877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f9eb29c9-2483-447e-9ffd-68b178a1909f req-7de615ab-6085-40dd-a304-be08df7f6e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee54bcd-4835-4e6b-b777-07188bfb608d", "tag": "fec2f708-b2fe-442f-9676-5104a4997d2c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:44.523156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f9eb29c9-2483-447e-9ffd-68b178a1909f req-7de615ab-6085-40dd-a304-be08df7f6e5b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.524932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f9eb29c9-2483-447e-9ffd-68b178a1909f req-7de615ab-6085-40dd-a304-be08df7f6e5b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.554052 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f9eb29c9-2483-447e-9ffd-68b178a1909f req-7de615ab-6085-40dd-a304-be08df7f6e5b service nova] Creating event network-changed:fec2f708-b2fe-442f-9676-5104a4997d2c for instance aee54bcd-4835-4e6b-b777-07188bfb608d on nch1-master-1 May 14 21:21:44.562312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f9eb29c9-2483-447e-9ffd-68b178a1909f req-7de615ab-6085-40dd-a304-be08df7f6e5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069186 May 14 21:21:44.563469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1411/3008] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:21:44.570512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:44.579533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:44.596386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.596386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.604043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.604869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.705304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:44.715372 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df186004-f164-4b0f-b44a-46eb5d712b0e tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.496178 May 14 21:21:44.728169 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1598/3009] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:44 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:44.733963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:44.734669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:44.768448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.769327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.770357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.770804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.907932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:44.935839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:44.942547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:44.944049 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d222078-e6f5-42d4-bbea-c60ca22e1c92 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1336 microversion: 2.57 time: 0.214224 May 14 21:21:44.949888 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1599/3010] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:44 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1336 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:44.955967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:44.956511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:44.962029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:44.969266 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9505df08-75e0-4101-9c5f-0ba2c4211c2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1530 microversion: 2.1 time: 0.404313 May 14 21:21:44.971144 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1412/3011] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:44 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1530 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:44.981262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.985678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:44.989806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:44.990408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:45.309940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:45.318151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fd501bc5-a33b-4981-883e-238d1168eb22 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.366904 May 14 21:21:45.319052 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1600/3012] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:44 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:45.740715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:45.741338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:45.750858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:45.753564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:45.754394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:45.754857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:45.964200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:45.965062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:45.976341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:45.976802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:45.977598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:45.978041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:46.133285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:46.140572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:46.144036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:46.148737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:46.150779 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d4ba643-ca67-42a3-bed9-4b11f82c95ea tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1334 microversion: 2.57 time: 0.190447 May 14 21:21:46.152116 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1601/3013] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:45 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1334 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:21:46.158162 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11c11215-20f0-43f0-a7f0-bdbb2afd23c6 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.421181 May 14 21:21:46.158888 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1413/3014] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:45 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:46.161232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:46.162763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:46.189851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:46.190735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:46.193298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:46.193967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:46.336289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:46.337975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:46.355365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:46.360731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:46.360731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:46.362305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:46.445292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:46.454417 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c42a1133-8fdc-46e7-bd96-ab1ca2c1393d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.300916 May 14 21:21:46.455292 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1602/3015] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:46 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:46.745735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:46.776493 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fcd41774-9502-495e-b3d9-2ea43d46b7d8 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.440162 May 14 21:21:46.794815 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1414/3016] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:46 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:47.187834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:47.187834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:47.197040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:47.197877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:47.199774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.200314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.201180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.202192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.215764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.217090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.223023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.224390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.321053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:47.359324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:47.363785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:47.367584 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29668d2d-0350-4309-87f2-5159229af4c7 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1334 microversion: 2.57 time: 0.184966 May 14 21:21:47.369045 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1603/3017] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:47 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:47.484224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:47.486107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:47.502195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.507048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.509363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.510961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.575808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:47.592175 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1fe9fb59-2334-4044-a7b1-02d1ec35d7f4 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.405963 May 14 21:21:47.594397 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1415/3018] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:47 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:47.720238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-84545bf2-6d64-45bb-8fb1-794b6c2e0b2d req-777ee656-2595-4416-9526-c4cbac190ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a84301d5-4d42-4c89-869c-ace2104d47d2", "name": "network-vif-plugged", "status": "completed", "tag": "49711784-f5dd-4fdf-bf81-805e6683243c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:47.740163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84545bf2-6d64-45bb-8fb1-794b6c2e0b2d req-777ee656-2595-4416-9526-c4cbac190ec9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.740909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84545bf2-6d64-45bb-8fb1-794b6c2e0b2d req-777ee656-2595-4416-9526-c4cbac190ec9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.769008 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-84545bf2-6d64-45bb-8fb1-794b6c2e0b2d req-777ee656-2595-4416-9526-c4cbac190ec9 service nova] Creating event network-vif-plugged:49711784-f5dd-4fdf-bf81-805e6683243c for instance a84301d5-4d42-4c89-869c-ace2104d47d2 on nch2-master-1 May 14 21:21:47.776693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:47.790206 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f017aa73-f511-46f4-84d9-dbed53326b0a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.320812 May 14 21:21:47.800730 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1604/3019] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:47 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:47.813889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:47.814471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-84545bf2-6d64-45bb-8fb1-794b6c2e0b2d req-777ee656-2595-4416-9526-c4cbac190ec9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099731 May 14 21:21:47.814815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:47.818880 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1416/3020] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:21:47.850582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.851386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:47.852236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:47.852689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.239505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:48.247440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de770434-bc8b-4c04-95fc-ed43bde46bec tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.443863 May 14 21:21:48.248051 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1605/3021] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:47 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:48.387212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:48.388356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:48.397327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.397786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.398584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.399028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.559521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:48.568994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:48.572167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:48.573849 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-736df080-5dee-4536-8a27-9f24ad9aa8b0 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1355 microversion: 2.57 time: 0.191293 May 14 21:21:48.574904 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1417/3022] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:48 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1355 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:48.601399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:48.604808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:48.612749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:48.613911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:48.620041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.620041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.620041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.620041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.625984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.626464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.630317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.630957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.750379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:21:48.752978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:21:48.752978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:21:48.752978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:21:48.753400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:21:48.930542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:48.943319 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e86993ca-0874-438e-a106-fe82fd4dc26a tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.334700 May 14 21:21:48.947520 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1418/3023] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:48 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:48.962182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:48.964960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:48.977679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.980920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:48.982028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:48.982693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.008192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:49.033648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.034120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.034926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.038846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.120921 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d98023da-b2d5-40b4-bfc7-4fdc5dfb9468 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "POST /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec/action" status: 202 len: 1136 microversion: 2.57 time: 0.529109 May 14 21:21:49.143681 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1606/3024] 10.222.0.52 () {62 vars in 1319 bytes} [Sat May 14 21:21:48 2022] POST /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec/action => generated 1136 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 14 21:21:49.177629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:49.180209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:49.190518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.196251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.196251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.196251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.293708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:49.303022 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f373281-9207-41ff-a1ab-937f5a91b7ea tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.352201 May 14 21:21:49.303696 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1419/3025] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:48 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:49.315128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:49.316266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:49.323129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.324221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.325373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.328781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.386460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:49.406478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:49.408937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:49.412089 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8c629cf-2039-4640-80be-6872061a4bdb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.249255 May 14 21:21:49.416430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1607/3026] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:49 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:49.642363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:49.657282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e1d9456e-54ff-480d-8e89-2eac64aacdfb tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1371 microversion: 2.1 time: 0.352226 May 14 21:21:49.668975 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1420/3027] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:49 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1371 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:49.966677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:49.968055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:49.981568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.983708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:49.983708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:49.983941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:50.289642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:50.299973 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-74f47406-0fff-4753-ab3d-104cfd4a2642 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.337438 May 14 21:21:50.310440 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1608/3028] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:49 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:50.321527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:50.322819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:50.335983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:50.336646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:50.337612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:50.338623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:50.435725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:50.436765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:50.448282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:50.453478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:50.456011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:50.456720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:50.589894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:50.601627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d74608ee-c474-4c73-8dff-815877eedf0e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.284326 May 14 21:21:50.611874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1421/3029] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:50 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:50.676916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:50.677545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:50.696954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:50.697537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:50.704567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:50.704567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:50.799466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:50.813668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:50.815214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:50.819232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b892b12c-cdc9-4d60-813b-ef6b9e7c2faa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.387246 May 14 21:21:50.821880 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1609/3030] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:50 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:50.995866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:51.008221 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37f91538-9c18-4d0d-97e8-189dbbd47779 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1557 microversion: 2.1 time: 0.335585 May 14 21:21:51.009234 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1422/3031] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:50 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1557 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:51.033967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92f944fc-6904-4618-bc15-0f29e82a5f04 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:51.034674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92f944fc-6904-4618-bc15-0f29e82a5f04 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:51.047963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92f944fc-6904-4618-bc15-0f29e82a5f04 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.048442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92f944fc-6904-4618-bc15-0f29e82a5f04 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.050282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92f944fc-6904-4618-bc15-0f29e82a5f04 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.050730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92f944fc-6904-4618-bc15-0f29e82a5f04 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.210879 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92f944fc-6904-4618-bc15-0f29e82a5f04 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.181867 May 14 21:21:51.212090 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1610/3032] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:21:51 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:51.317771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:51.318977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:51.343007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.343693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.344566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.349328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.619896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:51.620445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:51.627379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.628109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.629060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.629654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.676419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:51.692084 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-73a2f66f-a3f2-414c-993d-c68ffd0bc976 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.377846 May 14 21:21:51.702060 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1423/3033] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:51 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:51.843174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:51.844162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:51.852986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.856200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.857258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:51.860698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:51.871572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:51.881294 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e980bde-51a1-4b5c-bfb3-5e6aa2a64f27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.265587 May 14 21:21:51.882308 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1611/3034] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:51 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:51.984826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:51.994825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:51.998885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:52.001822 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1355201a-3d6c-4896-938c-950a6c649f67 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.163656 May 14 21:21:52.005360 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1424/3035] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:51 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:52.384665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-5bec4952-3c57-487b-80f5-72c4ca83f76a req-c0c3c8eb-4077-436c-8f94-7fc2fa47f837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee54bcd-4835-4e6b-b777-07188bfb608d", "name": "network-vif-plugged", "status": "completed", "tag": "fec2f708-b2fe-442f-9676-5104a4997d2c"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:52.406575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5bec4952-3c57-487b-80f5-72c4ca83f76a req-c0c3c8eb-4077-436c-8f94-7fc2fa47f837 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:52.406952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5bec4952-3c57-487b-80f5-72c4ca83f76a req-c0c3c8eb-4077-436c-8f94-7fc2fa47f837 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:52.454017 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-5bec4952-3c57-487b-80f5-72c4ca83f76a req-c0c3c8eb-4077-436c-8f94-7fc2fa47f837 service nova] Creating event network-vif-plugged:fec2f708-b2fe-442f-9676-5104a4997d2c for instance aee54bcd-4835-4e6b-b777-07188bfb608d on nch1-master-1 May 14 21:21:52.461101 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-5bec4952-3c57-487b-80f5-72c4ca83f76a req-c0c3c8eb-4077-436c-8f94-7fc2fa47f837 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080001 May 14 21:21:52.461724 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1612/3036] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:52.714666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:52.718227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:52.738792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:52.742735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:52.743669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:52.744132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:52.908950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:52.910004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:52.917117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:52.917774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:52.918700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:52.919279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:53.190879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:53.203666 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a1b92d81-ddc0-464d-a9bf-e60c537ff18e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.306315 May 14 21:21:53.204490 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1613/3037] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:52 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:53.215914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:53.232200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5842cd68-823b-46d8-bc91-7373f1199872 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1318 microversion: 2.1 time: 0.518846 May 14 21:21:53.232351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:53.232467 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1425/3038] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:52 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:53.232785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:53.242216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:53.242946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:53.243997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:53.244601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:53.379445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:53.396062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:53.399104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:53.404106 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac9851c7-9e68-46c4-a55a-4e202ca2b9cc tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.195625 May 14 21:21:53.406964 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1614/3039] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:53 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:54.058213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-feed6557-3879-493a-a345-8801cb4a653c req-95ffd4e4-73a0-4690-aa88-03df65647952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a84301d5-4d42-4c89-869c-ace2104d47d2", "tag": "49711784-f5dd-4fdf-bf81-805e6683243c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:54.075185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-feed6557-3879-493a-a345-8801cb4a653c req-95ffd4e4-73a0-4690-aa88-03df65647952 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.085898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-feed6557-3879-493a-a345-8801cb4a653c req-95ffd4e4-73a0-4690-aa88-03df65647952 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.113109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-feed6557-3879-493a-a345-8801cb4a653c req-95ffd4e4-73a0-4690-aa88-03df65647952 service nova] Creating event network-changed:49711784-f5dd-4fdf-bf81-805e6683243c for instance a84301d5-4d42-4c89-869c-ace2104d47d2 on nch2-master-1 May 14 21:21:54.119651 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-feed6557-3879-493a-a345-8801cb4a653c req-95ffd4e4-73a0-4690-aa88-03df65647952 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389457 May 14 21:21:54.121289 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1426/3040] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:21:54.223228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:54.224248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:54.233264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.234052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.235001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.235696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.251275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:54.252764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:54.263328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.271521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.272630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.273240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.502907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:54.514022 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1f4a7b72-cbe5-45bd-90cc-b4b3f1030319 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.296874 May 14 21:21:54.530674 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1615/3041] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:54 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:54.536687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:54.537319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:54.550988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.551448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.557564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.558368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.661283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:54.669077 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c7d167e2-69f8-4eed-b628-7ad3e55f58d3 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1508 microversion: 2.1 time: 0.424966 May 14 21:21:54.687863 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1427/3042] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:54 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:54.707777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:54.717186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:54.719189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:54.723036 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1cba716d-8748-408c-aff5-17f1ce02fb1f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.191224 May 14 21:21:54.730713 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1616/3043] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:54 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:54.788845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53ebdbef-94c6-472e-9f90-aae818b42c94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:54.790210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53ebdbef-94c6-472e-9f90-aae818b42c94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:54.802414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53ebdbef-94c6-472e-9f90-aae818b42c94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.803144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53ebdbef-94c6-472e-9f90-aae818b42c94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:54.804159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53ebdbef-94c6-472e-9f90-aae818b42c94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:54.804761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53ebdbef-94c6-472e-9f90-aae818b42c94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:55.179579 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53ebdbef-94c6-472e-9f90-aae818b42c94 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.391283 May 14 21:21:55.183806 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1428/3044] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:21:54 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:21:55.196899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:55.197550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:55.207575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:55.208294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:55.209233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:55.209837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:55.535721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:55.536702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:55.537615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:55.554231 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c39da543-3d9b-4f26-9a81-ae19d20b3d38 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1672 microversion: 2.1 time: 0.361150 May 14 21:21:55.554231 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1617/3045] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:55 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1672 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:55.554500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:55.554787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:55.556542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:55.557182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:55.752767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:55.753474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:55.769041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:55.769322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:55.775864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:55.775864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:55.944845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:55.953745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd8232aa-dbe6-4e61-8480-0937d81c5b89 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.426980 May 14 21:21:55.956800 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1429/3046] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:55 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:55.970129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:55.979606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:55.981156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:55.982386 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-525ce7a3-487f-4344-a4a2-c592d1509e5f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.236733 May 14 21:21:56.001441 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1618/3047] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:55 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:56.571004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:56.574208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:56.613801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:56.614666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:56.619069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:56.620999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:56.942386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:56.958492 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-522a8f2f-127d-4e00-a390-22129384204f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1672 microversion: 2.1 time: 0.396606 May 14 21:21:56.959641 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1430/3048] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:56 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1672 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:56.975380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:56.976832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:56.985679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:56.998401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:56.998401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:56.998401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:57.021845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:57.022802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:57.032906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:57.036102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:57.037318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:57.038618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:57.137007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:57.148201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:57.150030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:57.151828 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79a4943c-7628-426b-956b-f1b0a74ade61 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.134968 May 14 21:21:57.153096 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1431/3049] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:57 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:21:57.205939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:57.215155 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f4cd3ef6-0496-466d-a817-d0237e7862bf tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.243330 May 14 21:21:57.216296 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1619/3050] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:56 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:57.978274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:57.978901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:57.986414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:57.986867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:57.987672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:57.988113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:58.143248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:58.150766 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03f79c3c-3b72-4a31-8682-2e41a9c99c21 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.176432 May 14 21:21:58.151332 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1432/3051] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:57 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:58.176062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:58.176730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:58.183494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:58.183969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:58.184729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:58.185167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:58.232370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:58.234216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:58.240279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:58.240734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:58.241546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:58.241985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:58.255794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:58.264915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:58.266977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:58.268196 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0f7f57b7-1c02-4dba-99bb-bd7aa28171da tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.096051 May 14 21:21:58.269142 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1620/3052] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:58 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:21:58.399343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:58.411768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4dd98108-bb9f-4629-8a85-6cb695fd056b tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.183156 May 14 21:21:58.422549 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1433/3053] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:58 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:21:59.073316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cbab3b6d-d9f0-4460-8d58-91b18d2c76ef tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2aecd011-8bb0-4a67-b8ce-def64dd1d427"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:21:59.074454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cbab3b6d-d9f0-4460-8d58-91b18d2c76ef tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:59.086109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbab3b6d-d9f0-4460-8d58-91b18d2c76ef tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:59.086582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbab3b6d-d9f0-4460-8d58-91b18d2c76ef tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:59.087385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbab3b6d-d9f0-4460-8d58-91b18d2c76ef tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:59.088355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cbab3b6d-d9f0-4460-8d58-91b18d2c76ef tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:59.286558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:59.287226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:59.294785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:59.296643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:59.297491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:59.298077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:59.377527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:59.386264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:59.388055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:59.389758 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04b775f6-721c-491b-bba6-1a02d9d4bc66 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.107178 May 14 21:21:59.398957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1434/3054] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:21:59 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:21:59.432639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:21:59.433269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:21:59.441302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:59.441773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:59.442560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:21:59.443009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:21:59.594589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:21:59.603135 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-421d1031-89bd-4cbf-ba37-777e2f3dac64 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.177217 May 14 21:21:59.604905 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1435/3055] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:21:59 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:21:59.854066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cbab3b6d-d9f0-4460-8d58-91b18d2c76ef tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "POST /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784264 May 14 21:21:59.855952 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1621/3056] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:21:59 2022] POST /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:00.416797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:00.425706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:00.432041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:00.432747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:00.433680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:00.434863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:00.539104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:00.552860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:00.554943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:00.556357 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1abe210e-8402-4d48-ba79-b4e088886c2f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.143945 May 14 21:22:00.557336 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1436/3057] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:00 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:00.624002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:00.627071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:00.633867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:00.634565 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:00.636145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:00.637207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:00.794666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:00.806238 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8eb9f56a-7292-4913-b944-dcf21cdbec62 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.186842 May 14 21:22:00.808086 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1622/3058] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:00 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:01.576099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:01.576737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:01.584332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:01.584787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:01.585562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:01.590877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:01.669714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:01.678070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:01.679654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:01.680824 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2fa5fadd-90d2-496f-9b4c-fdb604880fd8 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.108771 May 14 21:22:01.681390 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1437/3059] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:01 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:01.824946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:01.825651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:01.833504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:01.833957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:01.834741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:01.835185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.001268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:02.009741 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6783b54a-6766-41c6-9d74-31a8453deb2e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.188636 May 14 21:22:02.020051 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1623/3060] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:01 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:02.085168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:02.088209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:02.089068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Searching by: {'deleted': False, 'project_id': 'ba969692dac24c5bab4062ca210bef43'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:22:02.095917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:02.096380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.097183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:02.097688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.137920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:22:02.170666 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b67d6f5-2ba7-4062-a03e-4d47a493831e tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.090964 May 14 21:22:02.179500 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1438/3061] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:22:02 2022] GET /compute/v2.1/servers => generated 339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:02.184048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:02.188773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:02.189917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Searching by: {'deleted': False, 'project_id': 'ba969692dac24c5bab4062ca210bef43'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:22:02.197487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:02.198208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.205021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:02.205021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.248186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:22:02.289643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:02.295638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:02.296189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.427670 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-615fdcb5-59d5-49ad-8f1d-70fe377e90c0 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.233432 May 14 21:22:02.427670 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1624/3062] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:22:02 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:02.433347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64fa1e66-2530-412f-b7cf-f7ab0e60eba4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:02.442191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64fa1e66-2530-412f-b7cf-f7ab0e60eba4 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013548 May 14 21:22:02.442742 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1439/3063] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:22:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:22:02.707326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:02.708005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:02.714152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:02.714612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.715387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:02.715860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:02.784714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:02.793615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:02.795176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:02.796757 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-20c3bd4d-d60e-48d7-b207-1b49bd55b998 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.094193 May 14 21:22:02.797317 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1625/3064] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:02 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:03.027686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:03.028314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:03.035996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.036454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.037223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.037666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.172329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:03.179983 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2f2bdb7-48e2-41b2-88c4-08d57df4ed8f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1525 microversion: 2.1 time: 0.156220 May 14 21:22:03.180571 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1440/3065] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:03 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:03.350811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:03.351330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:03.358053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.358558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.359338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.359843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.386004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:03.722103 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-11cac22b-c5cb-4c39-ba8b-6bb94b954c0d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "DELETE /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 204 len: 0 microversion: 2.1 time: 0.374879 May 14 21:22:03.722846 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1626/3066] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:22:03 2022] DELETE /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:22:03.734761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:03.735395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:03.741412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.741873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.742661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.743111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.818501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:03.819324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:03.826039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.826503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.827333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:03.828068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:03.893941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:03.902317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:03.903919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:03.905102 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99902ed8-5de5-4221-bbd9-c92b0bed28dd tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.091005 May 14 21:22:03.905755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1627/3067] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:03 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:03.938925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:03.946376 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c7161924-288d-484b-bbf1-fb50aeea804f tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1714 microversion: 2.1 time: 0.216337 May 14 21:22:03.946944 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1441/3068] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:03 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1714 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:04.197034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:04.197683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:04.204048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:04.205807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:04.206630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:04.207083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:04.356312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:04.365282 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cb621022-78d1-4ab2-acc8-631d96a29681 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1507 microversion: 2.1 time: 0.172084 May 14 21:22:04.365881 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1628/3069] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:04 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:04.924755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:04.925479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:04.932750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:04.933203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:04.933988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:04.934431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:04.963658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:04.964747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:04.971565 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:04.972020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:04.972958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:04.973391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.007779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:05.016807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:05.018351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:05.019612 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0e2f5ac-5cf7-46c3-8b32-1486b26bff04 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.099091 May 14 21:22:05.020194 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1442/3070] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:04 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:05.122983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:05.131413 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c9e6c03-b4b1-42cc-a05f-d75ee0c9aa8d tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1714 microversion: 2.1 time: 0.171468 May 14 21:22:05.132056 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1629/3071] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:04 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1714 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:05.209010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0398871c-f5b2-431d-a363-1e3dd7c62a8b req-adb9e19d-408f-4c1b-a8df-455afa38e76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fc6710-88a8-420b-b6cd-901e9eef71dc", "name": "network-vif-unplugged", "status": "completed", "tag": "2b63bcfc-9138-40aa-b6dd-b137c15d0bbe"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:05.216275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0398871c-f5b2-431d-a363-1e3dd7c62a8b req-adb9e19d-408f-4c1b-a8df-455afa38e76f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:05.216733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0398871c-f5b2-431d-a363-1e3dd7c62a8b req-adb9e19d-408f-4c1b-a8df-455afa38e76f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.227964 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0398871c-f5b2-431d-a363-1e3dd7c62a8b req-adb9e19d-408f-4c1b-a8df-455afa38e76f service nova] Creating event network-vif-unplugged:2b63bcfc-9138-40aa-b6dd-b137c15d0bbe for instance 21fc6710-88a8-420b-b6cd-901e9eef71dc on nch2-master-1 May 14 21:22:05.233032 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0398871c-f5b2-431d-a363-1e3dd7c62a8b req-adb9e19d-408f-4c1b-a8df-455afa38e76f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028551 May 14 21:22:05.234328 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1443/3072] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:05.383383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:05.384027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:05.394519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:05.394989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.395800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:05.396244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.537226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:05.545075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0393935f-f31b-4816-acab-719d8c9f49f9 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1507 microversion: 2.1 time: 0.165682 May 14 21:22:05.545668 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1630/3073] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:05 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:05.594299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "649c422b-7100-4b8c-a6be-25e3df6cb1fc"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:05.595491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:05.601829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:05.602282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.603089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:05.603558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.704862 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] HTTP exception thrown: Volume 649c422b-7100-4b8c-a6be-25e3df6cb1fc could not be found. May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Request method failure captured: May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/2aecd011-8bb0-4a67-b8ce-def64dd1d427 HTTP/1.1 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 74 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB1egH8t6G0q5S4IzPE4yGHRZNgd0eK_Z8hCK2tYiXM1HLQlPkTmKvDQpTdfOb9ohJLhb7uECZCFkU25h8dPNsuEVIHJELfg84jwgVK8K1ovQZgnW33kQVk6B4_RoPlpbxowHIHDUBMy9YkjhmvbKM6oZSv1_z-Czrmyjtj_PmXzeoY May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a7b652f4fb414727b68ba9078a657cb9 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-VolumesAdminNegativeTest-261307410 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7b652f4fb414727b68ba9078a657cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7b652f4fb414727b68ba9078a657cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a7b652f4fb414727b68ba9078a657cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a7b652f4fb414727b68ba9078a657cb9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-VolumesAdminNegativeTest-261307410 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a7b652f4fb414727b68ba9078a657cb9 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-261307410 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-VolumesAdminNegativeTest-261307410-project-admin May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 4c7b0ab4127a45869ce524ae057735b4 May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-VolumesAdminNegativeTest-261307410-project-admin May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: {"volumeAttachment": {"volumeId": "649c422b-7100-4b8c-a6be-25e3df6cb1fc"}} May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: exception: Volume 649c422b-7100-4b8c-a6be-25e3df6cb1fc could not be found. May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'server_id': 'aee54bcd-4835-4e6b-b777-07188bfb608d', 'id': '2aecd011-8bb0-4a67-b8ce-def64dd1d427', 'body': {'volumeAttachment': {'volumeId': '649c422b-7100-4b8c-a6be-25e3df6cb1fc'}}} May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 649c422b-7100-4b8c-a6be-25e3df6cb1fc could not be found. (HTTP 404) (Request-ID: req-d6546c25-b69e-432e-a54d-a689d6ce50d8) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:22:05.759394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 649c422b-7100-4b8c-a6be-25e3df6cb1fc could not be found. May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 649c422b-7100-4b8c-a6be-25e3df6cb1fc could not be found. May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 649c422b-7100-4b8c-a6be-25e3df6cb1fc could not be found. May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Returning 400 to user: Volume 649c422b-7100-4b8c-a6be-25e3df6cb1fc could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b3430a67-9944-440b-b7fd-b13dc98727c8 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/2aecd011-8bb0-4a67-b8ce-def64dd1d427" status: 400 len: 107 microversion: 2.1 time: 0.291418 May 14 21:22:05.763326 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1444/3074] 10.222.0.52 () {60 vars in 1432 bytes} [Sat May 14 21:22:05 2022] PUT /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/2aecd011-8bb0-4a67-b8ce-def64dd1d427 => generated 107 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:22:05.825425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:05.825924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:05.832645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:05.833095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.833855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:05.834288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:05.929048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lazy-loading 'services' on Instance uuid aee54bcd-4835-4e6b-b777-07188bfb608d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:22:06.040529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:06.042126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:06.049353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.049820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:06.050615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.051068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:06.122552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:06.130799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:06.132340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:06.133506 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c11994fb-ab45-4901-b374-23b927f884b6 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.098017 May 14 21:22:06.134073 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1445/3075] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:06 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:06.150550 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-76b65b9b-fa48-419a-828b-3c81da5f6b5b tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/2aecd011-8bb0-4a67-b8ce-def64dd1d427" status: 202 len: 0 microversion: 2.1 time: 0.329065 May 14 21:22:06.151468 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1631/3076] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:22:05 2022] DELETE /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/2aecd011-8bb0-4a67-b8ce-def64dd1d427 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:22:06.154736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:06.154736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:06.161737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e5d8626-96f6-471f-8d0f-e4794c2b0b45 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:06.161980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.162399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:06.163243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.163736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:06.164820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e5d8626-96f6-471f-8d0f-e4794c2b0b45 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:06.173169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e5d8626-96f6-471f-8d0f-e4794c2b0b45 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.173766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e5d8626-96f6-471f-8d0f-e4794c2b0b45 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:06.174661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e5d8626-96f6-471f-8d0f-e4794c2b0b45 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.175228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e5d8626-96f6-471f-8d0f-e4794c2b0b45 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:06.207668 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e5d8626-96f6-471f-8d0f-e4794c2b0b45 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050396 May 14 21:22:06.208610 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1632/3077] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:22:06 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:06.304922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:06.314289 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99118d28-9e21-4500-a911-44074079b839 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1714 microversion: 2.1 time: 0.167815 May 14 21:22:06.315282 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1446/3078] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:06 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:06.562806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:06.563516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:06.569971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.570425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:06.571225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:06.571762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.083378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:07.095818 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d580cac6-5a53-415d-aadf-2589791f7824 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 200 len: 1450 microversion: 2.1 time: 0.537348 May 14 21:22:07.096572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1633/3079] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:06 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 1450 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:07.120402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:07.120940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:07.150606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.152907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.153964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.157525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.160737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:07.161771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:07.168174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.168894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.169686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.170201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.200688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:07.208626 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Working on deleting snapshot 8135f967-90d6-423a-98b1-2fbc53439b12 from shelved instance... May 14 21:22:07.276637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:07.288291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:07.290103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:07.291366 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b23f8e5-55f3-4fbc-9eac-3218ade93ef4 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.142066 May 14 21:22:07.292234 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1634/3080] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:07 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:07.297676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e1ff79ca-0b06-4b34-8013-c74035fd8918 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:07.298669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e1ff79ca-0b06-4b34-8013-c74035fd8918 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:07.304848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1ff79ca-0b06-4b34-8013-c74035fd8918 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.305388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1ff79ca-0b06-4b34-8013-c74035fd8918 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.306240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1ff79ca-0b06-4b34-8013-c74035fd8918 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.306750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1ff79ca-0b06-4b34-8013-c74035fd8918 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.345663 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e1ff79ca-0b06-4b34-8013-c74035fd8918 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052254 May 14 21:22:07.346274 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1635/3081] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:22:07 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:22:07.359409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:07.360054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:07.376718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.377173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.378394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.378524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.476055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:07.488115 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf5b2c67-6c1f-495f-9d6d-f845066593ad tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1647 microversion: 2.1 time: 0.132473 May 14 21:22:07.502196 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1636/3082] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:07 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1647 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:07.519263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0f5cd089-d230-401b-98e4-acdb1a3c9811 req-69ab3450-f70e-4ba8-929a-b1aa677b8640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "815ca298-48a6-4a6b-af6c-8bb68179a7ea", "name": "network-vif-deleted", "tag": "32783b2c-8568-419c-979d-100fe44c3fb9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:07.528793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0f5cd089-d230-401b-98e4-acdb1a3c9811 req-69ab3450-f70e-4ba8-929a-b1aa677b8640 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:07.529253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0f5cd089-d230-401b-98e4-acdb1a3c9811 req-69ab3450-f70e-4ba8-929a-b1aa677b8640 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:07.543822 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0f5cd089-d230-401b-98e4-acdb1a3c9811 req-69ab3450-f70e-4ba8-929a-b1aa677b8640 service nova] Creating event network-vif-deleted:32783b2c-8568-419c-979d-100fe44c3fb9 for instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea on nch1-master-1 May 14 21:22:07.549554 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0f5cd089-d230-401b-98e4-acdb1a3c9811 req-69ab3450-f70e-4ba8-929a-b1aa677b8640 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 May 14 21:22:07.550179 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1637/3083] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:08.322305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:08.328079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:08.332066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:08.332697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:08.333482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:08.333920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:08.420013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:08.430509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:08.432312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:08.433516 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70995d5e-cbf2-4185-9f19-c72a5893a70f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.125109 May 14 21:22:08.434270 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1638/3084] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:08 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:08.519935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:08.521022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:08.528351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:08.529749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:08.530062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:08.531439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:08.566944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:08.567812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:08.568414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lazy-loading 'fault' on Instance uuid 815ca298-48a6-4a6b-af6c-8bb68179a7ea {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:22:08.647713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b54f1f777ca2448bb3ba65643cfcb530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba969692dac24c5bab4062ca210bef43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:08.660598 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50455900-5f77-431d-8b8c-9998e49175d2 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 200 len: 1366 microversion: 2.1 time: 0.144583 May 14 21:22:08.665328 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1639/3085] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:08 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:08.795052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Doing local delete in cell eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=130637) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 14 21:22:08.799120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:08.799885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:08.800502 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 14 21:22:08.806751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] deallocate_for_instance() {{(pid=130637) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 14 21:22:09.441910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6d04694b-0fbf-4503-b52b-6da84d8d5346 req-186930b2-c4b0-4d30-a265-4c92c12c1456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21fc6710-88a8-420b-b6cd-901e9eef71dc", "name": "network-vif-deleted", "tag": "2b63bcfc-9138-40aa-b6dd-b137c15d0bbe"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:09.452866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6d04694b-0fbf-4503-b52b-6da84d8d5346 req-186930b2-c4b0-4d30-a265-4c92c12c1456 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:09.459867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6d04694b-0fbf-4503-b52b-6da84d8d5346 req-186930b2-c4b0-4d30-a265-4c92c12c1456 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:09.465081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.server_external_events [req-6d04694b-0fbf-4503-b52b-6da84d8d5346 req-186930b2-c4b0-4d30-a265-4c92c12c1456 service nova] Unable to find a host for instance 21fc6710-88a8-420b-b6cd-901e9eef71dc. Dropping event network-vif-deleted {{(pid=130638) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 14 21:22:09.466174 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6d04694b-0fbf-4503-b52b-6da84d8d5346 req-186930b2-c4b0-4d30-a265-4c92c12c1456 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028286 May 14 21:22:09.468173 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1640/3086] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 14 21:22:09.477557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:09.478269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:09.488015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:09.488897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:09.489824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:09.490338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:09.507144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Updating instance_info_cache with network_info: [] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:22:09.586281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:09.594826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:09.596365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:09.597571 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-156a3027-1a22-47b5-8ebd-561aa3773803 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.126018 May 14 21:22:09.598139 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1641/3087] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:09 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:09.682468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:09.683090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] [instance: 815ca298-48a6-4a6b-af6c-8bb68179a7ea] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:09.689969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:09.702267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:09.702267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:09.702267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:09.706181 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] HTTP exception thrown: Instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea could not be found. May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Request method failure captured: May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea HTTP/1.1 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB0_BLKEIYxKFUbc0NZM1EJEPzykILwMk-CWKn-sszaxcZGEf8RLVlDZc2UTnOcuf-YC5W6meTc1YmrD5JGnhzMPYQZgQq6WgaVCX5REjbU0u1yuxhrmbi0ppwF7uOpOX-Fpcv0oNcYe2dOmKigNqNZA4NtJtRhbYjHUeX4AOy2P0s8 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: ba969692dac24c5bab4062ca210bef43 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestManualDisk-964793242 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba969692dac24c5bab4062ca210bef43"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ba969692dac24c5bab4062ca210bef43"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ba969692dac24c5bab4062ca210bef43"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ba969692dac24c5bab4062ca210bef43", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestManualDisk-964793242 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: ba969692dac24c5bab4062ca210bef43 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestManualDisk-964793242 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestManualDisk-964793242-project May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b54f1f777ca2448bb3ba65643cfcb530 May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestManualDisk-964793242-project May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea could not be found. May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '815ca298-48a6-4a6b-af6c-8bb68179a7ea'} May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea could not be found. May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea could not be found. May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:09.708045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea could not be found. May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Returning 404 to user: Instance 815ca298-48a6-4a6b-af6c-8bb68179a7ea could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ffd62805-b402-4f82-8b8d-c057381bfc79 tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea" status: 404 len: 111 microversion: 2.1 time: 0.031308 May 14 21:22:09.715284 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1642/3088] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:09 2022] GET /compute/v2.1/servers/815ca298-48a6-4a6b-af6c-8bb68179a7ea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:22:09.719786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9dbcf04d-9d99-4993-9c54-d5dcba06a1bf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] Calling method '.version_select at 0x7fb1a7186c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:09.867641 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9dbcf04d-9d99-4993-9c54-d5dcba06a1bf tempest-ServersTestManualDisk-964793242 tempest-ServersTestManualDisk-964793242-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-616671604" status: 202 len: 0 microversion: 2.1 time: 0.152462 May 14 21:22:09.868235 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1643/3089] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:22:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-616671604 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:22:10.249504 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11113e41-42f9-43d9-8985-ec207ae16e49 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 204 len: 0 microversion: 2.1 time: 3.135699 May 14 21:22:10.255320 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1447/3090] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:22:07 2022] DELETE /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 0 bytes in 3139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:22:10.288335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:10.288653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:10.306638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:10.307162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:10.307983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:10.308427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:10.359147 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc HTTP/1.1 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '21fc6710-88a8-420b-b6cd-901e9eef71dc'} May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:10.364707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:10.368167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:10.368167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:10.368167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:10.368167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:22:10.368167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:22:10.368167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:22:10.368167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:10.371008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:22:10.372899 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3e0192f0-98fd-416f-9a38-507c21ddeeb7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 404 len: 111 microversion: 2.1 time: 0.115813 May 14 21:22:10.373934 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1644/3091] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:10 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:22:10.394840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "444d77c2-4003-4c0b-a856-d73268fac0ac"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:10.396614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:10.404745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:10.405620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:10.406986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:10.409947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:10.479132 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] HTTP exception thrown: Volume 151b2e31-17b4-45c7-a126-95da31cfc663 could not be found. May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Request method failure captured: May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/151b2e31-17b4-45c7-a126-95da31cfc663 HTTP/1.1 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 74 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB1egH8t6G0q5S4IzPE4yGHRZNgd0eK_Z8hCK2tYiXM1HLQlPkTmKvDQpTdfOb9ohJLhb7uECZCFkU25h8dPNsuEVIHJELfg84jwgVK8K1ovQZgnW33kQVk6B4_RoPlpbxowHIHDUBMy9YkjhmvbKM6oZSv1_z-Czrmyjtj_PmXzeoY May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a7b652f4fb414727b68ba9078a657cb9 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-VolumesAdminNegativeTest-261307410 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7b652f4fb414727b68ba9078a657cb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a7b652f4fb414727b68ba9078a657cb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a7b652f4fb414727b68ba9078a657cb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a7b652f4fb414727b68ba9078a657cb9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-VolumesAdminNegativeTest-261307410 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a7b652f4fb414727b68ba9078a657cb9 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-261307410 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-VolumesAdminNegativeTest-261307410-project-admin May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 4c7b0ab4127a45869ce524ae057735b4 May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-VolumesAdminNegativeTest-261307410-project-admin May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: {"volumeAttachment": {"volumeId": "444d77c2-4003-4c0b-a856-d73268fac0ac"}} May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: exception: Volume 151b2e31-17b4-45c7-a126-95da31cfc663 could not be found. May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'server_id': 'aee54bcd-4835-4e6b-b777-07188bfb608d', 'id': '151b2e31-17b4-45c7-a126-95da31cfc663', 'body': {'volumeAttachment': {'volumeId': '444d77c2-4003-4c0b-a856-d73268fac0ac'}}} May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 151b2e31-17b4-45c7-a126-95da31cfc663 could not be found. (HTTP 404) (Request-ID: req-1fc025bd-58d3-4042-8aa7-76371df3854a) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:22:10.481453 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 151b2e31-17b4-45c7-a126-95da31cfc663 could not be found. May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 151b2e31-17b4-45c7-a126-95da31cfc663 could not be found. May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 151b2e31-17b4-45c7-a126-95da31cfc663 could not be found. May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] Returning 404 to user: Volume 151b2e31-17b4-45c7-a126-95da31cfc663 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4eef321-c247-4da2-8522-1a6c4a201cd9 tempest-VolumesAdminNegativeTest-261307410 tempest-VolumesAdminNegativeTest-261307410-project-admin] 10.222.0.52 "PUT /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/151b2e31-17b4-45c7-a126-95da31cfc663" status: 404 len: 109 microversion: 2.1 time: 0.094299 May 14 21:22:10.490851 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1448/3092] 10.222.0.52 () {60 vars in 1432 bytes} [Sat May 14 21:22:10 2022] PUT /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d/os-volume_attachments/151b2e31-17b4-45c7-a126-95da31cfc663 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:22:10.517790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1076957695", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3bdbef8a-a684-458d-bfe2-b4f322a15d2e"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:10.598571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] validate_networks() for [('3bdbef8a-a684-458d-bfe2-b4f322a15d2e', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:22:10.617627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:10.618148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:10.624874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:10.625813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:10.626787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:10.627404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:10.803629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:10.815254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:10.818350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:10.821735 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-779cf4fa-c402-47a5-95f3-5d7185886d8e tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.208489 May 14 21:22:10.822170 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1449/3093] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:10 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:11.498910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:22:11.499500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:22:11.500090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:22:11.500512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:22:11.500935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:22:11.523800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:11.523800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:11.527361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:11.528103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:11.570478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:22:11.578524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for user 71080496c33c4e2c8b2e16b950f0b9ea and project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:22:11.604266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:22:11.606766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:11.846664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:11.847298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:11.863755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:11.864209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:11.865207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:11.868077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:11.879946 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0177c583-bff8-4e1b-bac8-9b7beefe3991 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.366690 May 14 21:22:11.881212 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1645/3094] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:22:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:22:11.893855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8930f13-2886-4dc9-8ece-40e34e786b65 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:11.898788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8930f13-2886-4dc9-8ece-40e34e786b65 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:12.032072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8930f13-2886-4dc9-8ece-40e34e786b65 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:12.038629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:12.040323 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8930f13-2886-4dc9-8ece-40e34e786b65 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1215 microversion: 2.1 time: 0.152944 May 14 21:22:12.040915 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1646/3095] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:11 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:12.054508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:12.063700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:12.065673 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bde74f4f-387c-435c-9332-217f1a58f8aa tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.224168 May 14 21:22:12.066805 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1450/3096] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:11 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:13.059657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d953e662-947c-4e09-b209-941c6c85b893 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:13.060300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d953e662-947c-4e09-b209-941c6c85b893 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:13.089889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:13.091335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:13.103471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:13.103978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:13.107261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:13.107917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:13.228061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d953e662-947c-4e09-b209-941c6c85b893 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:13.238544 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d953e662-947c-4e09-b209-941c6c85b893 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1215 microversion: 2.1 time: 0.184383 May 14 21:22:13.240728 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1647/3097] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:13 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:13.353203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:13.368213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:13.370618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:13.372825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5bb4be38-ceb7-46b1-b431-e3dc19201657 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.286716 May 14 21:22:13.374800 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1451/3098] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:13 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:13.975413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c42d9fb2-4375-462f-b39a-9b33787af348 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Action: 'create', calling method: .version_select at 0x7fb1a7095670>, body: {"keypair": {"name": "tempest-keypair-1931352794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJGBC8c1oAgBLuM7gQQTO+/uPa3LkghrCgLZXg4LFzDC8FhDqgUm5H8l40b6WhLDCtw5iKwxwSZKYCuMr4DrqNpxa9asapo4aWSTUBl26NnMmRYZm+UXfYM0TaT/r6FLng=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:13.990849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c42d9fb2-4375-462f-b39a-9b33787af348 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Getting quotas for project c8d3f937d0cc40e6b1cd90e72b6fb07e. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:22:13.999288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c42d9fb2-4375-462f-b39a-9b33787af348 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Getting quotas for user 2d0ac47523ba4f288bcd89f8228ef910 and project c8d3f937d0cc40e6b1cd90e72b6fb07e. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:22:14.137789 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c42d9fb2-4375-462f-b39a-9b33787af348 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.166030 May 14 21:22:14.138358 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1648/3099] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:22:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 21:22:14.259243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:14.260619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:14.269979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:14.270525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:14.271318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:14.271795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:14.394471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:14.395743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:14.408593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:14.408593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:14.409668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:14.413625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:14.414132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:14.418953 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6b8b1647-6105-4c16-bf88-98288ebf0571 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1211 microversion: 2.1 time: 0.164552 May 14 21:22:14.432345 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1452/3100] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:14 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1211 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:14.535143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:14.548126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:14.548126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:14.549054 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0c801bbb-705c-49eb-961a-35f0df1f5864 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.160433 May 14 21:22:14.549938 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1649/3101] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:14 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:15.442546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:15.443525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:15.459953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:15.460659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:15.463182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:15.464127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:15.548238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:15.558182 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78b71c94-556c-4256-b3b6-47a4781dd6db tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1285 microversion: 2.1 time: 0.122130 May 14 21:22:15.559585 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1453/3102] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:15 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:15.567742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:15.568957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:15.576403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:15.577309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:15.578333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:15.578925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:15.690916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:15.713952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:15.715527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:15.723050 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca99ffcb-05ec-4f41-ad4b-e3559d8c58d2 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.159194 May 14 21:22:15.723906 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1650/3103] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:15 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:16.584239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:16.585454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:16.593832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:16.594291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:16.595235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:16.595845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:16.745602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:16.746811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:16.766833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:16.766833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:16.770747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:16.771436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:16.880412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:16.892220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:16.894302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:16.896563 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a69837bb-158e-4958-b494-023c174847cb tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.156116 May 14 21:22:16.897378 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1651/3104] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:16 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:16.935287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:16.944461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-75ccceed-daf5-46f6-aa11-7a2de2630f94 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.363946 May 14 21:22:16.945269 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1454/3105] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:16 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:17.568538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-672676252", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7e77eecd-4e91-4ff7-94ed-e78389e714c8"}, {"port": "295d1cbd-15b9-44db-8e23-acbc4c34efab", "tag": "port-1"}, {"port": "cb2ed6c9-1135-4b76-b18c-8882fea92d8d", "tag": "port-2"}, {"uuid": "4bc88faa-84db-4cff-8bb5-84c3d14fdc3b", "tag": "net-1"}, {"uuid": "4bc88faa-84db-4cff-8bb5-84c3d14fdc3b"}, {"uuid": "6e72934f-3fc8-4cfb-a320-816dc2a9b892", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "6e72934f-3fc8-4cfb-a320-816dc2a9b892", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "40376eea-0c0f-488c-ae00-97b792b66c72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "5ab5558f-588e-4b04-84f6-6f28c0048e77", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e6ef1b51-cb2d-47e8-b6cb-1d7a4cd951db", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1405810486"}], "key_name": "tempest-keypair-1931352794", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:17.694517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] validate_networks() for [('7e77eecd-4e91-4ff7-94ed-e78389e714c8', None, None, None, None, None), (None, None, '295d1cbd-15b9-44db-8e23-acbc4c34efab', None, None, None), (None, None, 'cb2ed6c9-1135-4b76-b18c-8882fea92d8d', None, None, None), ('4bc88faa-84db-4cff-8bb5-84c3d14fdc3b', None, None, None, None, None), ('4bc88faa-84db-4cff-8bb5-84c3d14fdc3b', None, None, None, None, None), ('6e72934f-3fc8-4cfb-a320-816dc2a9b892', '10.2.2.100', None, None, None, None), ('6e72934f-3fc8-4cfb-a320-816dc2a9b892', '10.2.2.200', None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:22:17.915654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:17.916411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:17.924569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:17.925035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:17.925822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:17.926546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:18.003227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:18.014326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:18.017896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:18.020562 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf4e80db-8fbe-4668-9c68-41c4c1ab6604 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.109150 May 14 21:22:18.027456 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1455/3106] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:17 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:18.035927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:18.037100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:18.047456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:18.048529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:18.049642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:18.050230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:18.295935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:18.301356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dbbaf947-b000-4d2e-b148-a5ea979c83fe tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.271775 May 14 21:22:18.314977 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1456/3107] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:18 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:18.326492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9675b42b-b8de-41e3-bb27-6451aa806bbc req-59284f56-3b90-4c5d-a296-495bdd2f2325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43bbc2dd-60e5-44e4-9601-74231273003b", "tag": "721a641c-f7ca-4d65-8daf-95a62b1570d4"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:18.340094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9675b42b-b8de-41e3-bb27-6451aa806bbc req-59284f56-3b90-4c5d-a296-495bdd2f2325 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:18.347375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9675b42b-b8de-41e3-bb27-6451aa806bbc req-59284f56-3b90-4c5d-a296-495bdd2f2325 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:18.375707 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9675b42b-b8de-41e3-bb27-6451aa806bbc req-59284f56-3b90-4c5d-a296-495bdd2f2325 service nova] Creating event network-changed:721a641c-f7ca-4d65-8daf-95a62b1570d4 for instance 43bbc2dd-60e5-44e4-9601-74231273003b on nch2-master-1 May 14 21:22:18.393812 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9675b42b-b8de-41e3-bb27-6451aa806bbc req-59284f56-3b90-4c5d-a296-495bdd2f2325 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066264 May 14 21:22:18.399050 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1457/3108] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:19.048120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:19.048919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:19.055913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:19.056309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:19.057254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:19.057855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:19.133846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:19.142784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:19.144420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:19.145590 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-35f09b5b-0209-4355-9f01-b5268b60a7a1 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.103391 May 14 21:22:19.146580 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1458/3109] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:19 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:19.320818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:19.321449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:19.327936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:19.328405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:19.329193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:19.329671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:19.527798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:19.539365 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d0758f1-6b3f-439b-a715-d584cd2cc987 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.222349 May 14 21:22:19.540341 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1459/3110] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:19 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:20.059913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:22:20.060463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:22:20.060875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:22:20.061931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:22:20.062606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:22:20.072006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:20.072457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:20.073256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:20.073695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:20.091699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Getting quotas for project c8d3f937d0cc40e6b1cd90e72b6fb07e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:22:20.097146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Getting quotas for user 2d0ac47523ba4f288bcd89f8228ef910 and project c8d3f937d0cc40e6b1cd90e72b6fb07e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:22:20.164666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:20.165657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:20.173371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:20.173832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:20.174606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:20.175045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:20.266347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:22:20.268984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='40376eea-0c0f-488c-ae00-97b792b66c72',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='5ab5558f-588e-4b04-84f6-6f28c0048e77',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e6ef1b51-cb2d-47e8-b6cb-1d7a4cd951db',volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:20.286724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:20.297853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:20.300598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:20.302076 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-faad0295-c14b-4ece-b884-12e30a3f8997 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.141393 May 14 21:22:20.302750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1460/3111] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:20 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:20.557799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:20.558461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:20.565929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:20.566374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:20.567992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:20.567992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:20.749495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:20.759568 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a732a6b-ee52-49af-a209-ad8cfb159cb6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.205696 May 14 21:22:20.760157 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1461/3112] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:20 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:20.880466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1318137379", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "18a13367-d709-44a6-83ee-a5a75d3ef57e"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:20.933716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] validate_networks() for [('18a13367-d709-44a6-83ee-a5a75d3ef57e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:22:21.290847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:22:21.291423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:22:21.291873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:22:21.292292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:22:21.292714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:22:21.301733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.302185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.302992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.303436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.321017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Getting quotas for project f589f7d7ad0f4b63afd4132efa4e798a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:22:21.326319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Getting quotas for user beb60582a8ae4b2499db4a45da00512f and project f589f7d7ad0f4b63afd4132efa4e798a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:22:21.339663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Going to run 2 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:22:21.342052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 3b4f8c2d-810e-45bc-acab-87cf44c9155a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:21.450585 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-886cba2f-58ee-4332-81eb-a2e7cbcd23f6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 3.886723 May 14 21:22:21.451336 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1652/3113] 10.222.0.52 () {62 vars in 1188 bytes} [Sat May 14 21:22:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 3888 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:22:21.457390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:21.459093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:21.464294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.464751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.465516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.465953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.538283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.546611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=3b4f8c2d-810e-45bc-acab-87cf44c9155a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:21.551180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.551180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.551180 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66092a06-5d5c-4a42-9900-b5bf0b73d351 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1364 microversion: 2.57 time: 0.096514 May 14 21:22:21.552728 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1653/3114] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:21 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1364 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:21.557350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f5eda7a-6a5e-4f14-a17d-71d8fe6979f5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:21.557955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0f5eda7a-6a5e-4f14-a17d-71d8fe6979f5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:21.620309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f5eda7a-6a5e-4f14-a17d-71d8fe6979f5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.628354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f5eda7a-6a5e-4f14-a17d-71d8fe6979f5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.629988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f5eda7a-6a5e-4f14-a17d-71d8fe6979f5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.635577 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0f5eda7a-6a5e-4f14-a17d-71d8fe6979f5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1285 microversion: 2.42 time: 0.077461 May 14 21:22:21.635577 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1654/3115] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:21 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1285 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:21.763583 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c4ada4ca-ad04-4711-876e-f79732c3f4c4 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.001718 May 14 21:22:21.770178 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1462/3116] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:22:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:22:21.774083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:21.782328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:21.785280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:21.787716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.790760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Searching by: {'deleted': False, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:22:21.797134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.797600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.798388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.798830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.827330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.828018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.828819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:21.829267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:21.926876 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a804f57a-5022-4591-907c-3e479d61d40f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.156452 May 14 21:22:21.927961 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1655/3117] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:22:21 2022] GET /compute/v2.1/servers => generated 677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:22:21.939165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9ff802f-d838-44aa-89cd-37cd48662afa tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:21.939848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d9ff802f-d838-44aa-89cd-37cd48662afa tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:21.980368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:21.990379 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f59437cc-bfa2-4943-8ff5-b3fc11d253a7 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.212233 May 14 21:22:21.991001 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1463/3118] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:21 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:21.993776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d9ff802f-d838-44aa-89cd-37cd48662afa tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:22.001566 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d9ff802f-d838-44aa-89cd-37cd48662afa tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1220 microversion: 2.1 time: 0.067437 May 14 21:22:22.002142 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1656/3119] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:21 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1220 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:22.570568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:22.571196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:22.578297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:22.578765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:22.579567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:22.580016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:22.644017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:22.650169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65c152f8-50ea-4ed9-a9f9-58711bc1b29a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:22.650938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65c152f8-50ea-4ed9-a9f9-58711bc1b29a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:22.652059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:22.653576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:22.654736 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f22ecb0d-2446-4097-a722-726ab4f3728c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1370 microversion: 2.57 time: 0.088161 May 14 21:22:22.655461 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1464/3120] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:22 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1370 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:22.710677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65c152f8-50ea-4ed9-a9f9-58711bc1b29a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:22.720301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65c152f8-50ea-4ed9-a9f9-58711bc1b29a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:22.722202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65c152f8-50ea-4ed9-a9f9-58711bc1b29a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:22.723366 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65c152f8-50ea-4ed9-a9f9-58711bc1b29a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1285 microversion: 2.42 time: 0.077265 May 14 21:22:22.724037 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1657/3121] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:22 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1285 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:23.007829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:23.008613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:23.016092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:23.017089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:23.017722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:23.018248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:23.019334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c903c68c-c131-44f4-8853-9fc1a186b0e3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:23.020131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c903c68c-c131-44f4-8853-9fc1a186b0e3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:23.075880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c903c68c-c131-44f4-8853-9fc1a186b0e3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.083839 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c903c68c-c131-44f4-8853-9fc1a186b0e3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1220 microversion: 2.1 time: 0.069440 May 14 21:22:23.084425 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1658/3122] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:23 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1220 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:23.172818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.180428 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5558549-bef8-4e02-a5d0-9657e4863931 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.176598 May 14 21:22:23.181007 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1465/3123] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:23 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:23.679614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:23.680248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:23.689213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:23.689701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:23.690487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:23.690924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:23.743270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:23.744572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:23.751522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:23.752698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:23.753628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:23.754074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:23.763108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.778474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.782115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.784466 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0244bca2-3010-4dd4-a2a6-c72a5ac0be0a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1370 microversion: 2.57 time: 0.110303 May 14 21:22:23.785496 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1659/3124] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:23 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1370 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:23.839281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.859933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.861727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:23.862902 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-89970c96-e44c-4db3-b3fb-a91ba2bae8c8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1527 microversion: 2.42 time: 0.123692 May 14 21:22:23.863492 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1466/3125] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:23 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1527 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:24.100546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:24.101176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:24.108545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.109200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.109980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.110426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.177004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.184604 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8644f74d-daac-433b-8f04-7b95d983e4f8 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1224 microversion: 2.1 time: 0.087910 May 14 21:22:24.185185 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1660/3126] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:24 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:24.200278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:24.200929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:24.209207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.209663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.210863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.211303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.363580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.370998 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22cce4ba-453d-4d4d-a2d7-52a5f66e7163 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.177004 May 14 21:22:24.371587 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1467/3127] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:24 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:24.805101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:24.805716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:24.812459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.812974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.813750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.814186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.882678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:24.883530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:24.892451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.895791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.896163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.896283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.896283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.902439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.903978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.905150 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-39516b65-4678-4bba-b520-f9ac1e1e9d1a tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1355 microversion: 2.57 time: 0.104398 May 14 21:22:24.905720 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1661/3128] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:24 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1355 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:24.945255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:24.946087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:24.957644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.958132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.959108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:24.959595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:24.985848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.996475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.998032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:24.999206 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79873399-ebc8-418a-8f69-e82098d6ee24 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1575 microversion: 2.42 time: 0.120740 May 14 21:22:25.000873 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1468/3129] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:24 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1575 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:25.006390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:25.202152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:25.202865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:25.210959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:25.216460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:25.216460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:25.216460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:25.294001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:25.304782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb91bf3b-fb4c-42da-a44f-a69bff47fe33 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1272 microversion: 2.1 time: 0.106216 May 14 21:22:25.306092 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1469/3130] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:25 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:25.388298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:25.388922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:25.396037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:25.396497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:25.397275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:25.397741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:25.496788 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-be0213e9-ff30-421b-8f8c-4f732b9e167d tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 204 len: 0 microversion: 2.57 time: 0.563644 May 14 21:22:25.497933 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1662/3131] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:22:24 2022] DELETE /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 21:22:25.509698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:25.510449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:25.527986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:25.536617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:25.536617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:25.536617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:25.628188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:25.637259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:25.638775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:25.639980 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1cf09ce-0f1d-4879-a211-33168e921f7f tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1361 microversion: 2.57 time: 0.137576 May 14 21:22:25.643524 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1663/3132] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:25 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1361 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:25.738722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8e487f21-795c-4171-9c40-6cae4b18fc5a req-fb699175-fa57-414d-910f-35dab84db836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43bbc2dd-60e5-44e4-9601-74231273003b", "name": "network-vif-plugged", "status": "completed", "tag": "721a641c-f7ca-4d65-8daf-95a62b1570d4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:25.753277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8e487f21-795c-4171-9c40-6cae4b18fc5a req-fb699175-fa57-414d-910f-35dab84db836 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:25.754361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8e487f21-795c-4171-9c40-6cae4b18fc5a req-fb699175-fa57-414d-910f-35dab84db836 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:25.754499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:25.768474 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a81589f3-17a5-4f64-8a32-d1fea18a8fe6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.381086 May 14 21:22:25.770761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1470/3133] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:25 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:25.772224 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8e487f21-795c-4171-9c40-6cae4b18fc5a req-fb699175-fa57-414d-910f-35dab84db836 service nova] Creating event network-vif-plugged:721a641c-f7ca-4d65-8daf-95a62b1570d4 for instance 43bbc2dd-60e5-44e4-9601-74231273003b on nch2-master-1 May 14 21:22:25.779963 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8e487f21-795c-4171-9c40-6cae4b18fc5a req-fb699175-fa57-414d-910f-35dab84db836 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137294 May 14 21:22:25.780945 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1664/3134] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:26.032174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:26.032795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:26.055741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.062924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.063814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.064255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.262534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.276759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.278711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.280476 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe272b3b-1058-46e0-bf00-35b1a4ba28d9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1593 microversion: 2.42 time: 0.253816 May 14 21:22:26.281650 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1471/3135] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:26 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1593 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:26.330889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:26.331696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:26.338537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.339567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.340080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.340723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.449330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.457948 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ddf5e20-1cb1-4520-8070-e0b6c81b9a58 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1278 microversion: 2.1 time: 0.134756 May 14 21:22:26.458577 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1665/3136] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:26 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1278 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:26.673800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:26.673800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:26.673800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.673800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.673800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.673800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.735652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.745601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.747170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.748428 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86fa1f15-4d37-4d61-bbf5-8d879e806704 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1361 microversion: 2.57 time: 0.090814 May 14 21:22:26.749094 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1472/3137] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:26 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:26.786211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:26.786928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:26.793046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.793512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.794295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:26.794800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:26.942444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:26.950192 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcb9ab45-6a1f-477b-a268-0ca25cba8d16 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1315 microversion: 2.1 time: 0.168224 May 14 21:22:26.950780 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1666/3138] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:26 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:27.303297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:27.304018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:27.312865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.313755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:27.314791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.315298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:27.475197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:27.475839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:27.483687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.484170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:27.484954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.485697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:27.701236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:27.724517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:27.763590 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d43c3c1-2de1-401d-96f4-6a94248632c2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.287438 May 14 21:22:27.766835 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1667/3139] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:27 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:27.768124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:27.778176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:27.784191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9aee96fb-d016-4cdc-98fc-6e17dd858a9b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1661 microversion: 2.42 time: 0.485003 May 14 21:22:27.786853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:27.787688 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1473/3140] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:27 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1661 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:27.790239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:27.799390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.800409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:27.801665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.802054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:27.946827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:27.957958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:27.960153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd59910b5e81045dc9ec13cded4cb41d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd750e4cf6fab4bc4983f5f2f37a01ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:27.961754 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1e362bd2-ca41-4215-8b9f-2791fdd3da3c tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 200 len: 1361 microversion: 2.57 time: 0.190590 May 14 21:22:27.983895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:27.983895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:27.988059 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1668/3141] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:27 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:27.991679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.992144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:27.992944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:27.993398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:28.549624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:28.568669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c2a5e4a-7922-49e0-ad53-6316996a06b1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1503 microversion: 2.1 time: 0.592688 May 14 21:22:28.570705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1474/3142] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:27 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1503 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:28.594408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae160820-c135-4d45-a6dc-057e5ea513a8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:28.617408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae160820-c135-4d45-a6dc-057e5ea513a8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:28.617866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae160820-c135-4d45-a6dc-057e5ea513a8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:28.634287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:28.634958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:28.678601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:28.678601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:28.678601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:28.678601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:28.691896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae160820-c135-4d45-a6dc-057e5ea513a8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Going to try to stop instance {{(pid=130638) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:22:28.704969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:28.936036 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae160820-c135-4d45-a6dc-057e5ea513a8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b/action" status: 202 len: 0 microversion: 2.1 time: 0.348725 May 14 21:22:28.936750 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1669/3143] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:22:28 2022] POST /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:22:28.946522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:28.947519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:28.955542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:28.956000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:28.957449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:28.958107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.172784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:29.189487 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d59e94c-66a0-49e0-a7f9-7e6b806c5b4a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.245999 May 14 21:22:29.190858 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1670/3144] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:28 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:29.202870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:29.204215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:29.213939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.224973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.226179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.226795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.242783 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03076715-7c14-47a7-b272-7fe072c23663 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 204 len: 0 microversion: 2.1 time: 0.606066 May 14 21:22:29.243750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1475/3145] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:22:28 2022] DELETE /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:22:29.258019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:29.260635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:29.273775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.278497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.278834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.279289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.448083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:29.459106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:29.460673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:29.461848 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6f2208f-b6dc-419a-9f82-2b868ecf56b5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1755 microversion: 2.42 time: 0.269335 May 14 21:22:29.462874 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1671/3146] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:29 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1755 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:29.467848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:29.468748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] [instance: 0ffe0224-15c6-4599-93cc-8ccc793efcec] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:29.475549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.476047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.476827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.477521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.495300 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] HTTP exception thrown: Instance 0ffe0224-15c6-4599-93cc-8ccc793efcec could not be found. May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Request method failure captured: May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec HTTP/1.1 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB1iqnqV0qBTf17lRI4iEbwo0bouzFU5sZsUIH8bZU8RHMBrL2W1z2KQlK7INkCJTgYqkzNC44DX1mUgdrVy5H0x-1dRixy4Gxmovq9Inbw0ExNV079RcWfkuHsu7H_QLmfqsfiloCvI6J6B3LWu0yn09WF0YG9dC2ap9bU6VS8T9SA May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.57 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: d750e4cf6fab4bc4983f5f2f37a01ae6 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerShowV257Test-948915513 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d750e4cf6fab4bc4983f5f2f37a01ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d750e4cf6fab4bc4983f5f2f37a01ae6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d750e4cf6fab4bc4983f5f2f37a01ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d750e4cf6fab4bc4983f5f2f37a01ae6", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerShowV257Test-948915513 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: d750e4cf6fab4bc4983f5f2f37a01ae6 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerShowV257Test-948915513 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerShowV257Test-948915513-project May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: d59910b5e81045dc9ec13cded4cb41d5 May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerShowV257Test-948915513-project May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 0ffe0224-15c6-4599-93cc-8ccc793efcec could not be found. May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '0ffe0224-15c6-4599-93cc-8ccc793efcec'} May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffe0224-15c6-4599-93cc-8ccc793efcec could not be found. May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffe0224-15c6-4599-93cc-8ccc793efcec could not be found. May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:29.497012 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffe0224-15c6-4599-93cc-8ccc793efcec could not be found. May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] Returning 404 to user: Instance 0ffe0224-15c6-4599-93cc-8ccc793efcec could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33763d63-0d83-487b-a28c-d033c4575b50 tempest-ServerShowV257Test-948915513 tempest-ServerShowV257Test-948915513-project] 10.222.0.52 "GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec" status: 404 len: 111 microversion: 2.57 time: 0.034190 May 14 21:22:29.502390 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1672/3147] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:29 2022] GET /compute/v2.1/servers/0ffe0224-15c6-4599-93cc-8ccc793efcec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:22:29.508179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fce48925-84e9-48ec-9767-9d9c1dd8837b req-cfe60fb3-a16b-4539-a3b6-8801af35f3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b4f8c2d-810e-45bc-acab-87cf44c9155a", "tag": "8671b6b0-61ff-4522-a9f4-1ee131e8cd0e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:29.518021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fce48925-84e9-48ec-9767-9d9c1dd8837b req-cfe60fb3-a16b-4539-a3b6-8801af35f3d2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.518482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fce48925-84e9-48ec-9767-9d9c1dd8837b req-cfe60fb3-a16b-4539-a3b6-8801af35f3d2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.530429 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fce48925-84e9-48ec-9767-9d9c1dd8837b req-cfe60fb3-a16b-4539-a3b6-8801af35f3d2 service nova] Creating event network-changed:8671b6b0-61ff-4522-a9f4-1ee131e8cd0e for instance 3b4f8c2d-810e-45bc-acab-87cf44c9155a on nch1-master-1 May 14 21:22:29.535234 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fce48925-84e9-48ec-9767-9d9c1dd8837b req-cfe60fb3-a16b-4539-a3b6-8801af35f3d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 May 14 21:22:29.535868 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1673/3148] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:29.540951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:29.541770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:29.542116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:29.551765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.551970 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-460babe3-8f81-48f7-87c5-b34dcad3acc6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.305799 May 14 21:22:29.552428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.553044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:29.553496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:29.565078 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1476/3149] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:29 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:29.698576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:29.706767 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6118e2e-886f-4d31-8547-b18bfd8959ec tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1514 microversion: 2.1 time: 0.169795 May 14 21:22:29.707336 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1674/3150] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:29 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:30.207240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:30.208110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:30.214386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.215048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.215877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.216339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.358268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:30.372580 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-abfefa92-776f-43be-8b51-a59b489b5bb9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.164057 May 14 21:22:30.372580 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1477/3151] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:30 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:30.481297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:30.481836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:30.487892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.488358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.489145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.489574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.572330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:30.573228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:30.580575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.581361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.582267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.583011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.742023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:30.756320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:30.762640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:30.764190 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-78a12f53-c89c-4afc-ac3d-1e94709bd719 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1755 microversion: 2.42 time: 0.286937 May 14 21:22:30.767904 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1675/3152] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:30 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1755 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:30.778637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:30.779306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:30.786971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.787522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.788403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.789217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.950098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:30.961153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a1c72431-7327-4e6a-b1af-165ee05dd395 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.393776 May 14 21:22:30.961923 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1478/3153] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:30 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:30.968351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fc877049-1625-40b2-a3e5-3beba6394d09 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66dac191-38b3-4bbd-bf9b-b7ff4ffce383"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:30.972097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fc877049-1625-40b2-a3e5-3beba6394d09 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:30.978769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc877049-1625-40b2-a3e5-3beba6394d09 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.979442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc877049-1625-40b2-a3e5-3beba6394d09 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:30.980454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc877049-1625-40b2-a3e5-3beba6394d09 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:30.981060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc877049-1625-40b2-a3e5-3beba6394d09 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:31.136847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:31.146562 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eef0cb7f-f163-4abe-87e2-9dab38b636ed tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1514 microversion: 2.1 time: 0.377110 May 14 21:22:31.152766 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1676/3154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:30 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1514 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:31.385779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:31.386812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:31.397795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:31.399778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:31.401885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:31.405634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:31.674376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:31.685592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7d391fe9-2ae1-4359-9424-828e9aa3859c tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.301542 May 14 21:22:31.686340 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1677/3155] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:31 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:31.703795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-f0ab99ef-317f-41a9-bf4c-03475df0c3c8 req-80b1b3b5-6e48-4cb7-a624-13ce2e2daf5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9845a1d3-50d1-4a2c-9648-4780611c1777", "tag": "d34dcd4f-5a70-44e8-b76f-c601780755a3"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:31.726509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f0ab99ef-317f-41a9-bf4c-03475df0c3c8 req-80b1b3b5-6e48-4cb7-a624-13ce2e2daf5f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:31.730298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f0ab99ef-317f-41a9-bf4c-03475df0c3c8 req-80b1b3b5-6e48-4cb7-a624-13ce2e2daf5f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:31.739429 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-f0ab99ef-317f-41a9-bf4c-03475df0c3c8 req-80b1b3b5-6e48-4cb7-a624-13ce2e2daf5f service nova] Creating event network-changed:d34dcd4f-5a70-44e8-b76f-c601780755a3 for instance 9845a1d3-50d1-4a2c-9648-4780611c1777 on nch2-master-1 May 14 21:22:31.746139 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-f0ab99ef-317f-41a9-bf4c-03475df0c3c8 req-80b1b3b5-6e48-4cb7-a624-13ce2e2daf5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053390 May 14 21:22:31.747942 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1678/3156] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:31.787649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:31.788646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:31.795428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:31.795915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:31.797409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:31.797860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:32.073149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:32.087119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:32.091642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:32.091955 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cdd0e6e0-6df2-4bb0-9d90-49cdbc94b655 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1755 microversion: 2.42 time: 0.308638 May 14 21:22:32.104339 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1679/3157] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:31 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1755 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:32.109576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:32.110494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:32.118201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:32.118656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:32.119443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:32.119909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:32.208671 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fc877049-1625-40b2-a3e5-3beba6394d09 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "POST /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.244506 May 14 21:22:32.209538 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1479/3158] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:22:30 2022] POST /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments => generated 194 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:32.221606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:32.223696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:32.231201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:32.232063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:32.233142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:32.233939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:32.379927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:32.399874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3adcb19d-0b07-4877-b568-325d4ac94495 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1472 microversion: 2.1 time: 0.183066 May 14 21:22:32.411362 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1480/3159] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:32 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1472 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:32.472081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:32.480602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d7ce36ce-eb12-48a9-b76d-41c7f7f08ceb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.374866 May 14 21:22:32.481545 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1680/3160] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:32 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:32.708073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:32.708709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:32.715377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:32.720655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:32.720655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:32.720655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:32.898883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:32.907512 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87c9703f-721e-4323-9f73-c95069c0121d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.203045 May 14 21:22:32.908179 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1481/3161] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:32 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:33.112695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:33.113547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:33.122307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.128982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.134974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.135651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.504665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:33.512222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:33.517502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:33.537819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.538628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.545275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:33.551697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:33.555725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4f2dfadf-7f2d-4545-892c-879cea1d72a6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1802 microversion: 2.42 time: 0.446723 May 14 21:22:33.575686 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1681/3162] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:33 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1802 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:33.575889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.576198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.592703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:33.592703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:33.614198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.615136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.616636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.620586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.732431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.733257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.734271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lazy-loading 'fault' on Instance uuid aee54bcd-4835-4e6b-b777-07188bfb608d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:22:33.864661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07186d1e535e4de2ae6b8269ca10b4c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cabbde4fba484c6d83f6ae32716cf82b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:33.887890 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd069c0a-54bd-4bd3-aed8-f01c5491fe71 tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 200 len: 1308 microversion: 2.1 time: 0.319698 May 14 21:22:33.888706 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1682/3163] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:33 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:33.895747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:33.896592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:33.901145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:33.910043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.910994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.912519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.913446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.924475 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9108ecb1-c0f4-4b93-8593-dfacfd76eb79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.796419 May 14 21:22:33.925658 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1482/3164] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:33 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:33.930831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-21831717-75c8-49a0-aefe-3949f56949bf req-3415b5c7-9c3a-4d0b-97ec-217d312ab7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee54bcd-4835-4e6b-b777-07188bfb608d", "name": "network-vif-deleted", "tag": "fec2f708-b2fe-442f-9676-5104a4997d2c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:33.946858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-21831717-75c8-49a0-aefe-3949f56949bf req-3415b5c7-9c3a-4d0b-97ec-217d312ab7cd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:33.947643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-21831717-75c8-49a0-aefe-3949f56949bf req-3415b5c7-9c3a-4d0b-97ec-217d312ab7cd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:33.964664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-21831717-75c8-49a0-aefe-3949f56949bf req-3415b5c7-9c3a-4d0b-97ec-217d312ab7cd service nova] Creating event network-vif-deleted:fec2f708-b2fe-442f-9676-5104a4997d2c for instance aee54bcd-4835-4e6b-b777-07188bfb608d on nch1-master-1 May 14 21:22:33.978855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-21831717-75c8-49a0-aefe-3949f56949bf req-3415b5c7-9c3a-4d0b-97ec-217d312ab7cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051754 May 14 21:22:33.983441 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1483/3165] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:33.990090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:33.992364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:34.001513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.002958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.008193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.008884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.178205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.192373 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd00337e-17c2-49b2-9c39-4f669099c8b9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.206268 May 14 21:22:34.193550 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1484/3166] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:33 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:34.195917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.200255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:34.202491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:34.208610 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e0ae3a1-180d-4e8e-bdf7-24abf7a81d91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.317612 May 14 21:22:34.209219 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1683/3167] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:33 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:34.222371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.223257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.223912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.225065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.382454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.392274 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1d9ea850-3cb4-4168-a49e-f4e2a12c79dd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.197681 May 14 21:22:34.403882 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1485/3168] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:34 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:34.409120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:34.409937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:34.416344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.417084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.418122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.419351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.596099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:34.596899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:34.604372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.604845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.605723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.606169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.698315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.707888 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3da16faa-4814-4cfe-bda2-9383b0b772b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.302712 May 14 21:22:34.708471 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1684/3169] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:34 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:34.725675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:34.726703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:34.739898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.739898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.740391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.740895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.838140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.850464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.852358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.854884 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-050aa7fd-1f8e-4d1a-97f7-d856df7ebee9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1837 microversion: 2.42 time: 0.263800 May 14 21:22:34.855749 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1486/3170] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:34 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1837 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:34.906631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:34.907688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] [instance: aee54bcd-4835-4e6b-b777-07188bfb608d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:34.914975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.915767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.916776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:34.917431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:34.934338 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] HTTP exception thrown: Instance aee54bcd-4835-4e6b-b777-07188bfb608d could not be found. May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Request method failure captured: May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d HTTP/1.1 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB1XOyz4xeJkSfslpas2IElGezBthEO7wylRvt_vI3klsBLOJ8m1IcFLoLqPIMliPLDFOOCceV7eK6WrgF6cPlAzJKmgZGtwdv24a14ar7T9sbGELEqfLw0kjGO4qYlJfleJfvQv7xpJIlpsDzO0yMDFXWvUci3jLLHOdM4orgSMb14 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cabbde4fba484c6d83f6ae32716cf82b May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-VolumesAdminNegativeTest-2091123030 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cabbde4fba484c6d83f6ae32716cf82b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cabbde4fba484c6d83f6ae32716cf82b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cabbde4fba484c6d83f6ae32716cf82b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cabbde4fba484c6d83f6ae32716cf82b", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-VolumesAdminNegativeTest-2091123030 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cabbde4fba484c6d83f6ae32716cf82b May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2091123030 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-VolumesAdminNegativeTest-2091123030-project May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 07186d1e535e4de2ae6b8269ca10b4c6 May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-VolumesAdminNegativeTest-2091123030-project May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance aee54bcd-4835-4e6b-b777-07188bfb608d could not be found. May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'aee54bcd-4835-4e6b-b777-07188bfb608d'} May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee54bcd-4835-4e6b-b777-07188bfb608d could not be found. May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee54bcd-4835-4e6b-b777-07188bfb608d could not be found. May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:34.936298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee54bcd-4835-4e6b-b777-07188bfb608d could not be found. May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] Returning 404 to user: Instance aee54bcd-4835-4e6b-b777-07188bfb608d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd2011c5-4bf9-4a7f-b3ad-4a9466e144ff tempest-VolumesAdminNegativeTest-2091123030 tempest-VolumesAdminNegativeTest-2091123030-project] 10.222.0.52 "GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d" status: 404 len: 111 microversion: 2.1 time: 0.035592 May 14 21:22:34.940065 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1487/3171] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:34 2022] GET /compute/v2.1/servers/aee54bcd-4835-4e6b-b777-07188bfb608d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:22:34.942167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:34.955625 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a6ba023e-522a-4793-91e7-ddf88ef3199e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.234123 May 14 21:22:34.956228 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1685/3172] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:34 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:35.075105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9d9b5dfc-fbbc-445d-83f1-08dda30be456 req-2395f7cc-d5c2-45bd-b852-dc676f9a2d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "ed4b2309-b8f5-4d14-9e50-2b5701924849"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:35.091573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9d9b5dfc-fbbc-445d-83f1-08dda30be456 req-2395f7cc-d5c2-45bd-b852-dc676f9a2d7d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:35.097372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9d9b5dfc-fbbc-445d-83f1-08dda30be456 req-2395f7cc-d5c2-45bd-b852-dc676f9a2d7d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:35.101449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2125629743", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "5fb69a44-68f6-44d7-9bcb-ee9798387585"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:35.114945 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9d9b5dfc-fbbc-445d-83f1-08dda30be456 req-2395f7cc-d5c2-45bd-b852-dc676f9a2d7d service nova] Creating event network-changed:ed4b2309-b8f5-4d14-9e50-2b5701924849 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:22:35.132970 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9d9b5dfc-fbbc-445d-83f1-08dda30be456 req-2395f7cc-d5c2-45bd-b852-dc676f9a2d7d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060795 May 14 21:22:35.134066 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1488/3173] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:35.208944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] validate_networks() for [('5fb69a44-68f6-44d7-9bcb-ee9798387585', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:22:35.213547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:35.214461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:35.221580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:35.222304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:35.223278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:35.225140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:35.515760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:35.527979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-686f9f18-b3be-4f24-b98f-c5ac9d52087e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.320786 May 14 21:22:35.528596 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1489/3174] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:35 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:35.547164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:35.547886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:35.568786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:35.569243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:35.570044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:35.570977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:35.966841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:35.977231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-325cbf62-0ee6-46cb-924c-1fa56af172b2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.434038 May 14 21:22:35.980952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1490/3175] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:35 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:35.993664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9b029b95-3435-4406-bc5d-bbb1c17f6888 req-e385856f-656a-411f-98b5-8975d62e3c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9845a1d3-50d1-4a2c-9648-4780611c1777", "name": "network-vif-plugged", "status": "completed", "tag": "d34dcd4f-5a70-44e8-b76f-c601780755a3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:36.003141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9b029b95-3435-4406-bc5d-bbb1c17f6888 req-e385856f-656a-411f-98b5-8975d62e3c41 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.003839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9b029b95-3435-4406-bc5d-bbb1c17f6888 req-e385856f-656a-411f-98b5-8975d62e3c41 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:36.020917 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9b029b95-3435-4406-bc5d-bbb1c17f6888 req-e385856f-656a-411f-98b5-8975d62e3c41 service nova] Creating event network-vif-plugged:d34dcd4f-5a70-44e8-b76f-c601780755a3 for instance 9845a1d3-50d1-4a2c-9648-4780611c1777 on nch2-master-1 May 14 21:22:36.026953 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9b029b95-3435-4406-bc5d-bbb1c17f6888 req-e385856f-656a-411f-98b5-8975d62e3c41 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044370 May 14 21:22:36.027741 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1491/3176] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:36.038207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:36.039166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:36.047695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.048409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:36.049546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.050212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:36.300666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:22:36.300666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:22:36.300666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:22:36.300666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:22:36.300666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:22:36.319817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.320290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:36.321277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.321801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:36.347122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:22:36.355428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for user a42e0caa0878447f98544e74f767c7ca and project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:22:36.375103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:22:36.377721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:36.412519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:36.435431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:36.441272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:36.442764 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93c5dd8a-90f2-4996-9ecd-a747b04c4921 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1837 microversion: 2.42 time: 0.410160 May 14 21:22:36.447272 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1492/3177] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:36 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1837 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:36.546224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:36.547712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:36.554145 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-817942f6-8052-4609-a3f0-fe9e538212b6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.456625 May 14 21:22:36.558476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.561536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:36.562687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.564781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:36.565226 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1686/3178] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:22:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:22:36.579877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2dbdd63e-97c5-4c9c-8b12-7bea2f1ec876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:36.583034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2dbdd63e-97c5-4c9c-8b12-7bea2f1ec876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:36.751686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2dbdd63e-97c5-4c9c-8b12-7bea2f1ec876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:36.760940 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2dbdd63e-97c5-4c9c-8b12-7bea2f1ec876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1215 microversion: 2.1 time: 0.192947 May 14 21:22:36.762302 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1687/3179] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:36 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:36.985067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59f28836-71e8-4dd9-9b1d-2dfaa9130192 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:36.986173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-59f28836-71e8-4dd9-9b1d-2dfaa9130192 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:36.998539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59f28836-71e8-4dd9-9b1d-2dfaa9130192 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:36.999963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59f28836-71e8-4dd9-9b1d-2dfaa9130192 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.001125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59f28836-71e8-4dd9-9b1d-2dfaa9130192 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.001763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59f28836-71e8-4dd9-9b1d-2dfaa9130192 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.031903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:37.048344 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-59f28836-71e8-4dd9-9b1d-2dfaa9130192 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067649 May 14 21:22:37.049560 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1688/3180] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:22:36 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:37.060299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:37.061026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:37.069866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.080722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.081187 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1d5a2ea8-9bb1-494d-9034-f9b8d68d985d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.528260 May 14 21:22:37.081343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.081418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1493/3181] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:36 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:37.081488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.090790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:37.091298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:37.127999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.128456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.134920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.135676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.246312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lazy-loading 'services' on Instance uuid a84301d5-4d42-4c89-869c-ace2104d47d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:22:37.450779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:37.461926 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81aac162-bae1-4c9f-a7f5-2dcb286b3503 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.410455 May 14 21:22:37.463135 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1689/3182] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:37 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:37.477431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0c13c619-47e7-4069-b413-bb84aa8cf76a req-59e77f6c-4172-4a07-926e-992121fb9569 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "295d1cbd-15b9-44db-8e23-acbc4c34efab"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:37.486756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0c13c619-47e7-4069-b413-bb84aa8cf76a req-59e77f6c-4172-4a07-926e-992121fb9569 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.487267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0c13c619-47e7-4069-b413-bb84aa8cf76a req-59e77f6c-4172-4a07-926e-992121fb9569 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.501031 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0c13c619-47e7-4069-b413-bb84aa8cf76a req-59e77f6c-4172-4a07-926e-992121fb9569 service nova] Creating event network-changed:295d1cbd-15b9-44db-8e23-acbc4c34efab for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:22:37.506293 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0c13c619-47e7-4069-b413-bb84aa8cf76a req-59e77f6c-4172-4a07-926e-992121fb9569 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041615 May 14 21:22:37.506910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1690/3183] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:37.522599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:37.523529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:37.531308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.532547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.533351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:37.533792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:37.568277 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-810e4233-9564-405d-bd8c-9f8d0117e692 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments/66dac191-38b3-4bbd-bf9b-b7ff4ffce383" status: 202 len: 0 microversion: 2.1 time: 0.495609 May 14 21:22:37.572303 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1494/3184] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:22:37 2022] DELETE /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments/66dac191-38b3-4bbd-bf9b-b7ff4ffce383 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:22:37.783153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7227a02e-2ad2-46cf-bdc8-8b0f305971a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:37.783905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7227a02e-2ad2-46cf-bdc8-8b0f305971a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:37.879180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7227a02e-2ad2-46cf-bdc8-8b0f305971a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:37.898608 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7227a02e-2ad2-46cf-bdc8-8b0f305971a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1215 microversion: 2.1 time: 0.120461 May 14 21:22:37.910098 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1495/3185] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:37 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1215 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:37.975555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:37.987436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:37.989328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:37.990369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1492f9a5-a3ec-4eb9-8181-c115ed54637e tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1858 microversion: 2.42 time: 0.481981 May 14 21:22:37.991274 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1691/3186] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:37 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1858 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:38.055782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ee1871e9-be6c-437e-a2dd-69980e4aa10d req-0acec346-b1f4-42d9-a4e4-6c139e2256f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b4f8c2d-810e-45bc-acab-87cf44c9155a", "name": "network-vif-plugged", "status": "completed", "tag": "8671b6b0-61ff-4522-a9f4-1ee131e8cd0e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:38.088532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:38.089351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:38.097460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:38.098087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:38.098545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee1871e9-be6c-437e-a2dd-69980e4aa10d req-0acec346-b1f4-42d9-a4e4-6c139e2256f0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:38.099154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee1871e9-be6c-437e-a2dd-69980e4aa10d req-0acec346-b1f4-42d9-a4e4-6c139e2256f0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:38.099378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:38.099981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:38.122598 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ee1871e9-be6c-437e-a2dd-69980e4aa10d req-0acec346-b1f4-42d9-a4e4-6c139e2256f0 service nova] Creating event network-vif-plugged:8671b6b0-61ff-4522-a9f4-1ee131e8cd0e for instance 3b4f8c2d-810e-45bc-acab-87cf44c9155a on nch1-master-1 May 14 21:22:38.134332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ee1871e9-be6c-437e-a2dd-69980e4aa10d req-0acec346-b1f4-42d9-a4e4-6c139e2256f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094799 May 14 21:22:38.138352 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1496/3187] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:38.309478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:38.318793 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b1e92f36-e441-4292-95cd-fcbf20f63efd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1320 microversion: 2.1 time: 0.234690 May 14 21:22:38.324691 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1692/3188] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:38 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:38.483841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:38.485463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:38.492508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:38.493199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:38.493996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:38.494440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:38.770447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:38.792497 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2b7cde3-905f-4448-a5e1-8fe9c30459a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.314299 May 14 21:22:38.803800 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1497/3189] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:38 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:38.916085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:38.917588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:38.927330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:38.928124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:38.929103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:38.929639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.008170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:39.012786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:39.013596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:39.016659 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b706882-94e9-494f-80d3-df63614d0fa1 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1267 microversion: 2.1 time: 0.104575 May 14 21:22:39.017525 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1693/3190] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:38 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1267 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:39.024045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.024599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.025394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.025839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.320651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:39.330015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:39.332095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:39.333360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-80565492-9489-4e64-be6f-79ea429b1e2d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.326339 May 14 21:22:39.334015 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1498/3191] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:39 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:39.336863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:39.337549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:39.344947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.345402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.346268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.346715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.511392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:39.519668 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c19515d-0f96-4c77-a315-8b23cf088cfb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 200 len: 1509 microversion: 2.1 time: 0.186673 May 14 21:22:39.525208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d13004ec-788e-4014-9d65-80ded11aa7a4 req-d05daec4-7bca-460a-bed1-4c3530ff39c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "cb2ed6c9-1135-4b76-b18c-8882fea92d8d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:39.531869 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1694/3192] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:39 2022] GET /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:39.535128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d13004ec-788e-4014-9d65-80ded11aa7a4 req-d05daec4-7bca-460a-bed1-4c3530ff39c4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.535824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d13004ec-788e-4014-9d65-80ded11aa7a4 req-d05daec4-7bca-460a-bed1-4c3530ff39c4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.553934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:39.554768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 3b4f8c2d-810e-45bc-acab-87cf44c9155a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:39.563364 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d13004ec-788e-4014-9d65-80ded11aa7a4 req-d05daec4-7bca-460a-bed1-4c3530ff39c4 service nova] Creating event network-changed:cb2ed6c9-1135-4b76-b18c-8882fea92d8d for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:22:39.564984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.570775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.570775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.570775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.579003 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d13004ec-788e-4014-9d65-80ded11aa7a4 req-d05daec4-7bca-460a-bed1-4c3530ff39c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055065 May 14 21:22:39.579672 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1499/3193] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:39.812817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:39.813626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:39.825304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.826038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.827032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.827731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.865026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:39.873593 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-981b6ebb-d9a9-40c4-9fd0-cecd32f15af6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4f8c2d-810e-45bc-acab-87cf44c9155a" status: 200 len: 1320 microversion: 2.1 time: 0.323431 May 14 21:22:39.875337 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1695/3194] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:39 2022] GET /compute/v2.1/servers/3b4f8c2d-810e-45bc-acab-87cf44c9155a => generated 1320 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:39.888723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cd9d92b-26c7-4351-b0dd-23dba322151e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:39.888723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cd9d92b-26c7-4351-b0dd-23dba322151e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:39.907350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd9d92b-26c7-4351-b0dd-23dba322151e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.910146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd9d92b-26c7-4351-b0dd-23dba322151e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.911318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd9d92b-26c7-4351-b0dd-23dba322151e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:39.913417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd9d92b-26c7-4351-b0dd-23dba322151e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:39.963669 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cd9d92b-26c7-4351-b0dd-23dba322151e tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086184 May 14 21:22:39.969566 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1696/3195] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:22:39 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:22:40.032453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0ca40ef-825a-47e9-b8aa-fcd93939496a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:40.033406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c0ca40ef-825a-47e9-b8aa-fcd93939496a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:40.041677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0ca40ef-825a-47e9-b8aa-fcd93939496a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.046577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0ca40ef-825a-47e9-b8aa-fcd93939496a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.046577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0ca40ef-825a-47e9-b8aa-fcd93939496a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.046577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0ca40ef-825a-47e9-b8aa-fcd93939496a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.085124 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c0ca40ef-825a-47e9-b8aa-fcd93939496a tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060647 May 14 21:22:40.086127 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1697/3196] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:22:40 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:22:40.098232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:40.099648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:40.109170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.109764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.110705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.111789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.199394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:40.209230 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2f7d82a-87b2-4f81-b087-33df106f5f30 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.401272 May 14 21:22:40.210824 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1500/3197] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:39 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:40.230227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:40.234821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:40.244736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:40.259719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.267529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.268614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.269064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.272923 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7226ddb-a8e2-414d-8edd-a8eb2fc588a7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1275 microversion: 2.1 time: 0.185019 May 14 21:22:40.291513 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1698/3198] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:40 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:40.320761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:40.353832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:40.354549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:40.370832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.371412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.372378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.372897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.580844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:40.590595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:40.592274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:40.594064 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4f68a98-a4cb-4632-a86f-fbd58bee7762 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.244679 May 14 21:22:40.594638 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1699/3199] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:40 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:22:40.819214 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-77864633-9ec2-4fe8-ae44-108c2c1c9b01 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 204 len: 0 microversion: 2.1 time: 0.602257 May 14 21:22:40.819864 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1501/3200] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:22:40 2022] DELETE /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:22:40.829079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:40.829707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:40.848294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.848995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.849936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.850597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.893499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:40.895005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 3b4f8c2d-810e-45bc-acab-87cf44c9155a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:40.908620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.933250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:40.939663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:40.943929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.081504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:41.089680 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7009e7c8-fbc9-44e7-b8e8-f99d0484d579 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1681 microversion: 2.1 time: 0.265360 May 14 21:22:41.090491 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1700/3201] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:40 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1681 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:41.219144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:41.232084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:41.232714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:41.233149 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bfc05170-ab61-41df-8876-603d164836fc tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/3b4f8c2d-810e-45bc-acab-87cf44c9155a" status: 200 len: 1508 microversion: 2.1 time: 0.344306 May 14 21:22:41.235722 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1502/3202] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:40 2022] GET /compute/v2.1/servers/3b4f8c2d-810e-45bc-acab-87cf44c9155a => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:41.243030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.243508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.246099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.249513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.269764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:41.271037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 3b4f8c2d-810e-45bc-acab-87cf44c9155a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:41.298128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.301094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.302825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.304474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.375749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 3b4f8c2d-810e-45bc-acab-87cf44c9155a] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:41.560544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:41.569303 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1484b516-3ae8-4c59-ad9c-23d6867efd69 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.341534 May 14 21:22:41.575443 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1701/3203] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:41 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:41.591931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:41.594166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:41.603726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.605344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.609340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.610045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.840166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:41.860167 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c39d03b1-8c44-43c8-a269-8ebd86494823 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.271178 May 14 21:22:41.860167 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1702/3204] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:41 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:41.860644 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03c91223-0424-49f2-a190-e960a7580ec3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3b4f8c2d-810e-45bc-acab-87cf44c9155a" status: 204 len: 0 microversion: 2.1 time: 0.599465 May 14 21:22:41.860644 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1503/3205] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:22:41 2022] DELETE /compute/v2.1/servers/3b4f8c2d-810e-45bc-acab-87cf44c9155a => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:22:41.865854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7a45e1a8-f733-438b-a202-155d8bb48661 req-0b789dca-e2bd-402b-ac89-a8129e9636b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "54b871a9-1a1e-4062-9a50-5ddf26961b8e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:41.874475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:41.876333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:41.877589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7a45e1a8-f733-438b-a202-155d8bb48661 req-0b789dca-e2bd-402b-ac89-a8129e9636b0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.878039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7a45e1a8-f733-438b-a202-155d8bb48661 req-0b789dca-e2bd-402b-ac89-a8129e9636b0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.884889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.885991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.887392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.888149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.904141 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7a45e1a8-f733-438b-a202-155d8bb48661 req-0b789dca-e2bd-402b-ac89-a8129e9636b0 service nova] Creating event network-changed:54b871a9-1a1e-4062-9a50-5ddf26961b8e for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:22:41.910070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7a45e1a8-f733-438b-a202-155d8bb48661 req-0b789dca-e2bd-402b-ac89-a8129e9636b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057467 May 14 21:22:41.911592 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1504/3206] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:41.919943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:41.920512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:41.929338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.930355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.931913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:41.932386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:41.966128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 9845a1d3-50d1-4a2c-9648-4780611c1777] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:42.094390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:42.104324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:42.106318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:42.107936 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7084412c-976c-4cc9-b7da-7df8a9a746ef tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.257481 May 14 21:22:42.125587 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1703/3207] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:41 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:42.126395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:42.127397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:42.134708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:42.135244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:42.136498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:42.136961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:42.300545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:42.337934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ddee1153-c4dd-4dee-9c09-d6f39207f04f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1681 microversion: 2.1 time: 0.215351 May 14 21:22:42.347621 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1704/3208] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:42 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:42.563666 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f52561f-a21c-4d2f-80f6-6351924b3ba0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777" status: 204 len: 0 microversion: 2.1 time: 0.649999 May 14 21:22:42.565085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1505/3209] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:22:41 2022] DELETE /compute/v2.1/servers/9845a1d3-50d1-4a2c-9648-4780611c1777 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:22:42.594596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:42.595581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:42.602882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:42.603676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:42.604695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:42.605342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:42.709433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-707102475", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "18a13367-d709-44a6-83ee-a5a75d3ef57e"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:42.815662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] validate_networks() for [('18a13367-d709-44a6-83ee-a5a75d3ef57e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:22:42.928029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:42.957497 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24f61b71-ea3e-4ff7-b6b9-a4720f6401e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.355591 May 14 21:22:42.957497 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1705/3210] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:42 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:42.969448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:42.970607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:42.987203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:42.988113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:42.989123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:42.990197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:43.398612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:43.407263 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b38d7ced-8b87-426b-9d6c-5a77db3dfa45 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.448038 May 14 21:22:43.407888 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1706/3211] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:42 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:43.412888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:43.413789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:43.421509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:43.422373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:43.423340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:43.423813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:43.633779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:43.648861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:43.651979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:43.658541 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-21cf0197-a651-4e0d-bada-272a5d4c2f0d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.244182 May 14 21:22:43.658541 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1707/3212] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:43 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:43.659374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:43.660021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:43.666085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:43.666537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:43.667309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:43.667950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:43.822639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:43.831526 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea0c3d45-6b8b-4241-8358-8246406a4073 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1681 microversion: 2.1 time: 0.176716 May 14 21:22:43.832125 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1708/3213] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:43 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:43.964832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:43.965733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:43.973772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:43.974711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:43.976663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:43.978272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:44.142144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:44.150595 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6a310d8-0e02-4001-ac59-70f818bc0a52 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.189986 May 14 21:22:44.151361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1709/3214] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:43 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:44.181072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6ed6deca-ca9a-48ce-8d9c-a8828c37eb35 req-6d529f2d-7644-4ddc-92ea-75c9a17a117e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "150fe679-5889-44eb-bcc1-bbb9d924b590"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:44.190114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6ed6deca-ca9a-48ce-8d9c-a8828c37eb35 req-6d529f2d-7644-4ddc-92ea-75c9a17a117e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:44.190802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6ed6deca-ca9a-48ce-8d9c-a8828c37eb35 req-6d529f2d-7644-4ddc-92ea-75c9a17a117e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:44.204202 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6ed6deca-ca9a-48ce-8d9c-a8828c37eb35 req-6d529f2d-7644-4ddc-92ea-75c9a17a117e service nova] Creating event network-changed:150fe679-5889-44eb-bcc1-bbb9d924b590 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:22:44.210716 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6ed6deca-ca9a-48ce-8d9c-a8828c37eb35 req-6d529f2d-7644-4ddc-92ea-75c9a17a117e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 May 14 21:22:44.214066 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1710/3215] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:22:44.425170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:44.425978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:44.432419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:44.432984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:44.433981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:44.434520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:44.688074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:44.697479 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f1c50583-7546-4a4b-90cc-adae4557704a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.276763 May 14 21:22:44.699378 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1711/3216] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:44 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:44.704263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:44.704934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:44.711620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:44.712285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:44.713074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:44.713521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:44.973524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:44.985659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:44.988052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:44.989504 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e5af25b-8671-4c14-9b11-1d63bef47502 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.289058 May 14 21:22:44.990239 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1712/3217] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:44 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:44.999668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:44.999668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:45.005753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.006291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.007296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.007796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.142422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:22:45.142949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:22:45.143671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:22:45.144175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:22:45.144743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:22:45.145711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:45.159790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.159790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.159993 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7d0ecfbc-ca72-4458-b5dc-b1fee081f051 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1681 microversion: 2.1 time: 0.164266 May 14 21:22:45.160079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.160156 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1713/3218] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:44 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:45.160233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.171557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:45.172376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:45.179362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Getting quotas for project f589f7d7ad0f4b63afd4132efa4e798a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:22:45.184236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.184694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.185492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.186059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Getting quotas for user beb60582a8ae4b2499db4a45da00512f and project f589f7d7ad0f4b63afd4132efa4e798a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:22:45.186194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.203055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Going to run 2 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:22:45.206793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 2225cca2-af55-4314-b378-e65945e6738b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:45.347022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=2225cca2-af55-4314-b378-e65945e6738b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:45.363249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:45.370685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d50429f3-c62d-49f9-95df-abbac8017a79 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.203119 May 14 21:22:45.371517 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1714/3219] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:45 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:45.606539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e2955a2-9773-4f1c-aaf9-74ea2fee2f64 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.901397 May 14 21:22:45.619524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1506/3220] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:22:42 2022] POST /compute/v2.1/servers => generated 32 bytes in 2909 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 14 21:22:45.644455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:45.653663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:45.655087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Searching by: {'deleted': False, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:22:45.681843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.682401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.683519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.684322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.722550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:45.722550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:45.729557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.730807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.731403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:22:45.734630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:45.735759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:45.823900 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea1e0dce-0a46-49da-83fb-eb749e827701 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.193055 May 14 21:22:45.824583 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1715/3221] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:22:45 2022] GET /compute/v2.1/servers => generated 1335 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:45.836744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24ece9d2-3b5e-4520-9b89-fa625c43f9c5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:45.837486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24ece9d2-3b5e-4520-9b89-fa625c43f9c5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:45.916854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-24ece9d2-3b5e-4520-9b89-fa625c43f9c5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:45.928798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24ece9d2-3b5e-4520-9b89-fa625c43f9c5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1217 microversion: 2.1 time: 0.097179 May 14 21:22:45.930939 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1716/3222] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:45 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:46.009798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:46.010516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:46.024906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:46.026243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:46.029194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:46.031316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:46.320611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:46.336196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:46.340364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:46.343074 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2095174-298f-437d-be70-5a796f6a8bbd tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.336860 May 14 21:22:46.345460 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1717/3223] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:46 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:46.353397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:46.353846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:46.363916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:46.364689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:46.365849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:46.366430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:46.375834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:46.402611 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-592a818b-8d90-4c9f-868d-b48636012795 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.679538 May 14 21:22:46.408220 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1507/3224] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:45 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:46.419776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ebf80612-9e39-4f19-b895-a3f36dd429c8 req-b35b5072-3828-4da9-bb4b-6dc4a1455834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85e9d3a-7530-4290-96bd-ed993a51bea3", "tag": "e4b19477-e7fa-47f0-9ae9-9db5cf586364"}, {"server_uuid": "3b4f8c2d-810e-45bc-acab-87cf44c9155a", "name": "network-vif-deleted", "tag": "8671b6b0-61ff-4522-a9f4-1ee131e8cd0e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:46.441781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ebf80612-9e39-4f19-b895-a3f36dd429c8 req-b35b5072-3828-4da9-bb4b-6dc4a1455834 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:46.442498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ebf80612-9e39-4f19-b895-a3f36dd429c8 req-b35b5072-3828-4da9-bb4b-6dc4a1455834 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:46.468841 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ebf80612-9e39-4f19-b895-a3f36dd429c8 req-b35b5072-3828-4da9-bb4b-6dc4a1455834 service nova] Creating event network-changed:e4b19477-e7fa-47f0-9ae9-9db5cf586364 for instance d85e9d3a-7530-4290-96bd-ed993a51bea3 on nch1-master-1 May 14 21:22:46.469868 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ebf80612-9e39-4f19-b895-a3f36dd429c8 req-b35b5072-3828-4da9-bb4b-6dc4a1455834 service nova] Creating event network-vif-deleted:8671b6b0-61ff-4522-a9f4-1ee131e8cd0e for instance 3b4f8c2d-810e-45bc-acab-87cf44c9155a on nch1-master-1 May 14 21:22:46.476952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ebf80612-9e39-4f19-b895-a3f36dd429c8 req-b35b5072-3828-4da9-bb4b-6dc4a1455834 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.066659 May 14 21:22:46.478251 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1508/3225] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:46.484405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:46.485491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:46.505553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:46.506299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:46.507597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:46.508499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:46.590845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:46.600908 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0f0cf3bf-7ca7-4699-bf70-7ebe833f78d9 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1614 microversion: 2.1 time: 0.252118 May 14 21:22:46.605349 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1718/3226] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:46 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1614 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:46.866041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:46.879732 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c669f6a-ae14-4b1f-bb41-9339cca07d9d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.400042 May 14 21:22:46.880456 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1509/3227] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:46 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:46.948054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec8bffe4-3c33-404e-a5ab-321da5912bb0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:46.949363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ec8bffe4-3c33-404e-a5ab-321da5912bb0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:47.084012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ec8bffe4-3c33-404e-a5ab-321da5912bb0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:47.092348 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec8bffe4-3c33-404e-a5ab-321da5912bb0 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1217 microversion: 2.1 time: 0.148094 May 14 21:22:47.096453 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1719/3228] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:46 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:47.364013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:47.364796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:47.371714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.372550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:47.373999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.374882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:47.426389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:47.427254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:47.441329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.445936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:47.445936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.445936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:47.642178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:47.652801 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81b83527-b7a9-4cfd-a487-d811c4dcfe88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.231756 May 14 21:22:47.657739 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1720/3229] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:47 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:47.663676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:47.665522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:47.672634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.673290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:47.674238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.674888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:47.757453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:47.769597 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24e80adb-215e-4730-8b73-909ae17d4549 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1614 microversion: 2.1 time: 0.111686 May 14 21:22:47.780781 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1721/3230] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:47 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1614 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:47.905932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:47.905932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:47.925534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.925995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:47.926785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:47.929906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:48.051767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:48.062304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:48.066575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:48.066716 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d9810c48-6b80-47b5-bef9-077a36ce4e0b tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.706931 May 14 21:22:48.071944 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1510/3231] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:47 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:48.116032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-806edd3e-5023-4a2c-8aeb-281aac25bcfd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:48.116857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-806edd3e-5023-4a2c-8aeb-281aac25bcfd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:48.275464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-806edd3e-5023-4a2c-8aeb-281aac25bcfd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:48.285275 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-806edd3e-5023-4a2c-8aeb-281aac25bcfd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1217 microversion: 2.1 time: 0.177835 May 14 21:22:48.290905 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1511/3232] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:48 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:48.448935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:48.460676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-207ee68c-0e48-4cd4-864b-64befaa3c01d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.566604 May 14 21:22:48.461692 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1722/3233] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:47 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:48.513162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cd301d37-88c5-4d1e-8d6a-6b9d92a35120 req-e7e2606c-bba3-4cb1-b233-297691addd47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9845a1d3-50d1-4a2c-9648-4780611c1777", "name": "network-vif-deleted", "tag": "d34dcd4f-5a70-44e8-b76f-c601780755a3"}, {"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "d09b3141-d774-4a45-8f42-7303f69488da"}, {"server_uuid": "a84301d5-4d42-4c89-869c-ace2104d47d2", "name": "network-vif-deleted", "tag": "49711784-f5dd-4fdf-bf81-805e6683243c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:48.525118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cd301d37-88c5-4d1e-8d6a-6b9d92a35120 req-e7e2606c-bba3-4cb1-b233-297691addd47 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:48.525577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cd301d37-88c5-4d1e-8d6a-6b9d92a35120 req-e7e2606c-bba3-4cb1-b233-297691addd47 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:48.541823 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cd301d37-88c5-4d1e-8d6a-6b9d92a35120 req-e7e2606c-bba3-4cb1-b233-297691addd47 service nova] Creating event network-vif-deleted:d34dcd4f-5a70-44e8-b76f-c601780755a3 for instance 9845a1d3-50d1-4a2c-9648-4780611c1777 on nch2-master-1 May 14 21:22:48.542657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cd301d37-88c5-4d1e-8d6a-6b9d92a35120 req-e7e2606c-bba3-4cb1-b233-297691addd47 service nova] Creating event network-changed:d09b3141-d774-4a45-8f42-7303f69488da for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:22:48.543365 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cd301d37-88c5-4d1e-8d6a-6b9d92a35120 req-e7e2606c-bba3-4cb1-b233-297691addd47 service nova] Creating event network-vif-deleted:49711784-f5dd-4fdf-bf81-805e6683243c for instance a84301d5-4d42-4c89-869c-ace2104d47d2 on nch2-master-1 May 14 21:22:48.553577 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cd301d37-88c5-4d1e-8d6a-6b9d92a35120 req-e7e2606c-bba3-4cb1-b233-297691addd47 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.045553 May 14 21:22:48.554197 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1512/3234] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:48.673517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:48.673674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:48.684472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:48.685997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:48.689022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:48.691223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:48.787127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:48.787881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:48.808591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:48.809301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:48.814974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:48.814974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:48.908972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:48.909673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:48.910289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lazy-loading 'fault' on Instance uuid a84301d5-4d42-4c89-869c-ace2104d47d2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:22:49.089858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2ef9ae6c6d24ba0b85fd8f41afb9c05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c96286063c40ac948610903a50e98f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:49.099820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd320d3d-9e8d-4885-b80e-2b95f4a37b07 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 200 len: 1332 microversion: 2.1 time: 0.317172 May 14 21:22:49.115247 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1513/3235] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:48 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 1332 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:49.128709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:49.129333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:49.154076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:49.158272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:49.160463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:49.161460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:49.164140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:49.166262 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac40bd9d-db6b-45b7-8bf2-bc0143165c8a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.497227 May 14 21:22:49.178843 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1723/3236] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:48 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:49.309510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:49.310359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:49.321133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:49.322523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:49.326351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:49.328463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:49.469699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:49.489448 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-328de8cb-045d-45d3-abfa-e1225d6cdc76 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1269 microversion: 2.1 time: 0.185526 May 14 21:22:49.496761 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1724/3237] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:49 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:49.525104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:49.532907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:49.559138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:49.561965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:49.563285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:49.564002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:49.692942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:49.706077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:49.710278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:49.712833 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bfc9025-9e82-407d-9d56-d757b2a69156 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.596206 May 14 21:22:49.715008 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1514/3238] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:49 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:50.086616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:50.099253 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a7c33141-2e1c-4970-bfa7-4eb3eed79e91 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.594980 May 14 21:22:50.100391 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1725/3239] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:49 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:50.133589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:50.134237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:50.162206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.164656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.171753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.172617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.187281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:50.188743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:50.202414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.206566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.213129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.213630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.248156 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] HTTP exception thrown: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Request method failure captured: May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 HTTP/1.1 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0if91-rovseJqE_aTHZRH9jRSDtM4BfZZFoe7mVic7zH8lI8RrSYU6aA3QWMWdFHBJD__0TLzn5Wd87dwjkZO_KpH-M1YslKO879xPr0SlqlnuQF9KhIcSPo7T0mooihIm2mVTQK9G0GG4GNsDYwPKPkXy8v7gU-EJA7cgzK8HfQQ May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 44c96286063c40ac948610903a50e98f May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/44c96286063c40ac948610903a50e98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/44c96286063c40ac948610903a50e98f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/44c96286063c40ac948610903a50e98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_44c96286063c40ac948610903a50e98f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 44c96286063c40ac948610903a50e98f May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachSCSIVolumeTestJSON-1113285562-project May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: f2ef9ae6c6d24ba0b85fd8f41afb9c05 May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1113285562-project May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'a84301d5-4d42-4c89-869c-ace2104d47d2'} May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:22:50.257365 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Returning 404 to user: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:22:50.262243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c06961b-a7f5-49dd-8199-579da004576f tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 404 len: 111 microversion: 2.1 time: 0.131804 May 14 21:22:50.268008 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1515/3240] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:50 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:22:50.295631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97f20ce9-1b1d-4ba7-ae8f-aa44c403aabe tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '.version_select at 0x7fb1a6e04dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:50.396603 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97f20ce9-1b1d-4ba7-ae8f-aa44c403aabe tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437584933" status: 202 len: 0 microversion: 2.1 time: 0.127244 May 14 21:22:50.399395 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1516/3241] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:22:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437584933 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:22:50.531859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:50.532524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:50.557631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.558100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.558919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.562603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.781893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:50.796388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fda24ea3-e2ed-4494-8a7c-58aa2380b3b2 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1275 microversion: 2.1 time: 0.274263 May 14 21:22:50.797602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1517/3242] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:50 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1275 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:50.807017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-87ece1aa-fc93-4769-83a9-d8163c68a65c req-7a9d77c2-e14d-4a7d-8edf-c05ceb908433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "5fe9ffa2-546d-42d9-a88d-11e41c94e5f9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:50.821220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-87ece1aa-fc93-4769-83a9-d8163c68a65c req-7a9d77c2-e14d-4a7d-8edf-c05ceb908433 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.821670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-87ece1aa-fc93-4769-83a9-d8163c68a65c req-7a9d77c2-e14d-4a7d-8edf-c05ceb908433 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.841121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-87ece1aa-fc93-4769-83a9-d8163c68a65c req-7a9d77c2-e14d-4a7d-8edf-c05ceb908433 service nova] Creating event network-changed:5fe9ffa2-546d-42d9-a88d-11e41c94e5f9 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:22:50.848616 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-87ece1aa-fc93-4769-83a9-d8163c68a65c req-7a9d77c2-e14d-4a7d-8edf-c05ceb908433 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049569 May 14 21:22:50.850974 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1518/3243] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:50.858776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:50.862133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:50.873197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.875701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.876883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:50.877493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:50.980880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:50.993717 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2cb84bf9-19bb-434d-ac52-ccef11bbacc8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.811517 May 14 21:22:51.003792 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1726/3244] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:50 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:51.118657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:51.119416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:51.131902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:51.132684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:51.133651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:51.134265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:51.471446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:51.503623 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1919425c-ad6d-43a2-9909-9a6cc22651f4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.370203 May 14 21:22:51.503623 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1727/3245] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:51 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:51.560266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:51.578043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:51.581770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:51.586199 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a55dd62d-f597-4472-9577-9f36dfbd68d2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.730642 May 14 21:22:51.586199 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1519/3246] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:50 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:51.816376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:51.817281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:51.826005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:51.827591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:51.832357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:51.838054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:51.984180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:51.996753 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28cf5a4d-8ee8-47c4-9b98-81a0560fbca6 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1275 microversion: 2.1 time: 0.186720 May 14 21:22:52.006745 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1728/3247] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:51 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:52.010269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:52.010897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:52.026910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:52.026910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:52.027671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:52.029473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:52.502509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:52.503509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:52.510614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:52.511509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:52.512567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:52.513299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:52.963428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:52.976702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:52.984523 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b88301b0-1bd3-4622-a7d6-014a47b47c46 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.978151 May 14 21:22:52.985763 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e4ca0f91-d84f-43f5-a4f8-d8c978be4d6a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.482652 May 14 21:22:52.986815 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1729/3248] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:52 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:52.994878 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1520/3249] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:52 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:53.014668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:53.015740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6f3b195f-fc1e-45ec-893f-b65dcbb8286d req-5772d9a7-5553-4a01-8e7b-18057c6e0472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85e9d3a-7530-4290-96bd-ed993a51bea3", "name": "network-vif-plugged", "status": "completed", "tag": "e4b19477-e7fa-47f0-9ae9-9db5cf586364"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:53.017097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:53.046919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:53.051516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:53.056549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6f3b195f-fc1e-45ec-893f-b65dcbb8286d req-5772d9a7-5553-4a01-8e7b-18057c6e0472 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:53.057316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:53.057509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6f3b195f-fc1e-45ec-893f-b65dcbb8286d req-5772d9a7-5553-4a01-8e7b-18057c6e0472 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:53.057598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:53.085226 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6f3b195f-fc1e-45ec-893f-b65dcbb8286d req-5772d9a7-5553-4a01-8e7b-18057c6e0472 service nova] Creating event network-vif-plugged:e4b19477-e7fa-47f0-9ae9-9db5cf586364 for instance d85e9d3a-7530-4290-96bd-ed993a51bea3 on nch1-master-1 May 14 21:22:53.096453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6f3b195f-fc1e-45ec-893f-b65dcbb8286d req-5772d9a7-5553-4a01-8e7b-18057c6e0472 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090299 May 14 21:22:53.097699 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1521/3250] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:53.131890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:53.133962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:53.159740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:53.160539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:53.161621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:53.162615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:53.447462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:53.458480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:53.460584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:53.462027 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd26a049-9c5f-406d-89a7-64771e86b1d8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.457381 May 14 21:22:53.462979 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1730/3251] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:52 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:53.480804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:53.490695 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9350efeb-5504-4c32-b9d1-45fa5ed08adb tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1275 microversion: 2.1 time: 0.390964 May 14 21:22:53.491750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1522/3252] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:53 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1275 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:54.007359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:54.007359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:54.013773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.014549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:54.016475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.016907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:54.017791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.018391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.038134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.039889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.040788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.042652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.380709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:54.393398 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-73eb1455-5c61-4c64-8a85-1e67d8ca3384 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1513 microversion: 2.1 time: 0.395074 May 14 21:22:54.411158 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1731/3253] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:53 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1513 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:54.483048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:54.483773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:54.494175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.494660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.495440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.500974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.741858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:54.750911 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0323656-6e65-4d54-9c3e-4fa3798f423b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1315 microversion: 2.1 time: 0.741436 May 14 21:22:54.753789 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1523/3254] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:54 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:54.771400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:54.772431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:54.780227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.780856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.781795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:54.782302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:54.947367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:54.960412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:54.961949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:54.963797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae035675-b892-4700-b5b0-9ba946ea8bc6 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.485062 May 14 21:22:54.965048 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1732/3255] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:54 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:55.357109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:55.369513 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b6d5b5c3-c26e-4390-b7f8-6e7087fea572 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.607937 May 14 21:22:55.378813 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1524/3256] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:54 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:55.410372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:55.411112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:55.422079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:55.422818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:55.423851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:55.424302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:55.698702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f0efa14-7db9-4c7f-8cc2-819a0201a156 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:55.699871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f0efa14-7db9-4c7f-8cc2-819a0201a156 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:55.710849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0efa14-7db9-4c7f-8cc2-819a0201a156 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:55.711312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0efa14-7db9-4c7f-8cc2-819a0201a156 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:55.717583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0efa14-7db9-4c7f-8cc2-819a0201a156 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:55.718053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f0efa14-7db9-4c7f-8cc2-819a0201a156 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:55.806807 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f0efa14-7db9-4c7f-8cc2-819a0201a156 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "POST /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c/action" status: 200 len: 24566 microversion: 2.1 time: 0.506690 May 14 21:22:55.807469 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1733/3257] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:22:55 2022] POST /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c/action => generated 24566 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:22:55.818504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:55.824984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:55.835890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:55.862726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:55.862726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:55.863395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.005614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.015569 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b7d71020-9840-49ae-8b5c-062b0b1b9efd tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1490 microversion: 2.1 time: 0.609059 May 14 21:22:56.028001 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1525/3258] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:55 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1490 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:22:56.028001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:56.036510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.036510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Searching by: {'deleted': False, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:22:56.037192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.037837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.038739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.039249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.070210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:22:56.132704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8cada85-ae25-4209-bdb3-a244ada92bef tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.112318 May 14 21:22:56.143568 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1526/3259] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:22:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:56.143568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:56.147288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:56.150711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.151176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.151994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.152429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.272688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.281359 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-be2dac2c-0346-47dd-8370-53b5c0f0a28a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1502 microversion: 2.1 time: 0.471572 May 14 21:22:56.282856 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1734/3260] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:55 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1502 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:56.288238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:56.288974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:56.296411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.297050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.298039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.298489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.327053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:22:56.631775 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0ab7e80-b013-4345-91e0-4d27a50517b3 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 204 len: 0 microversion: 2.1 time: 0.347354 May 14 21:22:56.633527 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1735/3261] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:22:56 2022] DELETE /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:22:56.640040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:56.643376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.644273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Searching by: {'deleted': False, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:22:56.650143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.650608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.651423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.652010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.684396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:22:56.697535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.711871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.717650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.729002 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b02ef965-22e0-4cb9-8dba-31aef2cf41a9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.590351 May 14 21:22:56.729930 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1527/3262] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:56 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:56.735750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:56.736501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:56.737143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:56.745591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.746548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.746757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.747019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.750366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.751000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.930362 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-419c2d4c-491a-42b4-9354-6e7c31ab6bcf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.294575 May 14 21:22:56.931043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1736/3263] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:22:56 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:56.940588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:56.943530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:56.957608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.963685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:56.963685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:56.963685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:57.118735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:57.128066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8f7218de-329b-4784-a5be-23d1e687bbec tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.195674 May 14 21:22:57.128663 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1737/3264] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:56 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:57.135462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-37c6cd2b-f289-4ed6-bb3a-d640544b312a req-e2db6495-7f1a-4b51-a0be-b0808927b35e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2225cca2-af55-4314-b378-e65945e6738b", "tag": "df6ad504-9db2-4d27-a0c0-ff808265d93b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:57.150247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-37c6cd2b-f289-4ed6-bb3a-d640544b312a req-e2db6495-7f1a-4b51-a0be-b0808927b35e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:57.150702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-37c6cd2b-f289-4ed6-bb3a-d640544b312a req-e2db6495-7f1a-4b51-a0be-b0808927b35e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:57.166481 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-37c6cd2b-f289-4ed6-bb3a-d640544b312a req-e2db6495-7f1a-4b51-a0be-b0808927b35e service nova] Creating event network-changed:df6ad504-9db2-4d27-a0c0-ff808265d93b for instance 2225cca2-af55-4314-b378-e65945e6738b on nch2-master-1 May 14 21:22:57.171283 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-37c6cd2b-f289-4ed6-bb3a-d640544b312a req-e2db6495-7f1a-4b51-a0be-b0808927b35e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041316 May 14 21:22:57.172190 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1738/3265] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:57.177905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:57.178232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:57.186555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:57.187011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:57.187858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:57.188302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:57.465502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:57.474384 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9422b30-554b-4193-8a7c-275faf94dbaa tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1496 microversion: 2.1 time: 0.301170 May 14 21:22:57.474991 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1739/3266] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:57 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1496 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:57.552669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.network.security_group_api [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Removing security group 28892892-771e-42d9-9034-0e43482d5785 from port e4b19477-e7fa-47f0-9ae9-9db5cf586364 May 14 21:22:57.688815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1211471074", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "b6600266-4425-42b1-a9f0-5eddc540b575"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:57.759089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] validate_networks() for [('b6600266-4425-42b1-a9f0-5eddc540b575', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:22:58.203033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:22:58.204035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:22:58.204035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:22:58.204603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:22:58.205289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:22:58.219808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:58.220381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:58.221303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:58.227725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:58.246754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Getting quotas for project 155b6f457be24818bb00db2560ef96fe. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:22:58.254105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Getting quotas for user a7f2d4818aa7461da8f30ddfe7641d93 and project 155b6f457be24818bb00db2560ef96fe. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:22:58.274763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:22:58.280119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:22:58.438901 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ca44620-e17e-4fe5-b13c-0921bbcd9b1d tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962550 May 14 21:22:58.440262 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1740/3267] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:22:58.446679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19320dee-ac4a-4bf9-b770-1a1ae11bbd09 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:58.463022 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19320dee-ac4a-4bf9-b770-1a1ae11bbd09 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020768 May 14 21:22:58.465143 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1741/3268] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:22:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:58.479259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:58.486200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:58.502493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:58.502493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:58.502493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:58.504626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:58.887535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:58.899162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:58.901362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:58.902948 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de1726f3-ba5d-4fed-81bf-c733a44db2b2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.436705 May 14 21:22:58.904284 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1742/3269] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:58 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:22:58.913371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:58.914795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:58.922804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:58.923346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:58.924248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:58.924853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.202373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:59.211637 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0e55aa7-7e2c-45df-b778-4fad0dcc0b0d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.304766 May 14 21:22:59.215165 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1743/3270] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:58 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:59.219932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-004d096a-63f4-41b3-96cc-742e62d9365f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:59.220829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-004d096a-63f4-41b3-96cc-742e62d9365f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:59.316074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-004d096a-63f4-41b3-96cc-742e62d9365f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:59.316074 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-004d096a-63f4-41b3-96cc-742e62d9365f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1224 microversion: 2.1 time: 0.096099 May 14 21:22:59.316074 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1744/3271] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:59 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:59.324217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:59.324849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:59.339389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.343353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.344235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.344686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.565208 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5aa9aae-a5f0-42c6-a467-de04e1d6e64c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3/action" status: 202 len: 0 microversion: 2.1 time: 2.833876 May 14 21:22:59.569237 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1528/3272] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:22:56 2022] POST /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3/action => generated 0 bytes in 2836 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:22:59.571101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ac3e200d-2f57-4b5f-b294-8790b2b63f2c req-9ac1dcc7-163d-4e54-8993-d7698e2db56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee92d0d1-cd16-4d03-809b-e0c6c9d2757f", "tag": "00931368-ab9a-4f28-b1fa-c6e357b7b760"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:22:59.604446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ac3e200d-2f57-4b5f-b294-8790b2b63f2c req-9ac1dcc7-163d-4e54-8993-d7698e2db56a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.604913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ac3e200d-2f57-4b5f-b294-8790b2b63f2c req-9ac1dcc7-163d-4e54-8993-d7698e2db56a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.619788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:59.633594 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-564c5eba-c29e-43a5-8f30-933ed09b6ed4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1496 microversion: 2.1 time: 0.316973 May 14 21:22:59.635073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1745/3273] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:59 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1496 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:59.645917 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ac3e200d-2f57-4b5f-b294-8790b2b63f2c req-9ac1dcc7-163d-4e54-8993-d7698e2db56a service nova] Creating event network-changed:00931368-ab9a-4f28-b1fa-c6e357b7b760 for instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f on nch1-master-1 May 14 21:22:59.657168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:59.657867 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ac3e200d-2f57-4b5f-b294-8790b2b63f2c req-9ac1dcc7-163d-4e54-8993-d7698e2db56a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090143 May 14 21:22:59.658473 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1529/3274] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:22:59.658860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:59.667203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.669874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.672346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.673021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.842345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:22:59.850310 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1aca9516-1f9b-46e5-9aae-3eff938a8c89 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1460 microversion: 2.1 time: 0.200045 May 14 21:22:59.850915 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1746/3275] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:59 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1460 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:22:59.871251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:59.872752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:59.885446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.890525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.891721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.892404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.923698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:22:59.924311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:22:59.932867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.935286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:22:59.936695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:22:59.937141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.234088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.243020 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-686e0339-2e65-47b1-9a47-6f9051655565 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.378587 May 14 21:23:00.243965 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1530/3276] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:22:59 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:00.260496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:00.261866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:00.270004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.270620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.270765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.272131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.272684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.292122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.293960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.297715 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-175b1045-90f4-4906-af4c-3cc7f8888693 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.376936 May 14 21:23:00.301967 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1747/3277] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:22:59 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:00.312177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:00.317221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:00.330428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.330891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.332840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.333288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.452933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.472170 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a98d9d87-c686-4bc2-81bf-eb21ccf01751 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.227001 May 14 21:23:00.481640 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1531/3278] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:00 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:00.488149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:00.489039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:00.499454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.503459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.503459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.503459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.564422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.579184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2ad101b-7c66-4855-8faf-88fde59d295c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.276064 May 14 21:23:00.580789 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1748/3279] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:00 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:00.596744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:00.598074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:00.604537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.609311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.609311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.609311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.653933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.666418 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e35b1f65-b7eb-4598-8513-078ce8c711f8 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1228 microversion: 2.1 time: 0.183405 May 14 21:23:00.700632 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1532/3280] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:00 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1228 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:00.729759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:00.730914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:00.754137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.756008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.759200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.759870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.897303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:00.914415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2e69a26-06f3-4162-9ef2-e51040b68f49 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.321596 May 14 21:23:00.937991 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1749/3281] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:00 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:00.943407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:00.944496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:00.952082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.952562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:00.953960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:00.955035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:01.123844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:01.132463 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89f4e1d5-33d4-4fc9-a16e-ab62775dcaf4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.193087 May 14 21:23:01.149236 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1750/3282] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:00 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:01.285279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1185975591", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "5fb69a44-68f6-44d7-9bcb-ee9798387585"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:01.364368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] validate_networks() for [('5fb69a44-68f6-44d7-9bcb-ee9798387585', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:23:01.437025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:01.444884 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3d6adf9-d234-4088-b815-223dc68976a4 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 200 len: 1454 microversion: 2.1 time: 0.742236 May 14 21:23:01.455377 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1533/3283] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:00 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 1454 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:01.460778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:01.461414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:01.472993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:01.473702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:01.474650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:01.475247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:01.961745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:23:01.963158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:23:01.963944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:23:01.964497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:23:01.965064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:23:01.972312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:01.977067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:01.977641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:01.978597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:01.979154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:01.987968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:01.993243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:01.994933 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a54b9628-8b34-49eb-9753-42abe28a651c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.538393 May 14 21:23:01.997410 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1534/3284] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:01 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:02.002878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:23:02.009225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Getting quotas for user a42e0caa0878447f98544e74f767c7ca and project a924ca59a9ac44cf96e53be012a43af1. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:23:02.016450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:02.017319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:02.027458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:02.028061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:23:02.028763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:02.030266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:02.030948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:23:02.031126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:02.239205 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1eace005-52d6-4d0b-8549-44c03117fa4e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.959291 May 14 21:23:02.241351 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1751/3285] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:23:02.264256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:02.264256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:02.264256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:02.264256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:02.264256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:02.264256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:02.463616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:02.489321 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0649f8c-8c45-473f-a66b-352663db2a18 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1276 microversion: 2.1 time: 0.246725 May 14 21:23:02.492998 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1752/3286] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:02 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1276 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:02.508351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c5fc358d-ead3-4985-b046-ff32e36bf812 req-d6c96161-207f-490b-95d8-e888a73beed5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d85e9d3a-7530-4290-96bd-ed993a51bea3", "tag": "e4b19477-e7fa-47f0-9ae9-9db5cf586364"}, {"server_uuid": "43bbc2dd-60e5-44e4-9601-74231273003b", "name": "network-vif-deleted", "tag": "721a641c-f7ca-4d65-8daf-95a62b1570d4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:02.520384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c5fc358d-ead3-4985-b046-ff32e36bf812 req-d6c96161-207f-490b-95d8-e888a73beed5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:02.521190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c5fc358d-ead3-4985-b046-ff32e36bf812 req-d6c96161-207f-490b-95d8-e888a73beed5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:02.539434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c5fc358d-ead3-4985-b046-ff32e36bf812 req-d6c96161-207f-490b-95d8-e888a73beed5 service nova] Creating event network-changed:e4b19477-e7fa-47f0-9ae9-9db5cf586364 for instance d85e9d3a-7530-4290-96bd-ed993a51bea3 on nch1-master-1 May 14 21:23:02.540194 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c5fc358d-ead3-4985-b046-ff32e36bf812 req-d6c96161-207f-490b-95d8-e888a73beed5 service nova] Creating event network-vif-deleted:721a641c-f7ca-4d65-8daf-95a62b1570d4 for instance 43bbc2dd-60e5-44e4-9601-74231273003b on nch2-master-1 May 14 21:23:02.550096 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c5fc358d-ead3-4985-b046-ff32e36bf812 req-d6c96161-207f-490b-95d8-e888a73beed5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055083 May 14 21:23:02.550946 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1753/3287] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:02.557224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f801c51c-a9f8-4a6b-8853-127c555a1593 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:02.557928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f801c51c-a9f8-4a6b-8853-127c555a1593 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:02.634340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f801c51c-a9f8-4a6b-8853-127c555a1593 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:02.643097 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f801c51c-a9f8-4a6b-8853-127c555a1593 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1215 microversion: 2.1 time: 0.090672 May 14 21:23:02.644910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1754/3288] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:02 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:02.652692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:02.653708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:02.661367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:02.662092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:02.663030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:02.663661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:02.679097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:02.688964 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2716deca-457b-4fe2-b028-9024915a63cd tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.690463 May 14 21:23:02.689567 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1535/3289] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:01 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:02.693201 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b HTTP/1.1 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '43bbc2dd-60e5-44e4-9601-74231273003b'} May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:02.696445 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:02.701193 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:02.701193 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:02.701193 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:02.701193 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:02.701193 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:02.701193 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:02.701193 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:02.703740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:02.706965 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9234d5dc-4ca1-409d-914e-8b6afbc58d59 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 404 len: 111 microversion: 2.1 time: 0.060907 May 14 21:23:02.707825 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1755/3290] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:02 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:02.901814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1276850733", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "3bdbef8a-a684-458d-bfe2-b4f322a15d2e"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:02.964669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] validate_networks() for [('3bdbef8a-a684-458d-bfe2-b4f322a15d2e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:23:03.016611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:03.017336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:03.023885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.024575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:03.025451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.025891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:03.339272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:03.353071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:03.355313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:03.356970 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3ca3ce5-e79c-46f8-813b-1721b6b305d5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.344715 May 14 21:23:03.362752 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1756/3291] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:03 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:03.509889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:03.510514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:03.519216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.519700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:03.520659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.521247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:03.601605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:03.610874 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e4a81c0f-c15a-4193-88c1-4fa2cbac42e9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1282 microversion: 2.1 time: 0.104729 May 14 21:23:03.611463 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1757/3292] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:03 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:03.662081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:03.662730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:03.668962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.669418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:03.670889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.671338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:03.746461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:03.755013 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0398baba-1bbf-4fb1-858f-f26f78930089 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1219 microversion: 2.1 time: 0.097292 May 14 21:23:03.755620 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1758/3293] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:03 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:03.773913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:03.774726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:03.822363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.822363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:03.822574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:03.826183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:04.017338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:04.027420 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-75fd2f74-d28b-4638-9cee-32f61c6ec571 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.260811 May 14 21:23:04.028639 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1759/3294] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:03 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:04.189769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:23:04.191512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:23:04.192056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:23:04.192736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:23:04.193393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:23:04.203343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:04.203935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:04.204830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:04.205361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:04.223768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:23:04.235420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Getting quotas for user 71080496c33c4e2c8b2e16b950f0b9ea and project b031454047774b4fb8b459f226f645d2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:23:04.251520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:23:04.255511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:23:04.388051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:04.389303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:04.395653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:04.396299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:04.397664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:04.398023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:04.446979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a79313f-b39f-44bf-97fc-455d488e1e47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.549598 May 14 21:23:04.459631 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1536/3295] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:23:04.465498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-07e87488-7b3f-45ea-96b7-7996be1dc1f5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:04.472232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-07e87488-7b3f-45ea-96b7-7996be1dc1f5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:04.721514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:04.734985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:04.755198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:04.758941 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8530336-dd16-47bc-9c6c-079a0a6940d3 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.376134 May 14 21:23:04.761735 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1760/3296] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:04 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:04.768069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:04.772590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:04.785910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:04.786485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:04.787352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:04.788102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:04.987836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:04.992042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-07e87488-7b3f-45ea-96b7-7996be1dc1f5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:05.002483 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0f5f93a-2b0f-4339-abfd-9c33225c2e66 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.239343 May 14 21:23:05.011907 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1761/3297] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:04 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:05.012247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-07e87488-7b3f-45ea-96b7-7996be1dc1f5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1215 microversion: 2.1 time: 0.542359 May 14 21:23:05.012247 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1537/3298] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:04 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1215 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:05.012461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-31d884e4-530c-4817-9bf5-9a2d570af82d req-12a66dfc-3c9b-4888-aec8-f3d8bfc8faed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee92d0d1-cd16-4d03-809b-e0c6c9d2757f", "name": "network-vif-plugged", "status": "completed", "tag": "00931368-ab9a-4f28-b1fa-c6e357b7b760"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:05.029127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:05.029994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:05.038503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.041617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.042813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.043509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.048498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-31d884e4-530c-4817-9bf5-9a2d570af82d req-12a66dfc-3c9b-4888-aec8-f3d8bfc8faed service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.049079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-31d884e4-530c-4817-9bf5-9a2d570af82d req-12a66dfc-3c9b-4888-aec8-f3d8bfc8faed service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.077691 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-31d884e4-530c-4817-9bf5-9a2d570af82d req-12a66dfc-3c9b-4888-aec8-f3d8bfc8faed service nova] Creating event network-vif-plugged:00931368-ab9a-4f28-b1fa-c6e357b7b760 for instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f on nch1-master-1 May 14 21:23:05.090947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-31d884e4-530c-4817-9bf5-9a2d570af82d req-12a66dfc-3c9b-4888-aec8-f3d8bfc8faed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086176 May 14 21:23:05.091615 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1762/3299] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:05.110042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:05.110841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:05.120469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.121352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.122451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.124638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.147451 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] HTTP exception thrown: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Request method failure captured: May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 HTTP/1.1 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB0if91-rovseJqE_aTHZRH9jRSDtM4BfZZFoe7mVic7zH8lI8RrSYU6aA3QWMWdFHBJD__0TLzn5Wd87dwjkZO_KpH-M1YslKO879xPr0SlqlnuQF9KhIcSPo7T0mooihIm2mVTQK9G0GG4GNsDYwPKPkXy8v7gU-EJA7cgzK8HfQQ May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 44c96286063c40ac948610903a50e98f May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/44c96286063c40ac948610903a50e98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/44c96286063c40ac948610903a50e98f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/44c96286063c40ac948610903a50e98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_44c96286063c40ac948610903a50e98f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 44c96286063c40ac948610903a50e98f May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachSCSIVolumeTestJSON-1113285562-project May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: f2ef9ae6c6d24ba0b85fd8f41afb9c05 May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1113285562-project May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'a84301d5-4d42-4c89-869c-ace2104d47d2'} May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:05.149146 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Returning 404 to user: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b5581f6-f2ac-46d5-a728-45c5a4de18fa tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 404 len: 111 microversion: 2.1 time: 0.054929 May 14 21:23:05.152829 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1763/3300] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:05 2022] DELETE /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:05.166563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:05.174593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:05.191797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.192253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.193049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.194240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.215202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:05.231962 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0046fa6-4119-4b6d-86fe-1f187ea34e4b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1275 microversion: 2.1 time: 0.222989 May 14 21:23:05.233354 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1538/3301] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:05 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1275 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:05.247241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:05.255134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] [instance: a84301d5-4d42-4c89-869c-ace2104d47d2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:05.262924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.267945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.269619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.270362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.290992 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] HTTP exception thrown: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Request method failure captured: May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 HTTP/1.1 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB0if91-rovseJqE_aTHZRH9jRSDtM4BfZZFoe7mVic7zH8lI8RrSYU6aA3QWMWdFHBJD__0TLzn5Wd87dwjkZO_KpH-M1YslKO879xPr0SlqlnuQF9KhIcSPo7T0mooihIm2mVTQK9G0GG4GNsDYwPKPkXy8v7gU-EJA7cgzK8HfQQ May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 44c96286063c40ac948610903a50e98f May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/44c96286063c40ac948610903a50e98f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/44c96286063c40ac948610903a50e98f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/44c96286063c40ac948610903a50e98f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_44c96286063c40ac948610903a50e98f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 44c96286063c40ac948610903a50e98f May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1113285562 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachSCSIVolumeTestJSON-1113285562-project May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: f2ef9ae6c6d24ba0b85fd8f41afb9c05 May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1113285562-project May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'a84301d5-4d42-4c89-869c-ace2104d47d2'} May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:05.301131 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:05.306816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:05.306816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:05.306816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:05.306816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:05.306816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:05.306816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. May 14 21:23:05.306816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:05.307779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] Returning 404 to user: Instance a84301d5-4d42-4c89-869c-ace2104d47d2 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:05.308715 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2908b53-66d8-4d10-a87a-be0e85182568 tempest-AttachSCSIVolumeTestJSON-1113285562 tempest-AttachSCSIVolumeTestJSON-1113285562-project] 10.222.0.52 "GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2" status: 404 len: 111 microversion: 2.1 time: 0.065380 May 14 21:23:05.314901 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1539/3302] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:05 2022] GET /compute/v2.1/servers/a84301d5-4d42-4c89-869c-ace2104d47d2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:05.413929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:05.422275 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-189c6436-d805-4d6a-a3cd-aeebee74975d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.269423 May 14 21:23:05.426024 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1764/3303] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:05 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:05.782065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:05.782681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:05.792381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.792956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:05.793604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:05.794039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.025140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:06.025763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:06.038674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.039381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.043307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.043307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.219270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:06.238903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:06.240809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:06.242243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e01f6e32-5d78-421d-86c1-1db922876f5a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.464756 May 14 21:23:06.245990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1540/3304] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:05 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:06.262934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:06.264258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:06.271719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.272276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.273203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.273877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.331928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:06.339675 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7188bd8c-00db-430f-8b74-ba27935e32a3 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.323355 May 14 21:23:06.340253 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1765/3305] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:06 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:06.346816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:06.347880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:06.354827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.355536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.356629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.357281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.368764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:06.383940 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5a35a584-66a5-4b35-acde-9c6072ebb5fc tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1219 microversion: 2.1 time: 0.136602 May 14 21:23:06.384854 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1541/3306] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:06 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:06.442931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:06.443964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:06.451601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:06.454662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.455140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.456526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:06.456986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:06.461247 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a0b049a-5c19-4e39-b8fc-f75fce35c7e4 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1273 microversion: 2.1 time: 0.119756 May 14 21:23:06.462137 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1766/3307] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:06 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:06.682437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:06.691545 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03fe0f1b-987e-4b40-ad24-cdb40e7ff927 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.252477 May 14 21:23:06.700464 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1542/3308] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:06 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:07.117374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fdc9c88e-b2c7-4c60-a5b9-e886b8164a0b req-d55ae12a-a0d0-4eb3-becb-2e9ce0ed3f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2225cca2-af55-4314-b378-e65945e6738b", "name": "network-vif-plugged", "status": "completed", "tag": "df6ad504-9db2-4d27-a0c0-ff808265d93b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:07.137629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fdc9c88e-b2c7-4c60-a5b9-e886b8164a0b req-d55ae12a-a0d0-4eb3-becb-2e9ce0ed3f17 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.141860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fdc9c88e-b2c7-4c60-a5b9-e886b8164a0b req-d55ae12a-a0d0-4eb3-becb-2e9ce0ed3f17 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.190409 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fdc9c88e-b2c7-4c60-a5b9-e886b8164a0b req-d55ae12a-a0d0-4eb3-becb-2e9ce0ed3f17 service nova] Creating event network-vif-plugged:df6ad504-9db2-4d27-a0c0-ff808265d93b for instance 2225cca2-af55-4314-b378-e65945e6738b on nch2-master-1 May 14 21:23:07.201491 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fdc9c88e-b2c7-4c60-a5b9-e886b8164a0b req-d55ae12a-a0d0-4eb3-becb-2e9ce0ed3f17 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088960 May 14 21:23:07.206726 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1767/3309] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:07.266838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:07.267498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:07.284107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.284806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.285995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.286807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.358621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:07.359376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:07.376400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.379702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.382611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.383339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.665941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:07.675153 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-69eda9e3-ca30-4f3d-9c52-accf2a3c7b4a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.321424 May 14 21:23:07.691819 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1768/3310] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:07 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:07.697827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:07.698859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:07.706169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.706954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.708343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.708998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.857495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:07.867764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:07.870205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:07.876990 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1bf91b16-9802-4a9b-93ba-92fc67d80999 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.607852 May 14 21:23:07.881516 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1543/3311] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:07 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:23:07.898302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:07.898538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:07.910281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:07.917859 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fff97a98-555f-4518-9782-66422283cb5e tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1267 microversion: 2.1 time: 0.224650 May 14 21:23:07.930011 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1769/3312] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:07 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1267 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:07.931039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.931039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.931039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.931039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.933475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-673b5799-832e-4e7b-905d-551a15e93897 req-6ba1d44d-3596-457b-bd60-44d0a1478f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faacea54-3046-4b55-bf30-040847940731", "tag": "5837daea-a74b-411d-b12d-81c8f1cedc5b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:07.951127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-673b5799-832e-4e7b-905d-551a15e93897 req-6ba1d44d-3596-457b-bd60-44d0a1478f13 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:07.952132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-673b5799-832e-4e7b-905d-551a15e93897 req-6ba1d44d-3596-457b-bd60-44d0a1478f13 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:07.983137 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-673b5799-832e-4e7b-905d-551a15e93897 req-6ba1d44d-3596-457b-bd60-44d0a1478f13 service nova] Creating event network-changed:5837daea-a74b-411d-b12d-81c8f1cedc5b for instance faacea54-3046-4b55-bf30-040847940731 on nch2-master-1 May 14 21:23:07.994450 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-673b5799-832e-4e7b-905d-551a15e93897 req-6ba1d44d-3596-457b-bd60-44d0a1478f13 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074228 May 14 21:23:07.995531 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1770/3313] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:08.016216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:08.016956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:08.025187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:08.025985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:08.027107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:08.027780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:08.210397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:08.226273 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1edc09bf-3302-4b27-815c-61be66fc77fa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.343405 May 14 21:23:08.227793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1544/3314] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:07 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:08.337172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:08.351391 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6e465da8-db88-405c-8b90-b3266ced6b1d tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1317 microversion: 2.1 time: 0.352498 May 14 21:23:08.352968 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1771/3315] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:07 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:08.700214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:08.701709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:08.713159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:08.715734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:08.716516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:08.717660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:08.899151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:08.900462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:08.950850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:08.952216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:08.952678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:08.953190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:09.768963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:09.782495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:09.784381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:09.785753 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07cc1d28-774f-4aac-88f5-7194e1618e12 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.893536 May 14 21:23:09.786483 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1772/3316] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:08 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:09.793101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:09.794095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:09.800931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:09.801584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:09.802546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:09.802989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:09.845987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:09.863227 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd080056-038c-49ad-bb27-b9fd8b87e644 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 1.167771 May 14 21:23:09.864604 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1545/3317] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:08 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:09.897165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:09.906950 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc1a9ce6-8b9e-4982-a9ef-0164c7a3611f tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1273 microversion: 2.1 time: 0.119252 May 14 21:23:09.911515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:09.912756 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1773/3318] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:09 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:09.913590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:09.932922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:09.932922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:09.937578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:09.938281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:09.941025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:09.941973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:09.956321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:09.960457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:09.960457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:09.960457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:10.307614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:10.322314 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-32e01296-c5cc-4d1a-8c13-be573e3572be tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.452355 May 14 21:23:10.323835 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1546/3319] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:09 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:10.327819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:10.331577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-3e1c327a-4f69-479c-ba6c-a9e6bba202af req-17f766ba-6d4a-45fd-8938-ff46be87e1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af92eb0e-dba1-4109-ae5a-2d8d02806cb0", "tag": "af229f26-8c15-4496-83fd-3745d3601050"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:10.346756 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dfa4da39-e380-43e6-9f3a-c2fd03b47c7a tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1505 microversion: 2.1 time: 0.425063 May 14 21:23:10.346756 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1774/3320] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:09 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:10.348532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3e1c327a-4f69-479c-ba6c-a9e6bba202af req-17f766ba-6d4a-45fd-8938-ff46be87e1e6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:10.349520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3e1c327a-4f69-479c-ba6c-a9e6bba202af req-17f766ba-6d4a-45fd-8938-ff46be87e1e6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:10.372518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:10.375400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 2225cca2-af55-4314-b378-e65945e6738b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:10.387841 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-3e1c327a-4f69-479c-ba6c-a9e6bba202af req-17f766ba-6d4a-45fd-8938-ff46be87e1e6 service nova] Creating event network-changed:af229f26-8c15-4496-83fd-3745d3601050 for instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 on nch2-master-1 May 14 21:23:10.391610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:10.400679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:10.402072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:10.402682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:10.417443 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-3e1c327a-4f69-479c-ba6c-a9e6bba202af req-17f766ba-6d4a-45fd-8938-ff46be87e1e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078058 May 14 21:23:10.417443 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1547/3321] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:10.604832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:10.612796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0645eac0-3a93-4211-a04e-cec8ded18978 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b" status: 200 len: 1505 microversion: 2.1 time: 0.253853 May 14 21:23:10.613384 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1775/3322] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:10 2022] GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:10.632837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:10.639815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 2225cca2-af55-4314-b378-e65945e6738b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:10.649292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:10.649956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:10.651876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:10.652373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:10.709802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 2225cca2-af55-4314-b378-e65945e6738b] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:23:10.806453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:10.808727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:10.827786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:10.828470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:10.842664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:10.842664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.122491 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64cc9901-cc6c-4b9f-84ed-6adcc2739ab9 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b" status: 204 len: 0 microversion: 2.1 time: 0.495006 May 14 21:23:11.123363 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1548/3323] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:10 2022] DELETE /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:23:11.130970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:11.132551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:11.141221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.143831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.144873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.145424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.225114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:11.241353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:11.243667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:11.246717 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d184e673-c6aa-49cb-abc0-81e9432b53da tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.445656 May 14 21:23:11.254146 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1776/3324] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:10 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:23:11.255232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:11.256268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:11.265502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.266421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.267560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.268205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.460482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:11.468684 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc49a273-3a97-4727-9536-d09562bc2e70 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.217971 May 14 21:23:11.478214 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1777/3325] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:11 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:11.483539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:11.484049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:11.490215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.490903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.491719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.492319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.521084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:23:11.533796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:11.551546 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9b02ce97-bf68-4ec4-ab62-b5aae5877ddd tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.426634 May 14 21:23:11.552423 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1549/3326] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:11 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:11.564813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:11.566251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:11.588202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.589237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.590449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.591174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.935103 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5bbcf22b-bea5-43d7-b18e-1a97e15e03a5 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 204 len: 0 microversion: 2.1 time: 0.454966 May 14 21:23:11.937146 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1778/3327] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:11 2022] DELETE /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:23:11.945503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:11.946872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 2225cca2-af55-4314-b378-e65945e6738b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:11.954384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.955075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:11.959640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:11.959640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:12.020310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:12.030471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9460ee22-25ee-4239-b9ec-54aad37ea6df tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.474845 May 14 21:23:12.040654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1550/3328] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:11 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:12.142079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:12.171606 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-00cdb20f-a278-4511-b463-8eb93deaf29e tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b" status: 200 len: 1511 microversion: 2.1 time: 0.229751 May 14 21:23:12.176983 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1779/3329] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:11 2022] GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:12.276439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:12.280150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:12.307088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:12.307088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:12.307088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:12.307088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:12.487690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:12.488902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:12.504509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:12.508920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:12.512281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:12.523594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:12.887550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:12.903577 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-20d3e9b3-b8fa-46a8-bc2e-cc4fc24e2094 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.420677 May 14 21:23:12.907321 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1780/3330] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:12 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:12.915231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:12.917050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:12.925081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:12.925796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:12.927345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:12.927960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:13.020171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:13.034643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:13.042922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:13.048595 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-85385fd6-cc0a-46ea-b782-fb002d288c2c tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.780331 May 14 21:23:13.049180 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1551/3331] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:12 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:13.060642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:13.065391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:13.084656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:13.086458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:13.088377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:13.089051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:13.202105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:13.214020 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14b7c667-373b-4ba7-a23f-c5337862b661 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.302292 May 14 21:23:13.214666 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1781/3332] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:12 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:13.223279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:13.224472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 2225cca2-af55-4314-b378-e65945e6738b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:13.246783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:13.251206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:13.252527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:13.253486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:13.582315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:13.596712 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-faaadfc6-e44a-47ff-93d6-cc6145f75e72 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b" status: 200 len: 1511 microversion: 2.1 time: 0.379855 May 14 21:23:13.597519 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1782/3333] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:13 2022] GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:13.940232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a2631ddb-a2ca-4459-a911-4f1c3892589b req-10c99ec3-918c-42cf-acaf-43df14ce9acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2225cca2-af55-4314-b378-e65945e6738b", "name": "network-vif-deleted", "tag": "df6ad504-9db2-4d27-a0c0-ff808265d93b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:13.950183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a2631ddb-a2ca-4459-a911-4f1c3892589b req-10c99ec3-918c-42cf-acaf-43df14ce9acc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:13.950959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a2631ddb-a2ca-4459-a911-4f1c3892589b req-10c99ec3-918c-42cf-acaf-43df14ce9acc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:13.985930 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a2631ddb-a2ca-4459-a911-4f1c3892589b req-10c99ec3-918c-42cf-acaf-43df14ce9acc service nova] Creating event network-vif-deleted:df6ad504-9db2-4d27-a0c0-ff808265d93b for instance 2225cca2-af55-4314-b378-e65945e6738b on nch2-master-1 May 14 21:23:13.996408 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a2631ddb-a2ca-4459-a911-4f1c3892589b req-10c99ec3-918c-42cf-acaf-43df14ce9acc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382038 May 14 21:23:14.000068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1783/3334] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:14.035986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:14.036956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:14.043834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.045238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.046465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.047116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.236281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:14.249184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fafff2d2-ecfc-483e-a675-85773ccbd1e1 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.238996 May 14 21:23:14.251546 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1784/3335] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:14 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:14.256372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:14.257122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:14.268380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.268606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.270554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.271015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.623515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:14.634017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:14.648351 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f7dccfaf-0dc9-4c72-adff-76e31e8a0cfd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 1.598160 May 14 21:23:14.650418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1552/3336] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:13 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:14.652049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:14.657517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:14.659015 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-546be5f6-9eb1-41eb-a9a3-41e536f9e7e8 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.407650 May 14 21:23:14.668030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:14.668576 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1785/3337] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:14 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:14.668667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:14.674922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:14.674922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: 2225cca2-af55-4314-b378-e65945e6738b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:14.678320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.684297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.684297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.684297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.690192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.690682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.694070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.694523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.720696 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] HTTP exception thrown: Instance 2225cca2-af55-4314-b378-e65945e6738b could not be found. May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Request method failure captured: May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b HTTP/1.1 May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB2Mebl8AqgxPppqC1OshrbNX4s1l5XuWKbleD3LFOpld43SOSossGH5NKKrNhoPZ3rNodeyX8KHD1A9R2vG4wVEetYS76JpHP7MVT4OsSIpR9Up36ohf22oVNxlH17CVnAi-Jt09mFyHCdEvYHI2oIsAcJSu4p0_CkRYusVY69B-Tk May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f589f7d7ad0f4b63afd4132efa4e798a May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-MultipleCreateTestJSON-1387053719 May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f589f7d7ad0f4b63afd4132efa4e798a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f589f7d7ad0f4b63afd4132efa4e798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f589f7d7ad0f4b63afd4132efa4e798a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f589f7d7ad0f4b63afd4132efa4e798a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-MultipleCreateTestJSON-1387053719 May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f589f7d7ad0f4b63afd4132efa4e798a May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1387053719 May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-MultipleCreateTestJSON-1387053719-project May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: beb60582a8ae4b2499db4a45da00512f May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-MultipleCreateTestJSON-1387053719-project May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 2225cca2-af55-4314-b378-e65945e6738b could not be found. May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2225cca2-af55-4314-b378-e65945e6738b'} May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2225cca2-af55-4314-b378-e65945e6738b could not be found. May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2225cca2-af55-4314-b378-e65945e6738b could not be found. May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:14.722513 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2225cca2-af55-4314-b378-e65945e6738b could not be found. May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Returning 404 to user: Instance 2225cca2-af55-4314-b378-e65945e6738b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:14.726857 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-134fe581-1524-443f-b580-fa193cde9e7f tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b" status: 404 len: 111 microversion: 2.1 time: 0.060287 May 14 21:23:14.729195 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1786/3338] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:14 2022] GET /compute/v2.1/servers/2225cca2-af55-4314-b378-e65945e6738b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:14.732394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:14.732812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:14.739757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.740200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.740970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:14.741406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:14.887981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:14.897028 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c460eefd-8734-4da0-9629-e29952320518 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1511 microversion: 2.1 time: 0.168444 May 14 21:23:14.907298 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1787/3339] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:14 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:15.195384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:15.202899 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f0463976-8e4d-47bc-954e-6e757e1a3eb7 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.549932 May 14 21:23:15.203489 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1553/3340] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:14 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:15.269329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:15.269953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:15.278137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.279315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.283404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.284272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.443909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8df00018-0991-48fa-bb64-691ee4c07224 req-6fe2f864-62bc-486e-ada5-9863f319bb49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98cfa904-6334-446b-9c55-78b1cad1609b", "tag": "bffc484e-a9f4-471b-ac3c-ff72cedc60b5"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:15.449434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:15.458529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8df00018-0991-48fa-bb64-691ee4c07224 req-6fe2f864-62bc-486e-ada5-9863f319bb49 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.459275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8df00018-0991-48fa-bb64-691ee4c07224 req-6fe2f864-62bc-486e-ada5-9863f319bb49 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.462440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-689e9ca0-8795-4c29-a615-06d088670320 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.196741 May 14 21:23:15.473385 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1788/3341] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:15 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:15.479904 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8df00018-0991-48fa-bb64-691ee4c07224 req-6fe2f864-62bc-486e-ada5-9863f319bb49 service nova] Creating event network-changed:bffc484e-a9f4-471b-ac3c-ff72cedc60b5 for instance 98cfa904-6334-446b-9c55-78b1cad1609b on nch1-master-1 May 14 21:23:15.489377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8df00018-0991-48fa-bb64-691ee4c07224 req-6fe2f864-62bc-486e-ada5-9863f319bb49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050700 May 14 21:23:15.495799 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1554/3342] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:15.666141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:15.666772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:15.673571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.674035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.675021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.675497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.683380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:15.684131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:15.691445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.692010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.692889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.693516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.818574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:15.827030 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-241f5c18-366a-4de2-9382-5bf0268e908b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.164946 May 14 21:23:15.836512 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1789/3343] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:15 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:15.922728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:15.922728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:15.926279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.926936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:15.928068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:15.928716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:16.014145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:16.025733 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac0d6e9f-8243-40ef-8fb5-144a0316adab tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1469 microversion: 2.1 time: 0.115302 May 14 21:23:16.026666 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1790/3344] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:15 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1469 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:16.032112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-35e438db-58d6-44a7-964f-dc0f71c5b160 req-b9ea596c-b083-40ce-9ff3-d6eba90b532f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faacea54-3046-4b55-bf30-040847940731", "name": "network-vif-plugged", "status": "completed", "tag": "5837daea-a74b-411d-b12d-81c8f1cedc5b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:16.041427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-35e438db-58d6-44a7-964f-dc0f71c5b160 req-b9ea596c-b083-40ce-9ff3-d6eba90b532f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:16.043015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-35e438db-58d6-44a7-964f-dc0f71c5b160 req-b9ea596c-b083-40ce-9ff3-d6eba90b532f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:16.065709 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-35e438db-58d6-44a7-964f-dc0f71c5b160 req-b9ea596c-b083-40ce-9ff3-d6eba90b532f service nova] Creating event network-vif-plugged:5837daea-a74b-411d-b12d-81c8f1cedc5b for instance faacea54-3046-4b55-bf30-040847940731 on nch2-master-1 May 14 21:23:16.072536 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-35e438db-58d6-44a7-964f-dc0f71c5b160 req-b9ea596c-b083-40ce-9ff3-d6eba90b532f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044176 May 14 21:23:16.074045 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1791/3345] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:16.220170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:16.221109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:16.222198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:16.229234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:16.229699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:16.230501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:16.231283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:16.231542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:16.233758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:16.235181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0648ee5e-e7af-49d7-bd27-53a0508a8335 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.556218 May 14 21:23:16.236635 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1555/3346] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:15 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:16.482861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:16.483720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:16.493168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:16.494162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:16.495540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:16.496245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:16.640262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:16.649691 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1ae756d-6708-44d3-9fe2-8b2d13e17220 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.433562 May 14 21:23:16.655244 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1792/3347] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:16 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:16.784912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:16.793011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bd432b3c-d554-428a-87f2-3538621c43e5 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.315744 May 14 21:23:16.797514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1556/3348] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:16 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:16.844511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:16.845256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:16.851362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:16.852542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:16.852758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:16.853056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.056717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:17.056717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:17.062820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.063925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:17.064282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.066103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.066573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.082553 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9b0a64c1-4ce2-4e61-bc07-a7bd2558d444 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.242071 May 14 21:23:17.083526 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1793/3349] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:16 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:17.117431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.118186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.118652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lazy-loading 'fault' on Instance uuid ee92d0d1-cd16-4d03-809b-e0c6c9d2757f {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:23:17.164057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'beb60582a8ae4b2499db4a45da00512f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f589f7d7ad0f4b63afd4132efa4e798a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:17.172405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f40a5bd5-fc6e-4782-b430-198bd6118878 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 200 len: 1307 microversion: 2.1 time: 0.131588 May 14 21:23:17.172998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1557/3350] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:17 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 1307 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:17.254882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:17.255462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:17.261844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.262587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.263400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.263937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.477764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:17.491889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:17.493423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:17.494631 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8ce5b0a-bffc-4f94-9183-30e779e9d212 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.243684 May 14 21:23:17.495194 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1794/3351] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:17 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:17.671731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:17.672387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:17.680001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.680576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.681489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.682001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.728240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6201dd77-c4b5-4b9e-a71b-85e06201ac63 req-c2d0b1ee-b2e2-429c-9fe9-c5de7d2f2711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee92d0d1-cd16-4d03-809b-e0c6c9d2757f", "name": "network-vif-deleted", "tag": "00931368-ab9a-4f28-b1fa-c6e357b7b760"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:17.737870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6201dd77-c4b5-4b9e-a71b-85e06201ac63 req-c2d0b1ee-b2e2-429c-9fe9-c5de7d2f2711 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.738335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6201dd77-c4b5-4b9e-a71b-85e06201ac63 req-c2d0b1ee-b2e2-429c-9fe9-c5de7d2f2711 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.752988 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6201dd77-c4b5-4b9e-a71b-85e06201ac63 req-c2d0b1ee-b2e2-429c-9fe9-c5de7d2f2711 service nova] Creating event network-vif-deleted:00931368-ab9a-4f28-b1fa-c6e357b7b760 for instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f on nch1-master-1 May 14 21:23:17.757622 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6201dd77-c4b5-4b9e-a71b-85e06201ac63 req-c2d0b1ee-b2e2-429c-9fe9-c5de7d2f2711 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033360 May 14 21:23:17.759005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1795/3352] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:23:17.818979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:17.820378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:17.829850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.830432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:17.832281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:17.833386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.043306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:18.055066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce1773bc-1204-4c1f-8974-6af0746ec890 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.245563 May 14 21:23:18.056091 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1796/3353] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:17 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:18.093414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-b69b7ff6-70a6-41e6-800f-e329e25e109b req-af58567b-92b7-45b0-9915-010b27c25e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-plugged", "status": "completed", "tag": "295d1cbd-15b9-44db-8e23-acbc4c34efab"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:18.104317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b69b7ff6-70a6-41e6-800f-e329e25e109b req-af58567b-92b7-45b0-9915-010b27c25e4c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:18.105008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b69b7ff6-70a6-41e6-800f-e329e25e109b req-af58567b-92b7-45b0-9915-010b27c25e4c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.109427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:18.121936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-51db7afc-ba1b-4bb9-87c9-b3b4a0d9c97a tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1324 microversion: 2.1 time: 0.455373 May 14 21:23:18.134081 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1558/3354] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:17 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1324 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:18.140475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:18.141854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:18.151259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:18.151750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.153069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:18.154368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.156075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-b69b7ff6-70a6-41e6-800f-e329e25e109b req-af58567b-92b7-45b0-9915-010b27c25e4c service nova] Creating event network-vif-plugged:295d1cbd-15b9-44db-8e23-acbc4c34efab for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:18.171416 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-b69b7ff6-70a6-41e6-800f-e329e25e109b req-af58567b-92b7-45b0-9915-010b27c25e4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081957 May 14 21:23:18.177122 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1797/3355] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:23:18.199358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:18.200259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] [instance: ee92d0d1-cd16-4d03-809b-e0c6c9d2757f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:18.208816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:18.209569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.216871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:18.216871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.229485 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] HTTP exception thrown: Instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f could not be found. May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Request method failure captured: May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f HTTP/1.1 May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB2Mebl8AqgxPppqC1OshrbNX4s1l5XuWKbleD3LFOpld43SOSossGH5NKKrNhoPZ3rNodeyX8KHD1A9R2vG4wVEetYS76JpHP7MVT4OsSIpR9Up36ohf22oVNxlH17CVnAi-Jt09mFyHCdEvYHI2oIsAcJSu4p0_CkRYusVY69B-Tk May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f589f7d7ad0f4b63afd4132efa4e798a May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-MultipleCreateTestJSON-1387053719 May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f589f7d7ad0f4b63afd4132efa4e798a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f589f7d7ad0f4b63afd4132efa4e798a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f589f7d7ad0f4b63afd4132efa4e798a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f589f7d7ad0f4b63afd4132efa4e798a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-MultipleCreateTestJSON-1387053719 May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f589f7d7ad0f4b63afd4132efa4e798a May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1387053719 May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-MultipleCreateTestJSON-1387053719-project May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: beb60582a8ae4b2499db4a45da00512f May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-MultipleCreateTestJSON-1387053719-project May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f could not be found. May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ee92d0d1-cd16-4d03-809b-e0c6c9d2757f'} May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f could not be found. May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f could not be found. May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:18.231166 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:18.236592 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:18.236592 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:18.236592 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:18.236592 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:18.236592 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:18.236592 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f could not be found. May 14 21:23:18.236592 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:18.238163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] Returning 404 to user: Instance ee92d0d1-cd16-4d03-809b-e0c6c9d2757f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:18.239572 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edd802a6-d1e0-4c69-9c3a-123e8f1724d3 tempest-MultipleCreateTestJSON-1387053719 tempest-MultipleCreateTestJSON-1387053719-project] 10.222.0.52 "GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f" status: 404 len: 111 microversion: 2.1 time: 0.049794 May 14 21:23:18.247088 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1798/3356] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:18 2022] GET /compute/v2.1/servers/ee92d0d1-cd16-4d03-809b-e0c6c9d2757f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:18.514884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:18.515865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:18.522877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:18.523635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.524818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:18.525433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:18.527645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:18.543716 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b3014b41-d419-4617-ad89-4603e3e8bfa7 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.409271 May 14 21:23:18.543716 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1559/3357] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:18 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:18.878720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:18.895043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:18.898180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:18.901688 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e986303-6631-4e2e-99aa-462ef80e6761 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.389627 May 14 21:23:18.909586 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1799/3358] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:18 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:23:19.074477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:19.075429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:19.092717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.094576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:19.096050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.097414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:19.151264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:19.152079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:19.178458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.178458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:19.178458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.179605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:19.381794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:19.393882 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5132cc9-2606-4be4-9cb9-260899cc2cc4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1520 microversion: 2.1 time: 0.257358 May 14 21:23:19.412478 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1800/3359] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:19 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:19.419089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:19.428557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a545f2b-c665-4bea-bbdf-6063919140bc tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'create', calling method: .version_select at 0x7fb1a6fc7820>, body: {"pool": null} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:19.436557 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f314064-deb0-4ebf-b642-81c9c633f703 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.367242 May 14 21:23:19.437321 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1560/3360] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:19 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:19.560631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:19.561571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:19.569340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.571456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:19.571456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.571456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:19.786444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:19.822363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b17d37a-307c-4572-b6c8-14a517eb8345 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.264520 May 14 21:23:19.830058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1561/3361] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:19 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:19.928101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:19.929036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:19.940247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.941669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:19.943824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:19.945980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:20.259165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:20.271652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:20.273636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:20.275763 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-677c826a-318e-4ddc-a756-61dbc906d8db tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.356675 May 14 21:23:20.289879 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1562/3362] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:19 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:20.296573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8992bb9d-9d9b-42f8-a985-b73f9693279a req-81d3d283-bd01-4323-bd2e-b01ee531c5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-plugged", "status": "completed", "tag": "54b871a9-1a1e-4062-9a50-5ddf26961b8e"}, {"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-plugged", "status": "completed", "tag": "150fe679-5889-44eb-bcc1-bbb9d924b590"}, {"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-plugged", "status": "completed", "tag": "d09b3141-d774-4a45-8f42-7303f69488da"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:20.307942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8992bb9d-9d9b-42f8-a985-b73f9693279a req-81d3d283-bd01-4323-bd2e-b01ee531c5e3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:20.308830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8992bb9d-9d9b-42f8-a985-b73f9693279a req-81d3d283-bd01-4323-bd2e-b01ee531c5e3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:20.332481 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8992bb9d-9d9b-42f8-a985-b73f9693279a req-81d3d283-bd01-4323-bd2e-b01ee531c5e3 service nova] Creating event network-vif-plugged:54b871a9-1a1e-4062-9a50-5ddf26961b8e for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:20.339801 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8992bb9d-9d9b-42f8-a985-b73f9693279a req-81d3d283-bd01-4323-bd2e-b01ee531c5e3 service nova] Creating event network-vif-plugged:150fe679-5889-44eb-bcc1-bbb9d924b590 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:20.339801 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8992bb9d-9d9b-42f8-a985-b73f9693279a req-81d3d283-bd01-4323-bd2e-b01ee531c5e3 service nova] Creating event network-vif-plugged:d09b3141-d774-4a45-8f42-7303f69488da for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:20.355634 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8992bb9d-9d9b-42f8-a985-b73f9693279a req-81d3d283-bd01-4323-bd2e-b01ee531c5e3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053895 May 14 21:23:20.359461 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1563/3363] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:20.460953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:20.464130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:20.484087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:20.485283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:20.486312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:20.488151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:20.750198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:20.758032 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d7b6a5c-7d7b-4050-8753-247947cc091a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.308197 May 14 21:23:20.758852 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1564/3364] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:20 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:20.841738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:20.842628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:20.878915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:20.882047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:20.882881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:20.883330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:21.265705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:21.277726 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7fe79b92-15f5-4b3d-a1a1-0e8a6f69e4d0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.440138 May 14 21:23:21.278869 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1565/3365] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:20 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:21.299366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:21.300239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:21.307238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:21.311943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:21.313188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:21.314190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:21.709490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:21.739680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:21.752854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:21.754251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-defd8969-f5f4-4078-9e38-bd0b6f0c4f8f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.462551 May 14 21:23:21.756916 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1566/3366] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:21 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:23:21.786953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:21.786953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:21.788768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:21.789515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:21.790418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:21.790970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:21.823452 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a545f2b-c665-4bea-bbdf-6063919140bc tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.409254 May 14 21:23:21.824084 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1801/3367] 10.222.0.52 () {60 vars in 1169 bytes} [Sat May 14 21:23:19 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:21.972082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-392415015", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "b6600266-4425-42b1-a9f0-5eddc540b575"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:22.047911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] validate_networks() for [('b6600266-4425-42b1-a9f0-5eddc540b575', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:23:22.129528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:22.139363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-da7f9f86-066d-47c6-b2ce-07464084620d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.366566 May 14 21:23:22.140638 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1567/3368] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:21 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:22.407977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04a3e036-6f12-4ff0-b6d2-c13218bd4d8f tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1687421480", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:22.420388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-04a3e036-6f12-4ff0-b6d2-c13218bd4d8f tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] HTTP exception thrown: min_count must be <= max_count May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04a3e036-6f12-4ff0-b6d2-c13218bd4d8f tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Request method failure captured: May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 184 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3K0oz11kBMCdHF-DYN-0xMIxOtVPruBenCOM2wcqFAX2TPFMlygURG4x2IbWsILwN4lIJBKLfsNtYsMQc6daIIGHHU4NvJLFPxn3pn-LJ0HsSs-LDnNvxz3nS3cvMrvwYQeY8fyxJwftN4fqyMSkfRJCs_b-of5Vy1Uh428gRO33c May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_386c2ac6c8354a37a6a22991fd1297a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: fddeac63ed6b4d968a00d93e16ba8f00 May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1687421480", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: exception: min_count must be <= max_count May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1687421480', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 14 21:23:22.425300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:22.429060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04a3e036-6f12-4ff0-b6d2-c13218bd4d8f tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Returning 400 to user: min_count must be <= max_count {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:22.430559 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04a3e036-6f12-4ff0-b6d2-c13218bd4d8f tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.195621 May 14 21:23:22.431833 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1568/3369] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:22 2022] POST /compute/v2.1/servers => generated 74 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 14 21:23:22.461608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:22.465081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:22.475033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:22.479080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:22.479080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:22.479080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:22.601435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:23:22.601994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:23:22.602722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:23:22.603205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:23:22.603752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:23:22.613911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:22.614488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:22.615606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:22.616277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:22.636209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Getting quotas for project 155b6f457be24818bb00db2560ef96fe. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:23:22.642987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Getting quotas for user a7f2d4818aa7461da8f30ddfe7641d93 and project 155b6f457be24818bb00db2560ef96fe. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:23:22.657448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:23:22.660460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:23:22.837586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:22.846056 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b998914f-bea3-446b-8670-5746384f3d79 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.412755 May 14 21:23:22.846632 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1569/3370] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:22 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:22.851207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-be0c8f7d-e844-451e-922b-58f837a03f9b req-c344eb2b-4a5c-4f29-8a72-bda2c9015afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-plugged", "status": "completed", "tag": "5fe9ffa2-546d-42d9-a88d-11e41c94e5f9"}, {"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-plugged", "status": "completed", "tag": "ed4b2309-b8f5-4d14-9e50-2b5701924849"}, {"server_uuid": "af92eb0e-dba1-4109-ae5a-2d8d02806cb0", "name": "network-vif-plugged", "status": "completed", "tag": "af229f26-8c15-4496-83fd-3745d3601050"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:22.860712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-be0c8f7d-e844-451e-922b-58f837a03f9b req-c344eb2b-4a5c-4f29-8a72-bda2c9015afd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:22.861158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-be0c8f7d-e844-451e-922b-58f837a03f9b req-c344eb2b-4a5c-4f29-8a72-bda2c9015afd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:22.874208 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-be0c8f7d-e844-451e-922b-58f837a03f9b req-c344eb2b-4a5c-4f29-8a72-bda2c9015afd service nova] Creating event network-vif-plugged:5fe9ffa2-546d-42d9-a88d-11e41c94e5f9 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:22.874720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-be0c8f7d-e844-451e-922b-58f837a03f9b req-c344eb2b-4a5c-4f29-8a72-bda2c9015afd service nova] Creating event network-vif-plugged:ed4b2309-b8f5-4d14-9e50-2b5701924849 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:22.875429 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-be0c8f7d-e844-451e-922b-58f837a03f9b req-c344eb2b-4a5c-4f29-8a72-bda2c9015afd service nova] Creating event network-vif-plugged:af229f26-8c15-4496-83fd-3745d3601050 for instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 on nch2-master-1 May 14 21:23:22.879694 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d9dd76a6-13dd-49bc-a83e-fea99b2e0d75 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913073 May 14 21:23:22.880824 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1802/3371] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:23:22.885794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15d2d059-d4eb-49b8-8add-935153349354 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1736662226", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "max_count": 0}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:22.889923 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-be0c8f7d-e844-451e-922b-58f837a03f9b req-c344eb2b-4a5c-4f29-8a72-bda2c9015afd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042068 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15d2d059-d4eb-49b8-8add-935153349354 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Request method failure captured: May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 168 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3K0oz11kBMCdHF-DYN-0xMIxOtVPruBenCOM2wcqFAX2TPFMlygURG4x2IbWsILwN4lIJBKLfsNtYsMQc6daIIGHHU4NvJLFPxn3pn-LJ0HsSs-LDnNvxz3nS3cvMrvwYQeY8fyxJwftN4fqyMSkfRJCs_b-of5Vy1Uh428gRO33c May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_386c2ac6c8354a37a6a22991fd1297a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: fddeac63ed6b4d968a00d93e16ba8f00 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1736662226", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "max_count": 0}} May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1736662226', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'max_count': 0}}} May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 0 May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:23:22.890744 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15d2d059-d4eb-49b8-8add-935153349354 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15d2d059-d4eb-49b8-8add-935153349354 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.011319 May 14 21:23:22.904858 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1803/3372] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:22 2022] POST /compute/v2.1/servers => generated 130 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:23:22.907101 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1570/3373] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:22.907101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c56fb6c3-045e-43ee-8bf6-e88749d7ea41 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:22.907101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c56fb6c3-045e-43ee-8bf6-e88749d7ea41 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:22.933156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:22.933996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:22.952777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:22.953229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:22.954043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:22.954487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:22.998046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c56fb6c3-045e-43ee-8bf6-e88749d7ea41 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:23.006484 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c56fb6c3-045e-43ee-8bf6-e88749d7ea41 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1223 microversion: 2.1 time: 0.110920 May 14 21:23:23.015376 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1571/3374] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:22 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1223 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:23.015376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7524af83-78ae-4d69-85c6-6036d90945eb tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-34264272", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "max_count": 2.5}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7524af83-78ae-4d69-85c6-6036d90945eb tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Request method failure captured: May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 168 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3K0oz11kBMCdHF-DYN-0xMIxOtVPruBenCOM2wcqFAX2TPFMlygURG4x2IbWsILwN4lIJBKLfsNtYsMQc6daIIGHHU4NvJLFPxn3pn-LJ0HsSs-LDnNvxz3nS3cvMrvwYQeY8fyxJwftN4fqyMSkfRJCs_b-of5Vy1Uh428gRO33c May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_386c2ac6c8354a37a6a22991fd1297a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: fddeac63ed6b4d968a00d93e16ba8f00 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-34264272", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "max_count": 2.5}} May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-34264272', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'max_count': 2.5}}} May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 2.5 May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:23:23.016522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 14 21:23:23.020552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.022838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7524af83-78ae-4d69-85c6-6036d90945eb tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:23.024197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7524af83-78ae-4d69-85c6-6036d90945eb tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015879 May 14 21:23:23.025629 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1572/3375] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:23:23.162877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:23.162877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:23.177374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:23.179069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:23.180585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:23.182776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:23.230445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:23.241925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:23.243547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:23.244806 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6013f04b-13af-46c4-bc63-9095b01062ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.350046 May 14 21:23:23.245434 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1804/3376] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:22 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:23.356749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:23.365673 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a555c600-6673-4a5a-98e6-9e6130b9d182 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.211289 May 14 21:23:23.366576 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1573/3377] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:23 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:23.651322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6524fd49-7fb5-4729-bb7d-ad4010c3e0fd tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1890658092", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 0}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6524fd49-7fb5-4729-bb7d-ad4010c3e0fd tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Request method failure captured: May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 168 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3K0oz11kBMCdHF-DYN-0xMIxOtVPruBenCOM2wcqFAX2TPFMlygURG4x2IbWsILwN4lIJBKLfsNtYsMQc6daIIGHHU4NvJLFPxn3pn-LJ0HsSs-LDnNvxz3nS3cvMrvwYQeY8fyxJwftN4fqyMSkfRJCs_b-of5Vy1Uh428gRO33c May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_386c2ac6c8354a37a6a22991fd1297a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: fddeac63ed6b4d968a00d93e16ba8f00 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1890658092", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 0}} May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1890658092', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'min_count': 0}}} May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 0 May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:23:23.654993 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6524fd49-7fb5-4729-bb7d-ad4010c3e0fd tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6524fd49-7fb5-4729-bb7d-ad4010c3e0fd tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009547 May 14 21:23:23.669045 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1805/3378] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:23 2022] POST /compute/v2.1/servers => generated 130 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:23:23.816045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3580119-5558-4932-91de-0209cd3d14a5 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-774396236", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 2.5}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3580119-5558-4932-91de-0209cd3d14a5 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Request method failure captured: May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 169 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3K0oz11kBMCdHF-DYN-0xMIxOtVPruBenCOM2wcqFAX2TPFMlygURG4x2IbWsILwN4lIJBKLfsNtYsMQc6daIIGHHU4NvJLFPxn3pn-LJ0HsSs-LDnNvxz3nS3cvMrvwYQeY8fyxJwftN4fqyMSkfRJCs_b-of5Vy1Uh428gRO33c May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/386c2ac6c8354a37a6a22991fd1297a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_386c2ac6c8354a37a6a22991fd1297a2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 386c2ac6c8354a37a6a22991fd1297a2 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-538916344 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: fddeac63ed6b4d968a00d93e16ba8f00 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-538916344-project May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-774396236", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 2.5}} May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-774396236', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'min_count': 2.5}}} May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 2.5 May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:23:23.818552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3580119-5558-4932-91de-0209cd3d14a5 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3580119-5558-4932-91de-0209cd3d14a5 tempest-MultipleCreateNegativeTestJSON-538916344 tempest-MultipleCreateNegativeTestJSON-538916344-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012370 May 14 21:23:23.837228 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1574/3379] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:23 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:23:23.865330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:23.865330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:23.874465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:23.875218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:23.876254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:23.877231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:24.035278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2453eb1-dae1-43f0-a9c2-b68cc89cff82 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:24.037337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2453eb1-dae1-43f0-a9c2-b68cc89cff82 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:24.045978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:24.054560 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fbdb1a9b-2db2-4e0c-8684-2e0f9279351e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1315 microversion: 2.1 time: 0.194823 May 14 21:23:24.067797 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1806/3380] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:23 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:24.123168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2453eb1-dae1-43f0-a9c2-b68cc89cff82 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:24.134074 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2453eb1-dae1-43f0-a9c2-b68cc89cff82 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1223 microversion: 2.1 time: 0.102995 May 14 21:23:24.135387 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1575/3381] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:24 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:24.266424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:24.267434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:24.275190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:24.275687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:24.276669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:24.277831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:24.382376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:24.383126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:24.390080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:24.390532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:24.391309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:24.391773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:24.502325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:24.520259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:24.522875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:24.527699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a754b142-dfc8-4eae-89e1-33d513982061 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.263445 May 14 21:23:24.528591 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1807/3382] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:24 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:24.556808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:24.564987 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22c5c73a-aae5-4f31-b8aa-50b1774697f8 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.186714 May 14 21:23:24.565706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1576/3383] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:24 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:24.913964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-3871ffc0-984c-4f4b-b8e8-c721ea0ac0dd req-197a4043-d440-4105-8a11-e5d32bf602ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-plugged", "status": "completed", "tag": "cb2ed6c9-1135-4b76-b18c-8882fea92d8d"}, {"server_uuid": "98cfa904-6334-446b-9c55-78b1cad1609b", "name": "network-vif-plugged", "status": "completed", "tag": "bffc484e-a9f4-471b-ac3c-ff72cedc60b5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:24.925349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3871ffc0-984c-4f4b-b8e8-c721ea0ac0dd req-197a4043-d440-4105-8a11-e5d32bf602ef service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:24.926046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3871ffc0-984c-4f4b-b8e8-c721ea0ac0dd req-197a4043-d440-4105-8a11-e5d32bf602ef service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:24.947134 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-3871ffc0-984c-4f4b-b8e8-c721ea0ac0dd req-197a4043-d440-4105-8a11-e5d32bf602ef service nova] Creating event network-vif-plugged:cb2ed6c9-1135-4b76-b18c-8882fea92d8d for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:24.948026 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-3871ffc0-984c-4f4b-b8e8-c721ea0ac0dd req-197a4043-d440-4105-8a11-e5d32bf602ef service nova] Creating event network-vif-plugged:bffc484e-a9f4-471b-ac3c-ff72cedc60b5 for instance 98cfa904-6334-446b-9c55-78b1cad1609b on nch1-master-1 May 14 21:23:24.958134 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-3871ffc0-984c-4f4b-b8e8-c721ea0ac0dd req-197a4043-d440-4105-8a11-e5d32bf602ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048272 May 14 21:23:24.959405 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1808/3384] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:25.075934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:25.077343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:25.084494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.084958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.092752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.093440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.157701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:25.157701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:25.163146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.163631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.164594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.165044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.257829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:25.270137 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6f887f4d-6962-48c0-bd11-d86b49ce0e2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1275 microversion: 2.1 time: 0.121572 May 14 21:23:25.270746 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1809/3385] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:25 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1275 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:25.397819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:25.406121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aaa95c1c-58f2-4e6c-ba4e-967d30c3d1fd tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1503 microversion: 2.1 time: 0.334249 May 14 21:23:25.406698 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1577/3386] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:25 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:25.423301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8cae262c-f2d2-48fa-88b1-da7b71a8d170 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:25.423825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8cae262c-f2d2-48fa-88b1-da7b71a8d170 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:25.429863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cae262c-f2d2-48fa-88b1-da7b71a8d170 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.430323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cae262c-f2d2-48fa-88b1-da7b71a8d170 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.431109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cae262c-f2d2-48fa-88b1-da7b71a8d170 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.431589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cae262c-f2d2-48fa-88b1-da7b71a8d170 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.548177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:25.549017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:25.556491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.556959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.557733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.558174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.724599 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8cae262c-f2d2-48fa-88b1-da7b71a8d170 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0/action" status: 202 len: 0 microversion: 2.1 time: 0.305908 May 14 21:23:25.725238 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1810/3387] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:23:25 2022] POST /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:23:25.736677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:25.737699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:25.745652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.746292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.747906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.748650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.804316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:25.821905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:25.824846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:25.828539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba7bcb75-a9fb-4655-a4d1-e4d056c87386 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.285859 May 14 21:23:25.829109 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1578/3388] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:25 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:25.839065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:25.839065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:25.847832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.848648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.849834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:25.850492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:25.955190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:25.963077 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e6a4a3fd-8e1c-4f2e-a56d-59daee6f068d tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1315 microversion: 2.1 time: 0.235935 May 14 21:23:25.963763 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1811/3389] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:25 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:26.108493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:26.116247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d2d809c-e41a-41c4-977b-ffced8700f1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1508 microversion: 2.1 time: 0.285837 May 14 21:23:26.117608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1579/3390] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:25 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:26.288005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:26.288618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:26.295809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:26.296266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:26.297208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:26.297650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:26.385161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:26.396483 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a704106e-52ca-45c1-97f8-3f4822030a7b tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1293 microversion: 2.1 time: 0.112491 May 14 21:23:26.397217 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1812/3391] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:26 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:26.853188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:26.854654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:26.863199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:26.863588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:26.865184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:26.865662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:26.981207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:26.982809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:26.997654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.002197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.004331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.007861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.225783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:27.235603 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d97d9211-100a-4beb-a80b-5ef17a556078 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1502 microversion: 2.1 time: 0.258294 May 14 21:23:27.245847 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1813/3392] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:26 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1502 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:27.256752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:27.257722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:27.265927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.266948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.278073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.289208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.398059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:27.413751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:27.416252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:27.419596 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-426af8ba-038b-42e5-9822-6cedcfa4b63d tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1879 microversion: 2.42 time: 0.574348 May 14 21:23:27.424636 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1580/3393] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:26 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1879 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:27.432918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:27.434389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:27.444275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.445071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.446373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.447592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.495117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'flavor' on Instance uuid 98cfa904-6334-446b-9c55-78b1cad1609b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:23:27.568046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:27.581969 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f7751137-685e-4415-a171-a4b890744909 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1488 microversion: 2.1 time: 0.332752 May 14 21:23:27.582382 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1814/3394] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:27 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1488 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:27.597780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:27.598674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:27.615583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.618690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.619818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.620470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.826497 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3cfb052-6eb3-4370-8464-1c8af6892f47 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "POST /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b/action" status: 202 len: 0 microversion: 2.1 time: 0.396722 May 14 21:23:27.831914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:27.835101 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1581/3395] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:23:27 2022] POST /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:23:27.848962 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fe6f447a-385f-48f9-9f42-50c896c45d86 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.258277 May 14 21:23:27.849612 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1815/3396] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:27 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:27.855430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:27.858466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:27.898971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.900435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.902950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:27.904158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:27.969102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lazy-loading 'flavor' on Instance uuid af92eb0e-dba1-4109-ae5a-2d8d02806cb0 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:23:28.124925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d14bd24-8be3-41a3-8b71-17450adc550f tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:28.140014 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d14bd24-8be3-41a3-8b71-17450adc550f tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.287573 May 14 21:23:28.142772 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1816/3397] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:23:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:28.149913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:28.150780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:28.193132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:28.195267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:28.197222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:28.197704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:28.440498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:28.448473 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8abb6ed-53f4-43ef-b1f9-5dab89515cab tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1510 microversion: 2.1 time: 0.304183 May 14 21:23:28.449615 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1817/3398] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:28 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:28.491094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:28.494704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:28.530571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:28.533805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:28.536151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:28.542762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:28.986381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a7178d95-697c-45c1-a066-68a0922767ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0/action" status: 202 len: 0 microversion: 2.1 time: 1.144002 May 14 21:23:28.987918 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1582/3399] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:23:27 2022] POST /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0/action => generated 0 bytes in 1152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:23:28.994392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:28.995541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:29.003791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.004675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.005759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.011156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.043723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:29.054654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:29.057284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:29.059011 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6650919a-5a02-4f40-ba44-9c70d9f7ffa0 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2838 microversion: 2.42 time: 0.603710 May 14 21:23:29.072420 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1818/3400] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:23:28 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2838 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:29.081395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-87b6bb7f-dbce-47a2-a8e9-2547addf625d req-b3bdcade-14a0-4b28-bc25-90c10b5c319b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d937c28-2ab7-41a9-8611-b8f0d77749a6", "tag": "7f5425e4-ec40-44fe-90e4-23cc30118671"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:29.108625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-87b6bb7f-dbce-47a2-a8e9-2547addf625d req-b3bdcade-14a0-4b28-bc25-90c10b5c319b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.112072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-87b6bb7f-dbce-47a2-a8e9-2547addf625d req-b3bdcade-14a0-4b28-bc25-90c10b5c319b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.130740 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-87b6bb7f-dbce-47a2-a8e9-2547addf625d req-b3bdcade-14a0-4b28-bc25-90c10b5c319b service nova] Creating event network-changed:7f5425e4-ec40-44fe-90e4-23cc30118671 for instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 on nch2-master-1 May 14 21:23:29.138721 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-87b6bb7f-dbce-47a2-a8e9-2547addf625d req-b3bdcade-14a0-4b28-bc25-90c10b5c319b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062351 May 14 21:23:29.138721 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1819/3401] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:29.149017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:29.150858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:29.161816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.168020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.168020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.168020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.310878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:29.320435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1cf2f800-ed26-4eb8-84e2-f2bb5a23b257 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.330897 May 14 21:23:29.321113 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1583/3402] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:28 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:29.326929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5773162a-4d49-408b-90b6-97bbec5d1105 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:29.327861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5773162a-4d49-408b-90b6-97bbec5d1105 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:29.334323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5773162a-4d49-408b-90b6-97bbec5d1105 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.334869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5773162a-4d49-408b-90b6-97bbec5d1105 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.335858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5773162a-4d49-408b-90b6-97bbec5d1105 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.336311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5773162a-4d49-408b-90b6-97bbec5d1105 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.353613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:29.361922 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0a354bd-c941-4c60-8e53-355ae52303af tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1494 microversion: 2.1 time: 0.222880 May 14 21:23:29.364230 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1820/3403] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:29 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1494 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:29.467446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:29.469743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:29.472632 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5773162a-4d49-408b-90b6-97bbec5d1105 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.150016 May 14 21:23:29.482596 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1584/3404] 10.222.0.52 () {60 vars in 1315 bytes} [Sat May 14 21:23:29 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90/os-interface => generated 1832 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:23:29.488512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.489221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.490375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.491039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.746905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcd50364-8f68-49bb-a0b7-51363253956d tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-647623281", "imageRef": "0aac1a55-07a0-419b-bf2b-535e7c41d5f7", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:29.839871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-bcd50364-8f68-49bb-a0b7-51363253956d tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:23:29.868541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:29.881203 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a0b28939-2dfc-462d-96df-3bd29555bb27 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1493 microversion: 2.1 time: 0.418063 May 14 21:23:29.882255 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1821/3405] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:29 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1493 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:29.906464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:29.907249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:29.915732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.919981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.919981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:29.919981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:29.961549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:23:30.143187 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-bcd50364-8f68-49bb-a0b7-51363253956d tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcd50364-8f68-49bb-a0b7-51363253956d tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] Request method failure captured: May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 142 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3PYTW_4jm5RxLsu0ujKh3zxXXd6duzuWmdQV9IBNrB-_4feJKqq5b0eIw8x_2YY5REnIX73hlzsgRxRNdklb7g-dVAOJ6JB-7sDkP6dddcBNY9tnQsMYHcLhtRXxTYx8BPJ1ZH0VjVubnQtUdDflAjL8-7Yv7PftyzQAp3l_E5yaQ May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 73731f1637db4792b4523545840a6f8c May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FlavorsV2NegativeTest-1871583979 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73731f1637db4792b4523545840a6f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/73731f1637db4792b4523545840a6f8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/73731f1637db4792b4523545840a6f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_73731f1637db4792b4523545840a6f8c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FlavorsV2NegativeTest-1871583979 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 73731f1637db4792b4523545840a6f8c May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1871583979 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FlavorsV2NegativeTest-1871583979-project May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1f256f3ef91b4df484d198fc7ce01296 May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FlavorsV2NegativeTest-1871583979-project May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-647623281", "imageRef": "0aac1a55-07a0-419b-bf2b-535e7c41d5f7", "flavorRef": "452"}} May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor's memory is too small for requested image. May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-647623281', 'imageRef': '0aac1a55-07a0-419b-bf2b-535e7c41d5f7', 'flavorRef': '452'}}} May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:30.145213 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:30.149702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcd50364-8f68-49bb-a0b7-51363253956d tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:30.150982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bcd50364-8f68-49bb-a0b7-51363253956d tempest-FlavorsV2NegativeTest-1871583979 tempest-FlavorsV2NegativeTest-1871583979-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.408038 May 14 21:23:30.151366 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1585/3406] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:29 2022] POST /compute/v2.1/servers => generated 93 bytes in 411 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 14 21:23:30.342923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-382198333", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:30.380390 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f80b162-d731-4007-a5e7-0a35e1e50165 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 204 len: 0 microversion: 2.1 time: 0.479054 May 14 21:23:30.381245 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1822/3407] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:29 2022] DELETE /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:23:30.394254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:30.399449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:30.411710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:30.412520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:30.413342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:30.413849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:30.435899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] validate_networks() for [('a654f805-d693-47d5-9845-d68b7a2a07c5', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:23:30.660945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:30.670030 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e16e39c-6b53-44cb-98d0-fcdf0516cdc9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.285720 May 14 21:23:30.670714 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1823/3408] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:30 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:30.676572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:30.677262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:30.684215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:30.685412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:30.686301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:30.687182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:30.854715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:30.863431 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c885fd13-4e80-4200-9c35-d27426baaad8 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1515 microversion: 2.1 time: 0.190508 May 14 21:23:30.864049 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1824/3409] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:30 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:30.868559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:30.869179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:30.875796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:30.876260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:30.877052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:30.877500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.067222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:23:31.067688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:23:31.068174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:23:31.068588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:23:31.069006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:23:31.080059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:31.081096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.082270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:31.082903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.110566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Getting quotas for project fe513cd0819f40d7866ce2aaa1b8ea8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:23:31.116517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Getting quotas for user 87538f2309714545bd47f228b6505883 and project fe513cd0819f40d7866ce2aaa1b8ea8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:23:31.132498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:23:31.134913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:23:31.171841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:31.179345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-57410ecf-3ac7-4cf2-bbaa-bc5e159905a6 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1499 microversion: 2.1 time: 0.314301 May 14 21:23:31.179956 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1825/3410] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:30 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1499 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:31.267387 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9753e4d9-b6f3-42a0-8bd2-1e7a17bc4f02 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.114745 May 14 21:23:31.273212 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1586/3411] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:23:31.286960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0af9a38a-92b1-4616-84fb-fff49cbaddd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:31.290687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0af9a38a-92b1-4616-84fb-fff49cbaddd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:31.426802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0af9a38a-92b1-4616-84fb-fff49cbaddd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:31.435942 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0af9a38a-92b1-4616-84fb-fff49cbaddd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1216 microversion: 2.1 time: 0.156262 May 14 21:23:31.436574 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1826/3412] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:31 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:31.676933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-51122c1d-a504-4f2a-bc21-f90ad018499d req-f0074a5b-b312-4581-9143-cb28b60448d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "tag": "ed4b2309-b8f5-4d14-9e50-2b5701924849"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:31.688422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:31.689093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:31.701663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-51122c1d-a504-4f2a-bc21-f90ad018499d req-f0074a5b-b312-4581-9143-cb28b60448d0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:31.702490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-51122c1d-a504-4f2a-bc21-f90ad018499d req-f0074a5b-b312-4581-9143-cb28b60448d0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.708991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:31.709470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.710246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:31.710690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.753101 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-51122c1d-a504-4f2a-bc21-f90ad018499d req-f0074a5b-b312-4581-9143-cb28b60448d0 service nova] Creating event network-changed:ed4b2309-b8f5-4d14-9e50-2b5701924849 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:23:31.773097 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-51122c1d-a504-4f2a-bc21-f90ad018499d req-f0074a5b-b312-4581-9143-cb28b60448d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100862 May 14 21:23:31.790106 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1587/3413] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:31.883037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:31.883790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:31.909765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:31.910249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.911056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:31.911599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:31.996541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:32.017706 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-523206c6-9fba-42e1-92a4-868062c0fb39 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.334741 May 14 21:23:32.027742 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1827/3414] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:31 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:32.198798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:32.201381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:32.210385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:32.211724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:32.212984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:32.214028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:32.433731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:32.443264 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-57c6e34d-22a2-4be0-8188-9115a69b78af tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1499 microversion: 2.1 time: 0.249988 May 14 21:23:32.444658 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1828/3415] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:32 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1499 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:32.454058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5b97be5-f1fd-4479-ba46-dc763646b25c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:32.455625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5b97be5-f1fd-4479-ba46-dc763646b25c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:32.552110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5b97be5-f1fd-4479-ba46-dc763646b25c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:32.570134 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5b97be5-f1fd-4479-ba46-dc763646b25c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1216 microversion: 2.1 time: 0.119295 May 14 21:23:32.572978 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1829/3416] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:32 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:32.836613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:32.845774 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c6e018f-683a-4466-9632-344ef31bb66f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.967138 May 14 21:23:32.848952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1588/3417] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:31 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:33.034640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:33.035335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:33.046481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.047298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.048330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.049013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.326569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:33.338555 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1fe2eda4-8b7a-43da-a27d-2c93d20fd31e tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.307577 May 14 21:23:33.349587 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1830/3418] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:33 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:33.463870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:33.464876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:33.475803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.477188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.478269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.479111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.593251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:33.594486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:33.617217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.622724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.627008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.628855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.766529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:33.798530 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d64af30d-3105-46bc-897b-387225ac53e0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1268 microversion: 2.1 time: 0.211967 May 14 21:23:33.799775 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1831/3419] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:33 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1268 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:33.852936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:33.867086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:33.867765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:33.869214 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fa287e26-e348-47a6-ac7c-6a3ec748fa36 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1457 microversion: 2.1 time: 0.411095 May 14 21:23:33.874506 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1589/3420] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:33 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1457 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:33.902230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.905932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.908913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:33.909321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:33.979773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-84bfbdd9-d084-45e0-9906-73cc7fad0058 req-7277e962-4e3b-4de1-8b04-60cf9325d1c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98cfa904-6334-446b-9c55-78b1cad1609b", "name": "network-vif-deleted", "tag": "bffc484e-a9f4-471b-ac3c-ff72cedc60b5"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:34.040622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84bfbdd9-d084-45e0-9906-73cc7fad0058 req-7277e962-4e3b-4de1-8b04-60cf9325d1c4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.041529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-84bfbdd9-d084-45e0-9906-73cc7fad0058 req-7277e962-4e3b-4de1-8b04-60cf9325d1c4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.074334 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-84bfbdd9-d084-45e0-9906-73cc7fad0058 req-7277e962-4e3b-4de1-8b04-60cf9325d1c4 service nova] Creating event network-vif-deleted:bffc484e-a9f4-471b-ac3c-ff72cedc60b5 for instance 98cfa904-6334-446b-9c55-78b1cad1609b on nch1-master-1 May 14 21:23:34.087724 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-84bfbdd9-d084-45e0-9906-73cc7fad0058 req-7277e962-4e3b-4de1-8b04-60cf9325d1c4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124555 May 14 21:23:34.089721 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1590/3421] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:34.304236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:34.317481 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8384d30-a6a5-4a9e-b9ce-94e8f0157887 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.453626 May 14 21:23:34.323312 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1832/3422] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:33 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:34.359769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:34.370086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:34.407012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.409684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.410788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.412285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.502990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0b3d9c7e-723a-4ca7-b043-5c60edd95107 req-5df907bf-5a3f-4e83-9ff3-d9c8a2b61470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af92eb0e-dba1-4109-ae5a-2d8d02806cb0", "name": "network-vif-plugged", "status": "completed", "tag": "af229f26-8c15-4496-83fd-3745d3601050"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:34.526024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0b3d9c7e-723a-4ca7-b043-5c60edd95107 req-5df907bf-5a3f-4e83-9ff3-d9c8a2b61470 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.526626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0b3d9c7e-723a-4ca7-b043-5c60edd95107 req-5df907bf-5a3f-4e83-9ff3-d9c8a2b61470 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.574509 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0b3d9c7e-723a-4ca7-b043-5c60edd95107 req-5df907bf-5a3f-4e83-9ff3-d9c8a2b61470 service nova] Creating event network-vif-plugged:af229f26-8c15-4496-83fd-3745d3601050 for instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 on nch2-master-1 May 14 21:23:34.595640 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0b3d9c7e-723a-4ca7-b043-5c60edd95107 req-5df907bf-5a3f-4e83-9ff3-d9c8a2b61470 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096393 May 14 21:23:34.608167 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1833/3423] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:23:34.817587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:34.818399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:34.835387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.836273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.837281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.837937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.868375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:34.881503 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-295e4b1a-2c63-4835-9892-0da0bdf0bfe1 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.525414 May 14 21:23:34.882538 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1591/3424] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:34 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:34.903808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:34.903808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:34.910776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.911720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.943308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:34.944033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:34.998330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:35.019227 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-756806ae-216f-4d3a-be59-c705880835ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1286 microversion: 2.1 time: 0.206154 May 14 21:23:35.022237 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1834/3425] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:34 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:35.034609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:35.034930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:35.035399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lazy-loading 'fault' on Instance uuid 98cfa904-6334-446b-9c55-78b1cad1609b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:23:35.140670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71080496c33c4e2c8b2e16b950f0b9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b031454047774b4fb8b459f226f645d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:35.156005 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-56b69fe8-298d-4419-a8f8-8c04b2e025e0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 200 len: 1305 microversion: 2.1 time: 0.270101 May 14 21:23:35.156640 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1592/3426] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:34 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 1305 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:35.344090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:35.344767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:35.361705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:35.362188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:35.365518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:35.366040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:35.593864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:35.602398 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-497e28aa-2a63-4c2c-8f77-4038f1726522 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.264990 May 14 21:23:35.602980 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1835/3427] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:35 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:35.911811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:35.912985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:35.929822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:35.930875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:35.932099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:35.932780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.042369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.043065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.055282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.059354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.062700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.063156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.188461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:36.198354 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c75c9474-8905-48fc-a5f2-a8f42f018806 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.301228 May 14 21:23:36.199469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1593/3428] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:35 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:36.204730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.205700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.212307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.213035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.214063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.214794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.255575 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b HTTP/1.1 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '98cfa904-6334-446b-9c55-78b1cad1609b'} May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.265465 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.271430 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.271430 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.271430 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.271430 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.271430 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.271430 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.271430 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.274913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.276639 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-89659a52-318d-450a-bd91-dd92722bf751 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 404 len: 111 microversion: 2.1 time: 0.075408 May 14 21:23:36.277890 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1594/3429] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.293061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.293931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.331121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.332033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.332150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:36.333231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.333901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.347348 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2453a09e-5f6f-42e7-b685-88f21f2fa7b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.309460 May 14 21:23:36.347973 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1836/3430] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:36.367743 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b HTTP/1.1 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '98cfa904-6334-446b-9c55-78b1cad1609b'} May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.369893 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.374499 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.376479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.377611 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ddf6a0b-0e00-4ce5-9bf1-a12ad44af46a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 404 len: 111 microversion: 2.1 time: 0.088544 May 14 21:23:36.378754 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1595/3431] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:36 2022] DELETE /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.388996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.389620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 98cfa904-6334-446b-9c55-78b1cad1609b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.401632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.402315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.403763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.404905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.421248 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b HTTP/1.1 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '98cfa904-6334-446b-9c55-78b1cad1609b'} May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.424011 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 98cfa904-6334-446b-9c55-78b1cad1609b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.433345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-152aa205-eba6-4796-946c-603b548219cb tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b" status: 404 len: 111 microversion: 2.1 time: 0.042354 May 14 21:23:36.439414 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1837/3432] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/98cfa904-6334-446b-9c55-78b1cad1609b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.442556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.443141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.453383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.453907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.456210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.458947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.488659 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b HTTP/1.1 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '43bbc2dd-60e5-44e4-9601-74231273003b'} May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.497461 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1cd5e32e-513d-49a3-b67d-4d740074958a tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 404 len: 111 microversion: 2.1 time: 0.061209 May 14 21:23:36.504051 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1596/3433] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:36 2022] DELETE /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.508241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.509041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 43bbc2dd-60e5-44e4-9601-74231273003b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.521832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.524642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.525609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.528602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.562057 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b HTTP/1.1 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '43bbc2dd-60e5-44e4-9601-74231273003b'} May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.564198 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 43bbc2dd-60e5-44e4-9601-74231273003b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.568009 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a484005-32b6-4c6f-b456-62eecb743916 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b" status: 404 len: 111 microversion: 2.1 time: 0.064950 May 14 21:23:36.575777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.576475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.580717 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1838/3434] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/43bbc2dd-60e5-44e4-9601-74231273003b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.584069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.584536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.585316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.585992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.621097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.621944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.629765 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.630964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc HTTP/1.1 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '21fc6710-88a8-420b-b6cd-901e9eef71dc'} May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.631562 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.636344 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.638275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.638520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.638614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.638614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.638765 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f219b256-5268-421d-86c3-96f04b0f3183 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 404 len: 111 microversion: 2.1 time: 0.062024 May 14 21:23:36.638765 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1597/3435] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:36 2022] DELETE /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.640854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-168dcc57-3116-41b9-98c8-61d7e9c9b242 req-56af59d3-7c54-446b-b982-ca163e6188bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d937c28-2ab7-41a9-8611-b8f0d77749a6", "name": "network-vif-plugged", "status": "completed", "tag": "7f5425e4-ec40-44fe-90e4-23cc30118671"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:36.652289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-168dcc57-3116-41b9-98c8-61d7e9c9b242 req-56af59d3-7c54-446b-b982-ca163e6188bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.652811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-168dcc57-3116-41b9-98c8-61d7e9c9b242 req-56af59d3-7c54-446b-b982-ca163e6188bc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.677363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-168dcc57-3116-41b9-98c8-61d7e9c9b242 req-56af59d3-7c54-446b-b982-ca163e6188bc service nova] Creating event network-vif-plugged:7f5425e4-ec40-44fe-90e4-23cc30118671 for instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 on nch2-master-1 May 14 21:23:36.687824 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-168dcc57-3116-41b9-98c8-61d7e9c9b242 req-56af59d3-7c54-446b-b982-ca163e6188bc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052397 May 14 21:23:36.689255 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1598/3436] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:36.696686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.701033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 21fc6710-88a8-420b-b6cd-901e9eef71dc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.710458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.711190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.712276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.712990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.735079 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc HTTP/1.1 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '21fc6710-88a8-420b-b6cd-901e9eef71dc'} May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.738006 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 21fc6710-88a8-420b-b6cd-901e9eef71dc could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-75471901-6e9b-4902-9aed-5103be443225 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc" status: 404 len: 111 microversion: 2.1 time: 0.049033 May 14 21:23:36.745498 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1599/3437] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/21fc6710-88a8-420b-b6cd-901e9eef71dc => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.751742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.752474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.759271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.764685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.764685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.764685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.778589 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c HTTP/1.1 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1fee5556-bd76-4312-b8c9-07955c04e89c'} May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.780593 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.788928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8ba8b7d-8d3d-4258-939f-3b918c685760 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 404 len: 111 microversion: 2.1 time: 0.039985 May 14 21:23:36.790078 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1600/3438] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:36 2022] DELETE /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.795835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.796696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 1fee5556-bd76-4312-b8c9-07955c04e89c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.803806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.804503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.805742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.806338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.828447 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c HTTP/1.1 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1fee5556-bd76-4312-b8c9-07955c04e89c'} May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.830277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 1fee5556-bd76-4312-b8c9-07955c04e89c could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.834663 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-25199b33-3b75-4237-81cf-a3db682a11c0 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c" status: 404 len: 111 microversion: 2.1 time: 0.040681 May 14 21:23:36.836582 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1601/3439] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/1fee5556-bd76-4312-b8c9-07955c04e89c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.841034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.841623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: d53680f2-134e-4b0b-9fe3-c669b62e4c30] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.851914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.852525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.853487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.853944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.872959 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 HTTP/1.1 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd53680f2-134e-4b0b-9fe3-c669b62e4c30'} May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.876241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.880782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97db641a-1c23-4e22-ad75-2af1d88ad0d2 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30" status: 404 len: 111 microversion: 2.1 time: 0.040907 May 14 21:23:36.882679 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1602/3440] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:36 2022] DELETE /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:36.889998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:36.890634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: d53680f2-134e-4b0b-9fe3-c669b62e4c30] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:36.902762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.903802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.904924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:36.905528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:36.933927 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 HTTP/1.1 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd53680f2-134e-4b0b-9fe3-c669b62e4c30'} May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:36.936971 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance d53680f2-134e-4b0b-9fe3-c669b62e4c30 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c2ce8af-08cf-405f-ba88-c5644375c6da tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30" status: 404 len: 111 microversion: 2.1 time: 0.054847 May 14 21:23:36.942092 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1603/3441] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/d53680f2-134e-4b0b-9fe3-c669b62e4c30 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:37.111283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:37.122670 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1372aff2-7ee5-4f6a-91e2-653833135d40 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.505498 May 14 21:23:37.128396 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1839/3442] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:36 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:37.219633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:37.220185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:37.239574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:37.243858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:37.244764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:37.245224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:37.371059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:37.372516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:37.381147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:37.381886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:37.383219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:37.384142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:37.621838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:37.632073 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ace0b2cd-45d1-4074-9c34-726a98fac41d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.268909 May 14 21:23:37.633370 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1840/3443] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:37 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:37.635269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:37.646494 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2317b0ba-3ca4-4e74-b97a-47fae75b7136 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.435287 May 14 21:23:37.650033 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1604/3444] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:37 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:38.143767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:38.144814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:38.158277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:38.159216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:38.164384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:38.164847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:38.276789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2a7bd302-6b4d-43cb-afc1-f155aa89f24e req-06b21fd7-2a25-4f8d-ba5d-0552a5fe8b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d052efd6-ef23-4eec-b96a-78cd75a193b1", "tag": "d14fe5ed-9ab8-4c6c-893f-768a8f7db696"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:38.300135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2a7bd302-6b4d-43cb-afc1-f155aa89f24e req-06b21fd7-2a25-4f8d-ba5d-0552a5fe8b44 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:38.301025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2a7bd302-6b4d-43cb-afc1-f155aa89f24e req-06b21fd7-2a25-4f8d-ba5d-0552a5fe8b44 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:38.354518 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2a7bd302-6b4d-43cb-afc1-f155aa89f24e req-06b21fd7-2a25-4f8d-ba5d-0552a5fe8b44 service nova] Creating event network-changed:d14fe5ed-9ab8-4c6c-893f-768a8f7db696 for instance d052efd6-ef23-4eec-b96a-78cd75a193b1 on nch2-master-1 May 14 21:23:38.360822 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2a7bd302-6b4d-43cb-afc1-f155aa89f24e req-06b21fd7-2a25-4f8d-ba5d-0552a5fe8b44 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097780 May 14 21:23:38.362089 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1605/3445] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:23:38.482085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:38.489899 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a0eabf0d-917e-4424-9b6f-c90afd49109a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.351376 May 14 21:23:38.490567 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1841/3446] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:38 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:38.652217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:38.652855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:38.660422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:38.660990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:38.661836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:38.662376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:38.667236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:38.667979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:38.675821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:38.676279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:38.677500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:38.677944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:38.846593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:38.869399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:38.874583 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-462a5f6e-d355-4484-b5b2-99cdbce1d52c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1323 microversion: 2.1 time: 0.212924 May 14 21:23:38.875177 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1842/3447] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:38 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1323 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:38.878186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ef508187-183e-4bf2-be2d-8a9561eb815a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.231444 May 14 21:23:38.879323 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1606/3448] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:38 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:39.510984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:39.512086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:39.524623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:39.525085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:39.534900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:39.535313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:39.765686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:39.782387 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-159f7814-7412-422f-8628-80dc42092194 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.271780 May 14 21:23:39.782387 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1843/3449] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:39 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:39.896891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:39.898060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:39.904451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:39.905591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:39.925040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:39.925570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:39.926435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:39.929386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:39.929904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:39.930552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:39.932615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:39.933076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:40.337898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:40.351808 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-066980dc-dd6c-46d1-aa72-2ddcc443dee4 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 200 len: 1518 microversion: 2.1 time: 0.463270 May 14 21:23:40.359574 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1607/3450] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:39 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 1518 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:40.383539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.124"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:40.393376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:40.404147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:40.404633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:40.405438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:40.405890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:40.496951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Acquired lock "refresh_cache-faacea54-3046-4b55-bf30-040847940731" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:23:40.591999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:40.644903 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-91611732-8b2c-4bb5-945a-ce814314e4b3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.746960 May 14 21:23:40.645517 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1844/3451] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:39 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:40.797557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:40.798193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:40.821312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:40.821785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:40.829701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:40.831578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:41.159662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:41.169205 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2b40d3af-acd0-4b73-adde-915b6742047f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.376707 May 14 21:23:41.169841 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1845/3452] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:40 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:41.664103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:41.664729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:41.681015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:41.681726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:41.685829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:41.686514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:41.999597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:42.008974 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c4bef5f-f142-42e5-b77a-4f8c688b3b93 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.349438 May 14 21:23:42.013072 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1846/3453] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:41 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:42.188107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:42.189024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:42.206422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:42.209321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:42.211805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:42.213892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:42.513597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:42.523590 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83e6b7b0-bc06-4f92-809a-be568908b617 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.341069 May 14 21:23:42.534309 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1847/3454] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:42 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:43.033262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:43.035058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:43.059128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:43.059774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:43.060913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:43.061579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:43.496703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:43.505774 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83bfd899-580c-4178-ad6e-106016ad80a1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.479827 May 14 21:23:43.513458 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1848/3455] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:43 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:43.542865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:43.544555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:43.556819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:43.558068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:43.560368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:43.564097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:43.726558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Building network info cache for instance {{(pid=130637) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:23:44.534303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:44.544446 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e6041d26-4235-4130-883f-2de408d071b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 1.006127 May 14 21:23:44.558769 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1849/3456] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:43 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:44.565344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-149d0ad5-27eb-452d-b9f2-7e28e61146b9 req-6551c255-6b3a-4903-8811-1c759b1947b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faacea54-3046-4b55-bf30-040847940731", "tag": "5837daea-a74b-411d-b12d-81c8f1cedc5b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:44.576006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-149d0ad5-27eb-452d-b9f2-7e28e61146b9 req-6551c255-6b3a-4903-8811-1c759b1947b4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:44.579131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-149d0ad5-27eb-452d-b9f2-7e28e61146b9 req-6551c255-6b3a-4903-8811-1c759b1947b4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:44.596454 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-149d0ad5-27eb-452d-b9f2-7e28e61146b9 req-6551c255-6b3a-4903-8811-1c759b1947b4 service nova] Creating event network-changed:5837daea-a74b-411d-b12d-81c8f1cedc5b for instance faacea54-3046-4b55-bf30-040847940731 on nch2-master-1 May 14 21:23:44.605275 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-149d0ad5-27eb-452d-b9f2-7e28e61146b9 req-6551c255-6b3a-4903-8811-1c759b1947b4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044764 May 14 21:23:44.606791 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1850/3457] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:44.628530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:44.630168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:44.642336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:44.643647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:44.646023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:44.646666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:44.966324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Updating instance_info_cache with network_info: [{"id": "5837daea-a74b-411d-b12d-81c8f1cedc5b", "address": "fa:16:3e:06:ea:d8", "network": {"id": "b6600266-4425-42b1-a9f0-5eddc540b575", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-775159343-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "155b6f457be24818bb00db2560ef96fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5837daea-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:23:45.040223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Releasing lock "refresh_cache-faacea54-3046-4b55-bf30-040847940731" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:23:45.044017 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6e33d382-36d4-4930-9fcc-7e4ec5670816 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action" status: 202 len: 0 microversion: 2.1 time: 4.667796 May 14 21:23:45.048942 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1608/3458] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:23:40 2022] POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action => generated 0 bytes in 4675 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:23:45.057769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.124"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:45.063268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:45.079847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:45.081084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:45.082183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:45.082945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:45.149571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Acquired lock "refresh_cache-8d937c28-2ab7-41a9-8611-b8f0d77749a6" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:23:45.154619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:45.162634 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-03e5b103-45e8-4309-b5e7-0697c7f95ef3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.554374 May 14 21:23:45.163206 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1851/3459] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:44 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:45.567094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:45.567805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:45.582308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:45.584315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:45.585534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:45.586454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:45.812731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:45.831257 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15e4666a-d6a8-445f-a2ff-2956731a4da3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.270776 May 14 21:23:45.838465 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1852/3460] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:45 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:46.180593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:46.181218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:46.202092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:46.209900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:46.214415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:46.219145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:46.569139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:46.581615 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e9dc3c63-9aea-4826-901b-ab3cd8d26f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.405022 May 14 21:23:46.583878 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1853/3461] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:46 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:46.849479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:46.850439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:46.859305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:46.868473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:46.868473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:46.868473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:47.482038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:47.497855 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f3904d5-e967-4e51-80a6-4ea2969bdaee tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.651410 May 14 21:23:47.501754 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1854/3462] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:46 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:47.509713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-11c7591d-6269-43b7-8725-b5b0f48be965 req-bf6c3559-252d-4547-b227-c54068dbdc82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d052efd6-ef23-4eec-b96a-78cd75a193b1", "name": "network-vif-plugged", "status": "completed", "tag": "d14fe5ed-9ab8-4c6c-893f-768a8f7db696"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:47.530828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-11c7591d-6269-43b7-8725-b5b0f48be965 req-bf6c3559-252d-4547-b227-c54068dbdc82 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:47.535339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-11c7591d-6269-43b7-8725-b5b0f48be965 req-bf6c3559-252d-4547-b227-c54068dbdc82 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:47.563360 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-11c7591d-6269-43b7-8725-b5b0f48be965 req-bf6c3559-252d-4547-b227-c54068dbdc82 service nova] Creating event network-vif-plugged:d14fe5ed-9ab8-4c6c-893f-768a8f7db696 for instance d052efd6-ef23-4eec-b96a-78cd75a193b1 on nch2-master-1 May 14 21:23:47.583345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-11c7591d-6269-43b7-8725-b5b0f48be965 req-bf6c3559-252d-4547-b227-c54068dbdc82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078860 May 14 21:23:47.587174 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1855/3463] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:47.601592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:47.602578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:47.615434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:47.616367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:47.618381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:47.619028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.154690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:48.163739 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c8521b6-c896-41e0-851d-e4737db4af8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.567869 May 14 21:23:48.166527 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1856/3464] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:47 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:48.333974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:48.334532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:48.366801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.367360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.380945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.381485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.424607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 HTTP/1.1 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b2e74105-d641-42cc-8282-4c6d13ec0581'} May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:48.436249 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:48.446307 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e8f7de30-37fe-4bb7-b62a-0a7667333448 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 404 len: 111 microversion: 2.1 time: 0.113058 May 14 21:23:48.459932 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1857/3465] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:48 2022] DELETE /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:23:48.472154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:48.488897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: b2e74105-d641-42cc-8282-4c6d13ec0581] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:48.513365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.513365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.527443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.534216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.555284 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 HTTP/1.1 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b2e74105-d641-42cc-8282-4c6d13ec0581'} May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:48.561212 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.565491 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.565491 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:48.565491 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:48.565491 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:48.565491 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:48.565491 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. May 14 21:23:48.565491 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.568631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance b2e74105-d641-42cc-8282-4c6d13ec0581 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:48.572190 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bc507c69-12d8-47f5-8ea3-80fab12cfa6c tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581" status: 404 len: 111 microversion: 2.1 time: 0.107765 May 14 21:23:48.573005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1858/3466] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:48 2022] GET /compute/v2.1/servers/b2e74105-d641-42cc-8282-4c6d13ec0581 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:48.586772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:48.588277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:48.603175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.608791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.620452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.620452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.855198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:48.883358 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-933deba8-4052-4c88-a3c9-73261acf76bc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.306107 May 14 21:23:48.884725 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1859/3467] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:48 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:48.893205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:48.893965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:48.909747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.910228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.913263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:48.916021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:48.938571 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d HTTP/1.1 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2d209b6a-5acd-489a-a90e-7007404e063d'} May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:48.939277 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-560cfcfc-c91d-474f-9d2e-cc7d2f7c4644 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 404 len: 111 microversion: 2.1 time: 0.054108 May 14 21:23:48.945557 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1860/3468] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:48 2022] DELETE /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:49.194371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef62cd42-5241-4b81-8f76-25b900e0c18c tempest-FloatingIPDetailsNegativeTestJSON-1532996770 tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project] Calling method '.version_select at 0x7fb1a70941f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:49.255728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG neutronclient.v2_0.client [None req-ef62cd42-5241-4b81-8f76-25b900e0c18c tempest-FloatingIPDetailsNegativeTestJSON-1532996770 tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 165b5a29-3ce4-47ad-a15b-cfeb50fdc230 could not be found", "detail": ""}} {{(pid=130638) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 14 21:23:49.255728 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ef62cd42-5241-4b81-8f76-25b900e0c18c tempest-FloatingIPDetailsNegativeTestJSON-1532996770 tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project] HTTP exception thrown: Floating IP not found for ID 165b5a29-3ce4-47ad-a15b-cfeb50fdc230 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef62cd42-5241-4b81-8f76-25b900e0c18c tempest-FloatingIPDetailsNegativeTestJSON-1532996770 tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project] Request method failure captured: May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-floating-ips/165b5a29-3ce4-47ad-a15b-cfeb50fdc230 HTTP/1.1 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3ksKSOml9BGnlLkv9IfN5R4raYM2h4dQrb773_IyxzXAZPUbNnLXUPNU_7PPy2qPxJ2ib0wZ9x3jZI2PWdqYg9Jl_-OcmO4-dX1Yx9tFVnWlUDnIlVN7AxHvux2ri1IXHUrHpaTrzyNdXwp3hjMuO3ioaUmoC0LXRY-DsS0CyG8jc May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 48cdf3efbfbc43d7bdce5958fd2ad1a4 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1532996770 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48cdf3efbfbc43d7bdce5958fd2ad1a4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/48cdf3efbfbc43d7bdce5958fd2ad1a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/48cdf3efbfbc43d7bdce5958fd2ad1a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_48cdf3efbfbc43d7bdce5958fd2ad1a4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1532996770 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 48cdf3efbfbc43d7bdce5958fd2ad1a4 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1532996770 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 00d9c6a6abe64522aca4b9a4f09f4258 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: exception: Floating IP not found for ID 165b5a29-3ce4-47ad-a15b-cfeb50fdc230 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '165b5a29-3ce4-47ad-a15b-cfeb50fdc230'} May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2809, in get_floating_ip May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 165b5a29-3ce4-47ad-a15b-cfeb50fdc230 could not be found May 14 21:23:49.257530 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c4894f-be5a-4be3-ab44-cd5cdf699606'] May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2812, in get_floating_ip May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 165b5a29-3ce4-47ad-a15b-cfeb50fdc230. May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 165b5a29-3ce4-47ad-a15b-cfeb50fdc230 May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 165b5a29-3ce4-47ad-a15b-cfeb50fdc230 May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef62cd42-5241-4b81-8f76-25b900e0c18c tempest-FloatingIPDetailsNegativeTestJSON-1532996770 tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project] Returning 404 to user: Floating IP not found for ID 165b5a29-3ce4-47ad-a15b-cfeb50fdc230 {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef62cd42-5241-4b81-8f76-25b900e0c18c tempest-FloatingIPDetailsNegativeTestJSON-1532996770 tempest-FloatingIPDetailsNegativeTestJSON-1532996770-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/165b5a29-3ce4-47ad-a15b-cfeb50fdc230" status: 404 len: 111 microversion: 2.1 time: 0.313349 May 14 21:23:49.262547 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1861/3469] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:23:48 2022] GET /compute/v2.1/os-floating-ips/165b5a29-3ce4-47ad-a15b-cfeb50fdc230 => generated 111 bytes in 319 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:49.279903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:49.284408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] [instance: 2d209b6a-5acd-489a-a90e-7007404e063d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:49.295452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:49.300213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:49.301058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:49.301516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:49.352113 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] HTTP exception thrown: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Request method failure captured: May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d HTTP/1.1 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBzSlDPKqONniOwtWtyOjpHjOMun8MOAiu2dbYNmmLrXgOds2WF9Sc21LHWZpkdrl4QbuRpDm04nfUoao9jCsAGyVsKfbl945XKoLJPaV3yobiRUBEnwKTI__WNCG7xnMPfvMVN9m_0zXSwO7A5R4ae9NYC1jEUdns0z2O5zjCRD5oI May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/b031454047774b4fb8b459f226f645d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/b031454047774b4fb8b459f226f645d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_b031454047774b4fb8b459f226f645d2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: b031454047774b4fb8b459f226f645d2 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-DeleteServersTestJSON-1962247194 May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 71080496c33c4e2c8b2e16b950f0b9ea May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-DeleteServersTestJSON-1962247194-project May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2d209b6a-5acd-489a-a90e-7007404e063d'} May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:49.359126 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] Returning 404 to user: Instance 2d209b6a-5acd-489a-a90e-7007404e063d could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-10c8838d-5437-4b22-a708-0a7aad037596 tempest-DeleteServersTestJSON-1962247194 tempest-DeleteServersTestJSON-1962247194-project] 10.222.0.52 "GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d" status: 404 len: 111 microversion: 2.1 time: 0.095528 May 14 21:23:49.363740 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1862/3470] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:49 2022] GET /compute/v2.1/servers/2d209b6a-5acd-489a-a90e-7007404e063d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:23:49.377428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:49.378519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:49.400959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:49.409154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:49.410826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:49.414675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:49.969559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:49.992907 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef17179e-e5c4-491a-9994-fa76e86955f1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1316 microversion: 2.1 time: 0.630577 May 14 21:23:49.998804 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1863/3471] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:49 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1316 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:50.015265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:50.023721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:50.038870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:50.039626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:50.041464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:50.042070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:50.595585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:50.604633 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d25f23c-acd8-43eb-8841-29a742d41288 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.595312 May 14 21:23:50.608616 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1864/3472] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:49 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:50.703974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fb07f440-7c8c-4733-bb6d-ee36bd3205d7 req-9a0327b5-2a4c-449e-80f4-b08be8bbc88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faacea54-3046-4b55-bf30-040847940731", "tag": "5837daea-a74b-411d-b12d-81c8f1cedc5b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:50.732436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fb07f440-7c8c-4733-bb6d-ee36bd3205d7 req-9a0327b5-2a4c-449e-80f4-b08be8bbc88b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:50.732436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fb07f440-7c8c-4733-bb6d-ee36bd3205d7 req-9a0327b5-2a4c-449e-80f4-b08be8bbc88b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:50.763571 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fb07f440-7c8c-4733-bb6d-ee36bd3205d7 req-9a0327b5-2a4c-449e-80f4-b08be8bbc88b service nova] Creating event network-changed:5837daea-a74b-411d-b12d-81c8f1cedc5b for instance faacea54-3046-4b55-bf30-040847940731 on nch2-master-1 May 14 21:23:50.777677 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fb07f440-7c8c-4733-bb6d-ee36bd3205d7 req-9a0327b5-2a4c-449e-80f4-b08be8bbc88b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077770 May 14 21:23:50.784424 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1865/3473] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:23:51.015508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:51.016227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:51.039080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:51.039577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:51.040395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:51.040846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:51.116522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.network.neutron [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] re-assign floating IP 172.35.4.124 from instance faacea54-3046-4b55-bf30-040847940731 May 14 21:23:51.142321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Building network info cache for instance {{(pid=130637) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:23:51.639559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:51.649460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6b0ff120-8b27-4151-a933-7731d2c37812 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.639367 May 14 21:23:51.650660 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1866/3474] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:51 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:51.676692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:51.677718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:51.687172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:51.696037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:51.696037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:51.696037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:52.349502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:52.369773 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a42fd345-fa8e-4ca9-9207-0b6d85d3547b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.712985 May 14 21:23:52.370457 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1867/3475] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:51 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:52.395347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1340369682", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:52.523443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] validate_networks() for [('a654f805-d693-47d5-9845-d68b7a2a07c5', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:23:53.100974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Updating instance_info_cache with network_info: [{"id": "5837daea-a74b-411d-b12d-81c8f1cedc5b", "address": "fa:16:3e:06:ea:d8", "network": {"id": "b6600266-4425-42b1-a9f0-5eddc540b575", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-775159343-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "155b6f457be24818bb00db2560ef96fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5837daea-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:23:53.112894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Building network info cache for instance {{(pid=130637) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:23:54.175716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Updating instance_info_cache with network_info: [{"id": "7f5425e4-ec40-44fe-90e4-23cc30118671", "address": "fa:16:3e:56:8c:78", "network": {"id": "b6600266-4425-42b1-a9f0-5eddc540b575", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-775159343-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "155b6f457be24818bb00db2560ef96fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f5425e4-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:23:54.390958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Releasing lock "refresh_cache-8d937c28-2ab7-41a9-8611-b8f0d77749a6" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:23:54.391565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e56917be-5bd6-4e35-9434-2678c031076f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6/action" status: 202 len: 0 microversion: 2.1 time: 9.341153 May 14 21:23:54.407963 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1609/3476] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:23:45 2022] POST /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6/action => generated 0 bytes in 9358 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:23:54.431919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1233fde3-5131-496b-9f74-ce9b73ea97fe req-e174c7d6-b151-4d0c-90ad-61dc585278aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d937c28-2ab7-41a9-8611-b8f0d77749a6", "tag": "7f5425e4-ec40-44fe-90e4-23cc30118671"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:54.457022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1233fde3-5131-496b-9f74-ce9b73ea97fe req-e174c7d6-b151-4d0c-90ad-61dc585278aa service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:54.457859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1233fde3-5131-496b-9f74-ce9b73ea97fe req-e174c7d6-b151-4d0c-90ad-61dc585278aa service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:54.501478 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1233fde3-5131-496b-9f74-ce9b73ea97fe req-e174c7d6-b151-4d0c-90ad-61dc585278aa service nova] Creating event network-changed:7f5425e4-ec40-44fe-90e4-23cc30118671 for instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 on nch2-master-1 May 14 21:23:54.509087 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1233fde3-5131-496b-9f74-ce9b73ea97fe req-e174c7d6-b151-4d0c-90ad-61dc585278aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099427 May 14 21:23:54.519629 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1610/3477] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:54.526343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:54.532998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:54.555808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:54.561687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:54.570006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:54.573346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:54.837881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:23:54.838431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:23:54.838779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:23:54.839194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:23:54.839639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:23:54.861283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:54.861752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:54.862568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:54.863010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:54.923714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Getting quotas for project fe513cd0819f40d7866ce2aaa1b8ea8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:23:54.935872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Getting quotas for user 87538f2309714545bd47f228b6505883 and project fe513cd0819f40d7866ce2aaa1b8ea8d. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:23:54.978105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:23:54.995311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:23:55.255670 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b165205e-fd13-4413-901c-cffb241ae39a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.871785 May 14 21:23:55.273361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1868/3478] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:23:55.273361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.124"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:55.798482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:55.798482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:55.798482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:55.798482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:55.798482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:55.874136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:55.885919 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc48ffa2-e243-42da-ac8e-7751dfe952da tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 1.364629 May 14 21:23:55.886518 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1611/3479] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:54 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:55.891770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d617330-dff0-4029-8e69-a2281de6e4f0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:55.903245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d617330-dff0-4029-8e69-a2281de6e4f0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:56.062631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5d617330-dff0-4029-8e69-a2281de6e4f0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:56.073002 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d617330-dff0-4029-8e69-a2281de6e4f0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1217 microversion: 2.1 time: 0.181855 May 14 21:23:56.083369 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1612/3480] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:55 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:56.455052 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] HTTP exception thrown: Floating IP 172.35.4.124 is not associated with instance faacea54-3046-4b55-bf30-040847940731. May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Request method failure captured: May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action HTTP/1.1 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 49 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB2wBRk9CSHRukmwWojap4KHRLDhay7jdinTKCc6GMI9LcHaq6KTYyauceeEZ__JwTV61dPxU_1XoBsTloIJiyqPf56e2B0LyBXjAbubY0UAg1ufZc2_DTPMR51Ou_eGp8r3NiMrCkbfqW7fAS6JtPh56_g6Dk5kl7g91X5jIiGuCeE May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_155b6f457be24818bb00db2560ef96fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a7f2d4818aa7461da8f30ddfe7641d93 May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: {"removeFloatingIp": {"address": "172.35.4.124"}} May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: exception: Floating IP 172.35.4.124 is not associated with instance faacea54-3046-4b55-bf30-040847940731. May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'faacea54-3046-4b55-bf30-040847940731', 'body': {'removeFloatingIp': {'address': '172.35.4.124'}}} May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.4.124 is not associated with instance faacea54-3046-4b55-bf30-040847940731. May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.4.124 is not associated with instance faacea54-3046-4b55-bf30-040847940731. May 14 21:23:56.457689 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:23:56.462148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Returning 409 to user: Floating IP 172.35.4.124 is not associated with instance faacea54-3046-4b55-bf30-040847940731. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:23:56.462148 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2a358627-1703-4615-8fa6-3262e0761cbb tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action" status: 409 len: 146 microversion: 2.1 time: 1.195114 May 14 21:23:56.462148 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1869/3481] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:23:55 2022] POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action => generated 146 bytes in 1199 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:23:56.474190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.124"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:56.670329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:56.678690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:56.679534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:56.680434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:56.680948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:56.907172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:56.908294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:56.919943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:56.921725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:56.921725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:56.921911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:56.999507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Acquired lock "refresh_cache-8d937c28-2ab7-41a9-8611-b8f0d77749a6" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:23:57.267646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:57.275201 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e5db4701-0e21-4db8-a6a9-669fbea3d730 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1507 microversion: 2.1 time: 0.374014 May 14 21:23:57.275826 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1870/3482] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:56 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1507 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:23:57.287494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:57.288336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:57.301811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:57.304278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:57.305156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:57.306009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:57.448734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:57.460956 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-086c5498-8f89-48f5-9d61-c572af695735 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1269 microversion: 2.1 time: 0.176977 May 14 21:23:57.462205 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1871/3483] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:57 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:58.297078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:58.297724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:58.313030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:58.314465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:58.318191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:58.318737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:58.485600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Building network info cache for instance {{(pid=130637) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:23:58.729639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:58.744237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c916936-41ea-45c2-8067-72e45a0927ff tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1507 microversion: 2.1 time: 0.452120 May 14 21:23:58.747686 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1872/3484] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:58 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:58.784814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:58.792240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:58.803139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:58.803681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:58.804515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:58.805126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:58.948319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:23:58.962242 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d66789d4-c309-4664-bc0d-8b5bcd0ccaf9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1275 microversion: 2.1 time: 0.200447 May 14 21:23:58.962779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1873/3485] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:23:58 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1275 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:23:58.973761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-f1cc3eaf-5e01-47cf-b2a4-e675daa8bb40 req-76cfc0fb-11ac-467d-b239-d01f14fca657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d937c28-2ab7-41a9-8611-b8f0d77749a6", "tag": "7f5425e4-ec40-44fe-90e4-23cc30118671"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:58.989774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f1cc3eaf-5e01-47cf-b2a4-e675daa8bb40 req-76cfc0fb-11ac-467d-b239-d01f14fca657 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:58.990301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f1cc3eaf-5e01-47cf-b2a4-e675daa8bb40 req-76cfc0fb-11ac-467d-b239-d01f14fca657 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:59.024433 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-f1cc3eaf-5e01-47cf-b2a4-e675daa8bb40 req-76cfc0fb-11ac-467d-b239-d01f14fca657 service nova] Creating event network-changed:7f5425e4-ec40-44fe-90e4-23cc30118671 for instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 on nch2-master-1 May 14 21:23:59.033359 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-f1cc3eaf-5e01-47cf-b2a4-e675daa8bb40 req-76cfc0fb-11ac-467d-b239-d01f14fca657 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068605 May 14 21:23:59.034901 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1874/3486] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:23:59.510769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Updating instance_info_cache with network_info: [{"id": "7f5425e4-ec40-44fe-90e4-23cc30118671", "address": "fa:16:3e:56:8c:78", "network": {"id": "b6600266-4425-42b1-a9f0-5eddc540b575", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-775159343-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "155b6f457be24818bb00db2560ef96fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap7f5425e4-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:23:59.635094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Releasing lock "refresh_cache-8d937c28-2ab7-41a9-8611-b8f0d77749a6" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:23:59.639162 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a9dd1e7-4c6a-483d-a8d6-2c4b659feded tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6/action" status: 202 len: 0 microversion: 2.1 time: 3.169004 May 14 21:23:59.639162 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1613/3487] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:23:56 2022] POST /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6/action => generated 0 bytes in 3171 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:23:59.649679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:23:59.650896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:23:59.660026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:59.664164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:59.664164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:23:59.664164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:23:59.699209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:23:59.912473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-439914080", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "4d7d4cb8-de36-4d1b-ae16-386ec3edd500"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:23:59.975983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] validate_networks() for [('4d7d4cb8-de36-4d1b-ae16-386ec3edd500', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:24:00.220576 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f1e29fcc-06ad-48b6-bb11-c208fb95409c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 204 len: 0 microversion: 2.1 time: 0.576346 May 14 21:24:00.225994 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1875/3488] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:23:59 2022] DELETE /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:00.238231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:00.239434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:00.252002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:00.253515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:00.256803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:00.257461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:00.524478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:00.538546 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fb63c7cc-408a-4799-be8b-1db07f922d88 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1507 microversion: 2.1 time: 0.310807 May 14 21:24:00.540459 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1876/3489] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:00 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:00.546803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:00.548368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:00.559295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:00.560660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:00.562111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:00.562111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:00.758907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:00.767114 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ab06fa3-3980-45bf-98d4-eeeb5d571e8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1317 microversion: 2.1 time: 0.225612 May 14 21:24:00.768216 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1877/3490] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:00 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:00.773384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.4.124"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:00.774474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:00.795255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:00.795758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:00.796733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:00.797330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:00.847984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Acquired lock "refresh_cache-faacea54-3046-4b55-bf30-040847940731" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:24:01.328044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:24:01.328552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:24:01.328961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:24:01.329447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:24:01.329874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:24:01.344751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:01.347917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:01.349067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:01.350478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:01.400498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Getting quotas for project 9b6232491b674705b2c339c302ac9000. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:01.406596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Getting quotas for user c4020cecd1174ff68101b6498780d00c and project 9b6232491b674705b2c339c302ac9000. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:01.424265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Going to run 3 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:24:01.427259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:24:01.602773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=656a3f63-e588-4886-8fb6-badfa00301d5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:24:01.865128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=dd230835-262d-4728-a1d2-ff33fbc18dd3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:24:02.156714 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d4684057-9590-4758-9bc2-eb7b9f13e508 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.488467 May 14 21:24:02.163208 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1614/3491] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:23:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:24:02.169411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ee6863e1-1a52-4adf-935e-8f0a5ccae32d req-0eb8408a-4363-449a-8019-ef020ea55220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af92eb0e-dba1-4109-ae5a-2d8d02806cb0", "name": "network-vif-unplugged", "status": "completed", "tag": "af229f26-8c15-4496-83fd-3745d3601050"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:02.179528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee6863e1-1a52-4adf-935e-8f0a5ccae32d req-0eb8408a-4363-449a-8019-ef020ea55220 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:02.180229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee6863e1-1a52-4adf-935e-8f0a5ccae32d req-0eb8408a-4363-449a-8019-ef020ea55220 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:02.193105 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ee6863e1-1a52-4adf-935e-8f0a5ccae32d req-0eb8408a-4363-449a-8019-ef020ea55220 service nova] Creating event network-vif-unplugged:af229f26-8c15-4496-83fd-3745d3601050 for instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 on nch2-master-1 May 14 21:24:02.199808 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ee6863e1-1a52-4adf-935e-8f0a5ccae32d req-0eb8408a-4363-449a-8019-ef020ea55220 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034216 May 14 21:24:02.200999 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1615/3492] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:02.208238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:02.209170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:02.215950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:02.216192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:02.217353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:02.217812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:02.589423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:02.613370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ea2b58c9-6b93-4e45-a95a-eee4b756a616 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 200 len: 1510 microversion: 2.1 time: 0.409475 May 14 21:24:02.616879 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1616/3493] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:02 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:02.639750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:02.640707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:02.648815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:02.649276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:02.650194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:02.650548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:02.965344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:02.973993 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a734411-fc65-49a5-bc58-504ffc5eb8dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1317 microversion: 2.1 time: 0.355913 May 14 21:24:02.975051 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1617/3494] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:02 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:02.980676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9cd8a19e-be67-4bbe-8b8f-9851ec2ad6fc req-dc5c6677-6c4b-40b3-bd15-7296acb3792c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c", "tag": "1178d7f5-ffca-4c69-a67d-4e3f79dc34f8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:02.996371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9cd8a19e-be67-4bbe-8b8f-9851ec2ad6fc req-dc5c6677-6c4b-40b3-bd15-7296acb3792c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:02.997054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9cd8a19e-be67-4bbe-8b8f-9851ec2ad6fc req-dc5c6677-6c4b-40b3-bd15-7296acb3792c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.014347 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9cd8a19e-be67-4bbe-8b8f-9851ec2ad6fc req-dc5c6677-6c4b-40b3-bd15-7296acb3792c service nova] Creating event network-changed:1178d7f5-ffca-4c69-a67d-4e3f79dc34f8 for instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c on nch1-master-1 May 14 21:24:03.021082 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9cd8a19e-be67-4bbe-8b8f-9851ec2ad6fc req-dc5c6677-6c4b-40b3-bd15-7296acb3792c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044174 May 14 21:24:03.022142 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1618/3495] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:03.036352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:03.040540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:03.045084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:03.097594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.098174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.100318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.100318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.115161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Building network info cache for instance {{(pid=130638) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:24:03.141680 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-142d0cc9-a912-42b4-ac17-d6310e9a863e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.113745 May 14 21:24:03.142482 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1619/3496] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:24:03 2022] GET /compute/v2.1/servers => generated 1015 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:03.305594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1449ff4a-a84d-4c3f-970a-6225e07bb1f5 tempest-AZV2TestJSON-1231068610 tempest-AZV2TestJSON-1231068610-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:03.307750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1449ff4a-a84d-4c3f-970a-6225e07bb1f5 tempest-AZV2TestJSON-1231068610 tempest-AZV2TestJSON-1231068610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.309319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1449ff4a-a84d-4c3f-970a-6225e07bb1f5 tempest-AZV2TestJSON-1231068610 tempest-AZV2TestJSON-1231068610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.310191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1449ff4a-a84d-4c3f-970a-6225e07bb1f5 tempest-AZV2TestJSON-1231068610 tempest-AZV2TestJSON-1231068610-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.310812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1449ff4a-a84d-4c3f-970a-6225e07bb1f5 tempest-AZV2TestJSON-1231068610 tempest-AZV2TestJSON-1231068610-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.337259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1449ff4a-a84d-4c3f-970a-6225e07bb1f5 tempest-AZV2TestJSON-1231068610 tempest-AZV2TestJSON-1231068610-project] 10.222.0.52 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.193480 May 14 21:24:03.338131 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1620/3497] 10.222.0.52 () {58 vars in 1163 bytes} [Sat May 14 21:24:03 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:24:03.364978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:03.367151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:03.380821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.385025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.387770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.389395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.596471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:03.612824 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db171af4-abb5-40bc-b3c2-6ce589ec430e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.273231 May 14 21:24:03.628091 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1621/3498] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:03 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:03.635502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9bad4ae5-4f34-4905-8ccb-3cc45a56db67 req-726b74cd-bda4-4df4-8a5e-848590256278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faacea54-3046-4b55-bf30-040847940731", "tag": "5837daea-a74b-411d-b12d-81c8f1cedc5b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:03.648376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9bad4ae5-4f34-4905-8ccb-3cc45a56db67 req-726b74cd-bda4-4df4-8a5e-848590256278 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.649221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9bad4ae5-4f34-4905-8ccb-3cc45a56db67 req-726b74cd-bda4-4df4-8a5e-848590256278 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.661508 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9bad4ae5-4f34-4905-8ccb-3cc45a56db67 req-726b74cd-bda4-4df4-8a5e-848590256278 service nova] Creating event network-changed:5837daea-a74b-411d-b12d-81c8f1cedc5b for instance faacea54-3046-4b55-bf30-040847940731 on nch2-master-1 May 14 21:24:03.666724 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9bad4ae5-4f34-4905-8ccb-3cc45a56db67 req-726b74cd-bda4-4df4-8a5e-848590256278 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037259 May 14 21:24:03.668160 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1622/3499] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:03.673557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04123bd3-1e1b-4d15-aa57-687e52e23c5d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:03.674483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04123bd3-1e1b-4d15-aa57-687e52e23c5d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:03.816502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04123bd3-1e1b-4d15-aa57-687e52e23c5d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:03.827436 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04123bd3-1e1b-4d15-aa57-687e52e23c5d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1222 microversion: 2.1 time: 0.157685 May 14 21:24:03.828753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1623/3500] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:03 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:03.840360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:03.842634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:03.885504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Updating instance_info_cache with network_info: [{"id": "5837daea-a74b-411d-b12d-81c8f1cedc5b", "address": "fa:16:3e:06:ea:d8", "network": {"id": "b6600266-4425-42b1-a9f0-5eddc540b575", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-775159343-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "155b6f457be24818bb00db2560ef96fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5837daea-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:24:03.886735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.890218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.892874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:03.894996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:03.954717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Releasing lock "refresh_cache-faacea54-3046-4b55-bf30-040847940731" {{(pid=130638) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:24:03.955835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1c7771ee-c163-4404-a1be-a8e70c902529 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action" status: 202 len: 0 microversion: 2.1 time: 3.186449 May 14 21:24:03.956986 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1878/3501] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:00 2022] POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action => generated 0 bytes in 3188 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:24:03.967220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba053a44-961f-4fb4-9c5d-e4a8655e2b92 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '.version_select at 0x7fb1a6fb1550>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:04.311959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba053a44-961f-4fb4-9c5d-e4a8655e2b92 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/os-floating-ips/6dc7d538-e903-4b47-839b-d6a6849efdc7" status: 200 len: 185 microversion: 2.1 time: 0.349224 May 14 21:24:04.320313 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1879/3502] 10.222.0.52 () {58 vars in 1259 bytes} [Sat May 14 21:24:03 2022] GET /compute/v2.1/os-floating-ips/6dc7d538-e903-4b47-839b-d6a6849efdc7 => generated 185 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:04.326643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:04.327798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:04.340585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:04.341297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:04.342302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:04.342929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:04.481805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:04.505548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-179a4e37-bb3f-4873-a4a9-8dfb8102bb0c tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.674601 May 14 21:24:04.512566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1624/3503] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:03 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:04.533630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.4.124"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:04.646147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:04.655594 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c1b2209-9341-4ef8-bc01-0ed31043950b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1317 microversion: 2.1 time: 0.333675 May 14 21:24:04.656073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1880/3504] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:04 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:04.660796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:04.661417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:04.673290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:04.673894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:04.674864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:04.675312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:04.932229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:04.942926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:04.944081 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6146a4c2-b131-40a5-b4bd-436aa36368a0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.286862 May 14 21:24:04.945806 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1881/3505] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:04 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:04.953790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f54d9952-542b-4e6b-9fad-afb3528065d0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:04.954801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f54d9952-542b-4e6b-9fad-afb3528065d0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:04.963416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:04.965704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:04.965704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:04.965704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.034836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f54d9952-542b-4e6b-9fad-afb3528065d0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:05.046434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f54d9952-542b-4e6b-9fad-afb3528065d0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1222 microversion: 2.1 time: 0.095402 May 14 21:24:05.046434 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1882/3506] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:04 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1222 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:05.049226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:05.050009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:05.060316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.061092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.062134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.062649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.295693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:05.314653 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c1396c3-0f11-440b-a418-00cc54a2a581 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.268784 May 14 21:24:05.329493 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1883/3507] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:05 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:05.336622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-af246f43-c209-4fd0-89f9-a59d607f3e20 req-968039d7-82d3-41f8-b778-b29ec2601c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d937c28-2ab7-41a9-8611-b8f0d77749a6", "name": "network-vif-deleted", "tag": "7f5425e4-ec40-44fe-90e4-23cc30118671"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:05.348484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-af246f43-c209-4fd0-89f9-a59d607f3e20 req-968039d7-82d3-41f8-b778-b29ec2601c8f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.349727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-af246f43-c209-4fd0-89f9-a59d607f3e20 req-968039d7-82d3-41f8-b778-b29ec2601c8f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.365710 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-af246f43-c209-4fd0-89f9-a59d607f3e20 req-968039d7-82d3-41f8-b778-b29ec2601c8f service nova] Creating event network-vif-deleted:7f5425e4-ec40-44fe-90e4-23cc30118671 for instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 on nch2-master-1 May 14 21:24:05.372602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-af246f43-c209-4fd0-89f9-a59d607f3e20 req-968039d7-82d3-41f8-b778-b29ec2601c8f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040618 May 14 21:24:05.373848 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1884/3508] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:05.380310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-033a0eb1-e910-4809-8b4e-bdf52327323b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:05.390825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-033a0eb1-e910-4809-8b4e-bdf52327323b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.391386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-033a0eb1-e910-4809-8b4e-bdf52327323b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.422408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-033a0eb1-e910-4809-8b4e-bdf52327323b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Going to try to stop instance {{(pid=130638) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:24:05.592548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Acquired lock "refresh_cache-faacea54-3046-4b55-bf30-040847940731" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 14 21:24:05.626558 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-033a0eb1-e910-4809-8b4e-bdf52327323b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.251025 May 14 21:24:05.627506 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1885/3509] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:05 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:24:05.640741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:05.642476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:05.652984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.657308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.659169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.659650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.824642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:05.837738 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f1b2b0c-be4c-4650-bf3b-eddf1c79ac8d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.205345 May 14 21:24:05.838984 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1886/3510] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:05 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:05.853591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:05.854352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:05.889675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.890125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:05.891321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:05.895691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:06.167539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:06.178022 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0fed77a5-6812-42ea-967a-d174b6f7dbbf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1317 microversion: 2.1 time: 0.336534 May 14 21:24:06.178911 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1887/3511] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:05 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:06.193184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:06.193803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:06.199870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:06.200340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:06.201183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:06.201568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:06.269984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:06.278466 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c401b2e9-f5b0-41eb-b3f6-0b887e73be79 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1226 microversion: 2.1 time: 0.089073 May 14 21:24:06.279050 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1888/3512] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:06 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1226 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:06.857358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:06.857985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:06.866522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:06.867361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:06.870174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:06.873829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:07.091307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:07.100673 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f661acd0-92d9-4819-8ca1-41fdd8443972 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.248796 May 14 21:24:07.101748 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1889/3513] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:06 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:07.201665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:07.202547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:07.211923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:07.215713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:07.215713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:07.215713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:07.304657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Building network info cache for instance {{(pid=130637) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1972}} May 14 21:24:07.495302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:07.504295 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b14fa726-c790-43fc-8c72-f6cde9957ae6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1317 microversion: 2.1 time: 0.311185 May 14 21:24:07.513631 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1890/3514] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:07 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:07.518924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:07.519662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:07.532264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:07.532711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:07.533725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:07.538267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:07.640418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:07.654807 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e1f2680b-2ece-4c99-a948-d80d86bce39c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1282 microversion: 2.1 time: 0.148540 May 14 21:24:07.655658 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1891/3515] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:07 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:07.662008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d2236b11-f26a-4222-918e-732f65e621ec req-85102122-8a14-440f-a53b-4d2fb41cedf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faacea54-3046-4b55-bf30-040847940731", "tag": "5837daea-a74b-411d-b12d-81c8f1cedc5b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:07.688673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d2236b11-f26a-4222-918e-732f65e621ec req-85102122-8a14-440f-a53b-4d2fb41cedf2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:07.689137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d2236b11-f26a-4222-918e-732f65e621ec req-85102122-8a14-440f-a53b-4d2fb41cedf2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:07.720197 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d2236b11-f26a-4222-918e-732f65e621ec req-85102122-8a14-440f-a53b-4d2fb41cedf2 service nova] Creating event network-changed:5837daea-a74b-411d-b12d-81c8f1cedc5b for instance faacea54-3046-4b55-bf30-040847940731 on nch2-master-1 May 14 21:24:07.727864 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d2236b11-f26a-4222-918e-732f65e621ec req-85102122-8a14-440f-a53b-4d2fb41cedf2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070701 May 14 21:24:07.728511 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1892/3516] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:08.124979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:08.124979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:08.128694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:08.129470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:08.130329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:08.131004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:08.380430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:08.391964 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1223b37f-3df1-4751-9b05-2cce857df4d6 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.275748 May 14 21:24:08.393848 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1893/3517] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:08 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:08.408140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-99b59196-f4be-41e6-9953-989b7a2581e2 req-bb5045cf-b2bd-4b47-b901-dee989cd0d1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c", "name": "network-vif-plugged", "status": "completed", "tag": "1178d7f5-ffca-4c69-a67d-4e3f79dc34f8"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:08.419167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-99b59196-f4be-41e6-9953-989b7a2581e2 req-bb5045cf-b2bd-4b47-b901-dee989cd0d1d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:08.420010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-99b59196-f4be-41e6-9953-989b7a2581e2 req-bb5045cf-b2bd-4b47-b901-dee989cd0d1d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:08.433799 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-99b59196-f4be-41e6-9953-989b7a2581e2 req-bb5045cf-b2bd-4b47-b901-dee989cd0d1d service nova] Creating event network-vif-plugged:1178d7f5-ffca-4c69-a67d-4e3f79dc34f8 for instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c on nch1-master-1 May 14 21:24:08.444019 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-99b59196-f4be-41e6-9953-989b7a2581e2 req-bb5045cf-b2bd-4b47-b901-dee989cd0d1d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043782 May 14 21:24:08.445235 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1894/3518] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:08.523038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:08.524768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:08.535242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:08.536893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:08.538128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:08.538788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:08.727642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:08.737203 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-739ecce9-f910-4852-a306-97ef93ccd54f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1317 microversion: 2.1 time: 0.219517 May 14 21:24:08.742649 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1895/3519] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:08 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:08.759872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:08.762297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:08.778103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:08.778881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:08.779991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:08.780675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:08.946911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:08.956232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d790e8f-9b59-4dcf-bad0-cfd38ee19484 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1280 microversion: 2.1 time: 0.211959 May 14 21:24:08.957160 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1896/3520] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:08 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:09.410276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:09.415872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:09.418785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.419358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.420181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.420629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.617837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:09.622138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Updating instance_info_cache with network_info: [{"id": "5837daea-a74b-411d-b12d-81c8f1cedc5b", "address": "fa:16:3e:06:ea:d8", "network": {"id": "b6600266-4425-42b1-a9f0-5eddc540b575", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-775159343-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "155b6f457be24818bb00db2560ef96fe", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5837daea-a7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=130637) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:24:09.625755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83a3551c-cdf9-4a2b-a06c-3b25a661dd62 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.219321 May 14 21:24:09.626349 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1897/3521] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:09 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:09.732088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Releasing lock "refresh_cache-faacea54-3046-4b55-bf30-040847940731" {{(pid=130637) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 14 21:24:09.733105 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b87ca6c-d9b9-4e21-93db-774b0e629f4f tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action" status: 202 len: 0 microversion: 2.1 time: 5.218752 May 14 21:24:09.734253 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1625/3522] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:04 2022] POST /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731/action => generated 0 bytes in 5221 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 14 21:24:09.744310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:09.744831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:09.750963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.753298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.754119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.754567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.764321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:09.765845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:09.772923 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] HTTP exception thrown: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Request method failure captured: May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 HTTP/1.1 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB2wBRk9CSHRukmwWojap4KHRLDhay7jdinTKCc6GMI9LcHaq6KTYyauceeEZ__JwTV61dPxU_1XoBsTloIJiyqPf56e2B0LyBXjAbubY0UAg1ufZc2_DTPMR51Ou_eGp8r3NiMrCkbfqW7fAS6JtPh56_g6Dk5kl7g91X5jIiGuCeE May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_155b6f457be24818bb00db2560ef96fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a7f2d4818aa7461da8f30ddfe7641d93 May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '8d937c28-2ab7-41a9-8611-b8f0d77749a6'} May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:09.774032 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Returning 404 to user: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bbd0c5fb-2a24-438f-9062-d8cc473e3479 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 404 len: 111 microversion: 2.1 time: 0.035862 May 14 21:24:09.780593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1898/3523] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:09 2022] DELETE /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:09.805948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.806476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.807596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.809287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.822574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:09.824638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: 8d937c28-2ab7-41a9-8611-b8f0d77749a6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:09.841187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.841839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.842665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:09.843130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:09.867494 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] HTTP exception thrown: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Request method failure captured: May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 HTTP/1.1 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB2wBRk9CSHRukmwWojap4KHRLDhay7jdinTKCc6GMI9LcHaq6KTYyauceeEZ__JwTV61dPxU_1XoBsTloIJiyqPf56e2B0LyBXjAbubY0UAg1ufZc2_DTPMR51Ou_eGp8r3NiMrCkbfqW7fAS6JtPh56_g6Dk5kl7g91X5jIiGuCeE May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_155b6f457be24818bb00db2560ef96fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a7f2d4818aa7461da8f30ddfe7641d93 May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '8d937c28-2ab7-41a9-8611-b8f0d77749a6'} May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.872743 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. May 14 21:24:09.877430 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:09.881488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Returning 404 to user: Instance 8d937c28-2ab7-41a9-8611-b8f0d77749a6 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:09.884535 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68b2247c-1246-4985-b8cf-4d5b74d84b02 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6" status: 404 len: 111 microversion: 2.1 time: 0.072619 May 14 21:24:09.885486 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1899/3524] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:09 2022] GET /compute/v2.1/servers/8d937c28-2ab7-41a9-8611-b8f0d77749a6 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:09.894092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5fa6843b-ee05-4215-88c5-acc1cb68b9ef tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '.version_select at 0x7fb1a711ac10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:10.223842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:10.232420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a637d14-b17c-4605-bedf-0c654f95cc70 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1317 microversion: 2.1 time: 0.476785 May 14 21:24:10.233792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1626/3525] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:09 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:10.238674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:10.239583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:10.247465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:10.248297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:10.249350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:10.250036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:10.447823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:10.458901 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97df0461-3606-4067-b69d-1b01e5beed11 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1280 microversion: 2.1 time: 0.222191 May 14 21:24:10.471420 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1627/3526] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:10 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:10.644514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:10.646054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:10.655760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:10.656380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:10.657723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:10.658178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:10.989779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:10.999084 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-046253e8-e807-4133-bfde-51ecf3d53ca3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.359571 May 14 21:24:11.012290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1628/3527] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:10 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:11.250046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:11.250783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:11.258789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.259286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.265188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.268857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.520263 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5fa6843b-ee05-4215-88c5-acc1cb68b9ef tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "DELETE /compute/v2.1/os-floating-ips/6dc7d538-e903-4b47-839b-d6a6849efdc7" status: 202 len: 0 microversion: 2.1 time: 1.630377 May 14 21:24:11.523873 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1900/3528] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:24:09 2022] DELETE /compute/v2.1/os-floating-ips/6dc7d538-e903-4b47-839b-d6a6849efdc7 => generated 0 bytes in 1634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:24:11.529424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:11.530291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:11.543429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.545467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.547178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.547900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.704530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:11.724106 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58a0e467-3550-4aa4-9a52-0eb0e172c1b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1505 microversion: 2.1 time: 0.477870 May 14 21:24:11.738404 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1629/3529] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:11 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:11.749830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:11.751136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:11.758781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.759249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.760086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.760533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.789692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:11.891375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:11.899135 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce05bf0a-0c6d-4431-87b2-bb41d5735cf1 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.373985 May 14 21:24:11.899756 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1901/3530] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:11 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:11.909228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:11.910526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:11.938944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.939397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.940273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:11.940712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:11.973345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:12.179233 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe79ebf9-9303-4aab-a083-8e9c895f1fa5 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "DELETE /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 204 len: 0 microversion: 2.1 time: 0.435915 May 14 21:24:12.180061 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1630/3531] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:11 2022] DELETE /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:12.187450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:12.188285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:12.201846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:12.202678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:12.203608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:12.204127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:12.522319 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-63a165fb-f155-4e2b-8470-25bb48a45878 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 204 len: 0 microversion: 2.1 time: 0.616578 May 14 21:24:12.524801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1902/3532] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:11 2022] DELETE /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:12.534939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:12.536143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:12.551247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:12.556042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:12.556042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:12.556758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:12.586308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:12.597663 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-57887a6c-edd0-4285-85be-194aa5ffe9b3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.416254 May 14 21:24:12.600239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1631/3533] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:12 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:12.613341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:12.614057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:12.627614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:12.628222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:12.633769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:12.634388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:12.972368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:12.984009 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7961675b-33f6-4f12-a6aa-d9f8d9052760 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1526 microversion: 2.1 time: 0.457420 May 14 21:24:12.986180 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1903/3534] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:12 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1526 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:12.999786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4f021473-32ea-42b9-ab00-52ed3429872b req-7c410add-ab53-4a59-aa37-0a78419f3929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "656a3f63-e588-4886-8fb6-badfa00301d5", "tag": "722b9ead-c2ae-4121-a8ee-86862e585087"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:13.018862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4f021473-32ea-42b9-ab00-52ed3429872b req-7c410add-ab53-4a59-aa37-0a78419f3929 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:13.019651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4f021473-32ea-42b9-ab00-52ed3429872b req-7c410add-ab53-4a59-aa37-0a78419f3929 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:13.039794 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4f021473-32ea-42b9-ab00-52ed3429872b req-7c410add-ab53-4a59-aa37-0a78419f3929 service nova] Creating event network-changed:722b9ead-c2ae-4121-a8ee-86862e585087 for instance 656a3f63-e588-4886-8fb6-badfa00301d5 on nch1-master-1 May 14 21:24:13.045599 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4f021473-32ea-42b9-ab00-52ed3429872b req-7c410add-ab53-4a59-aa37-0a78419f3929 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057951 May 14 21:24:13.046473 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1904/3535] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:13.056220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:13.060765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:13.084754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:13.085220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:13.086200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:13.086811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:13.374290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:13.384198 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2fcc38e-3777-4bdf-96b6-3aade7fc48f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.335756 May 14 21:24:13.385105 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1905/3536] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:13 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:13.618211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:13.618987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:13.627417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:13.627904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:13.628915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:13.629363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:13.635201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:13.644338 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-064574ce-57eb-4c10-b213-0f40808fced2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1511 microversion: 2.1 time: 1.041708 May 14 21:24:13.645222 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1632/3537] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:12 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1511 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:13.917961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:13.935640 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-32e34830-42e6-4242-bb91-c34c431ab876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.321740 May 14 21:24:13.936792 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1906/3538] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:13 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:14.003159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:14.003998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:14.014415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.015720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:14.017286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.019191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:14.409986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:14.410918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:14.424872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.426527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:14.427560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.428971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:14.727232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:14.735858 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab60ced7-6f85-4e9a-a244-ee43a5f2cfc2 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1526 microversion: 2.1 time: 0.736516 May 14 21:24:14.736463 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1633/3539] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:13 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1526 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:14.745785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:14.753855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:14.789853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.790690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:14.802197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.803069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:14.942372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:14.953065 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-13d787f0-2a55-422e-81ea-6ab8286b12e8 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.554623 May 14 21:24:14.954306 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1907/3540] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:14 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:14.972942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:14.974480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:14.987077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.988234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:14.989261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:14.990079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:15.415099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:15.424668 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e39fe806-9390-4289-afe6-386267a25dec tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1680 microversion: 2.1 time: 0.457164 May 14 21:24:15.440990 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1908/3541] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:14 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1680 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:15.448212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-51446ba5-b0d3-4a8b-a753-cee4770f38c1 req-952d7d70-b116-44c2-82a4-cfb4dc0d8fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd230835-262d-4728-a1d2-ff33fbc18dd3", "tag": "3a348e4f-ad3b-422c-95bb-dd7c013bb387"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:15.468930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-51446ba5-b0d3-4a8b-a753-cee4770f38c1 req-952d7d70-b116-44c2-82a4-cfb4dc0d8fff service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:15.469532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-51446ba5-b0d3-4a8b-a753-cee4770f38c1 req-952d7d70-b116-44c2-82a4-cfb4dc0d8fff service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:15.493728 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-51446ba5-b0d3-4a8b-a753-cee4770f38c1 req-952d7d70-b116-44c2-82a4-cfb4dc0d8fff service nova] Creating event network-changed:3a348e4f-ad3b-422c-95bb-dd7c013bb387 for instance dd230835-262d-4728-a1d2-ff33fbc18dd3 on nch1-master-1 May 14 21:24:15.502857 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-51446ba5-b0d3-4a8b-a753-cee4770f38c1 req-952d7d70-b116-44c2-82a4-cfb4dc0d8fff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060492 May 14 21:24:15.503580 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1909/3542] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:15.678309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:15.690462 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dc120938-91bb-4e3e-b46e-fe821a628535 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1511 microversion: 2.1 time: 0.952454 May 14 21:24:15.691869 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1634/3543] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:14 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1511 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:15.754778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:15.755623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:15.773014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:15.773719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:15.774680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:15.775289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:15.982148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:15.988988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:15.998067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:15.998914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:15.999998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:16.000996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:16.025879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:16.042672 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8445d7a3-f3f8-4865-9b1e-04840ca3322c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1526 microversion: 2.1 time: 0.292276 May 14 21:24:16.048215 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1910/3544] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:15 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1526 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:16.446236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:16.447066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:16.461493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:16.470610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:16.472661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:16.475508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.045255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:17.060488 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b3623817-a793-411b-8f24-f537c7466221 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1657 microversion: 2.1 time: 0.618262 May 14 21:24:17.065253 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1911/3545] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:16 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1657 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:17.086058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:17.087875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:17.110895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.111706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.112670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.113275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.217110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:17.226671 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-76aebc32-f4aa-49a6-bb62-1e98a081e644 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1469 microversion: 2.1 time: 0.159494 May 14 21:24:17.227646 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1912/3546] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:17 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:17.233650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:17.325961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:17.325961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.325961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.325961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.325961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.327053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:17.327053 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e038b621-7e8f-4077-af4c-4c7dc387cb72 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 1.311168 May 14 21:24:17.327053 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1635/3547] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:15 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:17.327053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f6506f06-27fa-4360-a8e2-fad15b02839f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:17.327053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6506f06-27fa-4360-a8e2-fad15b02839f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.327053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6506f06-27fa-4360-a8e2-fad15b02839f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.328667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:17.336049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f6506f06-27fa-4360-a8e2-fad15b02839f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Going to try to start instance {{(pid=130637) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 21:24:17.337740 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bbbf7d26-911f-40c0-b1a9-16fbc2e2ec93 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1484 microversion: 2.1 time: 0.108645 May 14 21:24:17.338419 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1913/3548] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:17 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1484 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:17.490179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-77dcc4fb-a996-4406-93c1-1f4253077268 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Action: 'create', calling method: .version_select at 0x7fb1a71eb8b0>, body: {"keypair": {"name": "tempest-keypair-1660060359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3Ig6HXQzYI/HlIYvLdEqz+rJFrgYYzz4Gh2qqzaJDVIAKSB+wdyDZ/c47+VQ/fivEXOmVFgE6kmKsdHDH64GWJUs8ePLXjVXWM7PVev0Gel7hzcIOLkZsGZV9qYzGjLA=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:17.504688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-77dcc4fb-a996-4406-93c1-1f4253077268 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Getting quotas for project f2a1c19cad6047f09d1b74a2a607dd28. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:17.510401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-77dcc4fb-a996-4406-93c1-1f4253077268 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Getting quotas for user 98b7bc6d0abe43a889cc29118685e8f4 and project f2a1c19cad6047f09d1b74a2a607dd28. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:17.734705 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-77dcc4fb-a996-4406-93c1-1f4253077268 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.394726 May 14 21:24:17.740787 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1914/3549] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:24:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:17.746614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-70ebd1ff-92c1-4413-94dd-9e53151f733c req-5c199121-5bf0-4f50-8ad6-12f8f4761b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b568eb49-248c-41f8-ae1f-1d2af49cb78c", "tag": "9e94139a-6e1c-4da1-8861-0687ddd3586e"}, {"server_uuid": "faacea54-3046-4b55-bf30-040847940731", "name": "network-vif-deleted", "tag": "5837daea-a74b-411d-b12d-81c8f1cedc5b"}, {"server_uuid": "6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c", "name": "network-vif-deleted", "tag": "1178d7f5-ffca-4c69-a67d-4e3f79dc34f8"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:17.757900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-70ebd1ff-92c1-4413-94dd-9e53151f733c req-5c199121-5bf0-4f50-8ad6-12f8f4761b7d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.758702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-70ebd1ff-92c1-4413-94dd-9e53151f733c req-5c199121-5bf0-4f50-8ad6-12f8f4761b7d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.781427 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-70ebd1ff-92c1-4413-94dd-9e53151f733c req-5c199121-5bf0-4f50-8ad6-12f8f4761b7d service nova] Creating event network-changed:9e94139a-6e1c-4da1-8861-0687ddd3586e for instance b568eb49-248c-41f8-ae1f-1d2af49cb78c on nch2-master-1 May 14 21:24:17.781427 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-70ebd1ff-92c1-4413-94dd-9e53151f733c req-5c199121-5bf0-4f50-8ad6-12f8f4761b7d service nova] Creating event network-vif-deleted:5837daea-a74b-411d-b12d-81c8f1cedc5b for instance faacea54-3046-4b55-bf30-040847940731 on nch2-master-1 May 14 21:24:17.781427 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-70ebd1ff-92c1-4413-94dd-9e53151f733c req-5c199121-5bf0-4f50-8ad6-12f8f4761b7d service nova] Creating event network-vif-deleted:1178d7f5-ffca-4c69-a67d-4e3f79dc34f8 for instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c on nch1-master-1 May 14 21:24:17.788300 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-70ebd1ff-92c1-4413-94dd-9e53151f733c req-5c199121-5bf0-4f50-8ad6-12f8f4761b7d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.046187 May 14 21:24:17.789479 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1915/3550] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:17.868526 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f6506f06-27fa-4360-a8e2-fad15b02839f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.588648 May 14 21:24:17.870331 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1636/3551] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:17 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:24:17.880459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:17.881665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:17.893961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.894440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:17.895421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:17.895868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.105221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:18.113370 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3aa1b734-11cf-4d3d-b5a1-3e38edd0357f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1666 microversion: 2.1 time: 0.238211 May 14 21:24:18.113626 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1916/3552] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:17 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1666 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:18.248290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:18.249338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:18.259120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:18.259120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.259120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:18.259686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.332133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:18.341032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:18.347621 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7488b08b-8fa4-4816-a767-8c9a92892702 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1302 microversion: 2.1 time: 0.100815 May 14 21:24:18.347897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:18.348019 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1637/3553] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:18 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1302 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:18.357030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:18.358253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:18.358871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:18.359173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.360265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:18.361053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.365127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:18.365811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.366783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:18.367384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.424047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:18.424520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:18.424999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lazy-loading 'fault' on Instance uuid faacea54-3046-4b55-bf30-040847940731 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:18.492469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:18.497147 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e62945d-91d2-4bb3-a902-7d4fa2815c2c tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1314 microversion: 2.1 time: 0.143248 May 14 21:24:18.498378 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1638/3554] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:18 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:18.540588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:18.564305 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-281f73d7-e140-4a85-a345-79f5439afbe6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.216113 May 14 21:24:18.564305 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1917/3555] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:18 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:19.140266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:19.141285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:19.153594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.154394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.155508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.156121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.365080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:19.365783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:19.374078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.374975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.376048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.377694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.426840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.426840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.427283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lazy-loading 'fault' on Instance uuid 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:19.544527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:19.554587 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-86678a6f-dc15-471c-839a-90807c3bff59 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 200 len: 1307 microversion: 2.1 time: 0.198108 May 14 21:24:19.558106 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1918/3556] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:19 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:19.571221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:19.576860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:19.591562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.592512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.593680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.594607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.658188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:19.676424 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-743541ee-f63f-4318-a53c-71e87d8db152 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1666 microversion: 2.1 time: 0.546330 May 14 21:24:19.676424 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1639/3557] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:19 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1666 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:19.708381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.710596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.711247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lazy-loading 'fault' on Instance uuid faacea54-3046-4b55-bf30-040847940731 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:19.713084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:19.713743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:19.746879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.747461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.748394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:19.750171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:19.986698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7f2d4818aa7461da8f30ddfe7641d93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '155b6f457be24818bb00db2560ef96fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:20.018749 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4672c718-c439-48de-97b3-3600b5c2d582 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 200 len: 1314 microversion: 2.1 time: 0.459046 May 14 21:24:20.030386 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1919/3558] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:19 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:20.174572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:20.182964 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0972b4b5-a7b3-4621-b35f-e3f4b350f046 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.491816 May 14 21:24:20.183957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1640/3559] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:19 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:20.575272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:20.576271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:20.591377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:20.591377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:20.591377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:20.593070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:20.633796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c HTTP/1.1 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c'} May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:20.636025 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d23507ea-9e44-4514-9130-42cef9640f6b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 404 len: 111 microversion: 2.1 time: 0.071246 May 14 21:24:20.645028 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1920/3560] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:20 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:20.650660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:20.652009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:20.666569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:20.666569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:20.673033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:20.673511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:20.700942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:20.701628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:20.717746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:20.718211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:20.719034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:20.719507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:20.962608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:20.972007 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11315c13-2b09-4f6d-b6e7-c09e5f215dd0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.325176 May 14 21:24:20.973220 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1641/3561] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:20 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:21.043263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:21.043954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] [instance: faacea54-3046-4b55-bf30-040847940731] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:21.053528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.054189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:21.055044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.055508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:21.079259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] HTTP exception thrown: Instance faacea54-3046-4b55-bf30-040847940731 could not be found. May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Request method failure captured: May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 HTTP/1.1 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB2wBRk9CSHRukmwWojap4KHRLDhay7jdinTKCc6GMI9LcHaq6KTYyauceeEZ__JwTV61dPxU_1XoBsTloIJiyqPf56e2B0LyBXjAbubY0UAg1ufZc2_DTPMR51Ou_eGp8r3NiMrCkbfqW7fAS6JtPh56_g6Dk5kl7g91X5jIiGuCeE May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/155b6f457be24818bb00db2560ef96fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_155b6f457be24818bb00db2560ef96fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 155b6f457be24818bb00db2560ef96fe May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-22779805 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: a7f2d4818aa7461da8f30ddfe7641d93 May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-22779805-project May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance faacea54-3046-4b55-bf30-040847940731 could not be found. May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'faacea54-3046-4b55-bf30-040847940731'} May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faacea54-3046-4b55-bf30-040847940731 could not be found. May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faacea54-3046-4b55-bf30-040847940731 could not be found. May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:21.082235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faacea54-3046-4b55-bf30-040847940731 could not be found. May 14 21:24:21.086500 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:21.087850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] Returning 404 to user: Instance faacea54-3046-4b55-bf30-040847940731 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:21.089620 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e1a9384c-9b84-476d-bbd4-f2fd740ceea9 tempest-FloatingIPsAssociationTestJSON-22779805 tempest-FloatingIPsAssociationTestJSON-22779805-project] 10.222.0.52 "GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731" status: 404 len: 111 microversion: 2.1 time: 0.050297 May 14 21:24:21.095032 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1642/3562] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:21 2022] GET /compute/v2.1/servers/faacea54-3046-4b55-bf30-040847940731 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:24:21.200755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:21.201390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:21.217918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.218638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:21.220961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.220961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:21.364158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:21.376251 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c64dcf8-f63b-42fb-bb9f-fb7f291b3903 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1666 microversion: 2.1 time: 0.685388 May 14 21:24:21.376858 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1921/3563] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:20 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1666 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:21.388356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-067f0c5a-bce9-4e74-a929-1ffcc2a60f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-067f0c5a-bce9-4e74-a929-1ffcc2a60f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 163 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": 12345, "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 12345 May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:21.396933 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:21.402697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-067f0c5a-bce9-4e74-a929-1ffcc2a60f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:21.405276 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-067f0c5a-bce9-4e74-a929-1ffcc2a60f47 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.027166 May 14 21:24:21.406361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1922/3564] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:21 2022] POST /compute/v2.1/servers => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:21.419359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:21.424860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:21.433489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.435783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:21.436923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.438313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:21.656013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:21.665246 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cbf6a934-bd58-41cd-abc2-06db308b2af0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.468864 May 14 21:24:21.665839 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1643/3565] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:21 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:21.831876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:21.841407 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-06be2612-f8a3-4782-88ff-6a708df22179 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.426218 May 14 21:24:21.841995 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1923/3566] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:21 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:21.861882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:21.863506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:21.881718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.882190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:21.883047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:21.886312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:22.396528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:22.397159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:22.412022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:22.412886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:22.413882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:22.414475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:22.595958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:22.608768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f3881b5-f9f4-4ae5-a23f-d75e95621143 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.751323 May 14 21:24:22.609869 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1644/3567] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:21 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:22.616937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-897146566", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a8234d4d-c69a-4d7e-8f40-9be71afea472"}], "security_groups": [{"name": "tempest-securitygroup--693647252"}], "key_name": "tempest-keypair-1660060359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:22.670330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:22.680545 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b7bd9a0-d6d1-4c5b-9cb1-8b1cf782647d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.287962 May 14 21:24:22.681454 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1924/3568] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:22 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:22.687446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0af52a09-ed8f-4acb-a7ba-71c48a3ee5ec req-dabecad8-0140-4437-a212-40184b099d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656a3f63-e588-4886-8fb6-badfa00301d5", "name": "network-vif-plugged", "status": "completed", "tag": "722b9ead-c2ae-4121-a8ee-86862e585087"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:22.709174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0af52a09-ed8f-4acb-a7ba-71c48a3ee5ec req-dabecad8-0140-4437-a212-40184b099d06 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:22.709668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0af52a09-ed8f-4acb-a7ba-71c48a3ee5ec req-dabecad8-0140-4437-a212-40184b099d06 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:22.744537 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0af52a09-ed8f-4acb-a7ba-71c48a3ee5ec req-dabecad8-0140-4437-a212-40184b099d06 service nova] Creating event network-vif-plugged:722b9ead-c2ae-4121-a8ee-86862e585087 for instance 656a3f63-e588-4886-8fb6-badfa00301d5 on nch1-master-1 May 14 21:24:22.780034 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0af52a09-ed8f-4acb-a7ba-71c48a3ee5ec req-dabecad8-0140-4437-a212-40184b099d06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097172 May 14 21:24:22.795314 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1925/3569] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:22.825367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:22.828537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:22.851209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:22.868125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:22.870595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:22.872702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:23.037777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] validate_networks() for [('a8234d4d-c69a-4d7e-8f40-9be71afea472', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:24:23.202211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:23.214111 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d202a941-9e60-4730-958e-97c0feaf354f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.412030 May 14 21:24:23.216494 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1926/3570] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:22 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:23.226868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:23.228961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:23.236799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:23.237521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:23.238562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:23.239179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:23.536235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:23.545848 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33cadfd6-589d-42fd-ad8a-3d46534d126a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.325332 May 14 21:24:23.546894 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1927/3571] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:23 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:23.575986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:23.576620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:23.597535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:23.597535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:23.598259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:23.599051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:23.866627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:23.878583 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c24239d4-d2f0-4382-a5bf-58dfe29961fc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.315183 May 14 21:24:23.883541 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1928/3572] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:23 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:23.900372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:23.901494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:23.908374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:23.909818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:23.911231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:23.912039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.028977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Getting quotas for project f2a1c19cad6047f09d1b74a2a607dd28. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:24.036364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Getting quotas for user 98b7bc6d0abe43a889cc29118685e8f4 and project f2a1c19cad6047f09d1b74a2a607dd28. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:24.070850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:24:24.071418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:24:24.074651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:24:24.074651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:24:24.074651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:24:24.092437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.092838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.093648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.094243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.118624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:24.132767 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0335d76c-1f86-4b12-9453-c4fb659ee931 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.236607 May 14 21:24:24.133385 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1929/3573] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:23 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:24.147040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Getting quotas for project f2a1c19cad6047f09d1b74a2a607dd28. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:24.150896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:24.153001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:24.160445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.161473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.162755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Getting quotas for user 98b7bc6d0abe43a889cc29118685e8f4 and project f2a1c19cad6047f09d1b74a2a607dd28. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:24.163125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.163777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.193690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:24:24.199730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:24:24.357752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:24.372036 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97975b7f-5c1e-46b5-a541-48068fc37cf4 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.760876 May 14 21:24:24.372698 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1645/3574] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:24:24.373425 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e87dcd8-4d32-4e1e-a91a-ab7d4b70b539 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.223967 May 14 21:24:24.374305 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1930/3575] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:24 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:24.383733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b26aa5ca-eac2-43ad-b0c6-1715dc69e25c tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:24.384840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b26aa5ca-eac2-43ad-b0c6-1715dc69e25c tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:24.400779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:24.402196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:24.421717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.421717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.422372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.422966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.506508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b26aa5ca-eac2-43ad-b0c6-1715dc69e25c tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:24.516835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b26aa5ca-eac2-43ad-b0c6-1715dc69e25c tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1269 microversion: 2.1 time: 0.137792 May 14 21:24:24.527029 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1931/3576] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:24 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1269 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:24.532069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:24.532624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:24.555728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.556205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.557278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.558324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.589148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lazy-loading 'flavor' on Instance uuid c355e95c-4110-4a0c-aa91-b881f09e9e1f {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:24.702062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:24.714070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f3ecf17-eb7b-4dc2-ab48-28f5f22a2e3f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.315941 May 14 21:24:24.723809 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1646/3577] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:24 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:24.840962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2fefa397-5e93-4107-a654-d975a452dd20 req-0a0d96e4-04c5-4939-817c-9e3c74691821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd230835-262d-4728-a1d2-ff33fbc18dd3", "name": "network-vif-plugged", "status": "completed", "tag": "3a348e4f-ad3b-422c-95bb-dd7c013bb387"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:24.851300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2fefa397-5e93-4107-a654-d975a452dd20 req-0a0d96e4-04c5-4939-817c-9e3c74691821 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:24.851989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2fefa397-5e93-4107-a654-d975a452dd20 req-0a0d96e4-04c5-4939-817c-9e3c74691821 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:24.864711 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2fefa397-5e93-4107-a654-d975a452dd20 req-0a0d96e4-04c5-4939-817c-9e3c74691821 service nova] Creating event network-vif-plugged:3a348e4f-ad3b-422c-95bb-dd7c013bb387 for instance dd230835-262d-4728-a1d2-ff33fbc18dd3 on nch1-master-1 May 14 21:24:24.870316 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2fefa397-5e93-4107-a654-d975a452dd20 req-0a0d96e4-04c5-4939-817c-9e3c74691821 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034689 May 14 21:24:24.871133 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1647/3578] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:24:25.002778 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-21c16f73-8fd4-4420-aff4-642d46542112 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.474227 May 14 21:24:25.014159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:25.015162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:25.015724 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1932/3579] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:24 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:24:25.024198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:25.025568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:25.026759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:25.027757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:25.224920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:25.234119 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-42da9d2a-5691-490c-a7b0-3237d093ab35 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1678 microversion: 2.1 time: 0.225518 May 14 21:24:25.234719 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1648/3580] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:25 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1678 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:25.534235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b08c89b7-600d-44aa-be80-bf5e991734c0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:25.534970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b08c89b7-600d-44aa-be80-bf5e991734c0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:25.637890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b08c89b7-600d-44aa-be80-bf5e991734c0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:25.646897 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b08c89b7-600d-44aa-be80-bf5e991734c0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1269 microversion: 2.1 time: 0.116974 May 14 21:24:25.648111 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1933/3581] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:25 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1269 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:25.731638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:25.732208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:25.741155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:25.741818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:25.742770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:25.745742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:25.917854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:25.924798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c1ea5cbb-29dc-4259-9285-90977bceac4b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.197750 May 14 21:24:25.925468 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1649/3582] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:25 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:26.259002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14a06fae-5f08-41db-8b51-c2ce9f4ab86e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-245821144", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4b223bea-c1a4-4957-a86b-0fbcf052cae4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:26.259510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:26.259510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:26.274876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.275344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.276763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.278202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.363725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-14a06fae-5f08-41db-8b51-c2ce9f4ab86e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Block Device 4b223bea-c1a4-4957-a86b-0fbcf052cae4 is not bootable. May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14a06fae-5f08-41db-8b51-c2ce9f4ab86e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 357 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-245821144", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4b223bea-c1a4-4957-a86b-0fbcf052cae4", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: exception: Block Device 4b223bea-c1a4-4957-a86b-0fbcf052cae4 is not bootable. May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-245821144', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '4b223bea-c1a4-4957-a86b-0fbcf052cae4'}], 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 4b223bea-c1a4-4957-a86b-0fbcf052cae4 is not bootable. May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:26.376358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 4b223bea-c1a4-4957-a86b-0fbcf052cae4 is not bootable. May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 4b223bea-c1a4-4957-a86b-0fbcf052cae4 is not bootable. May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14a06fae-5f08-41db-8b51-c2ce9f4ab86e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Block Device 4b223bea-c1a4-4957-a86b-0fbcf052cae4 is not bootable. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14a06fae-5f08-41db-8b51-c2ce9f4ab86e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.136431 May 14 21:24:26.380336 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1934/3583] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:26 2022] POST /compute/v2.1/servers => generated 110 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:26.390749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:26.391545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:26.405706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.406225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.407043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.407543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.569454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:26.579067 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53a764b4-877d-4812-acba-7cc41f27f40d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1661 microversion: 2.1 time: 0.331436 May 14 21:24:26.579880 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1650/3584] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:26 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1661 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:26.599588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:26.609611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88fab499-fb9e-4327-b02a-c48326ebd27a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:26.612109 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c7c4aaa0-9fd4-4b26-86c2-766b5a1ce902 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.228023 May 14 21:24:26.613058 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1935/3585] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:26 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:26.613713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-88fab499-fb9e-4327-b02a-c48326ebd27a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:26.620387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88fab499-fb9e-4327-b02a-c48326ebd27a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.625204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88fab499-fb9e-4327-b02a-c48326ebd27a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.626287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88fab499-fb9e-4327-b02a-c48326ebd27a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.629984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88fab499-fb9e-4327-b02a-c48326ebd27a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.633958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:26.633958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:26.644478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.644948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.646052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.646496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.909301 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88fab499-fb9e-4327-b02a-c48326ebd27a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action" status: 202 len: 0 microversion: 2.1 time: 0.313238 May 14 21:24:26.912955 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1651/3586] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:26 2022] POST /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:24:26.919430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:26.924383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:26.926530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:26.937447 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f8cd1a7-c8f3-4e88-853c-a0faf93255dd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.307971 May 14 21:24:26.938480 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1936/3587] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:26 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:26.943555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.943984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.944291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:26.944769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.945221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.945575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:26.952500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.953229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:26.958724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:26.958724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:27.133254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:27.147392 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1155a3e2-9e63-4f2a-83e8-63b1f991b44a tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1321 microversion: 2.1 time: 0.232504 May 14 21:24:27.148416 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1652/3588] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:26 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:27.174254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1c81f949-9e12-4d5d-9f8d-64e77bed955e req-de255fbe-1ec1-4002-8a35-6800b865c679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b568eb49-248c-41f8-ae1f-1d2af49cb78c", "name": "network-vif-plugged", "status": "completed", "tag": "9e94139a-6e1c-4da1-8861-0687ddd3586e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:27.187170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1c81f949-9e12-4d5d-9f8d-64e77bed955e req-de255fbe-1ec1-4002-8a35-6800b865c679 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:27.188127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1c81f949-9e12-4d5d-9f8d-64e77bed955e req-de255fbe-1ec1-4002-8a35-6800b865c679 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:27.202480 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1c81f949-9e12-4d5d-9f8d-64e77bed955e req-de255fbe-1ec1-4002-8a35-6800b865c679 service nova] Creating event network-vif-plugged:9e94139a-6e1c-4da1-8861-0687ddd3586e for instance b568eb49-248c-41f8-ae1f-1d2af49cb78c on nch2-master-1 May 14 21:24:27.207689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1c81f949-9e12-4d5d-9f8d-64e77bed955e req-de255fbe-1ec1-4002-8a35-6800b865c679 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049330 May 14 21:24:27.208380 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1653/3589] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:27.214967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:27.215856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:27.222558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:27.223306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:27.224198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:27.224644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:27.515294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:27.523057 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec0062c1-a938-4e38-9518-aa096f97ccb6 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.313311 May 14 21:24:27.531510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:27.533407 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1654/3590] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:27 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:27.540592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2217b9f4-8d2a-4cb8-9b7f-7a28a2e0055d tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1667 microversion: 2.1 time: 0.600804 May 14 21:24:27.541181 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1937/3591] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:26 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1667 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:28.166313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:28.167675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:28.188032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:28.188728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:28.191645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:28.191645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:28.456400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:28.482698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7aa6805f-d064-463b-a360-0ed686d2630f tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1327 microversion: 2.1 time: 0.316917 May 14 21:24:28.493108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1655/3592] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:28 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1327 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:28.540159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:28.540776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:28.550784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:28.551691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:28.552835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:28.553454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:28.561650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:28.562489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:28.573481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:28.579131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:28.580009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:28.580460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:28.743798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:28.756548 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a5dc30b-9f64-4181-afed-feb9fed35ee7 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1322 microversion: 2.1 time: 0.219682 May 14 21:24:28.766848 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1938/3593] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:28 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:28.898816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:28.908897 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-022b7cda-6f3b-4bba-b798-3146f5c40fe2 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1667 microversion: 2.1 time: 0.354366 May 14 21:24:28.912080 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1656/3594] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:28 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1667 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:29.502285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:29.503010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:29.511874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:29.515742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:29.515742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:29.515742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:29.733689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:29.742359 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5e0334e-560a-4fcc-bd47-b4959471eefe tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1394 microversion: 2.1 time: 0.244919 May 14 21:24:29.755267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1939/3595] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:29 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1394 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:29.778373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:29.778373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:29.785632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:29.793535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:29.795271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:29.796552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:29.927755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:29.929996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:29.943459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:29.944187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:29.956668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:29.957614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.113723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:30.121615 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ebed361d-1ed4-49f1-9ccf-a2267720ec95 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1514 microversion: 2.1 time: 0.349806 May 14 21:24:30.122308 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1657/3596] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:29 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1514 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8296cdc-8ca9-4081-bece-b8927215c3a2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1654033709", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "destination_type": "local"}, {"source_type": "volume", "uuid": "6f8096aa-7bba-4f4f-97a3-7aab39d69227", "destination_type": "invalid"}], "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8296cdc-8ca9-4081-bece-b8927215c3a2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 495 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1654033709", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "destination_type": "local"}, {"source_type": "volume", "uuid": "6f8096aa-7bba-4f4f-97a3-7aab39d69227", "destination_type": "invalid"}], "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1654033709', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '6f8096aa-7bba-4f4f-97a3-7aab39d69227', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:30.131627 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'invalid' May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8296cdc-8ca9-4081-bece-b8927215c3a2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:30.134705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8296cdc-8ca9-4081-bece-b8927215c3a2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009637 May 14 21:24:30.138369 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1658/3597] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:30 2022] POST /compute/v2.1/servers => generated 155 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:30.144316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:30.145004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:30.154241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.156836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.156836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.156836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.249219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:30.254221 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b843f601-1472-4284-a2c9-92e9ae162789 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.331568 May 14 21:24:30.255039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1940/3598] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:29 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:30.265651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:30.267876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:30.274235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.278259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.278259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.278259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.331704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:30.340490 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e050a40-e526-4b5f-87f8-0b5f28d1e7df tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3" status: 200 len: 1515 microversion: 2.1 time: 0.202255 May 14 21:24:30.341072 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1659/3599] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:30 2022] GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:30.346893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:30.347920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:30.353807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.355418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.356655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.357116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.511492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:30.522144 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68b1135a-0529-4499-ae39-eba9f896a6de tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.265717 May 14 21:24:30.522677 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1941/3600] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:30 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:30.530383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:30.531306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:30.553650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.554201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.558576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.559143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.632910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:30.643277 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae9d1779-f272-4ef6-9acc-05a5e93d6f9a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1670 microversion: 2.1 time: 0.299891 May 14 21:24:30.649415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1660/3601] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:30 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1670 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:30.659521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:30.660800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:30.679931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.680767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.682049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.683605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.854158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:30.866461 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1e8e6ad9-3b28-4d40-b0f7-a0991f0097ed tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 200 len: 1514 microversion: 2.1 time: 0.342703 May 14 21:24:30.868566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:30.876586 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1942/3602] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:30 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:30.879155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:30.885863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:30.896626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.897110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.899746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.900694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.904356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1cbcdd05-c3c7-475b-8181-26110fbfff46 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.259040 May 14 21:24:30.904961 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1661/3603] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:30 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:30.926539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:30.927747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:30.938087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.938812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.939821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:30.941478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:30.958424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:30.967702 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.compute.api [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Working on deleting snapshot a21713e7-c51d-4995-af38-97e655e653f4 from shelved instance... May 14 21:24:31.273410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:31.284317 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9cf7502b-fd59-4c97-86dc-fad1e754fcbf tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1394 microversion: 2.1 time: 0.362336 May 14 21:24:31.285361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1662/3604] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:30 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1394 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:31.294500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:31.295680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:31.310702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:31.311449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:31.312641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:31.314022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:31.345748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:31.692393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e913fb8f-36c6-4780-b40d-62e4478dc313 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 204 len: 0 microversion: 2.1 time: 0.404989 May 14 21:24:31.693300 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1663/3605] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:31 2022] DELETE /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:31.700342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-564f7e48-f1fd-412f-84d4-abd80731d2bc req-31af7fcc-4ab0-4f32-a458-b00f76b4f8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68de201-9379-4235-9f12-f43205e5341c", "tag": "a4831886-f328-4292-b75f-9f46662e69b1"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:31.709835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-564f7e48-f1fd-412f-84d4-abd80731d2bc req-31af7fcc-4ab0-4f32-a458-b00f76b4f8a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:31.710287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-564f7e48-f1fd-412f-84d4-abd80731d2bc req-31af7fcc-4ab0-4f32-a458-b00f76b4f8a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:31.724462 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-564f7e48-f1fd-412f-84d4-abd80731d2bc req-31af7fcc-4ab0-4f32-a458-b00f76b4f8a4 service nova] Creating event network-changed:a4831886-f328-4292-b75f-9f46662e69b1 for instance d68de201-9379-4235-9f12-f43205e5341c on nch1-master-1 May 14 21:24:31.730322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-564f7e48-f1fd-412f-84d4-abd80731d2bc req-31af7fcc-4ab0-4f32-a458-b00f76b4f8a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035327 May 14 21:24:31.730943 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1664/3606] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:31.739079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f48ef88c-47b7-4575-9f61-14ba5c3e1df5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-756898764", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f48ef88c-47b7-4575-9f61-14ba5c3e1df5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 491 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-756898764", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-756898764', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 14 21:24:31.742188 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f48ef88c-47b7-4575-9f61-14ba5c3e1df5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:31.746329 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f48ef88c-47b7-4575-9f61-14ba5c3e1df5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.012783 May 14 21:24:31.752140 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1665/3607] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:31 2022] POST /compute/v2.1/servers => generated 624 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:31.768900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:31.769762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:31.779952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:31.780344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:31.781303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:31.781753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.024970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:32.034587 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d07e4f1-01e6-4151-aa35-81fbd9548768 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 200 len: 1520 microversion: 2.1 time: 0.280787 May 14 21:24:32.035816 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1666/3608] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:31 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:32.052357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:32.062136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:32.076287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.076964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.077775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.078231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.238537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:32.246764 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-13118e7b-f8c3-4709-8671-e8bdca5c0261 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.209598 May 14 21:24:32.258760 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1667/3609] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:32 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:32.266061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:32.266627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:32.273542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.274216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.275012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.275682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.420161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:32.428399 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d12b3122-0312-4750-ae2f-b67bedf1a09d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.168136 May 14 21:24:32.428976 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1668/3610] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:32 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:32.434290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:32.434905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:32.441883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.442763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.444233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.444859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.641786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:32.652258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9e571de9-cd3e-4259-9990-c96809e5e6ae tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1394 microversion: 2.1 time: 0.222057 May 14 21:24:32.652927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1669/3611] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:32 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1394 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:32.658389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c098e502-aa43-4415-924a-2dbd5245a891 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c098e502-aa43-4415-924a-2dbd5245a891 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 416 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:32.661444 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c098e502-aa43-4415-924a-2dbd5245a891 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c098e502-aa43-4415-924a-2dbd5245a891 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.009059 May 14 21:24:32.665425 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1670/3612] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:32 2022] POST /compute/v2.1/servers => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:32.681228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:32.681868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:32.690086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.701966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.701966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.701966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.706280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Doing local delete in cell eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) {{(pid=130638) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 14 21:24:32.709786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:32.710566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:32.711231 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.compute.api [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 14 21:24:32.717760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] deallocate_for_instance() {{(pid=130638) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1765}} May 14 21:24:33.257959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:33.268529 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be47b218-d920-4aa5-8ac6-aefdaf5afd27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.591372 May 14 21:24:33.281337 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1671/3613] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:32 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:33.286949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:33.287655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:33.294556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:33.295610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:33.297181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:33.297829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:33.522385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:33.530926 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1df61a64-dd97-4678-81c8-50d844f6054b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 200 len: 1520 microversion: 2.1 time: 0.248141 May 14 21:24:33.531538 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1672/3614] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:33 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:33.536121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:33.536916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:33.543993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:33.544459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:33.545251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:33.545701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:33.712487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:33.715329 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4afc8e7e-ec4f-4fe8-a2f4-c70b102de17e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.182730 May 14 21:24:33.716294 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1673/3615] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:33 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:33.834083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Updating instance_info_cache with network_info: [] {{(pid=130638) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 14 21:24:33.920036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-773946734", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "af5a4b8e-1df1-4780-a149-63d1d293e5bd"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:34.022049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] validate_networks() for [('af5a4b8e-1df1-4780-a149-63d1d293e5bd', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:24:34.912392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:24:34.913185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:24:34.913405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:24:34.913837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:24:34.914264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:24:34.928819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:34.929288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:34.930107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:34.930560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:34.972540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:34.980286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for user ed0a76be93e44fa887cb813a8879e04d and project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:34.998097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:24:35.000560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:24:35.031879 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-79a18507-3d4e-438e-a243-58ad4b3cb8ce tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "DELETE /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 204 len: 0 microversion: 2.1 time: 4.156894 May 14 21:24:35.034687 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1943/3616] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:30 2022] DELETE /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 0 bytes in 4159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:35.042166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:35.043313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:35.051013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.052497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.053633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.054235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.165754 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dbbb0030-1b80-487d-9c33-5388c9988a10 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.448270 May 14 21:24:35.172183 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1674/3617] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:24:35.181806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-63234a22-3344-4f22-95ed-9365d171a2c8 req-2eb06080-440a-4ed3-a312-8cfffe9b7519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af92eb0e-dba1-4109-ae5a-2d8d02806cb0", "name": "network-vif-deleted", "tag": "af229f26-8c15-4496-83fd-3745d3601050"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:35.191471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-63234a22-3344-4f22-95ed-9365d171a2c8 req-2eb06080-440a-4ed3-a312-8cfffe9b7519 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.198458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-63234a22-3344-4f22-95ed-9365d171a2c8 req-2eb06080-440a-4ed3-a312-8cfffe9b7519 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.224773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.compute.server_external_events [req-63234a22-3344-4f22-95ed-9365d171a2c8 req-2eb06080-440a-4ed3-a312-8cfffe9b7519 service nova] Unable to find a host for instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0. Dropping event network-vif-deleted {{(pid=130637) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 14 21:24:35.233633 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-63234a22-3344-4f22-95ed-9365d171a2c8 req-2eb06080-440a-4ed3-a312-8cfffe9b7519 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.065028 May 14 21:24:35.236839 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1675/3618] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 14 21:24:35.241325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d30eedd2-0319-4b23-9a6e-8714461765c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1512072693", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": -1, "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:35.258018 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d30eedd2-0319-4b23-9a6e-8714461765c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Flavor -1 could not be found. May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d30eedd2-0319-4b23-9a6e-8714461765c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 206 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1512072693", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": -1, "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor -1 could not be found. May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1512072693', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': -1, 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:35.261399 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d30eedd2-0319-4b23-9a6e-8714461765c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:35.266130 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d30eedd2-0319-4b23-9a6e-8714461765c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.026433 May 14 21:24:35.267368 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1676/3619] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:35 2022] POST /compute/v2.1/servers => generated 73 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:24:35.271931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:35.272964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:35.288604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.289084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.290161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.291239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.376019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:35.396221 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cdefec8-2789-4918-a344-ec696950f0e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1394 microversion: 2.1 time: 0.361158 May 14 21:24:35.407318 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1944/3620] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:35 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1394 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:35.414502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:35.417955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:35.418959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: af92eb0e-dba1-4109-ae5a-2d8d02806cb0] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:35.439231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8dd926d-b7c5-47ab-a1c2-db8ef15c84b9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 200 len: 1478 microversion: 2.1 time: 0.159523 May 14 21:24:35.439231 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1677/3621] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:35 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 1478 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:35.439231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-881fdb66-384c-4353-951a-01e9b396ba0d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:35.439231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-881fdb66-384c-4353-951a-01e9b396ba0d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:35.439692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.439692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.439692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.439692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.465063 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] HTTP exception thrown: Instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 could not be found. May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Request method failure captured: May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 HTTP/1.1 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBxdQLyUXipdOs58tsX3ys7eUbGjDiSSYt_fXNeAeCW_o6z5ZETYif8XSUovghyEvodaTLuhKXDis9kPqLil9CjOGGR8wiGPdJRcCEBLsDFw2kX6XwAAfapme4UIgBFp9hMAIehUEC8AC9ze5SDL01BeK5x4aJALaKQS_i06ePj8WBQ May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a924ca59a9ac44cf96e53be012a43af1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a42e0caa0878447f98544e74f767c7ca May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 could not be found. May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'af92eb0e-dba1-4109-ae5a-2d8d02806cb0'} May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 could not be found. May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 could not be found. May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:35.467266 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 could not be found. May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Returning 404 to user: Instance af92eb0e-dba1-4109-ae5a-2d8d02806cb0 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84a5d55d-0b49-496a-ad6d-d2e93a16e82a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0" status: 404 len: 111 microversion: 2.1 time: 0.059616 May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1945/3622] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:35 2022] GET /compute/v2.1/servers/af92eb0e-dba1-4109-ae5a-2d8d02806cb0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:35.477326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-06995418-331a-4e49-8426-90d3c90ae87f req-9ce76d05-c1ea-484f-8d45-b8840865b09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "656a3f63-e588-4886-8fb6-badfa00301d5", "name": "network-vif-deleted", "tag": "722b9ead-c2ae-4121-a8ee-86862e585087"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:35.486767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-06995418-331a-4e49-8426-90d3c90ae87f req-9ce76d05-c1ea-484f-8d45-b8840865b09c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.487223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-06995418-331a-4e49-8426-90d3c90ae87f req-9ce76d05-c1ea-484f-8d45-b8840865b09c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.506042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-881fdb66-384c-4353-951a-01e9b396ba0d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:35.506200 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-06995418-331a-4e49-8426-90d3c90ae87f req-9ce76d05-c1ea-484f-8d45-b8840865b09c service nova] Creating event network-vif-deleted:722b9ead-c2ae-4121-a8ee-86862e585087 for instance 656a3f63-e588-4886-8fb6-badfa00301d5 on nch1-master-1 May 14 21:24:35.512426 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-06995418-331a-4e49-8426-90d3c90ae87f req-9ce76d05-c1ea-484f-8d45-b8840865b09c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038373 May 14 21:24:35.513080 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1946/3623] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:35.514035 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-881fdb66-384c-4353-951a-01e9b396ba0d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1207 microversion: 2.1 time: 0.084880 May 14 21:24:35.514733 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1678/3624] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:35 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1207 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:35.520383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:35.521275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:35.530375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.535298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:35.536098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:35.539975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.540997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.541425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.543111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.543717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.544576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.545089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.581226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:35.711626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:35.719494 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee8b9da7-5d3e-4c4f-a30b-ebb43f43c445 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.204299 May 14 21:24:35.720143 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1947/3625] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:35 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:35.737345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:35.738048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:35.745073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.745632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.746413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:35.746847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:35.909978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:35.918180 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b4467ea1-8cf6-4f2b-9f8a-6e2b3ec28f38 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.185075 May 14 21:24:35.919011 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1948/3626] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:35 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:35.974985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cc28716-ba12-4d9b-a1d8-e85bec6e9e0b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1271937260", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cc28716-ba12-4d9b-a1d8-e85bec6e9e0b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 173 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1271937260", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1271937260', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi -1 May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:35.977880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:35.984178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cc28716-ba12-4d9b-a1d8-e85bec6e9e0b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:35.985867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5cc28716-ba12-4d9b-a1d8-e85bec6e9e0b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.013279 May 14 21:24:35.987863 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1949/3627] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:35 2022] POST /compute/v2.1/servers => generated 145 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:35.997563 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec6fab0b-0168-4753-be64-77b58790d4c3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 204 len: 0 microversion: 2.1 time: 0.466704 May 14 21:24:35.998899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1679/3628] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:35 2022] DELETE /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:36.000817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.003939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.013678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.014193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.015035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.016407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.017226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.020578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.027429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.027949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.028908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.029415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.127914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:36.137297 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88041510-ea8f-4da8-9f8b-8e06dd57d876 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1466 microversion: 2.1 time: 0.134057 May 14 21:24:36.147419 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1680/3629] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:36 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1466 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:36.182945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:36.191151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-badc5fb4-044c-4c66-a57f-c30dadf86d4e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.201379 May 14 21:24:36.191950 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1950/3630] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:35 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:36.212736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.213421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.219989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.220375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.221245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.221693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.413288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:36.413442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.414051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.421305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.421774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.422698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.423320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.423856 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b47eef2-bcbb-4314-b121-c38d45c17687 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.214963 May 14 21:24:36.427919 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1681/3631] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:36 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:36.459330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.463574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.473661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.474151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.475025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.475584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.516621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.517395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.517885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lazy-loading 'fault' on Instance uuid 656a3f63-e588-4886-8fb6-badfa00301d5 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:36.578117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:36.586349 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76855447-c26a-4c37-ad8c-179f08035dcd tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 200 len: 1312 microversion: 2.1 time: 0.132403 May 14 21:24:36.587281 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1682/3632] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:36 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 1312 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:36.597064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:36.600836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2e44bd1-44af-4697-9758-bac297fd9a5a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1788166895", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:36.604831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a2e44bd1-44af-4697-9758-bac297fd9a5a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2e44bd1-44af-4697-9758-bac297fd9a5a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 216 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1788166895", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1788166895', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:36.606638 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2e44bd1-44af-4697-9758-bac297fd9a5a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2e44bd1-44af-4697-9758-bac297fd9a5a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.011233 May 14 21:24:36.613836 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1683/3633] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:36.616184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-388b35ff-ac4e-4bc8-b6e3-4a1c4a35df78 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1394 microversion: 2.1 time: 0.206280 May 14 21:24:36.620114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.620982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.621121 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1951/3634] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:36 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1394 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:36.628268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e1379003-9265-4f51-9699-3d2ad6a632e7 req-00e947c3-32d7-414d-b53d-ddf6e15ad76a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68de201-9379-4235-9f12-f43205e5341c", "name": "network-vif-plugged", "status": "completed", "tag": "a4831886-f328-4292-b75f-9f46662e69b1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:36.628981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.629625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.630478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.631931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.637651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e1379003-9265-4f51-9699-3d2ad6a632e7 req-00e947c3-32d7-414d-b53d-ddf6e15ad76a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.638454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e1379003-9265-4f51-9699-3d2ad6a632e7 req-00e947c3-32d7-414d-b53d-ddf6e15ad76a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.660793 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e1379003-9265-4f51-9699-3d2ad6a632e7 req-00e947c3-32d7-414d-b53d-ddf6e15ad76a service nova] Creating event network-vif-plugged:a4831886-f328-4292-b75f-9f46662e69b1 for instance d68de201-9379-4235-9f12-f43205e5341c on nch1-master-1 May 14 21:24:36.669602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e1379003-9265-4f51-9699-3d2ad6a632e7 req-00e947c3-32d7-414d-b53d-ddf6e15ad76a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047014 May 14 21:24:36.670385 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1952/3635] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:36.676081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.676714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.685596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.686062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.686849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.687454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.727146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:36.740012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0435549d-5501-4474-87bc-e090738e2515 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1211 microversion: 2.1 time: 0.130243 May 14 21:24:36.740837 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1684/3636] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:36 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:36.842093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:36.849646 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b08506ac-fb7d-44de-ab22-9d33ae8a8266 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.178185 May 14 21:24:36.850224 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1953/3637] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:36 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:36.867726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:36.868352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:36.875925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.876383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:36.877152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:36.877597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.040326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:37.050961 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-922b963b-2236-4e0f-bc63-e49413de486c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.187167 May 14 21:24:37.052131 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1685/3638] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:36 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:37.115767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-684d3af7-b4e7-413e-839a-faa5bf30e8f6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1004447484", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "key_name": "tempest-key-161839197", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:37.155397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:37.156396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:37.167361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.168284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.169981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.170611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.214990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-684d3af7-b4e7-413e-839a-faa5bf30e8f6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] validate_networks() for [('a654f805-d693-47d5-9845-d68b7a2a07c5', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:24:37.271574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:37.281757 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0caf69c8-bc15-43ba-bcf9-9647daf9252e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1466 microversion: 2.1 time: 0.130827 May 14 21:24:37.294056 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1686/3639] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:37 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:37.472706 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-684d3af7-b4e7-413e-839a-faa5bf30e8f6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Invalid key_name provided. May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-684d3af7-b4e7-413e-839a-faa5bf30e8f6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 246 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1004447484", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "key_name": "tempest-key-161839197", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid key_name provided. May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1004447484', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'key_name': 'tempest-key-161839197', 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-161839197 not found for user 87538f2309714545bd47f228b6505883 May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:37.484102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 14 21:24:37.487941 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:37.490359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-684d3af7-b4e7-413e-839a-faa5bf30e8f6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid key_name provided. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:37.491269 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-684d3af7-b4e7-413e-839a-faa5bf30e8f6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.379975 May 14 21:24:37.492581 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1954/3640] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:37 2022] POST /compute/v2.1/servers => generated 70 bytes in 382 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 14 21:24:37.501840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:37.502473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:37.510726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.513896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.513896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.513896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.606022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:37.606651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:37.612745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.613204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.613985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.614425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.648692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.649208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.649673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lazy-loading 'fault' on Instance uuid 656a3f63-e588-4886-8fb6-badfa00301d5 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:37.700647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:37.708242 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fcfa8226-bc90-4356-bf18-debf63f2c8d3 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 200 len: 1312 microversion: 2.1 time: 0.107038 May 14 21:24:37.708821 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1955/3641] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:37 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:37.718162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:37.718162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:37.723827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.724295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.725115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.725742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.897794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:37.908230 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6b0f26b-f990-42ca-9c43-2d502641731a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.410270 May 14 21:24:37.951502 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1687/3642] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:37 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:37.956941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:37.957830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:37.964946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.965639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.966594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:37.967197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:37.976104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:37.984799 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d3505c23-f723-4a09-af21-4503c50972f0 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1394 microversion: 2.1 time: 0.274763 May 14 21:24:37.995904 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1956/3643] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:37 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1394 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:38.001455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:38.002096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:38.008475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.009339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.011541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.012431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.100045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:38.120834 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c7d4363-da62-4758-9bf5-3392cd330b3c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1267 microversion: 2.1 time: 0.167873 May 14 21:24:38.125434 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1688/3644] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:37 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:38.265833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:38.273538 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-baaf7331-1c33-429c-837e-82c4e3fdd121 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.276357 May 14 21:24:38.274152 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1957/3645] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:37 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:38.298165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:38.298792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:38.306281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.306742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.307795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.308242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.337488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0636fc78-5acf-4335-8022-c20aef4c06b1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-246083623", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:38.492467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:38.502447 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f827bed-f03e-4d78-8c2e-a385db397635 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1466 microversion: 2.1 time: 0.208131 May 14 21:24:38.503198 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1689/3646] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:38 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1466 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:38.519629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.security_group_api [None req-0636fc78-5acf-4335-8022-c20aef4c06b1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Neutron security group does_not_exist not found {{(pid=130638) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 14 21:24:38.520229 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0636fc78-5acf-4335-8022-c20aef4c06b1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0636fc78-5acf-4335-8022-c20aef4c06b1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 257 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-246083623", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: exception: Unable to find security_group with name or id 'does_not_exist' May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-246083623', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 14 21:24:38.545030 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._create_instance( May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.553637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0636fc78-5acf-4335-8022-c20aef4c06b1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:38.557826 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0636fc78-5acf-4335-8022-c20aef4c06b1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.214433 May 14 21:24:38.557826 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1958/3647] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:38 2022] POST /compute/v2.1/servers => generated 106 bytes in 216 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:24:38.563737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:38.564486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:38.570893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.571627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.573524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.574240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.727564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:38.728486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:38.736124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.736592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.737461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.738003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.755680 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] HTTP exception thrown: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 HTTP/1.1 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '656a3f63-e588-4886-8fb6-badfa00301d5'} May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.759153 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 404 to user: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fee7dfdd-0a55-4725-8a1f-028d662d945a tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 404 len: 111 microversion: 2.1 time: 0.036801 May 14 21:24:38.764008 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1959/3648] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:38 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:24:38.772062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:38.775920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:38.776925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:38.782934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.783694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.784758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.785360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.875433 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef391d51-3df6-4e7a-9ac0-e994d8b58351 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.110280 May 14 21:24:38.876263 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1960/3649] 10.222.0.52 () {58 vars in 1229 bytes} [Sat May 14 21:24:38 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:24:38.890612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7db48f0-d315-45e1-a668-daa1252cb55d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7db48f0-d315-45e1-a668-daa1252cb55d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: action_args: {} May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance[0]: May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi '2011/01/01' May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 14 21:24:38.893235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7db48f0-d315-45e1-a668-daa1252cb55d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a7db48f0-d315-45e1-a668-daa1252cb55d tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.009632 May 14 21:24:38.902108 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1961/3650] 10.222.0.52 () {58 vars in 1181 bytes} [Sat May 14 21:24:38 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:24:38.911417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:38.926104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:38.926910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:38.937827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.938294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.939102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:38.939941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:38.970459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:24:39.015389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98359ff9-624f-473f-af56-55bf776e9e51 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.112222 May 14 21:24:39.016086 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1962/3651] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:24:38 2022] GET /compute/v2.1/servers => generated 681 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:24:39.021077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.022473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:39.028856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.029314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.030111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.030570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.228395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.245223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.245721 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5cb721d7-13a7-4c18-9417-ac627e4256e1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1394 microversion: 2.1 time: 0.225650 May 14 21:24:39.245721 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1963/3652] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1394 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:39.253012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3892413-b311-4fba-9754-6a33fd25da9e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.700569 May 14 21:24:39.254402 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1690/3653] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:38 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:39.260984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.261893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:39.263586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.268851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.273977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.273977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.274315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.282482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.284083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.servers [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Removing options 'limit' from query {{(pid=130638) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 14 21:24:39.287975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:39.294533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.295099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.296496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.302698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.335982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:24:39.380742 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de752841-eec5-4051-a1f5-6f707c795705 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.122092 May 14 21:24:39.381329 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1964/3654] 10.222.0.52 () {58 vars in 1143 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:39.407098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-eb41ecec-c841-44e0-a7c7-7c43c577f71e req-40273f16-1937-4b74-9e30-ee631c323b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d85e9d3a-7530-4290-96bd-ed993a51bea3", "name": "network-vif-deleted", "tag": "e4b19477-e7fa-47f0-9ae9-9db5cf586364"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:39.408047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-eb41ecec-c841-44e0-a7c7-7c43c577f71e req-40273f16-1937-4b74-9e30-ee631c323b68 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.408243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-eb41ecec-c841-44e0-a7c7-7c43c577f71e req-40273f16-1937-4b74-9e30-ee631c323b68 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.425604 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-eb41ecec-c841-44e0-a7c7-7c43c577f71e req-40273f16-1937-4b74-9e30-ee631c323b68 service nova] Creating event network-vif-deleted:e4b19477-e7fa-47f0-9ae9-9db5cf586364 for instance d85e9d3a-7530-4290-96bd-ed993a51bea3 on nch1-master-1 May 14 21:24:39.431363 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-eb41ecec-c841-44e0-a7c7-7c43c577f71e req-40273f16-1937-4b74-9e30-ee631c323b68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039820 May 14 21:24:39.433367 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1965/3655] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:39.442996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.443947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:39.450819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.451539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.452614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.453267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.496117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.504821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d954e09d-d79c-4286-b933-d21a1a0abab0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.248822 May 14 21:24:39.505603 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1691/3656] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:39.511058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3700202-25bb-4ed4-bcca-27a4c93dc406 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3700202-25bb-4ed4-bcca-27a4c93dc406 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance[0]: May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi '-1' May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 14 21:24:39.514668 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 14 21:24:39.518818 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.522182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3700202-25bb-4ed4-bcca-27a4c93dc406 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:39.523185 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b3700202-25bb-4ed4-bcca-27a4c93dc406 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.016395 May 14 21:24:39.523901 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1692/3657] 10.222.0.52 () {58 vars in 1141 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:39.529792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.530499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:39.537676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.538225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.539087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.539660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.630049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.639505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9140556d-b9f2-4ef7-8d23-4a0c9bdce7b0 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 200 len: 1300 microversion: 2.1 time: 0.114512 May 14 21:24:39.643973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1693/3658] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 1300 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:39.648798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68ca6255-f43f-4f26-af8e-dc280fa3f08b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68ca6255-f43f-4f26-af8e-dc280fa3f08b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: action_args: {} May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance[0]: May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'testing' May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 14 21:24:39.652892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 14 21:24:39.661612 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:39.664924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68ca6255-f43f-4f26-af8e-dc280fa3f08b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:39.668592 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-68ca6255-f43f-4f26-af8e-dc280fa3f08b tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023416 May 14 21:24:39.673563 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1694/3659] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:39.679423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14835764-c727-4eae-8281-7b4f78d0344c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.683798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-14835764-c727-4eae-8281-7b4f78d0344c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.685207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14835764-c727-4eae-8281-7b4f78d0344c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:39.710423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.compute.servers [None req-14835764-c727-4eae-8281-7b4f78d0344c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Flavor 'non_existing_flavor' could not be found {{(pid=130637) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 14 21:24:39.711911 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14835764-c727-4eae-8281-7b4f78d0344c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.036887 May 14 21:24:39.713218 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1695/3660] 10.222.0.52 () {58 vars in 1177 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:24:39.725836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.730819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.731831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:39.738269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.739792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.740727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.741399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.800861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.810619 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e763865-fd68-477e-9b44-4024cbe7c416 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.375214 May 14 21:24:39.824283 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1966/3661] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:39.829571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ec57e0b-d1ee-495c-a37c-cf4c03a11394 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.830792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6ec57e0b-d1ee-495c-a37c-cf4c03a11394 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:39.832055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ddd497bc-f044-4c45-9ffe-6bf11195b00e tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.111310 May 14 21:24:39.833498 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1696/3662] 10.222.0.52 () {58 vars in 1173 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:24:39.837442 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-6ec57e0b-d1ee-495c-a37c-cf4c03a11394 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 could not be found. May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ec57e0b-d1ee-495c-a37c-cf4c03a11394 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 HTTP/1.1 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 could not be found. May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1'} May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 could not be found. May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 could not be found. May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:39.839729 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 could not be found. May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ec57e0b-d1ee-495c-a37c-cf4c03a11394 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6ec57e0b-d1ee-495c-a37c-cf4c03a11394 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1" status: 404 len: 111 microversion: 2.1 time: 0.015943 May 14 21:24:39.844619 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1967/3663] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:39 2022] DELETE /compute/v2.1/servers/cb3fae0c-3b9d-4360-9099-6fd25e7d4eb1 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:39.851913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.856604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.857136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.857389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:39.858235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:39.864166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.864801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.865801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.866500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.866765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.867105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.867952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.868406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.958771 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e50a9bc1-eacc-49ce-9cdb-2abb71f972f9 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.111662 May 14 21:24:39.960377 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1697/3664] 10.222.0.52 () {58 vars in 1183 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:24:39.974399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:39.978202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:39.979045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:39.984745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.985188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:39.985991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:39.988537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.027152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:24:40.116598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.124711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.125184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.127413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.138033 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-480bfa1f-500a-4e64-bbb0-fb9b42572455 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.287122 May 14 21:24:40.152163 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1968/3665] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:40.157544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.158185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.164694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.165159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.165948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.166623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.364716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.374575 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-096077d6-5763-4204-a1e2-cae8bfc61f0d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.220772 May 14 21:24:40.375876 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1969/3666] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:40.380820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.381881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.388243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c6b8837b-a2a4-42b0-b286-f1987f0fa576 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.419533 May 14 21:24:40.389915 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1698/3667] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:24:39 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:40.400708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2cb89ad0-d04d-4734-af49-3841b9e4ef2d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.401608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2cb89ad0-d04d-4734-af49-3841b9e4ef2d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Failed to fetch instance by id 9223372036854775808 {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2926}} May 14 21:24:40.403061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2cb89ad0-d04d-4734-af49-3841b9e4ef2d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2cb89ad0-d04d-4734-af49-3841b9e4ef2d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 9223372036854775808 could not be found. May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '9223372036854775808'} May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.405210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:40.412324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:40.412324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:40.412324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:40.412324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 14 21:24:40.412324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.412324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2cb89ad0-d04d-4734-af49-3841b9e4ef2d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:40.412689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.412781 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2cb89ad0-d04d-4734-af49-3841b9e4ef2d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.010848 May 14 21:24:40.412859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.412935 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1699/3668] 10.222.0.52 () {58 vars in 1187 bytes} [Sat May 14 21:24:40 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 14 21:24:40.413021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.413021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.413242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97973786-2c0e-4082-8a68-83fbd5da591f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.417922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-97973786-2c0e-4082-8a68-83fbd5da591f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.419012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97973786-2c0e-4082-8a68-83fbd5da591f tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.010009 May 14 21:24:40.419656 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1700/3669] 10.222.0.52 () {58 vars in 1177 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:24:40.424605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.425505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.433880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.434450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.435257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.435738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.621127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.628776 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a6d83a1d-a0e2-4c71-9a9b-4256a60142fb tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1575 microversion: 2.1 time: 0.251690 May 14 21:24:40.630316 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1970/3670] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:40.636509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.641557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.642472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Searching by: {'deleted': False, 'project_id': '9b6232491b674705b2c339c302ac9000'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:24:40.649182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.649896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.651293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.652882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.658193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.669596 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d9203f0-39f6-40dc-81fd-ec2d7710f69e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.247244 May 14 21:24:40.683574 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1701/3671] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:40.684916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:24:40.688539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.689235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.695749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.696206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.697047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.697613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.726725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9b12428b-a2ef-468b-9df5-f21384187caf tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.088366 May 14 21:24:40.726725 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1971/3672] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers => generated 681 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:40.726725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-5cf241c5-29a5-4e08-a2c0-4d00dfc6e403 req-520cc5a2-cece-4cde-9aa6-6bfc561f7015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f740ee6-2164-45db-a16c-3fbe393cc90a", "tag": "fecd4045-e84a-40a2-8340-c732d9c9642c"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:40.736085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5cf241c5-29a5-4e08-a2c0-4d00dfc6e403 req-520cc5a2-cece-4cde-9aa6-6bfc561f7015 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.737359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-5cf241c5-29a5-4e08-a2c0-4d00dfc6e403 req-520cc5a2-cece-4cde-9aa6-6bfc561f7015 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.751415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-5cf241c5-29a5-4e08-a2c0-4d00dfc6e403 req-520cc5a2-cece-4cde-9aa6-6bfc561f7015 service nova] Creating event network-changed:fecd4045-e84a-40a2-8340-c732d9c9642c for instance 3f740ee6-2164-45db-a16c-3fbe393cc90a on nch2-master-1 May 14 21:24:40.756507 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-5cf241c5-29a5-4e08-a2c0-4d00dfc6e403 req-520cc5a2-cece-4cde-9aa6-6bfc561f7015 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034989 May 14 21:24:40.757421 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1972/3673] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:40.763443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c2a06438-c1e0-42f4-a5f5-e4ad54c73c7d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.773108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c2a06438-c1e0-42f4-a5f5-e4ad54c73c7d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.773108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a06438-c1e0-42f4-a5f5-e4ad54c73c7d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.773108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a06438-c1e0-42f4-a5f5-e4ad54c73c7d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.773108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a06438-c1e0-42f4-a5f5-e4ad54c73c7d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.773108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a06438-c1e0-42f4-a5f5-e4ad54c73c7d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.862775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:40.874572 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0b08d63-af67-4863-9b21-a1e17c0c152a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.189797 May 14 21:24:40.879559 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1702/3674] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:40.889023 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c2a06438-c1e0-42f4-a5f5-e4ad54c73c7d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130392 May 14 21:24:40.890118 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1973/3675] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:40.890496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.891226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: d85e9d3a-7530-4290-96bd-ed993a51bea3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.895605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.896558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.901006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.901767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.902442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.902877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.904582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.905186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.906030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.906563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.924658 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] HTTP exception thrown: Instance d85e9d3a-7530-4290-96bd-ed993a51bea3 could not be found. May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Request method failure captured: May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 HTTP/1.1 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBxdQLyUXipdOs58tsX3ys7eUbGjDiSSYt_fXNeAeCW_o6z5ZETYif8XSUovghyEvodaTLuhKXDis9kPqLil9CjOGGR8wiGPdJRcCEBLsDFw2kX6XwAAfapme4UIgBFp9hMAIehUEC8AC9ze5SDL01BeK5x4aJALaKQS_i06ePj8WBQ May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a924ca59a9ac44cf96e53be012a43af1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: a42e0caa0878447f98544e74f767c7ca May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d85e9d3a-7530-4290-96bd-ed993a51bea3 could not be found. May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd85e9d3a-7530-4290-96bd-ed993a51bea3'} May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d85e9d3a-7530-4290-96bd-ed993a51bea3 could not be found. May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d85e9d3a-7530-4290-96bd-ed993a51bea3 could not be found. May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:40.927886 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d85e9d3a-7530-4290-96bd-ed993a51bea3 could not be found. May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Returning 404 to user: Instance d85e9d3a-7530-4290-96bd-ed993a51bea3 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:40.932661 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b7d28c6b-1198-4458-90a9-942b963ca8e3 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3" status: 404 len: 111 microversion: 2.1 time: 0.052910 May 14 21:24:40.934714 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1703/3676] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers/d85e9d3a-7530-4290-96bd-ed993a51bea3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:40.940524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.941050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.947927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.948388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.953697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.953697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.966369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] HTTP exception thrown: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 HTTP/1.1 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '656a3f63-e588-4886-8fb6-badfa00301d5'} May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:40.968005 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 404 to user: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe3ce0eb-be07-4620-b59c-6dbd635e5869 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 404 len: 111 microversion: 2.1 time: 0.033923 May 14 21:24:40.974382 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1704/3677] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:40 2022] DELETE /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:40.979792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:40.980945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:40.988344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.989602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:40.991032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:40.991765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.026269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:41.293531 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d06dc91e-97d6-4f3b-ae65-64211f70b701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 204 len: 0 microversion: 2.1 time: 0.321481 May 14 21:24:41.294323 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1705/3678] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:40 2022] DELETE /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:41.300851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:41.303590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:41.308890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.309477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.310373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.310928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.345023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:41.589266 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b710bda-2ceb-4125-be13-6ad4ddf37a46 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3" status: 204 len: 0 microversion: 2.1 time: 0.293254 May 14 21:24:41.589978 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1706/3679] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:41 2022] DELETE /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:41.595374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:41.596141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:41.602119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.602577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.603354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.603833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.717607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:41.731961 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab7b9b3b-c1fd-4198-821c-61d81d95d2c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.840254 May 14 21:24:41.732557 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1974/3680] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:40 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:41.742882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:41.743633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:41.751723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.752508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.753287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.753895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.758555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:41.769894 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c82cbfec-bad4-4fb4-a64f-8d99279d076e tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1509 microversion: 2.1 time: 0.178473 May 14 21:24:41.779652 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1707/3681] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:41 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:41.783678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1bc38a92-5da4-4ea2-ba62-8c5ff6b11d89 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:41.784186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1bc38a92-5da4-4ea2-ba62-8c5ff6b11d89 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Failed to fetch instance by id -1 {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2926}} May 14 21:24:41.784804 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-1bc38a92-5da4-4ea2-ba62-8c5ff6b11d89 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance -1 could not be found. May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1bc38a92-5da4-4ea2-ba62-8c5ff6b11d89 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance -1 could not be found. May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '-1'} May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:41.786407 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:41.796336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:41.796336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:41.796336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 14 21:24:41.796336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:41.796336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1bc38a92-5da4-4ea2-ba62-8c5ff6b11d89 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance -1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:41.796336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1bc38a92-5da4-4ea2-ba62-8c5ff6b11d89 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.016990 May 14 21:24:41.796336 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1708/3682] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:24:41 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:24:41.796778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:41.801284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:41.801966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:41.810026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.810488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.811413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.811896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.953652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:41.961279 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-636f000f-74dd-4982-b0fe-f18c1df987ef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.164879 May 14 21:24:41.961847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1709/3683] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:41 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:41.967210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:41.968079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:41.975399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.975891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:41.976681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:41.977128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.129570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:42.139581 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82e19b2c-1f8a-4dff-997a-7abbfcc571b4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.176658 May 14 21:24:42.140179 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1710/3684] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:41 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:42.144828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:42.145456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.151659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.152103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.153169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.153641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.202809 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c87e423f-2ba9-4cb1-a7f0-5a189372e883 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 204 len: 0 microversion: 2.1 time: 0.464393 May 14 21:24:42.203698 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1975/3685] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:41 2022] DELETE /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:42.215008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:42.215776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: 656a3f63-e588-4886-8fb6-badfa00301d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.223653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.224889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.225884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.226331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.241380 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] HTTP exception thrown: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 HTTP/1.1 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '656a3f63-e588-4886-8fb6-badfa00301d5'} May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:42.243045 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 404 to user: Instance 656a3f63-e588-4886-8fb6-badfa00301d5 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1894787a-d95c-4fb1-bcb2-9c9a179dd142 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5" status: 404 len: 111 microversion: 2.1 time: 0.038589 May 14 21:24:42.252010 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1976/3686] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:42 2022] GET /compute/v2.1/servers/656a3f63-e588-4886-8fb6-badfa00301d5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:42.259539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:42.260302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.267219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.268443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.269233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.269842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.308552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:42.316560 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1e2667e0-9cdc-4def-a2ec-d6d5f3bc1aab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.175197 May 14 21:24:42.321754 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1711/3687] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:42 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:42.332980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7cc8c674-97f7-4dcd-8600-afafe522bea8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:42.333336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7cc8c674-97f7-4dcd-8600-afafe522bea8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 241fd8df-6d8d-4b6c-98f2-32cc855233de] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.339435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-7cc8c674-97f7-4dcd-8600-afafe522bea8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 241fd8df-6d8d-4b6c-98f2-32cc855233de could not be found. May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7cc8c674-97f7-4dcd-8600-afafe522bea8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/241fd8df-6d8d-4b6c-98f2-32cc855233de/action HTTP/1.1 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 19 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: {"forceDelete": {}} May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 241fd8df-6d8d-4b6c-98f2-32cc855233de could not be found. May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '241fd8df-6d8d-4b6c-98f2-32cc855233de', 'body': {'forceDelete': {}}} May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241fd8df-6d8d-4b6c-98f2-32cc855233de could not be found. May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241fd8df-6d8d-4b6c-98f2-32cc855233de could not be found. May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:42.346032 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:42.350710 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:42.350710 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:42.350710 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241fd8df-6d8d-4b6c-98f2-32cc855233de could not be found. May 14 21:24:42.350710 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:42.350710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7cc8c674-97f7-4dcd-8600-afafe522bea8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 241fd8df-6d8d-4b6c-98f2-32cc855233de could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:42.350710 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7cc8c674-97f7-4dcd-8600-afafe522bea8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/241fd8df-6d8d-4b6c-98f2-32cc855233de/action" status: 404 len: 111 microversion: 2.1 time: 0.018862 May 14 21:24:42.350710 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1712/3688] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:42 2022] POST /compute/v2.1/servers/241fd8df-6d8d-4b6c-98f2-32cc855233de/action => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:24:42.357281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:42.357952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.364906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.365369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.366146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.366585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.508087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:42.517252 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-68df1196-f782-414b-9b96-766179ec5e7d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.164667 May 14 21:24:42.517927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1713/3689] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:42 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:42.537623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:42.538227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.544896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.545370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.546577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.546971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.617220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:42.626498 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72fe459e-df6e-431b-9b0d-94ed629202f0 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3" status: 200 len: 1521 microversion: 2.1 time: 0.371525 May 14 21:24:42.637069 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1977/3690] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:42 2022] GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:42.760959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:42.769871 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c082ce45-116c-441c-b667-53fd79e049ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.236134 May 14 21:24:42.788885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28edba97-0a23-4069-b0da-adaf866c3dc8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:42.790103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28edba97-0a23-4069-b0da-adaf866c3dc8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d0fb83d8-3b1e-44cc-9b64-12a047f72f76] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.795574 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1714/3691] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:42 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:42.805545 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-28edba97-0a23-4069-b0da-adaf866c3dc8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance d0fb83d8-3b1e-44cc-9b64-12a047f72f76 could not be found. May 14 21:24:42.807382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:42.808279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28edba97-0a23-4069-b0da-adaf866c3dc8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/d0fb83d8-3b1e-44cc-9b64-12a047f72f76/action HTTP/1.1 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 39 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: {"os-getConsoleOutput": {"length": 10}} May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance d0fb83d8-3b1e-44cc-9b64-12a047f72f76 could not be found. May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd0fb83d8-3b1e-44cc-9b64-12a047f72f76', 'body': {'os-getConsoleOutput': {'length': 10}}} May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0fb83d8-3b1e-44cc-9b64-12a047f72f76 could not be found. May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0fb83d8-3b1e-44cc-9b64-12a047f72f76 could not be found. May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.814386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0fb83d8-3b1e-44cc-9b64-12a047f72f76 could not be found. May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28edba97-0a23-4069-b0da-adaf866c3dc8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance d0fb83d8-3b1e-44cc-9b64-12a047f72f76 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28edba97-0a23-4069-b0da-adaf866c3dc8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d0fb83d8-3b1e-44cc-9b64-12a047f72f76/action" status: 404 len: 111 microversion: 2.1 time: 0.032319 May 14 21:24:42.818544 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1978/3692] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:42 2022] POST /compute/v2.1/servers/d0fb83d8-3b1e-44cc-9b64-12a047f72f76/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:42.824719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.825259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.826072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.826499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.832079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:42.832936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:42.857416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.858196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:42.859222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:42.859886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.053520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:43.063032 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0dc5986f-4894-4b05-8cee-f50488855e3f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1509 microversion: 2.1 time: 0.266404 May 14 21:24:43.064073 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1715/3693] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:42 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1509 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:43.081399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:43.092139 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b14cb2e-4c25-439d-98f1-3a2e3a5427a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.270502 May 14 21:24:43.092740 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1979/3694] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:42 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:43.116399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:43.117010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:43.128856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.129961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.130738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.131202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.160299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:43.160993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:43.170841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.171372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.172589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.173039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.407003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:43.415811 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b8eaefcf-de69-463f-b1b1-1fa454c24d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.303042 May 14 21:24:43.430337 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1716/3695] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:43 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:43.437664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:43.438650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:43.447750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.448615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.449648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.450654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.515223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:43.530095 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-508b04d8-031b-44b2-9990-0ea728cc85ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.375814 May 14 21:24:43.531269 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1980/3696] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:43 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:43.539233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-70768d7d-4124-42ee-95d9-ad3ca1af1893 req-0535e77e-5659-4c92-952b-5a9fa72415b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d68de201-9379-4235-9f12-f43205e5341c", "tag": "a4831886-f328-4292-b75f-9f46662e69b1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:43.548969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-70768d7d-4124-42ee-95d9-ad3ca1af1893 req-0535e77e-5659-4c92-952b-5a9fa72415b1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.549733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-70768d7d-4124-42ee-95d9-ad3ca1af1893 req-0535e77e-5659-4c92-952b-5a9fa72415b1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.572734 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-70768d7d-4124-42ee-95d9-ad3ca1af1893 req-0535e77e-5659-4c92-952b-5a9fa72415b1 service nova] Creating event network-changed:a4831886-f328-4292-b75f-9f46662e69b1 for instance d68de201-9379-4235-9f12-f43205e5341c on nch1-master-1 May 14 21:24:43.579949 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-70768d7d-4124-42ee-95d9-ad3ca1af1893 req-0535e77e-5659-4c92-952b-5a9fa72415b1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047266 May 14 21:24:43.581655 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1981/3697] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:43.589744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c8f9126-f95c-45c5-adab-10c9f6ad74fa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:43.590751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0c8f9126-f95c-45c5-adab-10c9f6ad74fa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 55a9146d-2195-4686-94a1-7c358f31ad6f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:43.603217 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0c8f9126-f95c-45c5-adab-10c9f6ad74fa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 55a9146d-2195-4686-94a1-7c358f31ad6f could not be found. May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c8f9126-f95c-45c5-adab-10c9f6ad74fa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/55a9146d-2195-4686-94a1-7c358f31ad6f HTTP/1.1 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 55a9146d-2195-4686-94a1-7c358f31ad6f could not be found. May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '55a9146d-2195-4686-94a1-7c358f31ad6f'} May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55a9146d-2195-4686-94a1-7c358f31ad6f could not be found. May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55a9146d-2195-4686-94a1-7c358f31ad6f could not be found. May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:43.606768 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55a9146d-2195-4686-94a1-7c358f31ad6f could not be found. May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c8f9126-f95c-45c5-adab-10c9f6ad74fa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 55a9146d-2195-4686-94a1-7c358f31ad6f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0c8f9126-f95c-45c5-adab-10c9f6ad74fa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/55a9146d-2195-4686-94a1-7c358f31ad6f" status: 404 len: 111 microversion: 2.1 time: 0.025197 May 14 21:24:43.610687 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1982/3698] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:43 2022] GET /compute/v2.1/servers/55a9146d-2195-4686-94a1-7c358f31ad6f => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:43.620723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:43.621696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:43.633514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.633973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.635845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.643337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.704215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:43.715601 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2337d8fc-2152-43a1-99d9-7f4c34ae861d tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1575 microversion: 2.1 time: 0.281114 May 14 21:24:43.716274 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1717/3699] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:43 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1575 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:43.726648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:43.726648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:43.737218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.737682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.738490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.738940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.871452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:43.881608 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8f4e22d4-c8f8-4723-890a-3945359dfe6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.264186 May 14 21:24:43.882148 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1983/3700] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:43 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:43.899914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:43.901271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:43.908604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.912294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:43.912294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:43.912294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.118062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:44.132239 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3109424c-eefb-4c1b-8969-74c3d53e16af tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3" status: 200 len: 1521 microversion: 2.1 time: 0.413866 May 14 21:24:44.135889 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1718/3701] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:43 2022] GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:44.141493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:44.142445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:44.150020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:44.158809 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd2f3a5b-9ca6-41be-b69e-2aecfe7608ad tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.262714 May 14 21:24:44.169776 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1984/3702] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:43 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:44.174106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.175868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.177558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.182950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.183039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ab1e3872-dd80-44a2-8140-e4a6b7811213 req-828fb622-9193-41a4-b38a-cd229bb3a24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd230835-262d-4728-a1d2-ff33fbc18dd3", "name": "network-vif-deleted", "tag": "3a348e4f-ad3b-422c-95bb-dd7c013bb387"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:44.207888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ab1e3872-dd80-44a2-8140-e4a6b7811213 req-828fb622-9193-41a4-b38a-cd229bb3a24b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.208515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ab1e3872-dd80-44a2-8140-e4a6b7811213 req-828fb622-9193-41a4-b38a-cd229bb3a24b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.237369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ab1e3872-dd80-44a2-8140-e4a6b7811213 req-828fb622-9193-41a4-b38a-cd229bb3a24b service nova] Creating event network-vif-deleted:3a348e4f-ad3b-422c-95bb-dd7c013bb387 for instance dd230835-262d-4728-a1d2-ff33fbc18dd3 on nch1-master-1 May 14 21:24:44.244754 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ab1e3872-dd80-44a2-8140-e4a6b7811213 req-828fb622-9193-41a4-b38a-cd229bb3a24b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072548 May 14 21:24:44.248030 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1985/3703] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:44.317227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ded5ee1d-00ed-4cd8-9ad8-972ef1ef4389 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-882598992", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ded5ee1d-00ed-4cd8-9ad8-972ef1ef4389 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 237 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-882598992", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-882598992', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:44.320551 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 14 21:24:44.325081 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:44.327546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ded5ee1d-00ed-4cd8-9ad8-972ef1ef4389 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:44.328561 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ded5ee1d-00ed-4cd8-9ad8-972ef1ef4389 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.015962 May 14 21:24:44.338246 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1986/3704] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:44 2022] POST /compute/v2.1/servers => generated 139 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:24:44.344127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:44.344949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:44.353152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.354289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.354919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.355618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.485662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:44.495925 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc0fbd9c-659f-4a02-a62c-1620298a13cc tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1509 microversion: 2.1 time: 0.358321 May 14 21:24:44.497298 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1719/3705] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:44 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1509 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:44.547244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:44.548248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:44.554607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.555457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.556455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.557652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.622790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:44.631007 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-96bb72e5-273f-4433-8909-4fb2e0be5fab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.291254 May 14 21:24:44.631980 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1987/3706] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:44 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:44.649723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:44.649956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:44.656665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.657120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.657940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.658383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.769249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:44.781156 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c8618f4-9485-4a4a-9c30-6670f820dcda tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.234877 May 14 21:24:44.782550 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1720/3707] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:44 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:44.829831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:44.839152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d951307e-1574-4d47-8090-3c255fae71ab tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.193860 May 14 21:24:44.839925 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1988/3708] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:44 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:44.912770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-195566cb-87d1-4c9e-857b-963d91eaa81a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290675598", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-195566cb-87d1-4c9e-857b-963d91eaa81a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 234 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-290675598", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-290675598', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = func(instance) May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi 'notvalid' May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:44.932654 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-195566cb-87d1-4c9e-857b-963d91eaa81a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-195566cb-87d1-4c9e-857b-963d91eaa81a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025991 May 14 21:24:44.937791 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1721/3709] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:44 2022] POST /compute/v2.1/servers => generated 133 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:24:44.950440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:44.951379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:44.958172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.958646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:44.959505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:44.959947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.167071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:45.168662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:45.182442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.184959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.188612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.189086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.252217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.253062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.254307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lazy-loading 'fault' on Instance uuid dd230835-262d-4728-a1d2-ff33fbc18dd3 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:45.328588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:45.339895 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-77e54a61-31b4-4a2f-81f5-182c35921641 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.399915 May 14 21:24:45.344268 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1989/3710] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:44 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:45.363007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:45.364136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:45.376316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.376771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.377579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.378026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.410592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:45.418148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-260474e1-a779-489e-afd1-9546d6d05109 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3" status: 200 len: 1312 microversion: 2.1 time: 0.267796 May 14 21:24:45.421806 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1722/3711] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:45 2022] GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3 => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:45.518499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:45.522191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:45.534384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.535282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.541470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.541470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.854253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:45.863681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37f70405-92fd-4b6c-acaf-3ec26266c819 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1509 microversion: 2.1 time: 0.353632 May 14 21:24:45.864427 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1723/3712] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:45 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:45.879550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:45.880442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:45.888180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.890284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.890284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.890284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.919920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:45.928755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99bec5e1-17ae-4af0-b262-8c65f7c1c205 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.569709 May 14 21:24:45.930029 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1990/3713] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:45 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:45.946635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3779b8b9-e58b-4b46-8727-efdb599744ff tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:45.948362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3779b8b9-e58b-4b46-8727-efdb599744ff tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6bf97538-0531-4aea-a703-823dd189fc07] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:45.956008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-3779b8b9-e58b-4b46-8727-efdb599744ff tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 6bf97538-0531-4aea-a703-823dd189fc07 could not be found. May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3779b8b9-e58b-4b46-8727-efdb599744ff tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/6bf97538-0531-4aea-a703-823dd189fc07/action HTTP/1.1 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 13 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: {"pause": {}} May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 6bf97538-0531-4aea-a703-823dd189fc07 could not be found. May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6bf97538-0531-4aea-a703-823dd189fc07', 'body': {'pause': {}}} May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf97538-0531-4aea-a703-823dd189fc07 could not be found. May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf97538-0531-4aea-a703-823dd189fc07 could not be found. May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:45.962053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:45.972797 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:45.972797 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:45.972797 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf97538-0531-4aea-a703-823dd189fc07 could not be found. May 14 21:24:45.972797 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:45.972797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3779b8b9-e58b-4b46-8727-efdb599744ff tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 6bf97538-0531-4aea-a703-823dd189fc07 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:45.972797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3779b8b9-e58b-4b46-8727-efdb599744ff tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/6bf97538-0531-4aea-a703-823dd189fc07/action" status: 404 len: 111 microversion: 2.1 time: 0.022250 May 14 21:24:45.972797 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1991/3714] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:45 2022] POST /compute/v2.1/servers/6bf97538-0531-4aea-a703-823dd189fc07/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:45.985651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:45.986428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:45.997631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:45.999282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:45.999548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.000219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.138542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:46.147090 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-20b92868-1a75-49cd-97ff-26dcc8e1dab2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.281398 May 14 21:24:46.148288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1724/3715] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:45 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:46.246063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-4739f97e-80b3-4a93-bb2f-55bf1cffb1e1 req-d3cc5e78-94aa-447b-a4e2-f9a758f324eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6b381c3-d53d-4d16-8783-5b095927537a", "name": "network-vif-deleted", "tag": "0fd1ba02-b29d-4826-b8f2-bebee3a5e344"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:46.260992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4739f97e-80b3-4a93-bb2f-55bf1cffb1e1 req-d3cc5e78-94aa-447b-a4e2-f9a758f324eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.261817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4739f97e-80b3-4a93-bb2f-55bf1cffb1e1 req-d3cc5e78-94aa-447b-a4e2-f9a758f324eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.268204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:46.285524 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0c540e31-a82e-4278-8b68-be6584ad46bb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.310494 May 14 21:24:46.286889 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1992/3716] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:45 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:46.296282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-4739f97e-80b3-4a93-bb2f-55bf1cffb1e1 req-d3cc5e78-94aa-447b-a4e2-f9a758f324eb service nova] Creating event network-vif-deleted:0fd1ba02-b29d-4826-b8f2-bebee3a5e344 for instance e6b381c3-d53d-4d16-8783-5b095927537a on nch2-master-1 May 14 21:24:46.302920 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-4739f97e-80b3-4a93-bb2f-55bf1cffb1e1 req-d3cc5e78-94aa-447b-a4e2-f9a758f324eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062831 May 14 21:24:46.305965 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1725/3717] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:46.312752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-bf3eb853-1427-4da4-a3d4-2eb81d393664 req-bc2826a1-9a93-4725-8f95-d65a4cf190eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b568eb49-248c-41f8-ae1f-1d2af49cb78c", "name": "network-vif-deleted", "tag": "9e94139a-6e1c-4da1-8861-0687ddd3586e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:46.315321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:46.316260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:46.326653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.327415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.328744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.329446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.332576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bf3eb853-1427-4da4-a3d4-2eb81d393664 req-bc2826a1-9a93-4725-8f95-d65a4cf190eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.333040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bf3eb853-1427-4da4-a3d4-2eb81d393664 req-bc2826a1-9a93-4725-8f95-d65a4cf190eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.373396 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-bf3eb853-1427-4da4-a3d4-2eb81d393664 req-bc2826a1-9a93-4725-8f95-d65a4cf190eb service nova] Creating event network-vif-deleted:9e94139a-6e1c-4da1-8861-0687ddd3586e for instance b568eb49-248c-41f8-ae1f-1d2af49cb78c on nch2-master-1 May 14 21:24:46.384405 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-bf3eb853-1427-4da4-a3d4-2eb81d393664 req-bc2826a1-9a93-4725-8f95-d65a4cf190eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082829 May 14 21:24:46.385338 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1993/3718] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:46.440201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:46.440919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: dd230835-262d-4728-a1d2-ff33fbc18dd3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:46.450944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.451332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.452156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.452590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.493941 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] HTTP exception thrown: Instance dd230835-262d-4728-a1d2-ff33fbc18dd3 could not be found. May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3 HTTP/1.1 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance dd230835-262d-4728-a1d2-ff33fbc18dd3 could not be found. May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'dd230835-262d-4728-a1d2-ff33fbc18dd3'} May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd230835-262d-4728-a1d2-ff33fbc18dd3 could not be found. May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd230835-262d-4728-a1d2-ff33fbc18dd3 could not be found. May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:46.496581 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:46.501557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:46.501557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:46.501557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:46.501557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:46.501557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:46.501557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd230835-262d-4728-a1d2-ff33fbc18dd3 could not be found. May 14 21:24:46.501557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:46.503121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 404 to user: Instance dd230835-262d-4728-a1d2-ff33fbc18dd3 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:46.504218 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2238102f-fff0-4ebc-89d5-632f92f7ca7c tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3" status: 404 len: 111 microversion: 2.1 time: 0.069224 May 14 21:24:46.509541 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1994/3719] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:46 2022] GET /compute/v2.1/servers/dd230835-262d-4728-a1d2-ff33fbc18dd3 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:24:46.514292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:46.514913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:46.521467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.522345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.523735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.524355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.552926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:46.560231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.560686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.561149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lazy-loading 'fault' on Instance uuid b568eb49-248c-41f8-ae1f-1d2af49cb78c {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:46.567239 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ce3de357-7d5c-4cb6-8e48-6d6fa94c373b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.258978 May 14 21:24:46.571544 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1726/3720] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:46 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:46.588670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d2cd3a4-22bb-4bd2-8544-cc5927469ddd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:46.589393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1d2cd3a4-22bb-4bd2-8544-cc5927469ddd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:46.599083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d2cd3a4-22bb-4bd2-8544-cc5927469ddd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.599575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d2cd3a4-22bb-4bd2-8544-cc5927469ddd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.600375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d2cd3a4-22bb-4bd2-8544-cc5927469ddd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.600812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d2cd3a4-22bb-4bd2-8544-cc5927469ddd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.616996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4020cecd1174ff68101b6498780d00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6232491b674705b2c339c302ac9000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:46.625324 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-545066b1-5479-4470-9414-4b082733cbf4 tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 200 len: 1312 microversion: 2.1 time: 0.116215 May 14 21:24:46.627527 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1995/3721] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:46 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 1312 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:46.833904 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1d2cd3a4-22bb-4bd2-8544-cc5927469ddd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 202 len: 0 microversion: 2.1 time: 0.249373 May 14 21:24:46.835789 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1727/3722] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:46 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:24:46.857226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:46.859443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:46.873042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.874082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.875116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.876199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.881936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:46.882666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:46.892654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.893107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.894022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.894658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.996982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:46.997531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:46.998116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lazy-loading 'fault' on Instance uuid e6b381c3-d53d-4d16-8783-5b095927537a {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:47.043826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:47.048700 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-81c7308b-ba68-45b7-8d71-bc700086a731 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 200 len: 1305 microversion: 2.1 time: 0.171422 May 14 21:24:47.049283 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1728/3723] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:46 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 1305 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:47.083240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:47.091927 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dcef54e8-db3b-4d54-8771-6cc853d31001 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1509 microversion: 2.1 time: 0.249437 May 14 21:24:47.092500 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1996/3724] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:46 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:47.165169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:47.165791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:47.172097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:47.172561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:47.173346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:47.173790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:47.318366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:47.336362 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc32b94f-bddd-42f8-91f1-dca47ed8899b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.174028 May 14 21:24:47.340494 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1729/3725] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:47 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:47.643436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:47.644082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] [instance: b568eb49-248c-41f8-ae1f-1d2af49cb78c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:47.651719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:47.652196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:47.652989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:47.653440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:47.668188 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] HTTP exception thrown: Instance b568eb49-248c-41f8-ae1f-1d2af49cb78c could not be found. May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Request method failure captured: May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c HTTP/1.1 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3v6kFjs7f__lcyrg_SwsDohAnGzcOort52DvMB45S0ixwWpjYKbmYcWtk_dUbSM9yyQziwuDrckCGJeVOggas4G6YvQdGmVvv3Ycn0iy0mjUcUxuxUBjKhG6x9cwH6zBL6aJQsQ8QOqslLT_QevvMSf7Fc3aMN1EyXURuAWfbqroQ May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9b6232491b674705b2c339c302ac9000"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9b6232491b674705b2c339c302ac9000"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9b6232491b674705b2c339c302ac9000", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9b6232491b674705b2c339c302ac9000 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-115874616 May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: c4020cecd1174ff68101b6498780d00c May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServersNegativeTestJSON-115874616-project May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b568eb49-248c-41f8-ae1f-1d2af49cb78c could not be found. May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b568eb49-248c-41f8-ae1f-1d2af49cb78c'} May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b568eb49-248c-41f8-ae1f-1d2af49cb78c could not be found. May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b568eb49-248c-41f8-ae1f-1d2af49cb78c could not be found. May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:47.674577 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b568eb49-248c-41f8-ae1f-1d2af49cb78c could not be found. May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] Returning 404 to user: Instance b568eb49-248c-41f8-ae1f-1d2af49cb78c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2f4df7f-81ae-4868-9388-04a0f6f059de tempest-ListServersNegativeTestJSON-115874616 tempest-ListServersNegativeTestJSON-115874616-project] 10.222.0.52 "GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c" status: 404 len: 111 microversion: 2.1 time: 0.031761 May 14 21:24:47.679880 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1997/3726] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:47 2022] GET /compute/v2.1/servers/b568eb49-248c-41f8-ae1f-1d2af49cb78c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:48.065710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:48.066330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: e6b381c3-d53d-4d16-8783-5b095927537a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:48.072802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.073516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.074474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.075094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.090302 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] HTTP exception thrown: Instance e6b381c3-d53d-4d16-8783-5b095927537a could not be found. May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Request method failure captured: May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a HTTP/1.1 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBxdQLyUXipdOs58tsX3ys7eUbGjDiSSYt_fXNeAeCW_o6z5ZETYif8XSUovghyEvodaTLuhKXDis9kPqLil9CjOGGR8wiGPdJRcCEBLsDFw2kX6XwAAfapme4UIgBFp9hMAIehUEC8AC9ze5SDL01BeK5x4aJALaKQS_i06ePj8WBQ May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a924ca59a9ac44cf96e53be012a43af1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: a42e0caa0878447f98544e74f767c7ca May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance e6b381c3-d53d-4d16-8783-5b095927537a could not be found. May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'e6b381c3-d53d-4d16-8783-5b095927537a'} May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6b381c3-d53d-4d16-8783-5b095927537a could not be found. May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6b381c3-d53d-4d16-8783-5b095927537a could not be found. May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:48.092038 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.096723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:48.096723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:48.096723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:48.096723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:48.096723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:48.096723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6b381c3-d53d-4d16-8783-5b095927537a could not be found. May 14 21:24:48.096723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.097888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Returning 404 to user: Instance e6b381c3-d53d-4d16-8783-5b095927537a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:48.098760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b68ac1fc-0065-4869-b102-cad94d53aaaa tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a" status: 404 len: 111 microversion: 2.1 time: 0.037141 May 14 21:24:48.099324 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1730/3727] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:48 2022] GET /compute/v2.1/servers/e6b381c3-d53d-4d16-8783-5b095927537a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:48.108687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:48.109259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:48.109362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:48.109879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:48.116659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.116854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.117115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.119836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.120026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.120026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.120215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.120215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.151945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:48.268791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:48.278482 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3fdf7eb4-cbb1-49cf-af5c-b5de7d9b6784 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1489 microversion: 2.1 time: 0.173356 May 14 21:24:48.279105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1731/3728] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:48 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1489 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:48.309545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:48.310119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:48.317399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.318065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.319033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.319589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Cannot 'pause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state paused May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action HTTP/1.1 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 13 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: {"pause": {}} May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'pause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state paused May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'pause': {}}} May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 in vm_state paused. Cannot pause while the instance is in this state. May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state paused May 14 21:24:48.353762 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state paused May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 409 to user: Cannot 'pause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state paused {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8132c67a-09f2-4ed9-86d1-19a714502aa6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 409 len: 143 microversion: 2.1 time: 0.046280 May 14 21:24:48.361706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1732/3729] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:48 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 143 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:24:48.366014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7806d2c6-4daa-43b6-bf6c-b9aaad009344 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:48.366563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7806d2c6-4daa-43b6-bf6c-b9aaad009344 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:48.373280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7806d2c6-4daa-43b6-bf6c-b9aaad009344 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.373744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7806d2c6-4daa-43b6-bf6c-b9aaad009344 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.374542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7806d2c6-4daa-43b6-bf6c-b9aaad009344 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.374989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7806d2c6-4daa-43b6-bf6c-b9aaad009344 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.735965 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7806d2c6-4daa-43b6-bf6c-b9aaad009344 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 202 len: 0 microversion: 2.1 time: 0.377226 May 14 21:24:48.736784 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1733/3730] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:48 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:24:48.742360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:48.743062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:48.749506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.749957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.750975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.751622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.823506 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e2e3254-75f7-4e00-9d3f-0de42d649e1f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "DELETE /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 204 len: 0 microversion: 2.1 time: 0.719539 May 14 21:24:48.824243 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1998/3731] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:48 2022] DELETE /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:48.829923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:48.830641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:48.836704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.837211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.838060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:48.838505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:48.990008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:49.000695 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-711bd5d0-2076-4969-8c22-9e8e611e6f1e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1496 microversion: 2.1 time: 0.175154 May 14 21:24:49.001788 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 1999/3732] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:48 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1496 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:49.013533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:49.019853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:49.021054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:49.021758 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b431e44-a528-4849-9ed2-514fb2ace625 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.283571 May 14 21:24:49.022352 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1734/3733] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:48 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:49.033916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ce501d7e-9171-465d-bed9-9fef2fe56555 req-a324d9dc-f145-4cf1-98e2-dad4bc3d2f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f740ee6-2164-45db-a16c-3fbe393cc90a", "name": "network-vif-plugged", "status": "completed", "tag": "fecd4045-e84a-40a2-8340-c732d9c9642c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:49.038724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:49.041876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:49.042821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:49.044179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:49.044635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ce501d7e-9171-465d-bed9-9fef2fe56555 req-a324d9dc-f145-4cf1-98e2-dad4bc3d2f41 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:49.045124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ce501d7e-9171-465d-bed9-9fef2fe56555 req-a324d9dc-f145-4cf1-98e2-dad4bc3d2f41 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:49.057815 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ce501d7e-9171-465d-bed9-9fef2fe56555 req-a324d9dc-f145-4cf1-98e2-dad4bc3d2f41 service nova] Creating event network-vif-plugged:fecd4045-e84a-40a2-8340-c732d9c9642c for instance 3f740ee6-2164-45db-a16c-3fbe393cc90a on nch2-master-1 May 14 21:24:49.062942 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ce501d7e-9171-465d-bed9-9fef2fe56555 req-a324d9dc-f145-4cf1-98e2-dad4bc3d2f41 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039466 May 14 21:24:49.066927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1735/3734] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:49.286980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:49.295908 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c97924f-04c1-448e-ae6c-396982f5111b tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1493 microversion: 2.1 time: 0.291094 May 14 21:24:49.306580 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2000/3735] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:49 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1493 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:50.020269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:50.021895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:50.030211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.030725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.031539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.032032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.042150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:50.043275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:50.052324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.053820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.054876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.055387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.188520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:50.196354 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2546f4e2-faf1-4ab8-a4ea-09e71552fe92 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.181431 May 14 21:24:50.196934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1736/3736] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:50 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:50.218002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:50.218627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:50.225150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.225609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.226386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.226844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.418544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:50.427537 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c81d8dd3-c119-4105-9fa0-b367476a8f01 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1307 microversion: 2.1 time: 0.390810 May 14 21:24:50.434165 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2001/3737] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:50 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1307 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:50.435836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:50.436632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:50.443682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.444435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.445515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.446117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.536875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:50.546279 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b3606428-7534-4aa9-9f4c-c4a48e26e701 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 200 len: 1451 microversion: 2.1 time: 0.116459 May 14 21:24:50.549071 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2002/3738] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:50 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 1451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:50.551860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8ef76b62-01be-487d-9742-0a9998003a84 req-07f58588-c2ce-4301-9de3-4add717958e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "327460c9-f487-4dc2-8b71-495cf16c0620", "name": "network-vif-deleted", "tag": "ecde66c9-4927-4dbe-8a39-269b76b9b996"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:50.563528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8ef76b62-01be-487d-9742-0a9998003a84 req-07f58588-c2ce-4301-9de3-4add717958e1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.564274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8ef76b62-01be-487d-9742-0a9998003a84 req-07f58588-c2ce-4301-9de3-4add717958e1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.598000 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8ef76b62-01be-487d-9742-0a9998003a84 req-07f58588-c2ce-4301-9de3-4add717958e1 service nova] Creating event network-vif-deleted:ecde66c9-4927-4dbe-8a39-269b76b9b996 for instance 327460c9-f487-4dc2-8b71-495cf16c0620 on nch2-master-1 May 14 21:24:50.605460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8ef76b62-01be-487d-9742-0a9998003a84 req-07f58588-c2ce-4301-9de3-4add717958e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054784 May 14 21:24:50.609092 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2003/3739] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:50.674752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:50.686498 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9fdf4e08-3b4f-4f5e-9b67-8088350a9064 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.472330 May 14 21:24:50.687098 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1737/3740] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:50 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:50.704247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:50.705604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:50.726508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.727178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.729072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.729616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.749109 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c/action HTTP/1.1 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 28 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: {"reboot": {"type": "SOFT"}} May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c', 'body': {'reboot': {'type': 'SOFT'}}} May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:50.751200 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:50.756652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:50.757905 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a925f2b-412a-4c74-8e7e-647f9ed21586 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c/action" status: 404 len: 111 microversion: 2.1 time: 0.055640 May 14 21:24:50.758667 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2004/3741] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:50 2022] POST /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:50.769117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:50.770228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:50.779251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.779885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:50.781028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:50.781543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.021551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:51.029797 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a54d2966-36c0-4c0a-9a71-9bf70713c82d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.266485 May 14 21:24:51.030380 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1738/3742] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:50 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:51.047822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:51.048514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.055265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.055754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.057122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.057856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.265335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:51.273597 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-27352924-886b-446f-9ba8-45e8347e7bf7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.229827 May 14 21:24:51.281833 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2005/3743] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:51 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:51.291773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7fc3f012-1e6f-4bca-95c7-8d0ef9ed149d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:51.298554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7fc3f012-1e6f-4bca-95c7-8d0ef9ed149d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: e5e82470-3f2a-4923-8420-bb65a0b2a7c5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.299109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-7fc3f012-1e6f-4bca-95c7-8d0ef9ed149d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance e5e82470-3f2a-4923-8420-bb65a0b2a7c5 could not be found. May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7fc3f012-1e6f-4bca-95c7-8d0ef9ed149d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/e5e82470-3f2a-4923-8420-bb65a0b2a7c5/action HTTP/1.1 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 28 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: {"reboot": {"type": "SOFT"}} May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance e5e82470-3f2a-4923-8420-bb65a0b2a7c5 could not be found. May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'e5e82470-3f2a-4923-8420-bb65a0b2a7c5', 'body': {'reboot': {'type': 'SOFT'}}} May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e82470-3f2a-4923-8420-bb65a0b2a7c5 could not be found. May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e82470-3f2a-4923-8420-bb65a0b2a7c5 could not be found. May 14 21:24:51.300890 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e82470-3f2a-4923-8420-bb65a0b2a7c5 could not be found. May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7fc3f012-1e6f-4bca-95c7-8d0ef9ed149d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance e5e82470-3f2a-4923-8420-bb65a0b2a7c5 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7fc3f012-1e6f-4bca-95c7-8d0ef9ed149d tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/e5e82470-3f2a-4923-8420-bb65a0b2a7c5/action" status: 404 len: 111 microversion: 2.1 time: 0.015651 May 14 21:24:51.305548 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1739/3744] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:51 2022] POST /compute/v2.1/servers/e5e82470-3f2a-4923-8420-bb65a0b2a7c5/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:51.314946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:51.315594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.323259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.323820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.333397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.333397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.446751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:51.448347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.455915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.456376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.457233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.457683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.489889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:51.498912 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c19db5de-f551-4483-a9f8-d6dbc3a0e128 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.191216 May 14 21:24:51.499536 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2006/3745] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:51 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:51.522560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:51.523202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.536076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.536592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.540405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.541904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.601410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:51.610153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-121fcee3-2a3e-4df5-8518-429b195b4489 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1488 microversion: 2.1 time: 0.167139 May 14 21:24:51.610894 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1740/3746] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:51 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1488 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:51.620254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:51.621259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: 327460c9-f487-4dc2-8b71-495cf16c0620] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.627920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.628473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.629323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.629839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.644706 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] HTTP exception thrown: Instance 327460c9-f487-4dc2-8b71-495cf16c0620 could not be found. May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Request method failure captured: May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 HTTP/1.1 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigBxdQLyUXipdOs58tsX3ys7eUbGjDiSSYt_fXNeAeCW_o6z5ZETYif8XSUovghyEvodaTLuhKXDis9kPqLil9CjOGGR8wiGPdJRcCEBLsDFw2kX6XwAAfapme4UIgBFp9hMAIehUEC8AC9ze5SDL01BeK5x4aJALaKQS_i06ePj8WBQ May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a924ca59a9ac44cf96e53be012a43af1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: a42e0caa0878447f98544e74f767c7ca May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 327460c9-f487-4dc2-8b71-495cf16c0620 could not be found. May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '327460c9-f487-4dc2-8b71-495cf16c0620'} May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 327460c9-f487-4dc2-8b71-495cf16c0620 could not be found. May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 327460c9-f487-4dc2-8b71-495cf16c0620 could not be found. May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:51.646522 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 327460c9-f487-4dc2-8b71-495cf16c0620 could not be found. May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Returning 404 to user: Instance 327460c9-f487-4dc2-8b71-495cf16c0620 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd09284d-e89d-41d6-ae3d-49e50aea2f5f tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620" status: 404 len: 111 microversion: 2.1 time: 0.034878 May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1741/3747] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:51 2022] GET /compute/v2.1/servers/327460c9-f487-4dc2-8b71-495cf16c0620 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a7d995a9-9a09-480d-bbdb-ca77ab826a36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:51.656721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a7d995a9-9a09-480d-bbdb-ca77ab826a36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.660629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7d995a9-9a09-480d-bbdb-ca77ab826a36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.661093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7d995a9-9a09-480d-bbdb-ca77ab826a36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.661876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7d995a9-9a09-480d-bbdb-ca77ab826a36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.662327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7d995a9-9a09-480d-bbdb-ca77ab826a36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.722478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:51.731098 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bee4b193-e555-4eba-af6c-6403baec62f3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.212721 May 14 21:24:51.731737 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2007/3748] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:51 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:51.736429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:51.736930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:51.748157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.748708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.749492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:51.750000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:51.776828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:24:52.013735 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a7d995a9-9a09-480d-bbdb-ca77ab826a36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a/action" status: 202 len: 0 microversion: 2.1 time: 0.363966 May 14 21:24:52.014379 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1742/3749] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:51 2022] POST /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:24:52.021671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:52.027319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.031956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.032611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.033557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.034192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.049064 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c/action HTTP/1.1 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 65 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c', 'body': {'rebuild': {'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e'}}} May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 14 21:24:52.055178 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-301cf7f1-3ed6-440c-8635-ab0b6b6bb676 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c/action" status: 404 len: 111 microversion: 2.1 time: 0.036350 May 14 21:24:52.060739 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1743/3750] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:52 2022] POST /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:52.062404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:52.062404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.068653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.069643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.070376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.070914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.201384 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02aa106e-22d2-49c2-8194-c942a36a6118 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 204 len: 0 microversion: 2.1 time: 0.468369 May 14 21:24:52.202367 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2008/3751] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:24:51 2022] DELETE /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:52.209704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:52.211366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.220554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.221691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.222751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.223419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.273302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:52.287055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4205642-1082-47e4-8939-030392b275ea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1493 microversion: 2.1 time: 0.229181 May 14 21:24:52.297991 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1744/3752] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:52 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1493 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:52.298800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:52.300799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.310297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.311755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.313272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.313995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.416712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:52.424947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-878b11fe-3edc-44e5-b320-5331c2c8d3fc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.220135 May 14 21:24:52.425681 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2009/3753] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:52 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:52.443342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:52.444237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.451125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.453536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.453536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.453536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.523421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:52.536220 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ec20fcd-5b99-43ec-ba17-f8efdd041a75 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1676 microversion: 2.1 time: 0.247168 May 14 21:24:52.539608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1745/3754] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:52 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1676 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:52.654326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:52.664398 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a5481517-e2bc-44c1-8279-faf1b0d0909b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.224963 May 14 21:24:52.664991 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2010/3755] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:52 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:52.681887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50b54f1d-f341-4800-8ed2-1ba3ccd7f457 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:52.683692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-50b54f1d-f341-4800-8ed2-1ba3ccd7f457 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: c6c90343-26ad-4de8-af0c-a7bf447f8508] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.689536 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-50b54f1d-f341-4800-8ed2-1ba3ccd7f457 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance c6c90343-26ad-4de8-af0c-a7bf447f8508 could not be found. May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50b54f1d-f341-4800-8ed2-1ba3ccd7f457 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/c6c90343-26ad-4de8-af0c-a7bf447f8508/action HTTP/1.1 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 65 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance c6c90343-26ad-4de8-af0c-a7bf447f8508 could not be found. May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'c6c90343-26ad-4de8-af0c-a7bf447f8508', 'body': {'rebuild': {'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e'}}} May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c90343-26ad-4de8-af0c-a7bf447f8508 could not be found. May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 14 21:24:52.691183 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c90343-26ad-4de8-af0c-a7bf447f8508 could not be found. May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c90343-26ad-4de8-af0c-a7bf447f8508 could not be found. May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50b54f1d-f341-4800-8ed2-1ba3ccd7f457 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance c6c90343-26ad-4de8-af0c-a7bf447f8508 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:52.696083 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-50b54f1d-f341-4800-8ed2-1ba3ccd7f457 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/c6c90343-26ad-4de8-af0c-a7bf447f8508/action" status: 404 len: 111 microversion: 2.1 time: 0.015371 May 14 21:24:52.702229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:52.702865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.707900 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1746/3756] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:52 2022] POST /compute/v2.1/servers/c6c90343-26ad-4de8-af0c-a7bf447f8508/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:52.709563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.711862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.711862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.711862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.854627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:52.863501 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0944b9f6-4c58-4b8f-acf6-0abf1749ad96 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.165026 May 14 21:24:52.864321 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2011/3757] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:52 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:52.883728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:52.885390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:52.900983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.900983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:52.900983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:52.900983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.032790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:53.041350 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cbce9a62-cf11-45ed-ac42-142f0283c26f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.161571 May 14 21:24:53.042187 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1747/3758] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:52 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:53.058644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a68a45ed-05df-4e97-a0f1-29c2514afa30 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:53.059195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a68a45ed-05df-4e97-a0f1-29c2514afa30 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: f8c446fb-7453-4e76-9b3b-e3c3a95447c5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:53.065125 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a68a45ed-05df-4e97-a0f1-29c2514afa30 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance f8c446fb-7453-4e76-9b3b-e3c3a95447c5 could not be found. May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a68a45ed-05df-4e97-a0f1-29c2514afa30 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/f8c446fb-7453-4e76-9b3b-e3c3a95447c5/action HTTP/1.1 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 15 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: {"restore": {}} May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance f8c446fb-7453-4e76-9b3b-e3c3a95447c5 could not be found. May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'f8c446fb-7453-4e76-9b3b-e3c3a95447c5', 'body': {'restore': {}}} May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8c446fb-7453-4e76-9b3b-e3c3a95447c5 could not be found. May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8c446fb-7453-4e76-9b3b-e3c3a95447c5 could not be found. May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:53.066925 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:53.072422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:53.072422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:53.072422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8c446fb-7453-4e76-9b3b-e3c3a95447c5 could not be found. May 14 21:24:53.072422 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:53.072422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a68a45ed-05df-4e97-a0f1-29c2514afa30 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance f8c446fb-7453-4e76-9b3b-e3c3a95447c5 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:53.072422 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a68a45ed-05df-4e97-a0f1-29c2514afa30 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/f8c446fb-7453-4e76-9b3b-e3c3a95447c5/action" status: 404 len: 111 microversion: 2.1 time: 0.014475 May 14 21:24:53.072422 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2012/3759] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:53 2022] POST /compute/v2.1/servers/f8c446fb-7453-4e76-9b3b-e3c3a95447c5/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:53.077099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:53.077838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:53.084389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.087971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.087971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.087971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.253041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:53.253041 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f787eb3-b6b9-464e-99d5-314e48a933a5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.177879 May 14 21:24:53.253041 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1748/3760] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:53 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:53.273923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:53.275883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:53.286050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.286855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.288052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.288572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.307978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:53.308892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:53.316661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.317833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.318936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.319665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.452234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:53.460012 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9eb6f09b-18a0-4950-a0d4-1660124accd1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.193915 May 14 21:24:53.460767 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2013/3761] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:53 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:53.480870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:53.488726 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1e3dfbb5-8070-4b49-9eb9-2ea4c8ed8cf7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 200 len: 1473 microversion: 2.1 time: 0.186502 May 14 21:24:53.489305 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1749/3762] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:53 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 1473 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:53.495186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:53.496129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:53.505019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.505482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.506269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.506843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.531146 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Cannot 'restore' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action HTTP/1.1 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 15 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: {"restore": {}} May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'restore' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'restore': {}}} May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 in vm_state active. Cannot restore while the instance is in this state. May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:53.533216 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:53.537092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:53.537092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:53.537092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:53.537092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:53.537092 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:53.537092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 409 to user: Cannot 'restore' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:53.537092 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-363b54d9-5c0a-41c5-b0a1-aa5021889336 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 409 len: 145 microversion: 2.1 time: 0.043949 May 14 21:24:53.538801 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1750/3763] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:53 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 145 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:24:53.548118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-857517d7-88c9-4d38-bf4b-8d6043283c7a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1032328368"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:53.550108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-857517d7-88c9-4d38-bf4b-8d6043283c7a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:53.559045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-857517d7-88c9-4d38-bf4b-8d6043283c7a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.559651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-857517d7-88c9-4d38-bf4b-8d6043283c7a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.560708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-857517d7-88c9-4d38-bf4b-8d6043283c7a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.561278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-857517d7-88c9-4d38-bf4b-8d6043283c7a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.594447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67bcc0c7-706f-485b-9c1f-c0af4699afdb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Action: 'create', calling method: .version_select at 0x7fb1a7e5f430>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1211308978", "policies": ["affinity"]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:53.610054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-67bcc0c7-706f-485b-9c1f-c0af4699afdb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:53.615757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-67bcc0c7-706f-485b-9c1f-c0af4699afdb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:53.752789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-67bcc0c7-706f-485b-9c1f-c0af4699afdb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:53.759872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-67bcc0c7-706f-485b-9c1f-c0af4699afdb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:53.777464 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-67bcc0c7-706f-485b-9c1f-c0af4699afdb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.315332 May 14 21:24:53.778896 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2014/3764] 10.222.0.52 () {60 vars in 1173 bytes} [Sat May 14 21:24:53 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:53.787767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:53.792922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:53.795940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.796472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:53.797327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:53.797994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.020642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:54.041953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82a23468-6350-4fc2-9b6a-7c439aeda98e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.261707 May 14 21:24:54.042898 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2015/3765] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:53 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:54.047793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.048535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:54.056229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.056913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.057910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.058458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.138641 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-857517d7-88c9-4d38-bf4b-8d6043283c7a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a/action" status: 202 len: 0 microversion: 2.1 time: 0.597596 May 14 21:24:54.140012 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1751/3766] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:53 2022] POST /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:24:54.146435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61ae5bdd-f4d3-4d23-b5a0-57fc066ecd7f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Action: 'create', calling method: .version_select at 0x7fb1a6f571f0>, body: {"server_group": {"name": "tempest-server-group-459296324", "policies": ["affinity"]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:54.165201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-61ae5bdd-f4d3-4d23-b5a0-57fc066ecd7f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:54.172359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-61ae5bdd-f4d3-4d23-b5a0-57fc066ecd7f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:54.221109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:54.230975 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-135b76f1-0a45-492a-8d39-4877e9fd4266 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1676 microversion: 2.1 time: 0.186786 May 14 21:24:54.231859 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2016/3767] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:54 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:54.236449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.237320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:54.245497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.246302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.249391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.249391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.330205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-61ae5bdd-f4d3-4d23-b5a0-57fc066ecd7f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:54.335746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-61ae5bdd-f4d3-4d23-b5a0-57fc066ecd7f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:54.349973 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-61ae5bdd-f4d3-4d23-b5a0-57fc066ecd7f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.208357 May 14 21:24:54.355428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1752/3768] 10.222.0.52 () {60 vars in 1172 bytes} [Sat May 14 21:24:54 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:54.361199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ce1fad20-4141-4b59-ba2f-1fcd3e43c6d8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a784c1f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.394176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:54.402368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-effa3185-b848-415c-a053-32801b0a7ab8 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.169473 May 14 21:24:54.402942 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2017/3769] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:54 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:54.411023 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ce1fad20-4141-4b59-ba2f-1fcd3e43c6d8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.059120 May 14 21:24:54.412053 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1753/3770] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:54 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:54.420456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d43e501-d5cd-4acd-9641-7e327a9c8516 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:54.421259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1d43e501-d5cd-4acd-9641-7e327a9c8516 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 7f70ec32-1988-4183-8eac-c040fe877ac1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:54.426093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b9681c34-70d4-444d-95aa-d1a4a8f16676 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Action: 'create', calling method: .version_select at 0x7fb1a77c1700>, body: {"server_group": {"name": "tempest-server-group-459296324", "policies": ["affinity"]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:54.435322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-1d43e501-d5cd-4acd-9641-7e327a9c8516 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 7f70ec32-1988-4183-8eac-c040fe877ac1 could not be found. May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d43e501-d5cd-4acd-9641-7e327a9c8516 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/7f70ec32-1988-4183-8eac-c040fe877ac1/action HTTP/1.1 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 14 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: {"resume": {}} May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 7f70ec32-1988-4183-8eac-c040fe877ac1 could not be found. May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '7f70ec32-1988-4183-8eac-c040fe877ac1', 'body': {'resume': {}}} May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f70ec32-1988-4183-8eac-c040fe877ac1 could not be found. May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f70ec32-1988-4183-8eac-c040fe877ac1 could not be found. May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:54.442483 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:54.451353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:54.451353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:54.451353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f70ec32-1988-4183-8eac-c040fe877ac1 could not be found. May 14 21:24:54.451353 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:54.451353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d43e501-d5cd-4acd-9641-7e327a9c8516 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 7f70ec32-1988-4183-8eac-c040fe877ac1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:54.451353 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1d43e501-d5cd-4acd-9641-7e327a9c8516 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/7f70ec32-1988-4183-8eac-c040fe877ac1/action" status: 404 len: 111 microversion: 2.1 time: 0.030011 May 14 21:24:54.451353 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1754/3771] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:54 2022] POST /compute/v2.1/servers/7f70ec32-1988-4183-8eac-c040fe877ac1/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:54.453965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b9681c34-70d4-444d-95aa-d1a4a8f16676 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:54.460220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b9681c34-70d4-444d-95aa-d1a4a8f16676 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:54.467976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.468689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:54.479380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.479972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.480831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.481288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.581428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b9681c34-70d4-444d-95aa-d1a4a8f16676 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:54.587334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b9681c34-70d4-444d-95aa-d1a4a8f16676 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:54.606415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b9681c34-70d4-444d-95aa-d1a4a8f16676 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.201684 May 14 21:24:54.607034 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2018/3772] 10.222.0.52 () {60 vars in 1172 bytes} [Sat May 14 21:24:54 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:54.616847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c10702a9-c770-490d-9acc-9a65bbe4d2ea tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.679507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:54.688295 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6af74ff8-d010-4c99-8f3d-3baf811ee207 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.235317 May 14 21:24:54.690502 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1755/3773] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:54 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:54.705246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.705957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:54.714057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.719278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.719278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.719278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:54.749796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c10702a9-c770-490d-9acc-9a65bbe4d2ea tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/9c4d2831-67dc-4d20-9e61-bfac24e42a37" status: 204 len: 0 microversion: 2.1 time: 0.133112 May 14 21:24:54.749796 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2019/3774] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:24:54 2022] DELETE /compute/v2.1/os-server-groups/9c4d2831-67dc-4d20-9e61-bfac24e42a37 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:24:54.754288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d158bae0-8f8b-45b9-81b9-710d02b53b01 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.770135 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d158bae0-8f8b-45b9-81b9-710d02b53b01 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.019453 May 14 21:24:54.771522 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2020/3775] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:24:54 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:24:54.789851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3cc59a71-fb94-4f6d-be40-d411379a57f2 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.893353 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3cc59a71-fb94-4f6d-be40-d411379a57f2 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/5dd27e5e-73e7-4357-9ad7-f669c75b3bfd" status: 204 len: 0 microversion: 2.1 time: 0.108160 May 14 21:24:54.894098 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2021/3776] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:24:54 2022] DELETE /compute/v2.1/os-server-groups/5dd27e5e-73e7-4357-9ad7-f669c75b3bfd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:54.902886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2df17762-411a-4f78-8a46-ea6c4c2e69b2 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:54.916631 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2df17762-411a-4f78-8a46-ea6c4c2e69b2 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.017274 May 14 21:24:54.917923 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2022/3777] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:24:54 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:54.930085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f1bbd904-09eb-4c7d-9ec4-f528930765fb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Action: 'create', calling method: .version_select at 0x7fb1a77ea820>, body: {"server_group": {"name": "tempest-server-group-1723002189", "policies": ["affinity"]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:54.967066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:54.977703 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d9399de1-f040-4c5c-a647-ee57d740c6c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.275859 May 14 21:24:54.990988 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1756/3778] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:54 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:54.990988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-dd7a25c9-1565-49fb-913e-0c6668cebf98 req-5fe2527b-533f-4c8b-a330-2e0ac3d754dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c355e95c-4110-4a0c-aa91-b881f09e9e1f", "name": "network-vif-deleted", "tag": "7c41af0a-08b8-4556-a806-4fe58b10c2ea"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:54.996771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-dd7a25c9-1565-49fb-913e-0c6668cebf98 req-5fe2527b-533f-4c8b-a330-2e0ac3d754dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:54.997333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-dd7a25c9-1565-49fb-913e-0c6668cebf98 req-5fe2527b-533f-4c8b-a330-2e0ac3d754dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.001640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f1bbd904-09eb-4c7d-9ec4-f528930765fb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:55.011940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f1bbd904-09eb-4c7d-9ec4-f528930765fb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:55.014574 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-dd7a25c9-1565-49fb-913e-0c6668cebf98 req-5fe2527b-533f-4c8b-a330-2e0ac3d754dc service nova] Creating event network-vif-deleted:7c41af0a-08b8-4556-a806-4fe58b10c2ea for instance c355e95c-4110-4a0c-aa91-b881f09e9e1f on nch2-master-1 May 14 21:24:55.019367 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-dd7a25c9-1565-49fb-913e-0c6668cebf98 req-5fe2527b-533f-4c8b-a330-2e0ac3d754dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037175 May 14 21:24:55.021310 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1757/3779] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:55.029231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:55.030025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:55.038824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.039295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.041163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.041694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.091648 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Cannot 'resume' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action HTTP/1.1 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 14 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: {"resume": {}} May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'resume' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'resume': {}}} May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 in vm_state active. Cannot resume while the instance is in this state. May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:55.093364 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:55.099741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:55.099741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:55.099741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:55.099741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:24:55.099741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:55.099741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 409 to user: Cannot 'resume' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:55.099741 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-182e4e46-475e-47e7-bf7b-eb95432fcac7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 409 len: 144 microversion: 2.1 time: 0.072263 May 14 21:24:55.101087 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1758/3780] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:55 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 144 bytes in 79 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:24:55.108770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.109637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:55.119866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.120340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.121200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.121653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.215694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f1bbd904-09eb-4c7d-9ec4-f528930765fb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:55.221738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f1bbd904-09eb-4c7d-9ec4-f528930765fb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:55.241397 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f1bbd904-09eb-4c7d-9ec4-f528930765fb tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.315933 May 14 21:24:55.241805 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2023/3781] 10.222.0.52 () {60 vars in 1172 bytes} [Sat May 14 21:24:54 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:55.248678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.249530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:55.257308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.261006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.261834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.263782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.319229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:55.329787 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e18fd8c-84e5-4c75-b003-6765ef6add03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.225000 May 14 21:24:55.330846 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1759/3782] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:55 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:55.345328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a42e0caa0878447f98544e74f767c7ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a924ca59a9ac44cf96e53be012a43af1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:55.348683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09a865c6-d586-4bde-9aaa-1e9e29f33841 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.358309 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4d6677bd-b5a5-49d2-a4ef-cc84a6705462 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 200 len: 1324 microversion: 2.1 time: 0.112349 May 14 21:24:55.359660 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2024/3783] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:55 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 1324 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:55.364866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.366616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:55.374195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.375015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.376034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:55.376761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:55.493321 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09a865c6-d586-4bde-9aaa-1e9e29f33841 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5" status: 204 len: 0 microversion: 2.1 time: 0.148576 May 14 21:24:55.497386 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1760/3784] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:24:55 2022] DELETE /compute/v2.1/os-server-groups/fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:55.502676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f711fa24-2b11-4f29-ab92-79005ec2a0f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a7f0e790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.554339 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f711fa24-2b11-4f29-ab92-79005ec2a0f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.059290 May 14 21:24:55.555409 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1761/3785] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:55 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:55.560667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-caa4a40c-b7d0-44e8-903d-77c23d0f0347 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.577999 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-caa4a40c-b7d0-44e8-903d-77c23d0f0347 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.021330 May 14 21:24:55.578788 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1762/3786] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:24:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:55.590229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5ca72681-4f2b-48f2-a5ce-a096c1a5ef77 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Action: 'create', calling method: .version_select at 0x7fb1b4100c10>, body: {"server_group": {"name": "tempest-server-group-1787006247", "policies": ["anti-affinity"]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:55.613488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5ca72681-4f2b-48f2-a5ce-a096c1a5ef77 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:55.621775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5ca72681-4f2b-48f2-a5ce-a096c1a5ef77 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:55.738548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5ca72681-4f2b-48f2-a5ce-a096c1a5ef77 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:55.748408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5ca72681-4f2b-48f2-a5ce-a096c1a5ef77 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_groups'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:55.769689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5ca72681-4f2b-48f2-a5ce-a096c1a5ef77 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.183810 May 14 21:24:55.770852 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1763/3787] 10.222.0.52 () {60 vars in 1172 bytes} [Sat May 14 21:24:55 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:24:55.783376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8bc98c6a-3af9-4b69-816f-e16277283893 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.871985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:55.880302 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6e769e6c-14d7-4f9f-83e4-d3daac3eab17 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.519464 May 14 21:24:55.881267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2025/3788] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:55 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:55.912952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8bc98c6a-3af9-4b69-816f-e16277283893 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/9f77742b-aec6-48ce-bc2a-18c15454f25d" status: 204 len: 0 microversion: 2.1 time: 0.134921 May 14 21:24:55.913973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1764/3789] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:24:55 2022] DELETE /compute/v2.1/os-server-groups/9f77742b-aec6-48ce-bc2a-18c15454f25d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:24:55.924535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37fc3cb1-f2d4-41a5-83ef-bcc729b5c95d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:55.935358 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37fc3cb1-f2d4-41a5-83ef-bcc729b5c95d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.016353 May 14 21:24:55.949448 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2026/3790] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:24:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:56.018305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eeb25d03-4e6b-4c3e-8d1c-249ff2807767 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eeb25d03-4e6b-4c3e-8d1c-249ff2807767 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 160 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a654f805-d693-47d5-9845-d68b7a2a07c5"}]}} May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute name. Value: . '' is too short May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'networks': [{'uuid': 'a654f805-d693-47d5-9845-d68b7a2a07c5'}]}}} May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi '' May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:24:56.021197 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eeb25d03-4e6b-4c3e-8d1c-249ff2807767 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eeb25d03-4e6b-4c3e-8d1c-249ff2807767 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009027 May 14 21:24:56.026001 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1765/3791] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:56 2022] POST /compute/v2.1/servers => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:24:56.049813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:56.049813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:56.049813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.049813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.049813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.049813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.106769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1700765484", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "7f9edf66-9b9c-4e59-b7ce-233d052ab851"}]}, "os:scheduler_hints": {"group": "8491c3ce-3ddb-4058-8bd3-aec48463de4c"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:56.169961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] validate_networks() for [('7f9edf66-9b9c-4e59-b7ce-233d052ab851', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:24:56.208498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:56.223296 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4bdd946-def3-43d5-bbcb-e20bdb2d736a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.195434 May 14 21:24:56.224117 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2027/3792] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:56 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:56.241652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:56.248548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:56.249200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.249780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.252746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.253727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.457875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:56.469886 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e4d0d4cc-990c-4a14-bb76-6b24571002f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.232421 May 14 21:24:56.470693 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2028/3793] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:56 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:56.475389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:56.476422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] [instance: c355e95c-4110-4a0c-aa91-b881f09e9e1f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:56.486249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.486895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.487790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.488173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.509786 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] HTTP exception thrown: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f could not be found. May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Request method failure captured: May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f HTTP/1.1 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBxdQLyUXipdOs58tsX3ys7eUbGjDiSSYt_fXNeAeCW_o6z5ZETYif8XSUovghyEvodaTLuhKXDis9kPqLil9CjOGGR8wiGPdJRcCEBLsDFw2kX6XwAAfapme4UIgBFp9hMAIehUEC8AC9ze5SDL01BeK5x4aJALaKQS_i06ePj8WBQ May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a924ca59a9ac44cf96e53be012a43af1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a924ca59a9ac44cf96e53be012a43af1", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a924ca59a9ac44cf96e53be012a43af1 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerActionsTestJSON-1228353313 May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a42e0caa0878447f98544e74f767c7ca May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerActionsTestJSON-1228353313-project May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f could not be found. May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'c355e95c-4110-4a0c-aa91-b881f09e9e1f'} May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f could not be found. May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f could not be found. May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:56.511954 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f could not be found. May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Returning 404 to user: Instance c355e95c-4110-4a0c-aa91-b881f09e9e1f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e7c250a-2ad6-4b37-98ec-338eaabb9950 tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f" status: 404 len: 111 microversion: 2.1 time: 0.045573 May 14 21:24:56.519557 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2029/3794] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:56 2022] GET /compute/v2.1/servers/c355e95c-4110-4a0c-aa91-b881f09e9e1f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:56.527788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5564ab9-8305-4a64-810e-ce013a184fc3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:56.528345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c5564ab9-8305-4a64-810e-ce013a184fc3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 215c9afd-1f01-4992-b911-d90e0f00f92f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:56.534239 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c5564ab9-8305-4a64-810e-ce013a184fc3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 215c9afd-1f01-4992-b911-d90e0f00f92f could not be found. May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5564ab9-8305-4a64-810e-ce013a184fc3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/215c9afd-1f01-4992-b911-d90e0f00f92f/action HTTP/1.1 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 14 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: {"shelve": {}} May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 215c9afd-1f01-4992-b911-d90e0f00f92f could not be found. May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '215c9afd-1f01-4992-b911-d90e0f00f92f', 'body': {'shelve': {}}} May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215c9afd-1f01-4992-b911-d90e0f00f92f could not be found. May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215c9afd-1f01-4992-b911-d90e0f00f92f could not be found. May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:24:56.544881 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:24:56.549688 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:24:56.549688 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:24:56.549688 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215c9afd-1f01-4992-b911-d90e0f00f92f could not be found. May 14 21:24:56.549688 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:24:56.549688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5564ab9-8305-4a64-810e-ce013a184fc3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 215c9afd-1f01-4992-b911-d90e0f00f92f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:24:56.549688 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c5564ab9-8305-4a64-810e-ce013a184fc3 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/215c9afd-1f01-4992-b911-d90e0f00f92f/action" status: 404 len: 111 microversion: 2.1 time: 0.023663 May 14 21:24:56.549688 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2030/3795] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:56 2022] POST /compute/v2.1/servers/215c9afd-1f01-4992-b911-d90e0f00f92f/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:24:56.555254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-adef5d19-a90d-42f1-aa52-ffe7dd89776a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] Calling method '.version_select at 0x7fb1a77ce5e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:56.613066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:24:56.613560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:24:56.614018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:24:56.614443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:24:56.614897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:24:56.630468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.630925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.631775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.632224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.654881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:56.660276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:56.673750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:24:56.676351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:24:56.688132 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-adef5d19-a90d-42f1-aa52-ffe7dd89776a tempest-ServerActionsTestJSON-1228353313 tempest-ServerActionsTestJSON-1228353313-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240623792" status: 202 len: 0 microversion: 2.1 time: 0.136637 May 14 21:24:56.689341 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2031/3796] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240623792 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:24:56.699592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:56.700496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:56.708020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.708939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.710136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.710801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.891641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:56.899995 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2789f546-c2a5-42cd-9ed7-95126ed6794b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.205565 May 14 21:24:56.901096 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2032/3797] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:56 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:56.912843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:56.914152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a9905ea6-86c8-4a26-b8a3-d9e21ec86958 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a77ea430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:56.932112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:56.966293 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a9905ea6-86c8-4a26-b8a3-d9e21ec86958 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.063933 May 14 21:24:56.966882 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2033/3798] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:56 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:56.972257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:56.972875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:56.981462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.982028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:56.982886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:56.983716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.105780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:24:57.112462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Getting quotas for user ea1c919d55a34ef6b52e4ba211928f5b and project 69be921807044629a1b5f9e3adc7d5ef. Resources: {'server_group_members'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:24:57.147982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58d4f0aa-5bbc-4fbb-a7d9-155c1c677d12 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.046844 May 14 21:24:57.155750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1766/3799] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:24:57.162149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-177db01d-2629-4926-98b9-4a2f3d81c62b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:57.163002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-177db01d-2629-4926-98b9-4a2f3d81c62b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:57.174211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:57.188593 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef3033f4-6acf-4076-97e4-253d0711df7e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.220528 May 14 21:24:57.194906 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2034/3800] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:56 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:57.210437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:57.211271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:57.217969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:57.218649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.219947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:57.220602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.249399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lazy-loading 'flavor' on Instance uuid d052efd6-ef23-4eec-b96a-78cd75a193b1 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:24:57.273337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-177db01d-2629-4926-98b9-4a2f3d81c62b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:57.285218 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-177db01d-2629-4926-98b9-4a2f3d81c62b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1213 microversion: 2.1 time: 0.128015 May 14 21:24:57.285816 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1767/3801] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:57 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:57.846343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] Calling method '.version_select at 0x7fb1b40e53a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:57.847329 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:24:57.847329 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:24:57.848562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:57.849012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.863452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:57.863985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.874507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:57.874969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.880688 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0cd0a27e-0793-4014-9e3a-68c4f2938855 tempest-PortsAdminExtendedAttrsTestJSON-760877587 tempest-PortsAdminExtendedAttrsTestJSON-760877587-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.176126 May 14 21:24:57.881261 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1768/3802] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:24:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:57.935730 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec3b43e7-faee-49ec-9588-c75a41e0b6f5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 202 len: 0 microversion: 2.1 time: 0.728980 May 14 21:24:57.937209 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2035/3803] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:24:57 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:24:57.949739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:57.950369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:57.965852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:57.966890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.967660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:57.968110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:57.980154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8620611b-78f5-494b-952b-41c22e42feaa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a77d2790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:58.036957 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8620611b-78f5-494b-952b-41c22e42feaa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.059889 May 14 21:24:58.042779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2036/3804] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:57 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:58.303370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ca28f50-ece9-447c-a7e5-9f5226ea1d99 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:58.304539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ca28f50-ece9-447c-a7e5-9f5226ea1d99 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:58.478987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ca28f50-ece9-447c-a7e5-9f5226ea1d99 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:58.487266 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ca28f50-ece9-447c-a7e5-9f5226ea1d99 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1213 microversion: 2.1 time: 0.188717 May 14 21:24:58.487908 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2037/3805] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:58 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:24:58.577873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:58.586400 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a121ce93-b767-40ec-a6e7-80026965ad4a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.645185 May 14 21:24:58.587215 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1769/3806] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:57 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:58.969451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-60737837-7706-4e16-8c05-04448418cf3a req-6bb5f746-694c-41a4-a6df-ced0ede7c493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f740ee6-2164-45db-a16c-3fbe393cc90a", "name": "network-vif-plugged", "status": "completed", "tag": "fecd4045-e84a-40a2-8340-c732d9c9642c"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:24:58.981262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-60737837-7706-4e16-8c05-04448418cf3a req-6bb5f746-694c-41a4-a6df-ced0ede7c493 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:58.982211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-60737837-7706-4e16-8c05-04448418cf3a req-6bb5f746-694c-41a4-a6df-ced0ede7c493 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:58.998361 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-60737837-7706-4e16-8c05-04448418cf3a req-6bb5f746-694c-41a4-a6df-ced0ede7c493 service nova] Creating event network-vif-plugged:fecd4045-e84a-40a2-8340-c732d9c9642c for instance 3f740ee6-2164-45db-a16c-3fbe393cc90a on nch2-master-1 May 14 21:24:59.018241 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-60737837-7706-4e16-8c05-04448418cf3a req-6bb5f746-694c-41a4-a6df-ced0ede7c493 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059535 May 14 21:24:59.026510 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2038/3807] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:24:59.052030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de333a93-e44c-470f-a305-6eb987899f05 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a7b5fdc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:59.106606 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de333a93-e44c-470f-a305-6eb987899f05 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.060628 May 14 21:24:59.113231 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1770/3808] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:24:59 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:24:59.505532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:59.506607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:59.525476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:59.526207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:59.527001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:59.527437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:59.605461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:24:59.606397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:24:59.619211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:59.619959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:59.621109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:24:59.621720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:24:59.630237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:24:59.641092 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c95270b0-e9f2-4a1c-8cdb-1fef35613311 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1265 microversion: 2.1 time: 0.139559 May 14 21:24:59.642377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2039/3809] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:59 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:00.015591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:00.023873 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f6717a3-5f65-4f6f-9381-e8a578e41987 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.423838 May 14 21:25:00.036231 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1771/3810] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:24:59 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:00.121303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2895f144-c65e-4c8b-a731-2288b8670cde tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a771fb80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:00.187661 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2895f144-c65e-4c8b-a731-2288b8670cde tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.071110 May 14 21:25:00.188493 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2040/3811] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:00 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:00.661242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:00.661809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:00.674128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:00.674897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:00.675726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:00.676441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:00.782374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:00.799864 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-367ba212-8744-44a4-82c0-3d187a447827 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1271 microversion: 2.1 time: 0.144348 May 14 21:25:00.814136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1772/3812] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:00 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:01.043074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:01.044173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:01.054964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:01.060823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:01.062122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:01.063023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:01.202763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3716201-1d62-48be-b66c-411c09350ca6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a77ef3a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:01.267869 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3716201-1d62-48be-b66c-411c09350ca6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.068690 May 14 21:25:01.268728 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1773/3813] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:01 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:01.369568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:01.380369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84a73228-16f0-462e-9576-06327f322495 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.343205 May 14 21:25:01.399605 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2041/3814] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:01 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:01.821978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:01.823202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:01.847202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:01.848343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:01.850621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:01.851432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:02.113190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:02.125718 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba93dc0e-915a-4fcd-a41e-e1fd6135ad0b tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.308047 May 14 21:25:02.130768 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1774/3815] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:01 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:02.291716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d513a9d4-ddd7-4bcf-95e5-16d731e07c54 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b98c85e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:02.370695 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d513a9d4-ddd7-4bcf-95e5-16d731e07c54 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.092531 May 14 21:25:02.377686 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2042/3816] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:02 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:02.406304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:02.407522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:02.413838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:02.414569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:02.416336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:02.416944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:02.940580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:02.977127 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5b81dcde-49d2-4a87-8ab2-3a0d79879d1b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.575427 May 14 21:25:02.997276 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1775/3817] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:02 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:03.149096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:03.150046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:03.165127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:03.165841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:03.166831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:03.167538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:03.484056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-734ba0d5-8165-4c19-bad4-7bfaad6cbb04 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a785c160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:03.484056 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-734ba0d5-8165-4c19-bad4-7bfaad6cbb04 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.072902 May 14 21:25:03.484056 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1776/3818] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:03 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:03.530498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:03.545025 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e9c889dd-cb1d-41f2-8dec-5e2c08215d0d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.400306 May 14 21:25:03.546386 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2043/3819] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:03 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:03.954234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-af3006f2-7f8a-4f31-892d-2c97ee0c17ac req-282412c7-5aed-4c2b-a24e-27e20efed7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149b6a59-1e4a-42b8-a53a-b025a0378d7b", "tag": "b95b1c86-e8e8-4ad7-98b2-f025490189ca"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:03.967358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-af3006f2-7f8a-4f31-892d-2c97ee0c17ac req-282412c7-5aed-4c2b-a24e-27e20efed7a9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:03.967844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-af3006f2-7f8a-4f31-892d-2c97ee0c17ac req-282412c7-5aed-4c2b-a24e-27e20efed7a9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:04.004859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:04.005559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:04.017464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:04.018622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:04.019769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:04.021146 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-af3006f2-7f8a-4f31-892d-2c97ee0c17ac req-282412c7-5aed-4c2b-a24e-27e20efed7a9 service nova] Creating event network-changed:b95b1c86-e8e8-4ad7-98b2-f025490189ca for instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b on nch2-master-1 May 14 21:25:04.022105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:04.037161 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-af3006f2-7f8a-4f31-892d-2c97ee0c17ac req-282412c7-5aed-4c2b-a24e-27e20efed7a9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087429 May 14 21:25:04.045270 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1777/3820] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:04.470478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ce76e145-2105-4583-8e99-10655bae26fa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b4133e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:04.496735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:04.509838 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-09218275-c69e-4ed7-a8f1-52f0220ff12e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.508202 May 14 21:25:04.511063 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2044/3821] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:03 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:04.532847 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ce76e145-2105-4583-8e99-10655bae26fa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.068921 May 14 21:25:04.534607 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1778/3822] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:04 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:04.563865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:04.565006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:04.573214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:04.574418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:04.575388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:04.577121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:04.808769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:04.822814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14e30c1f-24b6-4cf9-ae07-dc6d43a3031a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.261178 May 14 21:25:04.832343 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2045/3823] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:04 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:05.528626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:05.530167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:05.540181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:05.548877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:05.548877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:05.548877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:05.550776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94f0e2a4-0837-47c3-b6be-ef8abaa960ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a77ea430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:05.648067 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-94f0e2a4-0837-47c3-b6be-ef8abaa960ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.099562 May 14 21:25:05.651511 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2046/3824] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:05 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:05.836924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:05.842196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:05.842832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:05.855554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:05.856115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:05.860435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:05.862342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:05.864260 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bb552d6a-2961-46c4-ba25-a573762f37f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.336831 May 14 21:25:05.864923 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1779/3825] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:05 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:06.152382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:06.162052 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-74bec41f-9c88-42d9-8041-e6919774b84c tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.325876 May 14 21:25:06.186140 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2047/3826] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:05 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:06.663705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7140d5d8-8e4d-4c31-ba02-2e2c083432ed tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b41331f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:06.737279 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7140d5d8-8e4d-4c31-ba02-2e2c083432ed tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.077495 May 14 21:25:06.737884 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1780/3827] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:06 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:06.882382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:06.883013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:06.892705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:06.894320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:06.895271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:06.895919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:07.182843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:07.183704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:07.219852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:07.222250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:07.235252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:07.238704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:07.467791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:07.476992 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7f119388-8fa2-48d2-bc53-aa5b8c0d79fb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.598885 May 14 21:25:07.481400 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2048/3828] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:06 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:07.546788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:07.556415 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4d88b78-2691-4c1e-92e5-f979f81a4c79 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.379349 May 14 21:25:07.568256 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1781/3829] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:07 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:07.757499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-88c3773c-6165-46e8-b16a-7644eeabf5f7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a773ea60>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:07.821467 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-88c3773c-6165-46e8-b16a-7644eeabf5f7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.074583 May 14 21:25:07.822234 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2049/3830] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:07 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:08.507392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:08.508755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:08.518733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:08.519980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:08.520973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:08.521737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:08.576949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:08.577703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:08.593103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:08.612754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:08.614011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:08.615162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:08.777800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:08.802171 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9143be1d-364a-472c-8e13-cd073452d508 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.231994 May 14 21:25:08.802761 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2050/3831] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:08 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:08.813601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:08.822258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3e71f2b-52f9-4c32-be40-4a43592a8138 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1531 microversion: 2.1 time: 0.319330 May 14 21:25:08.839828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e35d290f-9d33-4c74-885d-88ef3f58f353 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a78a44c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:08.844388 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1782/3832] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:08 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1531 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:08.897655 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e35d290f-9d33-4c74-885d-88ef3f58f353 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.063033 May 14 21:25:08.898288 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2051/3833] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:08 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:09.233499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e3f4b725-d7cf-4abd-9cf9-ab1e12dd2614 req-c21582bc-8a81-4461-ad1b-61bd85118134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149b6a59-1e4a-42b8-a53a-b025a0378d7b", "name": "network-vif-plugged", "status": "completed", "tag": "b95b1c86-e8e8-4ad7-98b2-f025490189ca"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:09.246394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e3f4b725-d7cf-4abd-9cf9-ab1e12dd2614 req-c21582bc-8a81-4461-ad1b-61bd85118134 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:09.246740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e3f4b725-d7cf-4abd-9cf9-ab1e12dd2614 req-c21582bc-8a81-4461-ad1b-61bd85118134 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:09.278329 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e3f4b725-d7cf-4abd-9cf9-ab1e12dd2614 req-c21582bc-8a81-4461-ad1b-61bd85118134 service nova] Creating event network-vif-plugged:b95b1c86-e8e8-4ad7-98b2-f025490189ca for instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b on nch2-master-1 May 14 21:25:09.283540 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e3f4b725-d7cf-4abd-9cf9-ab1e12dd2614 req-c21582bc-8a81-4461-ad1b-61bd85118134 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053921 May 14 21:25:09.284748 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1783/3834] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:25:09.824873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:09.825685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:09.834544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:09.835305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:09.836292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:09.839073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:10.047618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1746321398", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "c2e0f2de-38c7-4adc-9f96-48cdb31b8430"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:10.116103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] validate_networks() for [('c2e0f2de-38c7-4adc-9f96-48cdb31b8430', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:25:10.116895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:10.125568 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6173cf05-48fd-477b-b30f-9d110ceb82fe tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.309746 May 14 21:25:10.137620 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1784/3835] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:09 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:10.142973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:10.143850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:10.151178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:10.151897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:10.152897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:10.153635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:10.366129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:10.377541 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-94199016-d2a9-4ef5-a7e3-d9b1b589d5ea tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1531 microversion: 2.1 time: 0.238459 May 14 21:25:10.378722 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1785/3836] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:10 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1531 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:10.385928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c91c355f-bbd1-4dde-b6b5-ebf4fbf3ea36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a77dc160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:10.438326 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c91c355f-bbd1-4dde-b6b5-ebf4fbf3ea36 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.057362 May 14 21:25:10.440011 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1786/3837] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:10 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:10.619140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:25:10.619459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:25:10.619961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:25:10.620380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:25:10.620798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:25:10.631004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:10.631531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:10.632339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:10.632780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:10.653792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Getting quotas for project 7b8a604af2ec48059ef55244ec6a5363. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:25:10.660342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Getting quotas for user 6f0c6efc18184500875e0db8280d6bc3 and project 7b8a604af2ec48059ef55244ec6a5363. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:25:10.674903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:25:10.677495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:25:10.845034 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a69b7441-0f39-4ed1-8172-4cc340fc712b tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188313 May 14 21:25:10.849106 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2052/3838] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:25:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:25:10.857850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2de1045b-87cc-4480-b831-cd1e89641a33 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:10.859144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2de1045b-87cc-4480-b831-cd1e89641a33 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:10.951045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2de1045b-87cc-4480-b831-cd1e89641a33 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:10.967877 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2de1045b-87cc-4480-b831-cd1e89641a33 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1225 microversion: 2.1 time: 0.113220 May 14 21:25:10.969288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1787/3839] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:10 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1225 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:11.146084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:11.147382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:11.158747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:11.159271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:11.160087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:11.160696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:11.346677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-23359449-b6b8-4096-8421-0d1c7dff7aae req-70f8d1c6-a907-4f53-bcd4-a92308dc3f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d052efd6-ef23-4eec-b96a-78cd75a193b1", "name": "network-vif-plugged", "status": "completed", "tag": "d14fe5ed-9ab8-4c6c-893f-768a8f7db696"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:11.365566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-23359449-b6b8-4096-8421-0d1c7dff7aae req-70f8d1c6-a907-4f53-bcd4-a92308dc3f40 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:11.366035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-23359449-b6b8-4096-8421-0d1c7dff7aae req-70f8d1c6-a907-4f53-bcd4-a92308dc3f40 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:11.386164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:11.396658 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8e20d8b6-626a-4f99-b3cd-80a3629c7eec tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1313 microversion: 2.1 time: 0.255884 May 14 21:25:11.401179 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2053/3840] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:11 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:11.407441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:11.408555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:11.409837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-23359449-b6b8-4096-8421-0d1c7dff7aae req-70f8d1c6-a907-4f53-bcd4-a92308dc3f40 service nova] Creating event network-vif-plugged:d14fe5ed-9ab8-4c6c-893f-768a8f7db696 for instance d052efd6-ef23-4eec-b96a-78cd75a193b1 on nch2-master-1 May 14 21:25:11.416572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:11.417297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:11.418370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:11.419039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:11.440124 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-23359449-b6b8-4096-8421-0d1c7dff7aae req-70f8d1c6-a907-4f53-bcd4-a92308dc3f40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073860 May 14 21:25:11.442703 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1788/3841] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:25:11.462737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efe23a97-e1fb-4d07-961c-349e12eb426f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a78c48b0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:11.633794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:11.642934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81883572-cd94-4d57-bf4a-90837b871650 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.240236 May 14 21:25:11.644185 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2054/3842] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:11 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:11.706071 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efe23a97-e1fb-4d07-961c-349e12eb426f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1414 microversion: 2.1 time: 0.256310 May 14 21:25:11.706892 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1789/3843] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:11 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1414 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:11.987235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65205344-5d03-4a01-869f-2a5d39ab5b80 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:11.988329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65205344-5d03-4a01-869f-2a5d39ab5b80 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:12.069347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65205344-5d03-4a01-869f-2a5d39ab5b80 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:12.078792 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65205344-5d03-4a01-869f-2a5d39ab5b80 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1225 microversion: 2.1 time: 0.095330 May 14 21:25:12.091377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2055/3844] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:11 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:12.422232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:12.422973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:12.430015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:12.431010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:12.432049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:12.432497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:12.573725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:12.595716 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8b57e0e-d8c1-4ce4-8766-5e6c0f77a100 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1498 microversion: 2.1 time: 0.178096 May 14 21:25:12.597071 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1790/3845] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:12 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1498 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:12.625825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c597b3f0-f319-441f-8100-2e3122761c91 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:12.647384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.server_groups [None req-c597b3f0-f319-441f-8100-2e3122761c91 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Querying cell eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) for 1 instances {{(pid=130638) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 14 21:25:12.648780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c597b3f0-f319-441f-8100-2e3122761c91 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:12.649619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c597b3f0-f319-441f-8100-2e3122761c91 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:12.662315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:12.669535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:12.674066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c597b3f0-f319-441f-8100-2e3122761c91 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/8491c3ce-3ddb-4058-8bd3-aec48463de4c" status: 200 len: 222 microversion: 2.1 time: 0.053213 May 14 21:25:12.675409 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2056/3846] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:25:12 2022] GET /compute/v2.1/os-server-groups/8491c3ce-3ddb-4058-8bd3-aec48463de4c => generated 222 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:12.685417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:12.685885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:12.687119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:12.688484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:12.689228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:12.689557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:12.703855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:12.703855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:12.703855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:12.708226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:12.748326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:25:13.016799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:13.030270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-08297c77-6d3a-42b4-bff3-5ebe0fb410ce tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.372349 May 14 21:25:13.041267 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1791/3847] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:12 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:13.047084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-67aae773-c762-4d2c-82de-09bba39071fa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a77efa60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:13.222814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a6e8912d-4479-4cf6-b6af-a8a0ddc3abf3 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 204 len: 0 microversion: 2.1 time: 0.539721 May 14 21:25:13.223417 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2057/3848] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:25:12 2022] DELETE /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:25:13.228613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:13.229519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:13.242546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:13.243030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:13.244578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:13.245177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:13.419115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:13.428878 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-306d7d77-95cb-4f50-80a5-d95251cbaf83 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1277 microversion: 2.1 time: 0.204190 May 14 21:25:13.429597 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2058/3849] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:13 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:13.450741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:13.452005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:13.459967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:13.460481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:13.461285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:13.461838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:13.639193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:13.643636 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fccac55c-b12b-4f73-90f1-cf77ae967ddc tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1504 microversion: 2.1 time: 0.199319 May 14 21:25:13.644232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2059/3850] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:13 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:13.958912 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-67aae773-c762-4d2c-82de-09bba39071fa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1423 microversion: 2.1 time: 0.916213 May 14 21:25:13.972750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ff18e92-be9d-4cb9-9bbc-7025b515451c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a7774ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:13.976700 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1792/3851] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:13 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1423 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:14.025303 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ff18e92-be9d-4cb9-9bbc-7025b515451c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 200 len: 1423 microversion: 2.1 time: 0.055488 May 14 21:25:14.038119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f44378e-0b28-4d4a-ad37-9cecf1259b38 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a7990940>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:14.042882 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2060/3852] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:25:13 2022] GET /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 1423 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:14.054624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:14.056153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:14.068588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:14.074862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:14.076469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:14.076929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:14.333947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:14.349613 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04e65edf-7e12-4d93-ae1c-f0eb7df3f9bd tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.304865 May 14 21:25:14.350428 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2061/3853] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:14 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:14.454530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:14.455207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:14.462871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:14.463440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:14.464341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:14.464769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:14.565354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:14.573140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1cc2b5e1-fc6a-43b0-8c71-995f18008f14 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1295 microversion: 2.1 time: 0.122919 May 14 21:25:14.574386 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2062/3854] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:14 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1295 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:14.666700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:14.668206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:14.678160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:14.679842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:14.681722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:14.682747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:14.936737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:14.956211 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98227575-9e99-4068-9a22-ec4d109ec77d tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1504 microversion: 2.1 time: 0.293777 May 14 21:25:14.973079 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2063/3855] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:14 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:15.372323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:15.373245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:15.395161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:15.395860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:15.398680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:15.401480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:15.614328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:15.629960 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec100bfc-aeec-44d7-a9ca-bc7e5a082a94 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.263428 May 14 21:25:15.630926 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2064/3856] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:15 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:15.645992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:15.652578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:15.671095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:15.672866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:15.674245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:15.675430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:15.948059 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f44378e-0b28-4d4a-ad37-9cecf1259b38 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 204 len: 0 microversion: 2.1 time: 1.913588 May 14 21:25:15.948843 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1793/3857] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:14 2022] DELETE /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 0 bytes in 1915 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:25:15.955336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0763de39-8ff2-4db7-976f-a18a47c51f69 req-c6a9a8ad-3923-4a40-bc85-ebd935ef642b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149b6a59-1e4a-42b8-a53a-b025a0378d7b", "name": "network-vif-deleted", "tag": "b95b1c86-e8e8-4ad7-98b2-f025490189ca"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:15.968132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0763de39-8ff2-4db7-976f-a18a47c51f69 req-c6a9a8ad-3923-4a40-bc85-ebd935ef642b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:15.969453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0763de39-8ff2-4db7-976f-a18a47c51f69 req-c6a9a8ad-3923-4a40-bc85-ebd935ef642b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:16.003441 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0763de39-8ff2-4db7-976f-a18a47c51f69 req-c6a9a8ad-3923-4a40-bc85-ebd935ef642b service nova] Creating event network-vif-deleted:b95b1c86-e8e8-4ad7-98b2-f025490189ca for instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b on nch2-master-1 May 14 21:25:16.004637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:16.010989 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0763de39-8ff2-4db7-976f-a18a47c51f69 req-c6a9a8ad-3923-4a40-bc85-ebd935ef642b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060574 May 14 21:25:16.012825 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1794/3858] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:16.018938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:16.019975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:16.025665 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-112a1955-b476-4733-bd71-1461621af085 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.392289 May 14 21:25:16.026592 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2065/3859] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:15 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:16.031776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:16.033399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:16.043850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:16.043850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:16.043850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:16.044122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:16.048550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:16.049019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:16.049815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:16.050265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:16.076167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:25:16.169936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:16.181685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24d1afe2-4f9a-43d3-9ab9-a32986ee2993 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1298 microversion: 2.1 time: 0.153751 May 14 21:25:16.182660 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2066/3860] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:16 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:16.427303 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fdb4d508-29ab-4d3d-a8a0-c4a9fe6c9551 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 204 len: 0 microversion: 2.1 time: 0.412374 May 14 21:25:16.427847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1795/3861] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:25:16 2022] DELETE /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:25:16.582275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-465184931", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "af5a4b8e-1df1-4780-a149-63d1d293e5bd"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:16.648995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:16.650676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:16.664591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:16.665326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:16.666324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:16.666858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:16.687636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] validate_networks() for [('af5a4b8e-1df1-4780-a149-63d1d293e5bd', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:25:16.844191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:16.859130 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b279c6ab-57d5-401f-877e-3ce91b6a4227 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.214639 May 14 21:25:16.860141 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1796/3862] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:16 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:16.989650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6b204696-9241-4e7e-ab77-16f41ce4115b req-41c9f54f-f802-4f79-b62a-0e92f646fd73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f740ee6-2164-45db-a16c-3fbe393cc90a", "name": "network-vif-unplugged", "status": "completed", "tag": "fecd4045-e84a-40a2-8340-c732d9c9642c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:17.001171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6b204696-9241-4e7e-ab77-16f41ce4115b req-41c9f54f-f802-4f79-b62a-0e92f646fd73 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.002075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6b204696-9241-4e7e-ab77-16f41ce4115b req-41c9f54f-f802-4f79-b62a-0e92f646fd73 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.017410 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6b204696-9241-4e7e-ab77-16f41ce4115b req-41c9f54f-f802-4f79-b62a-0e92f646fd73 service nova] Creating event network-vif-unplugged:fecd4045-e84a-40a2-8340-c732d9c9642c for instance 3f740ee6-2164-45db-a16c-3fbe393cc90a on nch2-master-1 May 14 21:25:17.023350 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6b204696-9241-4e7e-ab77-16f41ce4115b req-41c9f54f-f802-4f79-b62a-0e92f646fd73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037726 May 14 21:25:17.025091 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1797/3863] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:25:17.054290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:17.055056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:17.064833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.065320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.066224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.066659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.161787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:25:17.162322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:25:17.162966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:25:17.163542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:25:17.164047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:25:17.183786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.184313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.185415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.186068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.206774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:25:17.215087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for user ed0a76be93e44fa887cb813a8879e04d and project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:25:17.238908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:25:17.241991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:25:17.328488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:17.344575 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-880941f4-a47e-4c1b-8e6e-064c32f8bed3 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.296560 May 14 21:25:17.354035 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1798/3864] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:17 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:17.381109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:17.384035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:17.388124 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5c32d3b6-affc-43f0-a108-9cb810d00365 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.808733 May 14 21:25:17.390240 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2067/3865] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:25:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:25:17.395960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.400618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c01857d4-4719-460a-a87b-6fe2f55e5001 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:17.401247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c01857d4-4719-460a-a87b-6fe2f55e5001 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:17.403671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.403671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.404432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.501033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.501766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.502415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lazy-loading 'fault' on Instance uuid 149b6a59-1e4a-42b8-a53a-b025a0378d7b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:17.519064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c01857d4-4719-460a-a87b-6fe2f55e5001 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:17.526687 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c01857d4-4719-460a-a87b-6fe2f55e5001 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1207 microversion: 2.1 time: 0.131797 May 14 21:25:17.528244 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2068/3866] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:17 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1207 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:17.581093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea1c919d55a34ef6b52e4ba211928f5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69be921807044629a1b5f9e3adc7d5ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:17.589565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88987e4d-bdc4-4899-b401-c9c0abf72833 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 200 len: 1303 microversion: 2.1 time: 0.234385 May 14 21:25:17.590339 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1799/3867] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:17 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:17.878602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:17.880118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:17.891843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.892701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:17.893718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:17.894598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.018499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:18.023455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:18.028483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Searching by: {'deleted': False, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:25:18.049417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.049876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.050762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.051215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.109782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:25:18.161488 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-145c182e-985e-496c-9d63-212e85ec3f99 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.148751 May 14 21:25:18.162706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1800/3868] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:25:18 2022] GET /compute/v2.1/servers => generated 333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:18.168265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-81330b10-b612-4c33-8e76-97e7cf001d30 req-728765e4-a7bd-4092-8def-d1471df23abe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1", "tag": "1d475c65-7229-4b89-9071-a6c006696fff"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:18.183057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:18.197808 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-854f19f4-f7f5-439f-9648-e72892469f27 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.322121 May 14 21:25:18.207910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2069/3869] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:17 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:18.208178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-81330b10-b612-4c33-8e76-97e7cf001d30 req-728765e4-a7bd-4092-8def-d1471df23abe service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.208178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-81330b10-b612-4c33-8e76-97e7cf001d30 req-728765e4-a7bd-4092-8def-d1471df23abe service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.215596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:18.225825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:18.228298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Searching by: {'deleted': False, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:25:18.231906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-81330b10-b612-4c33-8e76-97e7cf001d30 req-728765e4-a7bd-4092-8def-d1471df23abe service nova] Creating event network-changed:1d475c65-7229-4b89-9071-a6c006696fff for instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 on nch1-master-1 May 14 21:25:18.240107 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-81330b10-b612-4c33-8e76-97e7cf001d30 req-728765e4-a7bd-4092-8def-d1471df23abe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073430 May 14 21:25:18.240107 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1801/3870] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:18.242708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.245834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.246690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.247145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.290389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:25:18.367066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:18.369149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:18.369878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:18.378056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.379404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.381202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.381666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.388745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.389436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.618708 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9691bba6-586f-4a51-b5a0-8a8a215c6c09 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.417217 May 14 21:25:18.619499 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2070/3871] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:25:18 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:18.624026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:18.624647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:18.632312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.632709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.634085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.634596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.794447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:18.802919 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e49d0ecc-db71-42a6-813d-66103f3ac373 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1211 microversion: 2.1 time: 0.182266 May 14 21:25:18.812553 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2071/3872] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:18 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1211 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:18.812553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:18.812553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:18.833256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.835658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.839652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.840336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:18.869033 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] HTTP exception thrown: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Request method failure captured: May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b HTTP/1.1 May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4ll-ymUqF3M_26tTHNi0pWByQtauEnkhSMaH9CC5v-d2zEGOi3PbPKmamSwplLQQtrshOFWrTSWtfZ-zb_s4EBuJpQbtD7ECEDjx_oVta_pLM3Qvv18W_6AWCYPKz9PnUtc7sTn13okRRPM9IUMZdZID4fpFqCQ14NRigIY9nqZTg May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69be921807044629a1b5f9e3adc7d5ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ea1c919d55a34ef6b52e4ba211928f5b May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '149b6a59-1e4a-42b8-a53a-b025a0378d7b'} May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:18.870985 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Returning 404 to user: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c0788376-9ff8-480b-bd27-2430ff8ac32f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 404 len: 111 microversion: 2.1 time: 0.067353 May 14 21:25:18.876056 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2072/3873] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:18 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:25:18.885782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1fa53d6-55af-4f7d-8c10-5b3f21f2270c tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:18.915412 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1fa53d6-55af-4f7d-8c10-5b3f21f2270c tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.038679 May 14 21:25:18.917155 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2073/3874] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:25:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:18.928943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b6d079d-53fc-43d1-bdf8-2ceef03e58d0 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:18.994860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.server_groups [None req-4b6d079d-53fc-43d1-bdf8-2ceef03e58d0 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Querying cell eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) for 1 instances {{(pid=130638) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 14 21:25:18.995766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b6d079d-53fc-43d1-bdf8-2ceef03e58d0 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:18.996228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b6d079d-53fc-43d1-bdf8-2ceef03e58d0 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.027266 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b6d079d-53fc-43d1-bdf8-2ceef03e58d0 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.107494 May 14 21:25:19.035023 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2074/3875] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:25:18 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:19.041028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a95160b-ade7-4e58-a46c-4db6090886be tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.064409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.server_groups [None req-0a95160b-ade7-4e58-a46c-4db6090886be tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Querying cell eee792cc-a6a2-4967-ae25-d7f56985c297(cell1) for 1 instances {{(pid=130638) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 14 21:25:19.080485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a95160b-ade7-4e58-a46c-4db6090886be tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.080485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a95160b-ade7-4e58-a46c-4db6090886be tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.081851 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0a95160b-ade7-4e58-a46c-4db6090886be tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/8491c3ce-3ddb-4058-8bd3-aec48463de4c" status: 200 len: 184 microversion: 2.1 time: 0.045381 May 14 21:25:19.082599 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2075/3876] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:25:19 2022] GET /compute/v2.1/os-server-groups/8491c3ce-3ddb-4058-8bd3-aec48463de4c => generated 184 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:19.094908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.096458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:19.096928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:19.105073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.105824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.106064 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58ee0fa6-8daa-4e02-b2d1-2d4e49f37fa8 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.741889 May 14 21:25:19.107641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.108067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.109913 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1802/3877] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:18 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:19.131724 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] HTTP exception thrown: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Request method failure captured: May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b HTTP/1.1 May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4ll-ymUqF3M_26tTHNi0pWByQtauEnkhSMaH9CC5v-d2zEGOi3PbPKmamSwplLQQtrshOFWrTSWtfZ-zb_s4EBuJpQbtD7ECEDjx_oVta_pLM3Qvv18W_6AWCYPKz9PnUtc7sTn13okRRPM9IUMZdZID4fpFqCQ14NRigIY9nqZTg May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69be921807044629a1b5f9e3adc7d5ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ea1c919d55a34ef6b52e4ba211928f5b May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '149b6a59-1e4a-42b8-a53a-b025a0378d7b'} May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:25:19.135622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.140547 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.142520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Returning 404 to user: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:19.143577 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ccdfe7c2-5ff7-408a-a873-9836b212339a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 404 len: 111 microversion: 2.1 time: 0.053550 May 14 21:25:19.144609 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2076/3878] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:25:19 2022] DELETE /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:25:19.157226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.157866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] [instance: 149b6a59-1e4a-42b8-a53a-b025a0378d7b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:19.174695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.175176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.176092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.176693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.220525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.220983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:19.229565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] HTTP exception thrown: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.230649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.231155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.232048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Request method failure captured: May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b HTTP/1.1 May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB4ll-ymUqF3M_26tTHNi0pWByQtauEnkhSMaH9CC5v-d2zEGOi3PbPKmamSwplLQQtrshOFWrTSWtfZ-zb_s4EBuJpQbtD7ECEDjx_oVta_pLM3Qvv18W_6AWCYPKz9PnUtc7sTn13okRRPM9IUMZdZID4fpFqCQ14NRigIY9nqZTg May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69be921807044629a1b5f9e3adc7d5ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ea1c919d55a34ef6b52e4ba211928f5b May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '149b6a59-1e4a-42b8-a53a-b025a0378d7b'} May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.232320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:19.238337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.238337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.238337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.238337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:19.238337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:19.238337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. May 14 21:25:19.238337 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:19.238789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.240751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Returning 404 to user: Instance 149b6a59-1e4a-42b8-a53a-b025a0378d7b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:19.248018 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f22f8c02-8bb7-4677-8a84-b9ffeb4c26af tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b" status: 404 len: 111 microversion: 2.1 time: 0.095877 May 14 21:25:19.248909 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1803/3879] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:19 2022] GET /compute/v2.1/servers/149b6a59-1e4a-42b8-a53a-b025a0378d7b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:25:19.258006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.266246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:19.275909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.276791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.280830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.281564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.330749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:25:19.486574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:19.504731 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-61d32f68-e9a6-4969-8532-e1c0043ccbc9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.291265 May 14 21:25:19.504976 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2077/3880] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:19 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:19.519958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4e5bc79-9ceb-4a64-b433-c6d236d1301f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.538761 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c4e5bc79-9ceb-4a64-b433-c6d236d1301f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] HTTP exception thrown: Instance group 9f77742b-aec6-48ce-bc2a-18c15454f25d could not be found. May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4e5bc79-9ceb-4a64-b433-c6d236d1301f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Request method failure captured: May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-server-groups/9f77742b-aec6-48ce-bc2a-18c15454f25d HTTP/1.1 May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4ll-ymUqF3M_26tTHNi0pWByQtauEnkhSMaH9CC5v-d2zEGOi3PbPKmamSwplLQQtrshOFWrTSWtfZ-zb_s4EBuJpQbtD7ECEDjx_oVta_pLM3Qvv18W_6AWCYPKz9PnUtc7sTn13okRRPM9IUMZdZID4fpFqCQ14NRigIY9nqZTg May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69be921807044629a1b5f9e3adc7d5ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ea1c919d55a34ef6b52e4ba211928f5b May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance group 9f77742b-aec6-48ce-bc2a-18c15454f25d could not be found. May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '9f77742b-aec6-48ce-bc2a-18c15454f25d'} May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9f77742b-aec6-48ce-bc2a-18c15454f25d could not be found. May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9f77742b-aec6-48ce-bc2a-18c15454f25d could not be found. May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.559488 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.563608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.563608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.563608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:19.563608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:19.563608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9f77742b-aec6-48ce-bc2a-18c15454f25d could not be found. May 14 21:25:19.563608 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.567936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4e5bc79-9ceb-4a64-b433-c6d236d1301f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Returning 404 to user: Instance group 9f77742b-aec6-48ce-bc2a-18c15454f25d could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:19.568845 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4e5bc79-9ceb-4a64-b433-c6d236d1301f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/9f77742b-aec6-48ce-bc2a-18c15454f25d" status: 404 len: 117 microversion: 2.1 time: 0.052821 May 14 21:25:19.569430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2078/3881] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:25:19 2022] DELETE /compute/v2.1/os-server-groups/9f77742b-aec6-48ce-bc2a-18c15454f25d => generated 117 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:25:19.577414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07344c4b-815c-4375-b120-3d4ffa12799f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.584286 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-07344c4b-815c-4375-b120-3d4ffa12799f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] HTTP exception thrown: Instance group fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 could not be found. May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07344c4b-815c-4375-b120-3d4ffa12799f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Request method failure captured: May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-server-groups/fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 HTTP/1.1 May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4ll-ymUqF3M_26tTHNi0pWByQtauEnkhSMaH9CC5v-d2zEGOi3PbPKmamSwplLQQtrshOFWrTSWtfZ-zb_s4EBuJpQbtD7ECEDjx_oVta_pLM3Qvv18W_6AWCYPKz9PnUtc7sTn13okRRPM9IUMZdZID4fpFqCQ14NRigIY9nqZTg May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69be921807044629a1b5f9e3adc7d5ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ea1c919d55a34ef6b52e4ba211928f5b May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance group fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 could not be found. May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5'} May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 could not be found. May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 could not be found. May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.587504 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 could not be found. May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07344c4b-815c-4375-b120-3d4ffa12799f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Returning 404 to user: Instance group fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07344c4b-815c-4375-b120-3d4ffa12799f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5" status: 404 len: 117 microversion: 2.1 time: 0.015489 May 14 21:25:19.604678 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2079/3882] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:25:19 2022] DELETE /compute/v2.1/os-server-groups/fee24c9f-917f-4b8b-b51d-fd8c7c3e35a5 => generated 117 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:25:19.609319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95c23c1b-e124-4e92-becb-2307fde13547 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.617292 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-95c23c1b-e124-4e92-becb-2307fde13547 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] HTTP exception thrown: Instance group 5dd27e5e-73e7-4357-9ad7-f669c75b3bfd could not be found. May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95c23c1b-e124-4e92-becb-2307fde13547 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Request method failure captured: May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-server-groups/5dd27e5e-73e7-4357-9ad7-f669c75b3bfd HTTP/1.1 May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4ll-ymUqF3M_26tTHNi0pWByQtauEnkhSMaH9CC5v-d2zEGOi3PbPKmamSwplLQQtrshOFWrTSWtfZ-zb_s4EBuJpQbtD7ECEDjx_oVta_pLM3Qvv18W_6AWCYPKz9PnUtc7sTn13okRRPM9IUMZdZID4fpFqCQ14NRigIY9nqZTg May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69be921807044629a1b5f9e3adc7d5ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ea1c919d55a34ef6b52e4ba211928f5b May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance group 5dd27e5e-73e7-4357-9ad7-f669c75b3bfd could not be found. May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '5dd27e5e-73e7-4357-9ad7-f669c75b3bfd'} May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5dd27e5e-73e7-4357-9ad7-f669c75b3bfd could not be found. May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5dd27e5e-73e7-4357-9ad7-f669c75b3bfd could not be found. May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.619710 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5dd27e5e-73e7-4357-9ad7-f669c75b3bfd could not be found. May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95c23c1b-e124-4e92-becb-2307fde13547 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Returning 404 to user: Instance group 5dd27e5e-73e7-4357-9ad7-f669c75b3bfd could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:19.623845 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-95c23c1b-e124-4e92-becb-2307fde13547 tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/5dd27e5e-73e7-4357-9ad7-f669c75b3bfd" status: 404 len: 117 microversion: 2.1 time: 0.017234 May 14 21:25:19.626884 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2080/3883] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:25:19 2022] DELETE /compute/v2.1/os-server-groups/5dd27e5e-73e7-4357-9ad7-f669c75b3bfd => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:25:19.631460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a9104e15-d048-4fcb-aec6-31b27a07249f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.640061 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a9104e15-d048-4fcb-aec6-31b27a07249f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] HTTP exception thrown: Instance group 9c4d2831-67dc-4d20-9e61-bfac24e42a37 could not be found. May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a9104e15-d048-4fcb-aec6-31b27a07249f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Request method failure captured: May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-server-groups/9c4d2831-67dc-4d20-9e61-bfac24e42a37 HTTP/1.1 May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4ll-ymUqF3M_26tTHNi0pWByQtauEnkhSMaH9CC5v-d2zEGOi3PbPKmamSwplLQQtrshOFWrTSWtfZ-zb_s4EBuJpQbtD7ECEDjx_oVta_pLM3Qvv18W_6AWCYPKz9PnUtc7sTn13okRRPM9IUMZdZID4fpFqCQ14NRigIY9nqZTg May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/69be921807044629a1b5f9e3adc7d5ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_69be921807044629a1b5f9e3adc7d5ef", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 69be921807044629a1b5f9e3adc7d5ef May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerGroupTestJSON-1614887087 May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ea1c919d55a34ef6b52e4ba211928f5b May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerGroupTestJSON-1614887087-project May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance group 9c4d2831-67dc-4d20-9e61-bfac24e42a37 could not be found. May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '9c4d2831-67dc-4d20-9e61-bfac24e42a37'} May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 9c4d2831-67dc-4d20-9e61-bfac24e42a37 could not be found. May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 9c4d2831-67dc-4d20-9e61-bfac24e42a37 could not be found. May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.641644 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 9c4d2831-67dc-4d20-9e61-bfac24e42a37 could not be found. May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a9104e15-d048-4fcb-aec6-31b27a07249f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Returning 404 to user: Instance group 9c4d2831-67dc-4d20-9e61-bfac24e42a37 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:19.646773 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a9104e15-d048-4fcb-aec6-31b27a07249f tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/9c4d2831-67dc-4d20-9e61-bfac24e42a37" status: 404 len: 117 microversion: 2.1 time: 0.017419 May 14 21:25:19.648252 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2081/3884] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:25:19 2022] DELETE /compute/v2.1/os-server-groups/9c4d2831-67dc-4d20-9e61-bfac24e42a37 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:25:19.653790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a1ae339-2920-4980-95c0-dbbed21ba63a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.811430 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a1ae339-2920-4980-95c0-dbbed21ba63a tempest-ServerGroupTestJSON-1614887087 tempest-ServerGroupTestJSON-1614887087-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/8491c3ce-3ddb-4058-8bd3-aec48463de4c" status: 204 len: 0 microversion: 2.1 time: 0.157239 May 14 21:25:19.813074 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2082/3885] 10.222.0.52 () {58 vars in 1265 bytes} [Sat May 14 21:25:19 2022] DELETE /compute/v2.1/os-server-groups/8491c3ce-3ddb-4058-8bd3-aec48463de4c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:25:19.835515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:19.837852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:19.860363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.861277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.862404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:19.864194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:19.991169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:20.006846 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f705ca90-752b-450c-8f53-c51f657ef386 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 204 len: 0 microversion: 2.1 time: 0.756179 May 14 21:25:20.007857 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1804/3886] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:25:19 2022] DELETE /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 0 bytes in 758 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:25:20.011596 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-55462fc0-1785-4e37-809f-28a92fc342a5 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1259 microversion: 2.1 time: 0.191959 May 14 21:25:20.011596 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2083/3887] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:19 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:20.017728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:20.018449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:20.025827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:20.026670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:20.027724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:20.028494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:20.139219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:20.140207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:20.154618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:20.156427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:20.159115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:20.163545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:20.317578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:20.330607 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5804ee45-a298-4aed-987f-7e0098be39e5 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1700 microversion: 2.1 time: 0.317850 May 14 21:25:20.334989 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1805/3888] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:20 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1700 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:20.340024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-64cad0b6-f25a-4542-a937-a7aea92af6ee req-39609a95-3c02-4bc3-a83d-d6bc7e699d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f740ee6-2164-45db-a16c-3fbe393cc90a", "name": "network-vif-deleted", "tag": "fecd4045-e84a-40a2-8340-c732d9c9642c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:20.359456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-64cad0b6-f25a-4542-a937-a7aea92af6ee req-39609a95-3c02-4bc3-a83d-d6bc7e699d05 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:20.367193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-64cad0b6-f25a-4542-a937-a7aea92af6ee req-39609a95-3c02-4bc3-a83d-d6bc7e699d05 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:20.388332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-64cad0b6-f25a-4542-a937-a7aea92af6ee req-39609a95-3c02-4bc3-a83d-d6bc7e699d05 service nova] Creating event network-vif-deleted:fecd4045-e84a-40a2-8340-c732d9c9642c for instance 3f740ee6-2164-45db-a16c-3fbe393cc90a on nch2-master-1 May 14 21:25:20.402426 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-64cad0b6-f25a-4542-a937-a7aea92af6ee req-39609a95-3c02-4bc3-a83d-d6bc7e699d05 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065686 May 14 21:25:20.403416 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1806/3889] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:20.525034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:20.526228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:20.538283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:20.540845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:20.544576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:20.545442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:20.650356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:20.660996 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6ba43b79-c80a-45be-8c57-13e397d658cf tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.529052 May 14 21:25:20.672167 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2084/3890] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:20 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:20.889319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:20.905382 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-07c84161-51c2-4738-b8bd-bd263278e83e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.386666 May 14 21:25:20.906054 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1807/3891] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:20 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:21.026882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:21.028252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:21.043545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:21.044315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:21.046261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:21.049599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:21.263534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:21.276475 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-78795e54-f41b-442a-8ff1-2a273bc4a31d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1265 microversion: 2.1 time: 0.253597 May 14 21:25:21.276475 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2085/3892] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:21 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:21.351156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:21.353409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:21.364135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:21.372554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:21.377546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:21.377546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:21.682487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:21.683624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:21.696560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:21.696560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:21.696560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:21.697213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:22.020955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f4db84a-0880-4c88-8af6-53321dad9c18 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1700 microversion: 2.1 time: 0.692693 May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1808/3893] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:21 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1700 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:22.086364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:22.091543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:22.107539 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4a098d60-8e71-436a-9819-74d4ca95d525 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.429945 May 14 21:25:22.116129 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2086/3894] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:21 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:22.293516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:22.299789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:22.300591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:22.301058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:22.301891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:22.302335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:22.377580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:22.385929 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-27b4b4e1-edf1-4a71-8ec0-387debee26a8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1265 microversion: 2.1 time: 0.097543 May 14 21:25:22.386536 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2087/3895] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:22 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1265 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:22.612456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:22.624282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c014041-f07a-45da-804b-480c39ba03f2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.576592 May 14 21:25:22.625680 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1809/3896] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:22 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:23.056885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:23.057726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:23.068256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.069222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.070503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.071931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.130527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:23.131451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:23.160267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.160731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.161517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.167420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.366902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:23.376507 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4525b80f-2957-4afd-8d11-d3ae17fcd2a1 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1700 microversion: 2.1 time: 0.324668 May 14 21:25:23.388239 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2088/3897] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:23 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1700 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:23.405552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:23.406438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:23.415390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.415926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.416849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.417404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.528841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:23.544505 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-371262bc-f399-4a9f-b95d-b192475183ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1265 microversion: 2.1 time: 0.143677 May 14 21:25:23.557053 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2089/3898] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:23 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:23.643133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:23.646749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:23.658615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.659403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.661379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:23.661844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:23.938573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:23.988195 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f9fbcf8-35a6-460e-9fd8-85f2cbbd668e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.857652 May 14 21:25:23.991502 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1810/3899] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:23 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:24.043472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:24.054429 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab0e6748-2d77-4acd-9dbc-5be2b73b6514 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.415990 May 14 21:25:24.055318 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2090/3900] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:23 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:24.395600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:24.397324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:24.408654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:24.409385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:24.410384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:24.411039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:24.570059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:24.571316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:24.606826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:24.608778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:24.610094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:24.632572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:24.633823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:24.644993 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ebd8b37-4faf-40e5-9e61-214f8e355334 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1633 microversion: 2.1 time: 0.253810 May 14 21:25:24.662106 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1811/3901] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:24 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1633 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:25.005331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:25.006724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:25.011785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:25.029556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.035987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.039184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-255a6883-3d79-4e3c-9573-f6399a6eb39c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.479912 May 14 21:25:25.047872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.051155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.053075 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2091/3902] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:24 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:25.073953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:25.074863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:25.099214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.099992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.100959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.101653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.500170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:25.518432 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2500a7cc-0b23-4ca6-83d0-f77a46138097 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.448558 May 14 21:25:25.520388 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2092/3903] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:25 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:25.526600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-34d66faa-7454-4d54-94d3-6a602b6e65b8 req-5d9dcc26-b5e5-4dfa-9e10-174c58a3d1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1", "name": "network-vif-plugged", "status": "completed", "tag": "1d475c65-7229-4b89-9071-a6c006696fff"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:25.565716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-34d66faa-7454-4d54-94d3-6a602b6e65b8 req-5d9dcc26-b5e5-4dfa-9e10-174c58a3d1f1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.566284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-34d66faa-7454-4d54-94d3-6a602b6e65b8 req-5d9dcc26-b5e5-4dfa-9e10-174c58a3d1f1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.629922 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-34d66faa-7454-4d54-94d3-6a602b6e65b8 req-5d9dcc26-b5e5-4dfa-9e10-174c58a3d1f1 service nova] Creating event network-vif-plugged:1d475c65-7229-4b89-9071-a6c006696fff for instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 on nch1-master-1 May 14 21:25:25.647835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-34d66faa-7454-4d54-94d3-6a602b6e65b8 req-5d9dcc26-b5e5-4dfa-9e10-174c58a3d1f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125374 May 14 21:25:25.649367 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2093/3904] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:25.672934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:25.676159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:25.699981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:25.712852 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d221335-6b18-4705-af9d-2e5b7b740023 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.709666 May 14 21:25:25.714046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.714689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1812/3905] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:25 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:25.716843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.719171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.720750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.726340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e364f174-3eea-43ee-9348-11538f3bb9ff req-02842a63-1fb1-4d96-9d8a-3118d666f374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d68de201-9379-4235-9f12-f43205e5341c", "name": "network-vif-deleted", "tag": "a4831886-f328-4292-b75f-9f46662e69b1"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:25.753597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e364f174-3eea-43ee-9348-11538f3bb9ff req-02842a63-1fb1-4d96-9d8a-3118d666f374 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:25.754490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e364f174-3eea-43ee-9348-11538f3bb9ff req-02842a63-1fb1-4d96-9d8a-3118d666f374 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:25.779724 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e364f174-3eea-43ee-9348-11538f3bb9ff req-02842a63-1fb1-4d96-9d8a-3118d666f374 service nova] Creating event network-vif-deleted:a4831886-f328-4292-b75f-9f46662e69b1 for instance d68de201-9379-4235-9f12-f43205e5341c on nch1-master-1 May 14 21:25:25.797335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e364f174-3eea-43ee-9348-11538f3bb9ff req-02842a63-1fb1-4d96-9d8a-3118d666f374 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081161 May 14 21:25:25.798579 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1813/3906] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:25.928344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:25.939798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f1484ea8-08de-4f56-95d1-f1ae369a809e tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1633 microversion: 2.1 time: 0.274279 May 14 21:25:25.942226 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2094/3907] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:25 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1633 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:26.071495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:26.072369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:26.079496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:26.079965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:26.081096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:26.081878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:26.349331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:26.361579 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae0993aa-ff9f-47bc-8a93-e9fed29ee1d2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.295135 May 14 21:25:26.372057 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1814/3908] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:26 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:26.535773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:26.536674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:26.546629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:26.547095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:26.547915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:26.548359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:26.731035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:26.731778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:26.743514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:26.744086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:26.759704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:26.760233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:27.146480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:27.167393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-785fd9ed-33e8-40c4-a5df-ca805bb69091 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1325 microversion: 2.1 time: 0.435108 May 14 21:25:27.172501 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1815/3909] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:26 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1325 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:27.177979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:27.189084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:27.206106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:27.206575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:27.210692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:27.211077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:27.270837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:27.274994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:27.276159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lazy-loading 'fault' on Instance uuid d68de201-9379-4235-9f12-f43205e5341c {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:27.358442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:27.375889 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-649245a5-262c-44a2-86a9-936c188c0d03 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.841161 May 14 21:25:27.376724 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2095/3910] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:26 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:27.391047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:27.392016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:27.411754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:27.412415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:27.413391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98b7bc6d0abe43a889cc29118685e8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2a1c19cad6047f09d1b74a2a607dd28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:27.416748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:27.417276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:27.423214 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3df6d04e-8bc8-45e0-934f-a81b65866dfd tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 200 len: 1359 microversion: 2.1 time: 0.249588 May 14 21:25:27.451631 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1816/3911] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:27 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:27.680781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:27.694693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-deb19e51-0bdb-4df6-a323-e6c392a41523 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.314922 May 14 21:25:27.696840 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2096/3912] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:27 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:27.966164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-658b4ded-dd5e-46b8-8668-a10ae94ed514 req-484e7501-182a-4c6b-9af2-b049f013e724 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "090443ee-e680-4d1b-af54-a8c89476868e", "tag": "55bb719e-4e9c-4bcf-92d2-43a23d4716f4"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:28.032154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-658b4ded-dd5e-46b8-8668-a10ae94ed514 req-484e7501-182a-4c6b-9af2-b049f013e724 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.032524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-658b4ded-dd5e-46b8-8668-a10ae94ed514 req-484e7501-182a-4c6b-9af2-b049f013e724 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.088146 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-658b4ded-dd5e-46b8-8668-a10ae94ed514 req-484e7501-182a-4c6b-9af2-b049f013e724 service nova] Creating event network-changed:55bb719e-4e9c-4bcf-92d2-43a23d4716f4 for instance 090443ee-e680-4d1b-af54-a8c89476868e on nch2-master-1 May 14 21:25:28.117282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-658b4ded-dd5e-46b8-8668-a10ae94ed514 req-484e7501-182a-4c6b-9af2-b049f013e724 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144593 May 14 21:25:28.118996 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1817/3913] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:28.187470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:28.188419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:28.197220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.199957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.208370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.208370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.484478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:28.495515 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7e1da2bb-1347-4c09-b1a4-4fe90a69ac7e tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1522 microversion: 2.1 time: 0.310173 May 14 21:25:28.496594 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2097/3914] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:28 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:28.523845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:28.525768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:28.538015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.538403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.541937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.542712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.679253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1125302134", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "1751f203-c367-4f47-a95c-eaec8c425fb3"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:28.771782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:28.781966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] validate_networks() for [('1751f203-c367-4f47-a95c-eaec8c425fb3', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:25:28.787970 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-87f9b061-78bf-4ac2-b48d-89e5ea56acdf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.286599 May 14 21:25:28.798358 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2098/3915] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:28 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:28.808146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:28.809066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] [instance: d68de201-9379-4235-9f12-f43205e5341c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:28.816581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.817313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.818754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.819285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.837690 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] HTTP exception thrown: Instance d68de201-9379-4235-9f12-f43205e5341c could not be found. May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Request method failure captured: May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c HTTP/1.1 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4AxTDTuBckJ1EGYLH78Edvr6kVO3yenf7aGeIltYxGsqyU3zhKoNKRXmgcci9BlK3TAnPdlTzHfxpU2MakVW8toyCEdH8ne49GMfxY3vbWh5Oc0xCN6ovAoAFFkGrJ2YfDNmYOk1lwNVo5MAMH_hurLv7VqvEXl_UoEvCkrMvbepc May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f2a1c19cad6047f09d1b74a2a607dd28 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-1107533101 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2a1c19cad6047f09d1b74a2a607dd28"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f2a1c19cad6047f09d1b74a2a607dd28"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f2a1c19cad6047f09d1b74a2a607dd28"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f2a1c19cad6047f09d1b74a2a607dd28", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-1107533101 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f2a1c19cad6047f09d1b74a2a607dd28 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-1107533101 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-1107533101-project May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 98b7bc6d0abe43a889cc29118685e8f4 May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-1107533101-project May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance d68de201-9379-4235-9f12-f43205e5341c could not be found. May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd68de201-9379-4235-9f12-f43205e5341c'} May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d68de201-9379-4235-9f12-f43205e5341c could not be found. May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d68de201-9379-4235-9f12-f43205e5341c could not be found. May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.839922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:28.846028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:28.846028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:28.846028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:28.846028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:28.846028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d68de201-9379-4235-9f12-f43205e5341c could not be found. May 14 21:25:28.846028 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.846028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Returning 404 to user: Instance d68de201-9379-4235-9f12-f43205e5341c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:28.847516 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e29a279b-f44b-4bb9-aa27-3ae6e9aa7ed9 tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c" status: 404 len: 111 microversion: 2.1 time: 0.047701 May 14 21:25:28.848373 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2099/3916] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:28 2022] GET /compute/v2.1/servers/d68de201-9379-4235-9f12-f43205e5341c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:25:28.855597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:28.856342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:28.869679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.870573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.872126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.875913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.944099 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] HTTP exception thrown: Instance is not a member of specified network May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Request method failure captured: May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1/ips/invalid HTTP/1.1 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB41zC3e9b7sxgWSZeFmzVpbSCRyRJBRxgeQu20BG4GV8yAAy0f1mgxh_iFtFt559nYboZ9n7I3WqKqDV-XatDcdZHPaz1beDx7dg4lQx9SyqkLoEg-AfQ6J_GIhqM1ouz1SIrbkZrXyqZqGmPrf-IKCaWJJQnpIV5CfH2N80IN7G-Q May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7b8a604af2ec48059ef55244ec6a5363 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7b8a604af2ec48059ef55244ec6a5363", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7b8a604af2ec48059ef55244ec6a5363 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerAddressesNegativeTestJSON-17108292-project May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6f0c6efc18184500875e0db8280d6bc3 May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-17108292-project May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance is not a member of specified network May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': '93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1', 'id': 'invalid'} May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 14 21:25:28.951901 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:28.957629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Returning 404 to user: Instance is not a member of specified network {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:28.959057 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19f53bb0-a305-420b-92b2-1986cf7daec7 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.109427 May 14 21:25:28.961990 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2100/3917] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 21:25:28 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1/ips/invalid => generated 91 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:25:28.971841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:28.973074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:28.980881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.981731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:28.983035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:28.983803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:29.250201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:29.259008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f360a4f-46d9-4920-8e14-79ec50abd57a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.294919 May 14 21:25:29.259826 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2101/3918] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:28 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:29.265206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1e6746f-5c19-48cd-8bf7-4eb07516424b tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] Calling method '.version_select at 0x7fb1b97c3280>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:29.340106 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1e6746f-5c19-48cd-8bf7-4eb07516424b tempest-ServersTestJSON-1107533101 tempest-ServersTestJSON-1107533101-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660060359" status: 202 len: 0 microversion: 2.1 time: 0.078781 May 14 21:25:29.340628 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2102/3919] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:25:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660060359 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:25:29.346393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b69bcecb-d70f-40b7-b00f-50fa7570f0ba tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b69bcecb-d70f-40b7-b00f-50fa7570f0ba tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Failed to fetch instance by id 999 {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2926}} May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-b69bcecb-d70f-40b7-b00f-50fa7570f0ba tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] HTTP exception thrown: Instance 999 could not be found. May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b69bcecb-d70f-40b7-b00f-50fa7570f0ba tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Request method failure captured: May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB41zC3e9b7sxgWSZeFmzVpbSCRyRJBRxgeQu20BG4GV8yAAy0f1mgxh_iFtFt559nYboZ9n7I3WqKqDV-XatDcdZHPaz1beDx7dg4lQx9SyqkLoEg-AfQ6J_GIhqM1ouz1SIrbkZrXyqZqGmPrf-IKCaWJJQnpIV5CfH2N80IN7G-Q May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7b8a604af2ec48059ef55244ec6a5363 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7b8a604af2ec48059ef55244ec6a5363", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7b8a604af2ec48059ef55244ec6a5363 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerAddressesNegativeTestJSON-17108292-project May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6f0c6efc18184500875e0db8280d6bc3 May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-17108292-project May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 999 could not be found. May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': '999'} May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:29.349610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b69bcecb-d70f-40b7-b00f-50fa7570f0ba tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Returning 404 to user: Instance 999 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b69bcecb-d70f-40b7-b00f-50fa7570f0ba tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008889 May 14 21:25:29.354942 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2103/3920] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:25:29 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:25:29.360821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:29.361378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:29.368906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:29.378945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:29.378945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:29.378945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:29.401589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:25:29.641095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:25:29.641565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:25:29.642052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:25:29.642473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:25:29.643359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:25:29.666577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:29.672060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:29.672060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:29.672060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:29.706532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Getting quotas for project f81d13056f0041a4b01112cd3d502b78. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:25:29.717160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Getting quotas for user fbbd79f0a4984166a48522eb5103f0c1 and project f81d13056f0041a4b01112cd3d502b78. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:25:29.749013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:25:29.752738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:25:29.859352 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e580435e-571d-403b-b129-490e39fe7d18 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "DELETE /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 204 len: 0 microversion: 2.1 time: 0.501801 May 14 21:25:29.862430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2104/3921] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:25:29 2022] DELETE /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:25:29.871228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:29.873399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:29.906231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:29.909074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:29.910485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:29.911104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:29.963069 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe3d0703-5c15-41af-8558-999187cf5afe tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.593788 May 14 21:25:29.971610 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1818/3922] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:25:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:25:29.979393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:29.980046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:29.999722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:30.002822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:30.004312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:30.007410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:30.197080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:30.212681 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-125c869a-f4a6-4cf5-a010-03f4b7f58453 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.347416 May 14 21:25:30.214041 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2105/3923] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:29 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:30.224995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c9dc34e-cc15-41ee-ac32-26c96de1d6c7 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:30.226785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c9dc34e-cc15-41ee-ac32-26c96de1d6c7 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:30.302490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c9dc34e-cc15-41ee-ac32-26c96de1d6c7 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:30.311974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c9dc34e-cc15-41ee-ac32-26c96de1d6c7 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:30.316432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c9dc34e-cc15-41ee-ac32-26c96de1d6c7 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:30.317997 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c9dc34e-cc15-41ee-ac32-26c96de1d6c7 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1262 microversion: 2.26 time: 0.102530 May 14 21:25:30.319035 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2106/3924] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:30 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1262 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:30.326886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:30.332129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:30.345214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:30.345872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:30.347826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:30.348627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:30.663428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:30.719248 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34d88794-2bb1-497b-ace2-cba5eb8f07e9 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1528 microversion: 2.1 time: 0.745582 May 14 21:25:30.720996 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1819/3925] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:29 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1528 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:30.771401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:30.781237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1d1b024-ae4f-4e9b-aa0f-07ba28ee997d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.460850 May 14 21:25:30.792465 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2107/3926] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:30 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:31.232116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:31.232767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:31.259386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:31.259386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:31.259386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:31.259386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:31.339303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65a00d6a-0b47-4eee-b4c7-2768ef4a16ca tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:31.341535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65a00d6a-0b47-4eee-b4c7-2768ef4a16ca tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:31.462702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65a00d6a-0b47-4eee-b4c7-2768ef4a16ca tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:31.481649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65a00d6a-0b47-4eee-b4c7-2768ef4a16ca tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:31.485267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65a00d6a-0b47-4eee-b4c7-2768ef4a16ca tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:31.489568 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65a00d6a-0b47-4eee-b4c7-2768ef4a16ca tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1262 microversion: 2.26 time: 0.154600 May 14 21:25:31.503984 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2108/3927] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:31 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1262 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:31.523238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:31.533471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b12aebd6-d5fb-4c7d-b8f6-5080ccab189a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1526 microversion: 2.1 time: 0.306184 May 14 21:25:31.533471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1820/3928] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:31 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1526 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:31.741914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:31.744373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:31.756707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:31.758308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:31.759939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:31.761321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:31.801496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:31.802772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:31.814429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:31.814907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:31.816961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:31.817606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:31.905707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:31.915857 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3cf09edd-2340-4a00-acf7-e657b2cada75 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1486 microversion: 2.1 time: 0.178545 May 14 21:25:31.919077 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2109/3929] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:31 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1486 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:32.038191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c6136c5e-f4ba-4e9e-9c4a-649f441ee110 req-a3b36051-74af-4239-bee8-46418f00300e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1", "name": "network-vif-deleted", "tag": "1d475c65-7229-4b89-9071-a6c006696fff"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:32.057022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c6136c5e-f4ba-4e9e-9c4a-649f441ee110 req-a3b36051-74af-4239-bee8-46418f00300e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.057485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c6136c5e-f4ba-4e9e-9c4a-649f441ee110 req-a3b36051-74af-4239-bee8-46418f00300e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.072986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c6136c5e-f4ba-4e9e-9c4a-649f441ee110 req-a3b36051-74af-4239-bee8-46418f00300e service nova] Creating event network-vif-deleted:1d475c65-7229-4b89-9071-a6c006696fff for instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 on nch1-master-1 May 14 21:25:32.078844 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c6136c5e-f4ba-4e9e-9c4a-649f441ee110 req-a3b36051-74af-4239-bee8-46418f00300e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058956 May 14 21:25:32.080184 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2110/3930] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:25:32.164720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:32.173582 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d1cc7946-4a44-48f2-acfc-bf546f869ff8 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.376311 May 14 21:25:32.174350 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1821/3931] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:31 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:32.510449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:32.512223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:32.521261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.521843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.524124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.524586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.552415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:32.553423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:32.560933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.561660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.562695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.563239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.594214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:32.606143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:32.607759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:32.609112 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e12eda8-9aa8-4004-b602-bf351b33b05f tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1314 microversion: 2.26 time: 0.103821 May 14 21:25:32.611652 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2111/3932] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:32 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1314 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:32.829243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:32.842073 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9e4827c5-7165-469a-a830-2eb3ce68c8e1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1508 microversion: 2.1 time: 0.293147 May 14 21:25:32.842991 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1822/3933] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:32 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:32.937642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:32.937642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:32.944350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.945039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.946689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.947429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.985690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:32.986662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:32.987287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lazy-loading 'fault' on Instance uuid 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:33.193146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:33.194684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:33.203840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:33.204418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:33.205214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:33.205873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:33.267757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f0c6efc18184500875e0db8280d6bc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b8a604af2ec48059ef55244ec6a5363', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:33.275419 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6e6521f5-d7f8-4529-b8ae-f090544c1207 tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 200 len: 1315 microversion: 2.1 time: 0.343433 May 14 21:25:33.278804 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2112/3934] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:32 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:33.292254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-7f7cb521-ae78-4776-a9fb-48718fbc08c1 req-4227fbe6-a044-4ec0-a345-cfac478555bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090443ee-e680-4d1b-af54-a8c89476868e", "name": "network-vif-plugged", "status": "completed", "tag": "55bb719e-4e9c-4bcf-92d2-43a23d4716f4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:33.307298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7f7cb521-ae78-4776-a9fb-48718fbc08c1 req-4227fbe6-a044-4ec0-a345-cfac478555bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:33.308662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7f7cb521-ae78-4776-a9fb-48718fbc08c1 req-4227fbe6-a044-4ec0-a345-cfac478555bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:33.325175 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-7f7cb521-ae78-4776-a9fb-48718fbc08c1 req-4227fbe6-a044-4ec0-a345-cfac478555bf service nova] Creating event network-vif-plugged:55bb719e-4e9c-4bcf-92d2-43a23d4716f4 for instance 090443ee-e680-4d1b-af54-a8c89476868e on nch2-master-1 May 14 21:25:33.330846 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-7f7cb521-ae78-4776-a9fb-48718fbc08c1 req-4227fbe6-a044-4ec0-a345-cfac478555bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045560 May 14 21:25:33.331917 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2113/3935] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:25:33.396958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:33.407953 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9abd5a93-0ea1-4282-a864-3661a91cf96d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.221073 May 14 21:25:33.419401 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1823/3936] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:33 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:33.629182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:33.630465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:33.641398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:33.641860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:33.642651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:33.643503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:33.735590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:33.757460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:33.763704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:33.765740 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6b4f3d3b-ffda-4fe1-b999-9c159b7623d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1322 microversion: 2.26 time: 0.141686 May 14 21:25:33.767410 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2114/3937] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:33 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:33.860029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:33.861446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:33.868482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:33.869200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:33.869995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:33.870612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:34.294897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:34.295857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] [instance: 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:34.302467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:34.303240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:34.304094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:34.304544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:34.319250 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] HTTP exception thrown: Instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 could not be found. May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Request method failure captured: May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 HTTP/1.1 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB41zC3e9b7sxgWSZeFmzVpbSCRyRJBRxgeQu20BG4GV8yAAy0f1mgxh_iFtFt559nYboZ9n7I3WqKqDV-XatDcdZHPaz1beDx7dg4lQx9SyqkLoEg-AfQ6J_GIhqM1ouz1SIrbkZrXyqZqGmPrf-IKCaWJJQnpIV5CfH2N80IN7G-Q May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7b8a604af2ec48059ef55244ec6a5363 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7b8a604af2ec48059ef55244ec6a5363"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7b8a604af2ec48059ef55244ec6a5363", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7b8a604af2ec48059ef55244ec6a5363 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-17108292 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerAddressesNegativeTestJSON-17108292-project May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6f0c6efc18184500875e0db8280d6bc3 May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-17108292-project May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 could not be found. May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1'} May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 could not be found. May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 could not be found. May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:34.321691 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 could not be found. May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] Returning 404 to user: Instance 93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1166fed2-93fd-4316-9243-6163bcaa7cee tempest-ServerAddressesNegativeTestJSON-17108292 tempest-ServerAddressesNegativeTestJSON-17108292-project] 10.222.0.52 "GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1" status: 404 len: 111 microversion: 2.1 time: 0.033021 May 14 21:25:34.326087 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2115/3938] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:34 2022] GET /compute/v2.1/servers/93d5408f-4bcf-4ef8-a5e7-6256e19f3dc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:25:34.332890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:34.342669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f486724f-94f5-4aef-8da4-33b05a115500 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1508 microversion: 2.1 time: 0.486526 May 14 21:25:34.343650 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1824/3939] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:33 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1508 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:34.425596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:34.426241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:34.432632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:34.433221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:34.434096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:34.434628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:34.779950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:34.786867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:34.788324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:34.799775 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2dc17698-3114-4e64-89a0-4deff0bb0ed3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.369434 May 14 21:25:34.799775 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2116/3940] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:34 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:34.806717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:34.807450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:34.808392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:34.809008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:34.926772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:34.939464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:34.941066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:34.942241 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ab052b2-f31e-4a0d-9dbc-84117e8df5cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1332 microversion: 2.26 time: 0.160141 May 14 21:25:34.948447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1825/3941] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:34 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1332 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:35.349329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-9d287efe-d890-441e-8ec7-f20c47bf44e2 req-1d70fb32-c72e-475c-b3be-0c006bdc6194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d052efd6-ef23-4eec-b96a-78cd75a193b1", "name": "network-vif-unplugged", "status": "completed", "tag": "d14fe5ed-9ab8-4c6c-893f-768a8f7db696"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:35.360192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:35.360813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:35.361206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9d287efe-d890-441e-8ec7-f20c47bf44e2 req-1d70fb32-c72e-475c-b3be-0c006bdc6194 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:35.362192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9d287efe-d890-441e-8ec7-f20c47bf44e2 req-1d70fb32-c72e-475c-b3be-0c006bdc6194 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:35.368313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:35.368880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:35.369666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:35.370104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:35.389959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9d287efe-d890-441e-8ec7-f20c47bf44e2 req-1d70fb32-c72e-475c-b3be-0c006bdc6194 service nova] Creating event network-vif-unplugged:d14fe5ed-9ab8-4c6c-893f-768a8f7db696 for instance d052efd6-ef23-4eec-b96a-78cd75a193b1 on nch2-master-1 May 14 21:25:35.404704 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-9d287efe-d890-441e-8ec7-f20c47bf44e2 req-1d70fb32-c72e-475c-b3be-0c006bdc6194 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059606 May 14 21:25:35.405326 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2117/3942] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:35.728059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:35.738414 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28035d3a-5800-466b-b0e7-262f3dfc1310 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1511 microversion: 2.1 time: 0.382174 May 14 21:25:35.755987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:35.757145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:35.760737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1826/3943] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:35 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1511 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:35.764762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:35.765398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:35.766361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:35.766965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:35.807312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:35.808097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:35.816922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:35.821323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:35.822527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:35.824231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.053743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:36.062244 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-932d717a-80aa-44ee-9fb9-607527a674b4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1511 microversion: 2.1 time: 0.310898 May 14 21:25:36.074380 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2118/3944] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:35 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1511 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:36.080709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:36.081538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:36.088664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.089353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.090352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.090798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.174399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:36.187672 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ca38b29-f978-4887-a8f3-51fce1d1ff0c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1307 microversion: 2.1 time: 0.384145 May 14 21:25:36.190240 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1827/3945] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:35 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1307 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:36.198012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:36.205585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:36.213382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.213875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.214669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.215311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.241934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lazy-loading 'flavor' on Instance uuid d052efd6-ef23-4eec-b96a-78cd75a193b1 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:36.255386 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Cannot 'shelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state shelved_offloaded May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action HTTP/1.1 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 14 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: {"shelve": {}} May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'shelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state shelved_offloaded May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'shelve': {}}} May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 14 21:25:36.257693 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state shelved_offloaded May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state shelved_offloaded May 14 21:25:36.262394 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:36.265001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 409 to user: Cannot 'shelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state shelved_offloaded {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:36.266099 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6db88562-ef5e-461e-a8c5-28d55e2cb9cb tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 409 len: 155 microversion: 2.1 time: 0.074643 May 14 21:25:36.266911 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1828/3946] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:25:36 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 155 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:25:36.276280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a188a52-41f5-4de7-b437-4412206bcac9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:36.277192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a188a52-41f5-4de7-b437-4412206bcac9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:36.285248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a188a52-41f5-4de7-b437-4412206bcac9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.285969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a188a52-41f5-4de7-b437-4412206bcac9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.287349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a188a52-41f5-4de7-b437-4412206bcac9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.288046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a188a52-41f5-4de7-b437-4412206bcac9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.509299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:36.525735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:36.528322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:36.530555 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2ee9c6d-770f-4726-b653-e8e23cff906e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1362 microversion: 2.26 time: 0.453444 May 14 21:25:36.531373 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2119/3947] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:36 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:36.579123 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a188a52-41f5-4de7-b437-4412206bcac9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 202 len: 0 microversion: 2.1 time: 0.307779 May 14 21:25:36.582237 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1829/3948] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:25:36 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:25:36.591416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:36.597994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:36.604552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.607201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.610470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:36.611016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:36.894589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:36.917945 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ee20db7-b9a6-44ce-88b7-a909964bbd9c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1459 microversion: 2.1 time: 0.331132 May 14 21:25:36.931260 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2120/3949] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:36 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1459 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:37.213276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:37.214981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:37.228586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.229282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:37.230263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.230908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:37.432280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:37.441957 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9efbb322-f274-4ead-9ecd-70c918ec8397 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1487 microversion: 2.1 time: 0.238799 May 14 21:25:37.444379 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1830/3950] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:37 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1487 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:37.461989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddc423f8-56bf-47a1-bc49-b08658865939 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:37.474964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddc423f8-56bf-47a1-bc49-b08658865939 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.475435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddc423f8-56bf-47a1-bc49-b08658865939 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:37.529374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1045905b-11bc-417d-9d8d-7e30b071f2c3 req-4425acfb-4e51-40b7-acda-734fab1f1923 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bd1f782-c732-46c6-81ef-083cc4610ae8", "tag": "a2a7ab53-1274-4bf3-8bd8-b8927d4717b9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:37.549626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1045905b-11bc-417d-9d8d-7e30b071f2c3 req-4425acfb-4e51-40b7-acda-734fab1f1923 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.550117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1045905b-11bc-417d-9d8d-7e30b071f2c3 req-4425acfb-4e51-40b7-acda-734fab1f1923 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:37.556766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ddc423f8-56bf-47a1-bc49-b08658865939 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Going to try to stop instance {{(pid=130638) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:25:37.569529 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1045905b-11bc-417d-9d8d-7e30b071f2c3 req-4425acfb-4e51-40b7-acda-734fab1f1923 service nova] Creating event network-changed:a2a7ab53-1274-4bf3-8bd8-b8927d4717b9 for instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 on nch2-master-1 May 14 21:25:37.581308 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1045905b-11bc-417d-9d8d-7e30b071f2c3 req-4425acfb-4e51-40b7-acda-734fab1f1923 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061719 May 14 21:25:37.581925 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1831/3951] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:37.592913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:37.598528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:37.602958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.603420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:37.608479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.609186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:37.907513 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ddc423f8-56bf-47a1-bc49-b08658865939 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e/action" status: 202 len: 0 microversion: 2.1 time: 0.449750 May 14 21:25:37.908504 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2121/3952] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:25:37 2022] POST /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:25:37.918361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:37.923557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:37.937580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.938050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:37.940760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:37.946576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:38.004487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:38.037875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:38.052522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:38.052522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d79cd57a-8bcb-44c0-a9cc-a2c5b9b99ca5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1362 microversion: 2.26 time: 0.455759 May 14 21:25:38.052522 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1832/3953] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:37 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1362 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:38.071890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:38.074631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:38.107166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:38.108699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:38.114001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:38.116879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:38.821489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:38.840113 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fcd5fd77-08e4-4079-bd3f-49bdd34124ba tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1459 microversion: 2.1 time: 0.792925 May 14 21:25:38.840723 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1833/3954] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:38 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1459 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:38.880687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:38.900270 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-54097742-22ca-4ce4-bbd2-e084ca40eee1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.986187 May 14 21:25:38.909805 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2122/3955] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:37 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:39.080362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:39.081254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:39.097121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:39.098045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:39.099699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:39.100696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:39.588433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:39.594205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:39.596278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:39.598050 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5980c5ed-63a7-4717-be6f-4a3bf058fc22 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1362 microversion: 2.26 time: 0.524354 May 14 21:25:39.599259 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1834/3956] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:39 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:39.857895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:39.858524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:39.885460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:39.886124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:39.886707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:39.887148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:39.919552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:39.920162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:39.932671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:39.933376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:39.939247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:39.940024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:40.207608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:40.218431 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6995cf36-ae05-4298-b52d-d8b29cf0e246 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1461 microversion: 2.1 time: 0.364438 May 14 21:25:40.219035 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2123/3957] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:39 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1461 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:40.262060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:40.274817 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c7dc76ab-63df-4ce8-86d5-601fd1787859 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.361367 May 14 21:25:40.276021 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1835/3958] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:39 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:40.618731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:40.619690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:40.631621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:40.632083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:40.632907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:40.633371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:40.830364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:40.847770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:40.851964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:40.853405 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aeea4b54-09b0-477d-9abc-18a6a1e9ae30 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1362 microversion: 2.26 time: 0.239829 May 14 21:25:40.854187 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2124/3959] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:40 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:41.236007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:41.236982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:41.243845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:41.244597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:41.245562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:41.246130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:41.292745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:41.294065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:41.302225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:41.303014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:41.304058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:41.304818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:41.559683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:41.576773 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-44090f04-8101-488e-ae88-d9e2f37a624d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.288192 May 14 21:25:41.587128 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2125/3960] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:41 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:41.749394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07c475b9-ac05-4f22-8e61-0e635ef48137 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Action: 'create', calling method: .version_select at 0x7fb1a783d940>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:41.771048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-07c475b9-ac05-4f22-8e61-0e635ef48137 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Getting quotas for project 1bdcf091cf2140d9ae48f8fe5554a0bb. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:25:41.777178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-07c475b9-ac05-4f22-8e61-0e635ef48137 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Getting quotas for user f40558cc65e44e90bd9462b4c848826d and project 1bdcf091cf2140d9ae48f8fe5554a0bb. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:25:41.841864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:41.853857 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5c824b4-57f2-406c-8647-572bbcaef519 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.621646 May 14 21:25:41.854813 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1836/3961] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:41 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:41.873102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:41.873728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:41.881844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:41.882774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:41.884162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:41.884825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:41.905397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-07c475b9-ac05-4f22-8e61-0e635ef48137 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Getting quotas for project 1bdcf091cf2140d9ae48f8fe5554a0bb. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:25:41.912559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-07c475b9-ac05-4f22-8e61-0e635ef48137 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Getting quotas for user f40558cc65e44e90bd9462b4c848826d and project 1bdcf091cf2140d9ae48f8fe5554a0bb. Resources: {'server_groups'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:25:41.946396 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07c475b9-ac05-4f22-8e61-0e635ef48137 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] 10.222.0.52 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.357394 May 14 21:25:41.948600 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2126/3962] 10.222.0.52 () {62 vars in 1213 bytes} [Sat May 14 21:25:41 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:25:41.959781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc2d63f5-e745-4b5e-978a-c60ff2039c73 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:41.974709 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc2d63f5-e745-4b5e-978a-c60ff2039c73 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.020597 May 14 21:25:41.975948 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2127/3963] 10.222.0.52 () {60 vars in 1192 bytes} [Sat May 14 21:25:41 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:25:41.986345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df99dab4-0896-4a57-821c-d5febfcaaf01 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:42.000587 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df99dab4-0896-4a57-821c-d5febfcaaf01 tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] 10.222.0.52 "GET /compute/v2.1/os-server-groups/41262ce7-2260-46a9-8312-a0fb506027fd" status: 200 len: 235 microversion: 2.64 time: 0.018011 May 14 21:25:42.002416 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2128/3964] 10.222.0.52 () {60 vars in 1303 bytes} [Sat May 14 21:25:41 2022] GET /compute/v2.1/os-server-groups/41262ce7-2260-46a9-8312-a0fb506027fd => generated 235 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:25:42.021414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce27ee30-8857-4714-ae39-42e994c4155b tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:42.122588 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce27ee30-8857-4714-ae39-42e994c4155b tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/41262ce7-2260-46a9-8312-a0fb506027fd" status: 204 len: 0 microversion: 2.64 time: 0.111317 May 14 21:25:42.123371 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2129/3965] 10.222.0.52 () {60 vars in 1306 bytes} [Sat May 14 21:25:42 2022] DELETE /compute/v2.1/os-server-groups/41262ce7-2260-46a9-8312-a0fb506027fd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 21:25:42.133171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1da58fe3-bd19-416f-97f7-5e043b5c594b tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:42.143288 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1da58fe3-bd19-416f-97f7-5e043b5c594b tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] HTTP exception thrown: Instance group 41262ce7-2260-46a9-8312-a0fb506027fd could not be found. May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1da58fe3-bd19-416f-97f7-5e043b5c594b tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Request method failure captured: May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-server-groups/41262ce7-2260-46a9-8312-a0fb506027fd HTTP/1.1 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5V43PvSzHkf8zgkvKqmGx3DVCRFKbWAvOWLXdg4UWDFQQY747a9CqhVE1ZMi_o4YTG-ZtwHXDFZ-T_CUCEWxbjMtJVWCPansWzI0IvGDEOrC6BVOmBrNqK8ED7yp0H1qsi7gwwg1ZdTsnAN0-RXhHWwjYrwcB72HelXOvpWb2_4VM May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.64 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 1bdcf091cf2140d9ae48f8fe5554a0bb May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerGroup264TestJSON-1923513643 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bdcf091cf2140d9ae48f8fe5554a0bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1bdcf091cf2140d9ae48f8fe5554a0bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1bdcf091cf2140d9ae48f8fe5554a0bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1bdcf091cf2140d9ae48f8fe5554a0bb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerGroup264TestJSON-1923513643 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 1bdcf091cf2140d9ae48f8fe5554a0bb May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1923513643 May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerGroup264TestJSON-1923513643-project May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: f40558cc65e44e90bd9462b4c848826d May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerGroup264TestJSON-1923513643-project May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance group 41262ce7-2260-46a9-8312-a0fb506027fd could not be found. May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '41262ce7-2260-46a9-8312-a0fb506027fd'} May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 41262ce7-2260-46a9-8312-a0fb506027fd could not be found. May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 41262ce7-2260-46a9-8312-a0fb506027fd could not be found. May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:42.145311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 41262ce7-2260-46a9-8312-a0fb506027fd could not be found. May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1da58fe3-bd19-416f-97f7-5e043b5c594b tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] Returning 404 to user: Instance group 41262ce7-2260-46a9-8312-a0fb506027fd could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1da58fe3-bd19-416f-97f7-5e043b5c594b tempest-ServerGroup264TestJSON-1923513643 tempest-ServerGroup264TestJSON-1923513643-project] 10.222.0.52 "DELETE /compute/v2.1/os-server-groups/41262ce7-2260-46a9-8312-a0fb506027fd" status: 404 len: 117 microversion: 2.64 time: 0.018090 May 14 21:25:42.152664 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2130/3966] 10.222.0.52 () {60 vars in 1306 bytes} [Sat May 14 21:25:42 2022] DELETE /compute/v2.1/os-server-groups/41262ce7-2260-46a9-8312-a0fb506027fd => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:25:42.251941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-cf5d7b60-4c9a-488f-92fe-1f36e4a5351b req-33bde9b1-7446-4d9c-aec2-86ef6ff71f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d052efd6-ef23-4eec-b96a-78cd75a193b1", "tag": "d14fe5ed-9ab8-4c6c-893f-768a8f7db696"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:42.266111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cf5d7b60-4c9a-488f-92fe-1f36e4a5351b req-33bde9b1-7446-4d9c-aec2-86ef6ff71f67 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:42.266571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cf5d7b60-4c9a-488f-92fe-1f36e4a5351b req-33bde9b1-7446-4d9c-aec2-86ef6ff71f67 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:42.271357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:42.284876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:42.292269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:42.295018 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6483aca9-6a80-49ae-b148-7929765f9676 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1362 microversion: 2.26 time: 0.425717 May 14 21:25:42.296657 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-cf5d7b60-4c9a-488f-92fe-1f36e4a5351b req-33bde9b1-7446-4d9c-aec2-86ef6ff71f67 service nova] Creating event network-changed:d14fe5ed-9ab8-4c6c-893f-768a8f7db696 for instance d052efd6-ef23-4eec-b96a-78cd75a193b1 on nch1-master-1 May 14 21:25:42.306118 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-cf5d7b60-4c9a-488f-92fe-1f36e4a5351b req-33bde9b1-7446-4d9c-aec2-86ef6ff71f67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057580 May 14 21:25:42.308013 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1837/3968] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:41 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:25:42.309541 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2131/3968] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:42.595831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:42.596366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:42.606662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:42.607360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:42.608517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:42.609956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:42.867186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:42.879788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:42.880693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:42.880845 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-862ed2d1-62e2-489f-b065-3b2121a9c47a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.289353 May 14 21:25:42.891317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:42.891847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:42.893153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:42.894342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:42.907147 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1838/3969] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:42 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:43.160243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:43.179194 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-88d3477d-3def-4581-8db1-a496aca3e144 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.307762 May 14 21:25:43.193024 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2132/3970] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:42 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:43.317961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:43.319071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:43.345425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:43.351109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:43.352995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:43.355265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:43.543974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1531591095", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "c4ebc950-9fb0-4cbc-ad1b-7d96c5298b41"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:43.575669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:43.589853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:43.593779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:43.596191 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e935f3a4-32b4-4b0c-b7d9-b29897d3b9cc tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1362 microversion: 2.26 time: 0.284723 May 14 21:25:43.609351 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2133/3971] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:43 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:43.617753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-7f1b7ba8-0575-4140-87e8-2d8bda5cc9bf req-888302cf-3d6d-4d8a-8edb-4970053502a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd1f782-c732-46c6-81ef-083cc4610ae8", "name": "network-vif-plugged", "status": "completed", "tag": "a2a7ab53-1274-4bf3-8bd8-b8927d4717b9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:43.627317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7f1b7ba8-0575-4140-87e8-2d8bda5cc9bf req-888302cf-3d6d-4d8a-8edb-4970053502a5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:43.629120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7f1b7ba8-0575-4140-87e8-2d8bda5cc9bf req-888302cf-3d6d-4d8a-8edb-4970053502a5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:43.645873 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-7f1b7ba8-0575-4140-87e8-2d8bda5cc9bf req-888302cf-3d6d-4d8a-8edb-4970053502a5 service nova] Creating event network-vif-plugged:a2a7ab53-1274-4bf3-8bd8-b8927d4717b9 for instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 on nch2-master-1 May 14 21:25:43.654178 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-7f1b7ba8-0575-4140-87e8-2d8bda5cc9bf req-888302cf-3d6d-4d8a-8edb-4970053502a5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042658 May 14 21:25:43.661642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2134/3972] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:43.670192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] validate_networks() for [('c4ebc950-9fb0-4cbc-ad1b-7d96c5298b41', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:25:43.904544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:43.907468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:43.937583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:43.944504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:43.945697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:43.946475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:44.214965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:44.222617 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee5d5324-22f1-4ab5-877f-c0060565ed98 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.328018 May 14 21:25:44.224403 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2135/3973] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:43 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:44.249659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:44.249659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:44.260327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:44.261305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:44.262466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:44.263799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:44.477695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:44.496815 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1132a3eb-9793-4bf7-964f-dceef768e911 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.271390 May 14 21:25:44.497700 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2136/3974] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:44 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:44.628284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:44.629212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:44.636111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:44.637352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:44.638753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:44.639700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:44.896380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:25:44.896873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:25:44.897303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:25:44.897716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:25:44.898418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:25:44.910622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:44.915227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:44.916374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:44.917231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:44.963207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Getting quotas for project 689bc5cf419440f683a6ab4fd29dc06e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:25:44.975632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Getting quotas for user 1b4361b4b12041edbd523eef23f82dae and project 689bc5cf419440f683a6ab4fd29dc06e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:25:44.991149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:25:44.995059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:25:45.064253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:45.083505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:45.086485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:45.091115 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e6276cfc-9510-450e-8d83-3d86cfcbc631 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1362 microversion: 2.26 time: 0.466950 May 14 21:25:45.093018 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2137/3975] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:44 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:25:45.240082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:45.240598 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d599a71b-7618-42a1-835c-9bc1de66c9f2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.934629 May 14 21:25:45.241363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:45.250136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1839/3976] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:25:45.253025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:45.255128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:45.258836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:45.259580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:45.262554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7014b2bf-7187-4f3b-bedb-38aae22bf944 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:45.267591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7014b2bf-7187-4f3b-bedb-38aae22bf944 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:45.364560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7014b2bf-7187-4f3b-bedb-38aae22bf944 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:45.374635 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7014b2bf-7187-4f3b-bedb-38aae22bf944 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1225 microversion: 2.1 time: 0.119493 May 14 21:25:45.386281 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1840/3977] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:45 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:45.514812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:45.515441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:45.547594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:45.548535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:45.552247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:45.555265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:45.871356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:45.881635 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04bc43a2-5013-4115-aceb-f57045a5799a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.370438 May 14 21:25:45.885455 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1841/3978] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:45 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:46.033077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:46.047727 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-42d8e52b-c179-4fde-9fad-d57c9b83b3c2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.807559 May 14 21:25:46.047727 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2138/3979] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:45 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:46.112939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:46.114592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:46.126069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.126069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.126069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.126069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.397494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83d1e2dd-dd47-4e50-81f8-f6f681ae9ebe tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:46.399435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83d1e2dd-dd47-4e50-81f8-f6f681ae9ebe tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:46.416590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:46.426657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:46.428213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:46.433783 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71bd0473-eaf0-4fc1-bc2b-46cdbf912318 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1546 microversion: 2.26 time: 0.326053 May 14 21:25:46.448557 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1842/3980] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:46 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1546 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:46.458803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b96dd820>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:46.467981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.468674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.469400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:46.475771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.476628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.477642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.478310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.507944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-83d1e2dd-dd47-4e50-81f8-f6f681ae9ebe tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:46.515167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.515458 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83d1e2dd-dd47-4e50-81f8-f6f681ae9ebe tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1225 microversion: 2.1 time: 0.125527 May 14 21:25:46.515662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.520159 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2139/3981] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:46 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:46.531912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.532376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.627013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:46.658449 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-298a8885-12fd-4cc0-a282-3d3cdfff875e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-361344930" status: 201 len: 0 microversion: 2.26 time: 0.204415 May 14 21:25:46.659623 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1843/3982] 10.222.0.52 () {62 vars in 1376 bytes} [Sat May 14 21:25:46 2022] PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-361344930 => generated 0 bytes in 207 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) May 14 21:25:46.669768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-74f1f4f1-d237-4add-9c0c-abc22bdd1698 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b97b4ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:46.700364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74f1f4f1-d237-4add-9c0c-abc22bdd1698 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.700802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74f1f4f1-d237-4add-9c0c-abc22bdd1698 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.716833 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-74f1f4f1-d237-4add-9c0c-abc22bdd1698 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-361344930" status: 204 len: 0 microversion: 2.26 time: 0.051440 May 14 21:25:46.717910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2140/3983] 10.222.0.52 () {60 vars in 1357 bytes} [Sat May 14 21:25:46 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-361344930 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:25:46.725744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b98d8310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:46.735089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.735901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.736638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:46.744747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.745521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.746493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.747255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.777654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.778546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.889637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:46.903796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:46.904803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:46.924631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.925509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.932563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.933368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.940879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e46b5eb7-5ab6-4607-a7e3-a292b6e3726e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 204 len: 0 microversion: 2.26 time: 0.219015 May 14 21:25:46.943810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1844/3984] 10.222.0.52 () {60 vars in 1294 bytes} [Sat May 14 21:25:46 2022] DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:25:46.953653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47e8d212-3802-4dd7-97cb-5ec71c338c99 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a77b10d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:46.981640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47e8d212-3802-4dd7-97cb-5ec71c338c99 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:46.983639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47e8d212-3802-4dd7-97cb-5ec71c338c99 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:46.997192 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47e8d212-3802-4dd7-97cb-5ec71c338c99 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 200 len: 12 microversion: 2.26 time: 0.047796 May 14 21:25:46.998810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1845/3985] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:25:46 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 12 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:47.017256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b98d8ee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.031297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.032108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.036114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:47.040365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.041058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.042146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.043659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.114339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.115892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.140188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.140732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.258514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:47.279974 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-005f6b3d-834d-49ad-a986-cdd26e31c942 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-282087590" status: 201 len: 0 microversion: 2.26 time: 0.273903 May 14 21:25:47.286703 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1846/3986] 10.222.0.52 () {62 vars in 1376 bytes} [Sat May 14 21:25:47 2022] PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-282087590 => generated 0 bytes in 282 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 14 21:25:47.295776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.297705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:47.310494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.312284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.316972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.318652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.333099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:47.350303 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e6e39e04-cd86-44dd-af6d-147fcfc9b188 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.451797 May 14 21:25:47.354820 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2141/3987] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:46 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:47.372622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-660c3ce2-748c-4654-8e75-0a171c768142 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b97c3e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.411748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-660c3ce2-748c-4654-8e75-0a171c768142 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.412943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-660c3ce2-748c-4654-8e75-0a171c768142 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.447681 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-660c3ce2-748c-4654-8e75-0a171c768142 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 200 len: 35 microversion: 2.26 time: 0.089229 May 14 21:25:47.449423 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2142/3988] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:25:47 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 35 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:47.470405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a7771c10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.483748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.484502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.485161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:47.492983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.493699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.494667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.495304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.525470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.526062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.599866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:47.608928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f28ce1c9-fe19-4882-ab22-0aeb679f1e6a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.320676 May 14 21:25:47.620146 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1847/3989] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:47 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:47.627463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.628901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:47.636255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.637090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.639810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.640888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.651839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:47.674380 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e2efd92-3111-405a-a194-20280474304e tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-282087590" status: 204 len: 0 microversion: 2.26 time: 0.215515 May 14 21:25:47.676002 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2143/3990] 10.222.0.52 () {60 vars in 1360 bytes} [Sat May 14 21:25:47 2022] DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-282087590 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:25:47.688430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b5d9b699-fbd4-4fbe-a1c8-70bd2c17dbd0 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a771f280>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.699709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5d9b699-fbd4-4fbe-a1c8-70bd2c17dbd0 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.700915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5d9b699-fbd4-4fbe-a1c8-70bd2c17dbd0 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.716449 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b5d9b699-fbd4-4fbe-a1c8-70bd2c17dbd0 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 200 len: 12 microversion: 2.26 time: 0.033143 May 14 21:25:47.717688 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2144/3991] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:25:47 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 12 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:47.729836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a77029d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.738973 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.739774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.740263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:47.753975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.754703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.757008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.757622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.788717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.789908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.791254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:47.811134 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-036d574b-c0eb-4b42-a19a-3bd78f45ca3e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1277 microversion: 2.1 time: 0.188358 May 14 21:25:47.812089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:47.812818 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1848/3992] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:47 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:47.830605 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-583cdc14-315a-4c1a-a05c-1e43e7bd2de9 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 204 len: 0 microversion: 2.26 time: 0.107147 May 14 21:25:47.833068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2145/3993] 10.222.0.52 () {60 vars in 1294 bytes} [Sat May 14 21:25:47 2022] DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 21:25:47.852979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b96dd550>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:47.861540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.865219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.865219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:47.869176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.869638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.870677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.871127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.903671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.904128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:47.919511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:47.919511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.057888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:48.074296 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8927ea14-c109-4aad-b0df-f2f896773936 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-1197824858" status: 201 len: 0 microversion: 2.26 time: 0.229710 May 14 21:25:48.077751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1849/3994] 10.222.0.52 () {62 vars in 1379 bytes} [Sat May 14 21:25:47 2022] PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-1197824858 => generated 0 bytes in 231 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 14 21:25:48.085891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a7c72310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:48.101889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.101889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.101889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:48.102860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.103402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.104281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.105197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.136714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.137582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.148481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.159211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.268044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:48.304701 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a48b60b1-66f7-41d6-a9ad-c8e8aa73223a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-783331117" status: 201 len: 0 microversion: 2.26 time: 0.223722 May 14 21:25:48.306748 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2146/3995] 10.222.0.52 () {62 vars in 1376 bytes} [Sat May 14 21:25:48 2022] PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-783331117 => generated 0 bytes in 227 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) May 14 21:25:48.316724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a768f040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:48.329377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.329942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.330364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:48.338463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.338929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.339760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.340251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.373807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:48.374518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:48.388440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.393064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.394024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.394487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.416173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.416807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.494250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:48.521711 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-70258e30-e235-45b0-b4d2-bcb44172e74d tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 204 len: 0 microversion: 2.26 time: 0.209866 May 14 21:25:48.528003 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1850/3996] 10.222.0.52 () {60 vars in 1294 bytes} [Sat May 14 21:25:48 2022] DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:25:48.539707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6665c9f5-5614-42c6-a2bc-8eca00097e40 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a76b7dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:48.587666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6665c9f5-5614-42c6-a2bc-8eca00097e40 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.588441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6665c9f5-5614-42c6-a2bc-8eca00097e40 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.613089 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6665c9f5-5614-42c6-a2bc-8eca00097e40 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 200 len: 12 microversion: 2.26 time: 0.080521 May 14 21:25:48.619052 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1851/3997] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:25:48 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 12 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:48.630731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b98d83a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:48.661426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.661907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.662446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:48.688856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.695928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.695928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.695928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.696216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:48.705154 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-27216f15-7742-4916-894e-ee53c3b8581c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.335796 May 14 21:25:48.715737 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2147/3998] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:48 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:48.721478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:48.722513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:48.730534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.736076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.736076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.736076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.777754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.778241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.829042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:48.869537 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1fb968ed-f6a6-44c5-b18c-111bc0f3a440 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 204 len: 0 microversion: 2.26 time: 0.244854 May 14 21:25:48.870481 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1852/3999] 10.222.0.52 () {60 vars in 1294 bytes} [Sat May 14 21:25:48 2022] DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 21:25:48.877485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:48.878443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:48.888407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.888880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:48.889968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:48.890423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.057842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:49.072875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:49.084244 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cedf9379-077c-458b-9a71-2ce40d12e89e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.367071 May 14 21:25:49.084878 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-373683ae-f85b-438d-bffa-bee4ef29c17f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1285 microversion: 2.1 time: 0.212625 May 14 21:25:49.095125 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2148/4000] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:48 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:49.095728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a6ed6b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:49.096401 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1853/4001] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:48 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:49.109577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.110271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.110872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:49.129468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.130241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.131252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.133548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.177642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.178221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.204780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.205408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.301446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:49.345427 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66abfc74-859a-4c1e-9b24-32a200b7a68a tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-2114385108" status: 201 len: 0 microversion: 2.26 time: 0.257531 May 14 21:25:49.346122 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2149/4002] 10.222.0.52 () {62 vars in 1379 bytes} [Sat May 14 21:25:49 2022] PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-2114385108 => generated 0 bytes in 259 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 14 21:25:49.356890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1a6f57f70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:49.369487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.369950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.370451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:49.401154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.401154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.401154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.401523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.438922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.439661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.455799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.456433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.626950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:49.683806 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-964c70f3-e658-4b7e-bd04-2775e28f7429 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-339320097" status: 201 len: 0 microversion: 2.26 time: 0.331833 May 14 21:25:49.688597 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1854/4003] 10.222.0.52 () {62 vars in 1376 bytes} [Sat May 14 21:25:49 2022] PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags/tempest-tag-339320097 => generated 0 bytes in 334 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) May 14 21:25:49.701010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Action: 'update_all', calling method: .version_select at 0x7fb1a77ce8b0>, body: {"tags": ["tempest-tag-1017981102", "tempest-tag-421188325"]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:49.723736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:49.724483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:49.740079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.741884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.742770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:49.748481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.748937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.756692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.759501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.775164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.775709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.778140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.778615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.812318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:49.812952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:49.949971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:50.035681 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8f50f19c-0f38-4929-9b01-a73929e853a5 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 200 len: 61 microversion: 2.26 time: 0.335743 May 14 21:25:50.043882 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2150/4004] 10.222.0.52 () {62 vars in 1311 bytes} [Sat May 14 21:25:49 2022] PUT /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 61 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:50.050959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-22c647ad-2c6b-4128-9d93-47cc83a3d3ac tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b97c3f70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:50.088966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-22c647ad-2c6b-4128-9d93-47cc83a3d3ac tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.090943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-22c647ad-2c6b-4128-9d93-47cc83a3d3ac tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.120987 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-22c647ad-2c6b-4128-9d93-47cc83a3d3ac tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 200 len: 61 microversion: 2.26 time: 0.076761 May 14 21:25:50.121629 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2151/4005] 10.222.0.52 () {60 vars in 1291 bytes} [Sat May 14 21:25:50 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 61 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:50.130831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:50.131583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:50.158114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.158580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.159387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.159869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.323520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:50.331812 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a89bc0d7-8472-45f4-932c-9977c8b76e0c tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1283 microversion: 2.1 time: 0.209060 May 14 21:25:50.337037 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2152/4006] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:50 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1283 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:50.341133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:50.345045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:50.346060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:50.350399 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d676612-f1d4-4367-9d94-938f392fbd66 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.630701 May 14 21:25:50.361198 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1855/4007] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:49 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:50.366608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '.version_select at 0x7fb1b96dd3a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:50.371189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.374060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.375453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.377668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.398635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.399029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.399691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:50.428363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.428873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.430365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.431125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.487696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.488164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.561144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lazy-loading 'flavor' on Instance uuid 9bd1f782-c732-46c6-81ef-083cc4610ae8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:25:50.596579 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c13503be-c84b-4cf9-8485-b736dc4da4ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags" status: 204 len: 0 microversion: 2.26 time: 0.233679 May 14 21:25:50.599877 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1856/4008] 10.222.0.52 () {60 vars in 1294 bytes} [Sat May 14 21:25:50 2022] DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8/tags => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:25:50.610612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:50.611118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:50.617666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.627302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.627302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:50.627302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:50.680736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:25:50.795131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:50.826625 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7b1f74e-897c-4853-b6d9-38473de94101 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.487109 May 14 21:25:50.827357 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2153/4009] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:50 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:51.150527 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a13a696-f433-419a-b6ba-0fa013bf07c4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 204 len: 0 microversion: 2.26 time: 0.544180 May 14 21:25:51.154645 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1857/4010] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:25:50 2022] DELETE /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:25:51.160227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:51.160926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:51.189910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.189910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:51.197473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.198940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:51.361392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:51.363582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:51.379258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.380134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:51.381023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.381501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:51.605425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:51.615259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:51.620907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:51.624404 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6978d294-f4c1-4b73-9188-69adb6d8e7ea tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1552 microversion: 2.26 time: 0.468894 May 14 21:25:51.628421 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2154/4011] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:51 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1552 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:51.634903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:51.635572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:51.651110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.651606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:51.652385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.652827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:51.673908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:51.684685 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-70a76db5-941c-43ed-af8e-c7d2be234890 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.332815 May 14 21:25:51.695589 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1858/4012] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:51 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:51.846653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:51.847677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:51.856832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.859384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:51.859384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:51.864303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:52.120157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:52.130411 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ef153a4e-d425-4d12-92eb-b728d21e0d2b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.499841 May 14 21:25:52.131331 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2155/4013] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:51 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:52.313712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:52.326323 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-893408c5-5f2c-4a95-bc6f-2b1226ece2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.486022 May 14 21:25:52.327829 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1859/4014] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:51 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:52.651647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:52.652073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:52.659352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:52.659816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:52.660618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:52.661379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:52.706279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:52.708103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:52.720812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:52.727640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:52.728804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:52.729274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:53.494524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:53.524893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:53.527888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:53.530432 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-03fd4bdb-c146-4e62-9642-f0f86e5e4090 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1552 microversion: 2.26 time: 0.883957 May 14 21:25:53.534423 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2156/4015] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:52 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1552 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:53.572931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:53.575042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:53.587221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:53.596025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:53.602216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:53.602216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:53.894828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:53.906067 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a876ab4c-42e4-48e0-8b8a-942b023f1915 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 1.207063 May 14 21:25:53.909814 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1860/4016] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:52 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:53.929827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:53.934655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:53.945266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:53.948510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:53.948510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:53.948510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:53.950649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:53.959619 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9096d0ff-295c-4af5-850e-042ecc0c8241 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.423458 May 14 21:25:53.964466 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2157/4017] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:53 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:54.349381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-b37b526e-8371-4db7-81b6-fb5a2b345e3e req-bcd4ac88-f7f6-4de2-9569-b1b198cb09d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bd1f782-c732-46c6-81ef-083cc4610ae8", "name": "network-vif-deleted", "tag": "a2a7ab53-1274-4bf3-8bd8-b8927d4717b9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:54.372841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b37b526e-8371-4db7-81b6-fb5a2b345e3e req-bcd4ac88-f7f6-4de2-9569-b1b198cb09d7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:54.372841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b37b526e-8371-4db7-81b6-fb5a2b345e3e req-bcd4ac88-f7f6-4de2-9569-b1b198cb09d7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:54.393788 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-b37b526e-8371-4db7-81b6-fb5a2b345e3e req-bcd4ac88-f7f6-4de2-9569-b1b198cb09d7 service nova] Creating event network-vif-deleted:a2a7ab53-1274-4bf3-8bd8-b8927d4717b9 for instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 on nch2-master-1 May 14 21:25:54.420047 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-b37b526e-8371-4db7-81b6-fb5a2b345e3e req-bcd4ac88-f7f6-4de2-9569-b1b198cb09d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074276 May 14 21:25:54.421257 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2158/4018] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:54.471801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:54.484479 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc6f3b10-78c4-4c2d-b60b-a9316084aecf tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.573492 May 14 21:25:54.486415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1861/4019] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:53 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:54.565115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:54.566429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:54.588108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:54.589796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:54.591206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:54.591967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:54.813821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:54.824489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:54.832044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd79f0a4984166a48522eb5103f0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f81d13056f0041a4b01112cd3d502b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:54.833611 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-80836f64-ac8a-4482-b459-96ab3c1a70d4 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 200 len: 1347 microversion: 2.26 time: 0.275162 May 14 21:25:54.835183 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2159/4020] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:54 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 1347 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:25:54.925720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:54.927282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:54.945219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:54.945992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:54.946809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:54.947254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:55.008084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:55.013472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:55.062055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:55.069000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:55.088135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:55.088689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:55.501000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:55.515374 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c631ed4d-b1be-424f-af3f-f772ff127e1c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.538083 May 14 21:25:55.516787 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2160/4021] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:54 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:55.531695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:55.533539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:55.554067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:55.560649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:55.560649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:55.560649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:55.920638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:55.926755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82ba7d9c-1c96-4863-a9c1-23daff392643 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 1.006713 May 14 21:25:55.932882 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1862/4022] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:54 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:55.942135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:55.944498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] [instance: 9bd1f782-c732-46c6-81ef-083cc4610ae8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:55.951432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:55.952150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:55.953126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:55.953757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:55.968953 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] HTTP exception thrown: Instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 could not be found. May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Request method failure captured: May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 HTTP/1.1 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5ICc2owVszP6c_RyGalzgbGi8DcJBonCDJpiySMV4zez2cZT_TcQw4frBneXDk8rvzBu3DrnnMo4R4CY892gNGFi90yClUNQy2Xrxqu8rmql77s40P3lEGcN4st9xxw0nGCny9sSZ1HZ0qyMY5ujmvjO-m3axfsYuAn8oREAVanTg May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.26 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: f81d13056f0041a4b01112cd3d502b78 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerTagsTestJSON-1401983451 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f81d13056f0041a4b01112cd3d502b78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f81d13056f0041a4b01112cd3d502b78"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f81d13056f0041a4b01112cd3d502b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f81d13056f0041a4b01112cd3d502b78", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerTagsTestJSON-1401983451 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: f81d13056f0041a4b01112cd3d502b78 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerTagsTestJSON-1401983451 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerTagsTestJSON-1401983451-project May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: fbbd79f0a4984166a48522eb5103f0c1 May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerTagsTestJSON-1401983451-project May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 could not be found. May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '9bd1f782-c732-46c6-81ef-083cc4610ae8'} May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 could not be found. May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 could not be found. May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:25:55.971016 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 could not be found. May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] Returning 404 to user: Instance 9bd1f782-c732-46c6-81ef-083cc4610ae8 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:25:55.976162 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26501eff-4922-4d7a-a3bc-bc569c404528 tempest-ServerTagsTestJSON-1401983451 tempest-ServerTagsTestJSON-1401983451-project] 10.222.0.52 "GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8" status: 404 len: 111 microversion: 2.26 time: 0.038477 May 14 21:25:55.976932 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1863/4023] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:25:55 2022] GET /compute/v2.1/servers/9bd1f782-c732-46c6-81ef-083cc4610ae8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:25:56.030199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:56.048055 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c82580d3-7ffb-46a5-a20a-b53adb6fd535 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.527733 May 14 21:25:56.050299 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2161/4024] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:55 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:56.449391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-45e66bbd-f9b3-4f5d-9c5b-77052b847cb5 req-067e3411-e4df-4592-9290-321d9937af6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67fb6a1d-5712-41f9-8e46-5e5a76cf8599", "tag": "d52780c9-cd7b-4b32-9e8e-ee70a76a4c6b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:56.458156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-45e66bbd-f9b3-4f5d-9c5b-77052b847cb5 req-067e3411-e4df-4592-9290-321d9937af6e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:56.458617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-45e66bbd-f9b3-4f5d-9c5b-77052b847cb5 req-067e3411-e4df-4592-9290-321d9937af6e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:56.471648 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-45e66bbd-f9b3-4f5d-9c5b-77052b847cb5 req-067e3411-e4df-4592-9290-321d9937af6e service nova] Creating event network-changed:d52780c9-cd7b-4b32-9e8e-ee70a76a4c6b for instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 on nch1-master-1 May 14 21:25:56.477871 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-45e66bbd-f9b3-4f5d-9c5b-77052b847cb5 req-067e3411-e4df-4592-9290-321d9937af6e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033400 May 14 21:25:56.478598 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1864/4025] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:25:56.533722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:56.534342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:56.540557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:56.541018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:56.541798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:56.542254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:56.682245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:56.689745 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5754c507-044a-42cb-982c-fbf7bce37f77 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.159986 May 14 21:25:56.690327 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2162/4026] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:56 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:56.954316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:56.955058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:56.971864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:56.972614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:56.973438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:56.974656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:57.070157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:57.070952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:57.078631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:57.079355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:57.080415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:57.080858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:57.245795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:57.261774 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2612fffe-a1ed-4148-b14c-58775f3a06df tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.310684 May 14 21:25:57.261774 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1865/4027] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:56 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:57.513644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:57.556394 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b868286-9fed-4b56-ae8d-f6ed149f4bfb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.487238 May 14 21:25:57.558213 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2163/4028] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:57 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:57.708149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:57.708858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:57.716094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:57.716870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:57.717901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:57.718401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:58.121951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:58.134555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53b3d06c-306d-4e51-801e-6c986fbad93f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.430534 May 14 21:25:58.145794 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1866/4029] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:57 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:58.276474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:58.277271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:58.293980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:58.293980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:58.293980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:58.293980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:58.506797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:58.516525 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab63df58-10cc-4d84-bcb9-54b1a76340e4 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.246038 May 14 21:25:58.518389 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2164/4030] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:58 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:58.577911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:58.577911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:58.582918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:58.583715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:58.585217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:58.585668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:58.719827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1bf1cbad-9dcf-4f4e-be02-8149c1b0c539 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: .version_select at 0x7fb1b96e5b80>, body: {"keypair": {"name": "tempest-keypair-1082053266", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaNa6x+4fiKRDvNbCD2oOoQUvXV+uwVqY9WkQiJ3t5Zb4RBKiLlRzwGWFp1c2YI8z+m0XhxqRPTD3WpNps3e1t1uFUwq0jCv65UQaYJOF4g/lGNulsSt2COG8owPIabog=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:25:58.736504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1bf1cbad-9dcf-4f4e-be02-8149c1b0c539 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:25:58.743286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1bf1cbad-9dcf-4f4e-be02-8149c1b0c539 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:25:58.785588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:58.795836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5224748a-1fe7-41f6-9a8a-0722df353cc2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.225010 May 14 21:25:58.807877 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2165/4031] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:58 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:25:58.874304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1bf1cbad-9dcf-4f4e-be02-8149c1b0c539 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.384630 May 14 21:25:58.874304 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1867/4032] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:25:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:25:59.153870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:59.154493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:59.164194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:59.167749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:59.170257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:59.171148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:59.417257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:59.431164 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0791b7e-a508-4f9a-a7cb-730ba6c7884b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.281662 May 14 21:25:59.441097 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2166/4033] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:59 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:59.536395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:59.537135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:59.546845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:59.547402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:59.548360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:59.549213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:59.816598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:25:59.817339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:25:59.820149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:25:59.833224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:59.833813 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f6c6706d-c87a-4b90-8b2f-ad22a90bac85 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.300841 May 14 21:25:59.844196 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1868/4034] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:59 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:25:59.859395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:25:59.859395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:25:59.859395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:00.039776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:00.047459 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f68f7364-74b2-4216-91ac-f90c1f3bc0f0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.237134 May 14 21:26:00.048438 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2167/4035] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:25:59 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:00.448671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:00.449289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:00.455305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:00.455791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:00.456562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:00.457003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:00.699784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:00.718109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-543218c1-586d-4bdb-a99c-a07881a4b20e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.272918 May 14 21:26:00.721037 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1869/4036] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:00 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:00.858302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:00.858302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:00.867640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:00.868270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:00.869862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:00.870388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:01.068345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:01.069220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:01.082974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:01.086990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:01.090242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:01.090923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:01.102193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:01.124345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-54d8f9fb-9478-4c0c-bdc6-773b32ae453a tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.272997 May 14 21:26:01.126873 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2168/4037] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:00 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:01.366524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:01.380334 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a2734e7-1332-4745-bf35-9c644157c0ce tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.318199 May 14 21:26:01.384160 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1870/4038] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:01 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:01.736340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:01.736974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:01.747628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:01.748519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:01.749509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:01.750019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:02.126598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:02.136177 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-63a34472-0e9d-4a14-ae0e-701e9fa3e7aa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.403398 May 14 21:26:02.142717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:02.144155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:02.146642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2169/4039] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:01 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:02.157156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:02.157156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:02.157156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:02.157156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:02.383338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-358019186", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8da851bf-8623-41cd-8e7e-e11152a2fef0"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:02.437679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:02.456348 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-800b47e9-cf15-41cb-ba1d-ae0d2777a276 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.315595 May 14 21:26:02.457915 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1871/4040] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:02 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:02.475089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:26:02.481247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:02.481873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:02.489520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:02.490195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:02.495134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:02.495134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:02.714671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:02.739507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6fac4309-5008-40a0-92d1-c11daf2ffca1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1497 microversion: 2.1 time: 0.279588 May 14 21:26:02.740334 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1872/4041] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:02 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1497 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:02.749447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-184870208", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd341be-651f-4dc3-82bf-83f603d58628"}], "security_groups": [{"name": "tempest-securitygroup--1845451012"}], "key_name": "tempest-keypair-1082053266", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:02.912204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] validate_networks() for [('afd341be-651f-4dc3-82bf-83f603d58628', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:26:03.455536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:26:03.456786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:26:03.457625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:26:03.459057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:26:03.460715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:26:03.494319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:03.495149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:03.496789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:03.497418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:03.519889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:26:03.533003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:26:03.553299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:26:03.556971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:26:03.711549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:26:03.718339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:26:03.718339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:26:03.718339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:26:03.718339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:26:03.722809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:03.723276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:03.724158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:03.724608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:03.742652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:26:03.748366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:26:03.749042 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a086716-c502-4437-acc1-d98ff602639d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.006158 May 14 21:26:03.749701 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1873/4042] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:26:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1009 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:26:03.757589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:03.758524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:03.770219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:26:03.770219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:26:03.778856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:03.781752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:03.782900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:03.784625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:04.001035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:04.008960 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31242cc6-84a1-4ad2-bbd1-820a0c5883e4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.257961 May 14 21:26:04.009549 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1874/4043] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:03 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:04.020788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:04.021657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:04.028688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:04.029303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:04.030177 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83379d69-56a4-4c36-950b-18173c334ccc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.862773 May 14 21:26:04.030323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:04.031151 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2170/4044] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:26:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:26:04.031470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:04.036691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:04.042558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:04.047221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:04.048115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:04.049104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:04.049717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:04.202230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:04.212996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5ee8f2ee-1c27-43ff-9d8a-5f2df2019435 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.202184 May 14 21:26:04.215610 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1875/4045] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:04 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:04.221256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a244190-2a7e-46b8-89a3-77339298fd00 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:04.222156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a244190-2a7e-46b8-89a3-77339298fd00 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:04.292528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7a244190-2a7e-46b8-89a3-77339298fd00 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:04.304448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:04.305820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a244190-2a7e-46b8-89a3-77339298fd00 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1241 microversion: 2.1 time: 0.084790 May 14 21:26:04.307912 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1876/4046] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:04 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:04.312481 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-34358e76-5950-44d5-9077-cace370cf20b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 200 len: 1474 microversion: 2.1 time: 0.279779 May 14 21:26:04.315243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1003b7c7-b756-411c-813e-f44c92daa827 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:04.315868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1003b7c7-b756-411c-813e-f44c92daa827 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:04.316265 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2171/4047] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:04 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 1474 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:04.338664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99c0947e-b0e6-4618-90ec-41c5bb124521 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-962588872"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:04.339930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-99c0947e-b0e6-4618-90ec-41c5bb124521 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:04.347967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99c0947e-b0e6-4618-90ec-41c5bb124521 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:04.348781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99c0947e-b0e6-4618-90ec-41c5bb124521 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:04.349611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99c0947e-b0e6-4618-90ec-41c5bb124521 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:04.350062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99c0947e-b0e6-4618-90ec-41c5bb124521 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:04.377143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1003b7c7-b756-411c-813e-f44c92daa827 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:04.385713 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1003b7c7-b756-411c-813e-f44c92daa827 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1192 microversion: 2.1 time: 0.076469 May 14 21:26:04.386612 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1877/4048] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:04 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1192 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:04.952394 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99c0947e-b0e6-4618-90ec-41c5bb124521 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e/action" status: 202 len: 0 microversion: 2.1 time: 0.617852 May 14 21:26:04.953979 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2172/4049] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:04 2022] POST /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 14 21:26:04.964797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0508b355-12c4-4c81-ba97-1baf40ec53c6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b96dd0d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:05.028079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:05.034057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:05.041657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0508b355-12c4-4c81-ba97-1baf40ec53c6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.081810 May 14 21:26:05.042905 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1878/4050] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:04 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:05.045686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.046149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.047172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.047941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.222458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:05.232437 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04894b7d-2c29-42a9-81a9-a92298ae68cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.209950 May 14 21:26:05.233050 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2173/4051] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:05 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:05.248457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:05.248457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:05.248457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.248457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.248457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.248457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.325390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:05.326353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:05.344901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.345750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.346777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.347383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.421620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:05.432318 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2165f6fd-079c-4982-b8ba-ef63166e7e77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1245 microversion: 2.1 time: 0.110839 May 14 21:26:05.435317 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2174/4052] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:05 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1245 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:05.445401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-50bdde10-308e-4274-a22c-81a3bc123e61 req-8f71c67c-11fd-49a5-8494-d758796ce8bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fb6a1d-5712-41f9-8e46-5e5a76cf8599", "name": "network-vif-plugged", "status": "completed", "tag": "d52780c9-cd7b-4b32-9e8e-ee70a76a4c6b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:05.454130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-50bdde10-308e-4274-a22c-81a3bc123e61 req-8f71c67c-11fd-49a5-8494-d758796ce8bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.454606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-50bdde10-308e-4274-a22c-81a3bc123e61 req-8f71c67c-11fd-49a5-8494-d758796ce8bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.456060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:05.464644 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71fe143d-e736-4b92-b23c-1f22ac44c09e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.235923 May 14 21:26:05.465240 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1879/4053] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:05 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:05.469234 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-50bdde10-308e-4274-a22c-81a3bc123e61 req-8f71c67c-11fd-49a5-8494-d758796ce8bf service nova] Creating event network-vif-plugged:d52780c9-cd7b-4b32-9e8e-ee70a76a4c6b for instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 on nch1-master-1 May 14 21:26:05.475748 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-50bdde10-308e-4274-a22c-81a3bc123e61 req-8f71c67c-11fd-49a5-8494-d758796ce8bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035407 May 14 21:26:05.476403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:05.476854 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2175/4054] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:05.477099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:05.489787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.489787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.489787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:05.489787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:05.583428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:05.593631 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4698001d-3a3e-42d9-91d5-6c7ed4388fac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1196 microversion: 2.1 time: 0.121006 May 14 21:26:05.594253 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1880/4055] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:05 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1196 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:06.057522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8d5e59c-e795-4f1e-b33e-622ce9e82564 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6e87700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:06.104158 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8d5e59c-e795-4f1e-b33e-622ce9e82564 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.052173 May 14 21:26:06.104941 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2176/4056] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:06 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:06.249393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:06.250137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:06.257022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.257473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.258235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.258673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.427631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:06.443801 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-156ae22b-cdf5-419b-bdeb-14b9292ad0c9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.197347 May 14 21:26:06.446120 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1881/4057] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:06 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:06.451264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:06.453525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:06.461802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.462485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.463259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.463955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.489556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:06.490181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:06.496467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.496975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.497963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.498489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.547315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:06.555771 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a115a359-f215-421f-9033-1a56d7a2ca3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1301 microversion: 2.1 time: 0.109706 May 14 21:26:06.556572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2177/4058] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:06 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1301 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:06.610774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:06.611315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:06.617376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.617837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.618654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:06.619165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:06.688801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:06.699848 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cab70442-1749-43b9-85b8-83372357eba6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1244 microversion: 2.1 time: 0.092987 May 14 21:26:06.701078 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2178/4059] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:06 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:07.084208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:07.097300 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ae23d25-e44b-4ba0-afa9-5b0eaf1e8237 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1325 microversion: 2.1 time: 0.617743 May 14 21:26:07.098203 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1882/4060] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:06 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1325 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:07.118462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84634611-f5a0-4078-99a9-51d172a580a2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6e881f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:07.172331 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84634611-f5a0-4078-99a9-51d172a580a2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.058457 May 14 21:26:07.173016 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2179/4061] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:07 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:07.465182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:07.466511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:07.473696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:07.474572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:07.476744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:07.477330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:07.496084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fbd3f004-f413-4141-a6b5-533791f0bf5a req-c3cd285d-fe4c-4d37-be35-37f4c57dca53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d052efd6-ef23-4eec-b96a-78cd75a193b1", "name": "network-vif-plugged", "status": "completed", "tag": "d14fe5ed-9ab8-4c6c-893f-768a8f7db696"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:07.510271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fbd3f004-f413-4141-a6b5-533791f0bf5a req-c3cd285d-fe4c-4d37-be35-37f4c57dca53 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:07.511014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fbd3f004-f413-4141-a6b5-533791f0bf5a req-c3cd285d-fe4c-4d37-be35-37f4c57dca53 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:07.523296 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fbd3f004-f413-4141-a6b5-533791f0bf5a req-c3cd285d-fe4c-4d37-be35-37f4c57dca53 service nova] Creating event network-vif-plugged:d14fe5ed-9ab8-4c6c-893f-768a8f7db696 for instance d052efd6-ef23-4eec-b96a-78cd75a193b1 on nch1-master-1 May 14 21:26:07.530448 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fbd3f004-f413-4141-a6b5-533791f0bf5a req-c3cd285d-fe4c-4d37-be35-37f4c57dca53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040549 May 14 21:26:07.534497 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2180/4062] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:07.577711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:07.578756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:07.586246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:07.587160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:07.588213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:07.589059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:07.732556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:07.742908 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c83b04b8-b495-4af4-8066-dbfe48f9245b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1299 microversion: 2.1 time: 0.171917 May 14 21:26:07.743879 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2181/4063] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:07 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:07.750962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:07.751971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:07.760787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:07.764085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:07.764085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:07.764085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:07.816434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:07.830764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:07.904569 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ccb37ac2-53e3-4c0a-83fb-b8a3c94882ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.446127 May 14 21:26:07.916485 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1883/4064] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:07 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:07.919981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c3084e42-6936-4819-a0b9-a056b3bd2912 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1250 microversion: 2.1 time: 0.172014 May 14 21:26:07.920823 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2182/4065] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:07 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1250 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:08.119147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:08.120199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:08.127767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.129309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:08.130444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.131114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:08.187540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7fda523a-1d6a-41f6-b7e2-b599ee3c4644 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6e9d5e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:08.259294 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7fda523a-1d6a-41f6-b7e2-b599ee3c4644 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.076703 May 14 21:26:08.260081 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2183/4066] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:08 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:08.497319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:08.514879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-706d4a65-4f72-487b-9d7c-f6cd709ab149 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1520 microversion: 2.1 time: 0.404461 May 14 21:26:08.515874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1884/4067] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:08 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1520 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:08.533082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:08.533879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:08.547963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.550249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:08.551296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.552556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:08.609240 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] HTTP exception thrown: Action 999 not found May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Request method failure captured: May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599/os-instance-actions/999 HTTP/1.1 May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5XDL6V14_oGKzo0coyBj4zgul5rtEknyZEbUpGwgghPklr1rPkSmWoJGzuGnS8tHpeUIle1jsDXOI154kKJA6T3A7hWu9l6hYYkenDSakjQWX1lcOnhGLlA0jqWp9a9UbJzPDpkSsmTSEcUq4gXoQCjhkr3-yQ58E01wz4ZKkOYyw May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 689bc5cf419440f683a6ab4fd29dc06e May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_689bc5cf419440f683a6ab4fd29dc06e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 689bc5cf419440f683a6ab4fd29dc06e May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-InstanceActionsNegativeTestJSON-2109940117-project May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1b4361b4b12041edbd523eef23f82dae May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2109940117-project May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: exception: Action 999 not found May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': '67fb6a1d-5712-41f9-8e46-5e5a76cf8599', 'id': '999'} May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 14 21:26:08.612179 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:08.618490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Returning 404 to user: Action 999 not found {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:08.620525 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4f6503f3-e5cc-4362-91ed-1ab4c7936d2f tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.091512 May 14 21:26:08.622349 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2184/4068] 10.222.0.52 () {58 vars in 1307 bytes} [Sat May 14 21:26:08 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599/os-instance-actions/999 => generated 66 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:26:08.630800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-471429bc-6464-44d6-897c-939134c74dfa tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '.version_select at 0x7fb1a767d310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:08.634310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-471429bc-6464-44d6-897c-939134c74dfa tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 79482762-c9bf-499f-a931-f93c79214c4e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:08.638913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-471429bc-6464-44d6-897c-939134c74dfa tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] HTTP exception thrown: Instance 79482762-c9bf-499f-a931-f93c79214c4e could not be found. May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-471429bc-6464-44d6-897c-939134c74dfa tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Request method failure captured: May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/79482762-c9bf-499f-a931-f93c79214c4e/os-instance-actions HTTP/1.1 May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5XDL6V14_oGKzo0coyBj4zgul5rtEknyZEbUpGwgghPklr1rPkSmWoJGzuGnS8tHpeUIle1jsDXOI154kKJA6T3A7hWu9l6hYYkenDSakjQWX1lcOnhGLlA0jqWp9a9UbJzPDpkSsmTSEcUq4gXoQCjhkr3-yQ58E01wz4ZKkOYyw May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 689bc5cf419440f683a6ab4fd29dc06e May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_689bc5cf419440f683a6ab4fd29dc06e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 689bc5cf419440f683a6ab4fd29dc06e May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-InstanceActionsNegativeTestJSON-2109940117-project May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1b4361b4b12041edbd523eef23f82dae May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2109940117-project May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 79482762-c9bf-499f-a931-f93c79214c4e could not be found. May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'server_id': '79482762-c9bf-499f-a931-f93c79214c4e'} May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79482762-c9bf-499f-a931-f93c79214c4e could not be found. May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:08.641738 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79482762-c9bf-499f-a931-f93c79214c4e could not be found. May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79482762-c9bf-499f-a931-f93c79214c4e could not be found. May 14 21:26:08.646851 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:08.648920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-471429bc-6464-44d6-897c-939134c74dfa tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Returning 404 to user: Instance 79482762-c9bf-499f-a931-f93c79214c4e could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:08.649968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-471429bc-6464-44d6-897c-939134c74dfa tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/79482762-c9bf-499f-a931-f93c79214c4e/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.023228 May 14 21:26:08.654838 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1885/4069] 10.222.0.52 () {58 vars in 1295 bytes} [Sat May 14 21:26:08 2022] GET /compute/v2.1/servers/79482762-c9bf-499f-a931-f93c79214c4e/os-instance-actions => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:08.677980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:08.678573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:08.691929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.693882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:08.699857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.701003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:08.733294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:26:08.778881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:08.778881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:08.795105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.795618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:08.798849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:08.799354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:09.187518 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-83e77729-231a-48ee-a9cc-b5173034ade2 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "DELETE /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 204 len: 0 microversion: 2.1 time: 0.531148 May 14 21:26:09.188397 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2185/4070] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:08 2022] DELETE /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:26:09.193759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:09.194565 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:09.212315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:09.214163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:09.215038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:09.215548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:09.318004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:09.348593 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbd23962-448c-4ad0-89d8-d2c90ebac95e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.591356 May 14 21:26:09.349874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1886/4071] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:08 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:09.367799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:09.373467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:09.409204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:09.409774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:09.410820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:09.411753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:09.629781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:09.640928 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d5789c4-8bec-4e99-b4a5-37d4fad8c824 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.450897 May 14 21:26:09.641807 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2186/4072] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:09 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:09.647536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:09.649008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:09.656700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:09.657056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:09.660159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:09.660787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:09.932053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:09.940928 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d803b4d-0611-45f4-a817-250e35e0e48e tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1526 microversion: 2.1 time: 0.297863 May 14 21:26:09.941745 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2187/4073] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:09 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1526 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:09.959437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-76bdcf58-f361-403b-a7b8-1f5644bcc7fd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6e88280>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:09.984625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:09.994639 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b215e317-19fb-4bcf-8460-52afdc704b6f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.642635 May 14 21:26:09.997524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1887/4074] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:09 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:10.014449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9a7ba63d-8c3a-4388-ad43-76071da91ff3 req-7a273aa0-3e11-4fef-8399-9736bcd0ea86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "936e1550-0631-4554-ac76-155d45752fd2", "tag": "d7b1cab6-624b-468c-b548-316667b4aa2b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:10.033491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9a7ba63d-8c3a-4388-ad43-76071da91ff3 req-7a273aa0-3e11-4fef-8399-9736bcd0ea86 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:10.041163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9a7ba63d-8c3a-4388-ad43-76071da91ff3 req-7a273aa0-3e11-4fef-8399-9736bcd0ea86 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:10.057866 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9a7ba63d-8c3a-4388-ad43-76071da91ff3 req-7a273aa0-3e11-4fef-8399-9736bcd0ea86 service nova] Creating event network-changed:d7b1cab6-624b-468c-b548-316667b4aa2b for instance 936e1550-0631-4554-ac76-155d45752fd2 on nch2-master-1 May 14 21:26:10.068157 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9a7ba63d-8c3a-4388-ad43-76071da91ff3 req-7a273aa0-3e11-4fef-8399-9736bcd0ea86 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064185 May 14 21:26:10.069186 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1888/4075] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:10.368183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:10.369007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:10.378843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:10.379303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:10.392689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:10.393372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.007751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:11.022748 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5606efd-287c-4d28-bf86-9ae4d85ccaad tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.658821 May 14 21:26:11.026586 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1889/4076] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:10 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:11.036474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cac0af4d-5254-4761-bc2e-dd569ff0677b req-1b14983c-fd94-4958-a77c-9ccc6df08e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933ec720-1f55-478a-bac2-8f9e96aa692b", "tag": "b88ac6b1-d929-407f-bf99-94e2f2e3f04b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:11.053185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cac0af4d-5254-4761-bc2e-dd569ff0677b req-1b14983c-fd94-4958-a77c-9ccc6df08e98 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.054763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cac0af4d-5254-4761-bc2e-dd569ff0677b req-1b14983c-fd94-4958-a77c-9ccc6df08e98 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.074127 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cac0af4d-5254-4761-bc2e-dd569ff0677b req-1b14983c-fd94-4958-a77c-9ccc6df08e98 service nova] Creating event network-changed:b88ac6b1-d929-407f-bf99-94e2f2e3f04b for instance 933ec720-1f55-478a-bac2-8f9e96aa692b on nch2-master-1 May 14 21:26:11.089855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cac0af4d-5254-4761-bc2e-dd569ff0677b req-1b14983c-fd94-4958-a77c-9ccc6df08e98 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061753 May 14 21:26:11.095047 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1890/4077] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:11.103341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:11.109313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:11.118448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.118911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.119727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.120168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.165715 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-76bdcf58-f361-403b-a7b8-1f5644bcc7fd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 1.220510 May 14 21:26:11.167061 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2188/4078] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:09 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:11.197698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:11.198621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:11.214196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.214650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.216376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.216840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.485028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:11.493252 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a5edb5c-c9f9-4824-9f6c-63b9fdf0e7b0 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1517 microversion: 2.1 time: 0.396262 May 14 21:26:11.493747 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1891/4079] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:11 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1517 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:11.511394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:11.515581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:11.531395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.531395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.535098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.535676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.561976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:11.582941 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-36758e78-442a-457f-833f-f2f647eb34ff tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1526 microversion: 2.1 time: 0.406568 May 14 21:26:11.596702 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2189/4080] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:11 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1526 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:11.603443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ba95b4ce-9e58-473f-88b5-5d0d7d668fd5 req-c5b95f6a-72e8-4bbe-9a68-5408d6ebe3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090443ee-e680-4d1b-af54-a8c89476868e", "name": "network-vif-plugged", "status": "completed", "tag": "55bb719e-4e9c-4bcf-92d2-43a23d4716f4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:11.612315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ba95b4ce-9e58-473f-88b5-5d0d7d668fd5 req-c5b95f6a-72e8-4bbe-9a68-5408d6ebe3b6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:11.612994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ba95b4ce-9e58-473f-88b5-5d0d7d668fd5 req-c5b95f6a-72e8-4bbe-9a68-5408d6ebe3b6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:11.635875 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ba95b4ce-9e58-473f-88b5-5d0d7d668fd5 req-c5b95f6a-72e8-4bbe-9a68-5408d6ebe3b6 service nova] Creating event network-vif-plugged:55bb719e-4e9c-4bcf-92d2-43a23d4716f4 for instance 090443ee-e680-4d1b-af54-a8c89476868e on nch2-master-1 May 14 21:26:11.643298 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ba95b4ce-9e58-473f-88b5-5d0d7d668fd5 req-c5b95f6a-72e8-4bbe-9a68-5408d6ebe3b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043380 May 14 21:26:11.646149 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2190/4081] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:11.908361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:11.929871 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-69343168-7eb8-42a7-9fb6-06e02ef51ff7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.421723 May 14 21:26:11.939707 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1892/4082] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:11 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:12.041701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:12.042877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:12.055283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.058791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.059839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.061535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.181275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e348d19a-61a9-4754-bc17-0962d9cb9075 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6fc7e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:12.289605 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e348d19a-61a9-4754-bc17-0962d9cb9075 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.113959 May 14 21:26:12.291702 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1893/4083] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:12 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:12.411758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:12.417846 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fa8111a2-fa14-4666-84a8-3156812ae7aa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.381338 May 14 21:26:12.427374 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2191/4084] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:12 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:12.514945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:12.516119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:12.534270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.538621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.538621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.538621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.604438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:12.605386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:12.627261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.628119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.629225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.629687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.674716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.675112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.675604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lazy-loading 'fault' on Instance uuid 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:12.749932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:12.758764 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-68989938-e933-456e-95ed-dd8cf11200f9 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.248826 May 14 21:26:12.759360 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1894/4085] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:12 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:12.774903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b4361b4b12041edbd523eef23f82dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '689bc5cf419440f683a6ab4fd29dc06e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:12.778475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:12.779460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:12.785037 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5da4e1c7-0bb9-4c3d-b5dd-c07da0582552 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 200 len: 1315 microversion: 2.1 time: 0.186149 May 14 21:26:12.788577 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2192/4086] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:12 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:12.798365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.799206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.800231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.801309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.967111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:12.969841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:12.983358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.985360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:12.987763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:12.988962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:12.991883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.011432 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4471fb27-dbcd-4c5e-ba0b-60a771650398 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.237790 May 14 21:26:13.012604 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1895/4087] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:12 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:13.038812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:13.039814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:13.073616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.077457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.081995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.082716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.297843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:13.309616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:13.323120 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e749d3f-b800-4470-87f0-69a2ab583be0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.374327 May 14 21:26:13.324299 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2193/4088] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:12 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:13.330986 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e06ded6-8032-4c36-b4c5-b597da935d8f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.298959 May 14 21:26:13.339219 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1896/4089] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:13 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:13.343733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-197d9877-6011-4057-a061-402e9256c08c req-85adcf7d-353d-4628-9d92-77ab812885d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fb6a1d-5712-41f9-8e46-5e5a76cf8599", "name": "network-vif-deleted", "tag": "d52780c9-cd7b-4b32-9e8e-ee70a76a4c6b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:13.365479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-197d9877-6011-4057-a061-402e9256c08c req-85adcf7d-353d-4628-9d92-77ab812885d5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.368232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-197d9877-6011-4057-a061-402e9256c08c req-85adcf7d-353d-4628-9d92-77ab812885d5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.369905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5bd78f7a-1a0c-435c-8082-a5e7ac88bda7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b97320d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:13.403976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-197d9877-6011-4057-a061-402e9256c08c req-85adcf7d-353d-4628-9d92-77ab812885d5 service nova] Creating event network-vif-deleted:d52780c9-cd7b-4b32-9e8e-ee70a76a4c6b for instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 on nch1-master-1 May 14 21:26:13.429695 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-197d9877-6011-4057-a061-402e9256c08c req-85adcf7d-353d-4628-9d92-77ab812885d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094917 May 14 21:26:13.431131 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2194/4090] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:13.449424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a8c4547-0c7e-49b3-a8ff-fff66fa8c399 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:13.453079 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5bd78f7a-1a0c-435c-8082-a5e7ac88bda7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.111393 May 14 21:26:13.455990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1897/4091] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:13 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:13.462462 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5a8c4547-0c7e-49b3-a8ff-fff66fa8c399 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance b2c8b11f-df37-4b59-a426-c0dd70cbf6d9 has no mapping to a cell. May 14 21:26:13.473549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:13.474334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a8c4547-0c7e-49b3-a8ff-fff66fa8c399 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/b2c8b11f-df37-4b59-a426-c0dd70cbf6d9/action HTTP/1.1 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 15 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: {"os-stop": {}} May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b2c8b11f-df37-4b59-a426-c0dd70cbf6d9 has no mapping to a cell. May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b2c8b11f-df37-4b59-a426-c0dd70cbf6d9', 'body': {'os-stop': {}}} May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance b2c8b11f-df37-4b59-a426-c0dd70cbf6d9 has no mapping to a cell. May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:13.477802 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c8b11f-df37-4b59-a426-c0dd70cbf6d9 has no mapping to a cell. May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c8b11f-df37-4b59-a426-c0dd70cbf6d9 has no mapping to a cell. May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:13.484035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a8c4547-0c7e-49b3-a8ff-fff66fa8c399 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance b2c8b11f-df37-4b59-a426-c0dd70cbf6d9 has no mapping to a cell. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:13.487165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.487675 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a8c4547-0c7e-49b3-a8ff-fff66fa8c399 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/b2c8b11f-df37-4b59-a426-c0dd70cbf6d9/action" status: 404 len: 117 microversion: 2.1 time: 0.043969 May 14 21:26:13.488014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.488599 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2195/4092] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:13 2022] POST /compute/v2.1/servers/b2c8b11f-df37-4b59-a426-c0dd70cbf6d9/action => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:13.490771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.492020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.509003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:13.510696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:13.526519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.527927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.529232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.530056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.703928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:13.713654 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-90eb3882-ed86-4e3a-88a5-a76a63c50983 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.255615 May 14 21:26:13.714855 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1898/4093] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:13 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:13.793192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:13.801549 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d441f8de-0a87-4fb4-a7df-0faddbc6257e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.307851 May 14 21:26:13.802402 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2196/4094] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:13 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:13.804044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:13.805045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] [instance: 67fb6a1d-5712-41f9-8e46-5e5a76cf8599] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:13.815980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.816711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.817743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.818453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.819114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:13.819966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:13.827178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.828784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.828784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:13.828984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:13.839610 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] HTTP exception thrown: Instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 could not be found. May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Request method failure captured: May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 HTTP/1.1 May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5XDL6V14_oGKzo0coyBj4zgul5rtEknyZEbUpGwgghPklr1rPkSmWoJGzuGnS8tHpeUIle1jsDXOI154kKJA6T3A7hWu9l6hYYkenDSakjQWX1lcOnhGLlA0jqWp9a9UbJzPDpkSsmTSEcUq4gXoQCjhkr3-yQ58E01wz4ZKkOYyw May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 689bc5cf419440f683a6ab4fd29dc06e May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/689bc5cf419440f683a6ab4fd29dc06e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_689bc5cf419440f683a6ab4fd29dc06e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 689bc5cf419440f683a6ab4fd29dc06e May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2109940117 May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-InstanceActionsNegativeTestJSON-2109940117-project May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1b4361b4b12041edbd523eef23f82dae May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2109940117-project May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 could not be found. May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '67fb6a1d-5712-41f9-8e46-5e5a76cf8599'} May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 could not be found. May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 could not be found. May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:13.841736 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 could not be found. May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] Returning 404 to user: Instance 67fb6a1d-5712-41f9-8e46-5e5a76cf8599 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d86cd7a3-8db1-40d1-8123-e0a5a091e668 tempest-InstanceActionsNegativeTestJSON-2109940117 tempest-InstanceActionsNegativeTestJSON-2109940117-project] 10.222.0.52 "GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599" status: 404 len: 111 microversion: 2.1 time: 0.044880 May 14 21:26:13.845799 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1899/4095] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:13 2022] GET /compute/v2.1/servers/67fb6a1d-5712-41f9-8e46-5e5a76cf8599 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:26:14.341266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:14.341951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:14.349515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:14.349997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:14.363009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:14.363595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:14.657784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:14.666497 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d76038e8-3e2d-4742-92c0-cc06c23b5680 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.329069 May 14 21:26:14.678105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1900/4096] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:14 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:14.683666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31299fec-e1fd-430a-b63b-120482e0a1d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b9780c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:14.765151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:14.780054 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31299fec-e1fd-430a-b63b-120482e0a1d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.100335 May 14 21:26:14.780871 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1901/4097] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:14 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:14.782065 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4926d426-40ef-4d89-bb4e-14ab3314f885 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.964960 May 14 21:26:14.783097 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2197/4098] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:13 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:14.785823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:14.786763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:14.794471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:14.795222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:14.796489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:14.797104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:14.804458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02a7cfd9-24cc-4edd-abd4-51d84f4f059c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:14.805166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02a7cfd9-24cc-4edd-abd4-51d84f4f059c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: ee18472d-c5b5-4df0-828b-93d2dc4bbedc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:14.812803 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-02a7cfd9-24cc-4edd-abd4-51d84f4f059c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance ee18472d-c5b5-4df0-828b-93d2dc4bbedc could not be found. May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02a7cfd9-24cc-4edd-abd4-51d84f4f059c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/ee18472d-c5b5-4df0-828b-93d2dc4bbedc/action HTTP/1.1 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 15 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: {"suspend": {}} May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ee18472d-c5b5-4df0-828b-93d2dc4bbedc could not be found. May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ee18472d-c5b5-4df0-828b-93d2dc4bbedc', 'body': {'suspend': {}}} May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee18472d-c5b5-4df0-828b-93d2dc4bbedc could not be found. May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee18472d-c5b5-4df0-828b-93d2dc4bbedc could not be found. May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:14.816311 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:14.821518 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:14.821518 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:14.821518 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee18472d-c5b5-4df0-828b-93d2dc4bbedc could not be found. May 14 21:26:14.821518 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:14.823529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02a7cfd9-24cc-4edd-abd4-51d84f4f059c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance ee18472d-c5b5-4df0-828b-93d2dc4bbedc could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:14.825836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02a7cfd9-24cc-4edd-abd4-51d84f4f059c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/ee18472d-c5b5-4df0-828b-93d2dc4bbedc/action" status: 404 len: 111 microversion: 2.1 time: 0.026320 May 14 21:26:14.829766 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2198/4099] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:14 2022] POST /compute/v2.1/servers/ee18472d-c5b5-4df0-828b-93d2dc4bbedc/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:14.859359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:14.861185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:14.897915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:14.898421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:14.899278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:14.899753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:15.055046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:15.063453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e7c4de1-dada-42d6-98ea-116ff0e18691 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.281410 May 14 21:26:15.070330 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1902/4100] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:14 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:15.249751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:15.260747 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1e12720-76b7-494b-8979-35033bcb7ce4 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.418822 May 14 21:26:15.261959 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2199/4101] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:14 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:15.283305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:15.283305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:15.293510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:15.294324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:15.295535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:15.296091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:15.693084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:15.693849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:15.701353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:15.705609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:15.706541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:15.707205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:15.823397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:15.856671 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27cc067f-bd10-4b58-b590-e2036f2ea226 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.576959 May 14 21:26:15.865583 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1903/4102] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:15 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:15.887368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbd9a933-5763-4c81-a2b8-4c458c01842c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b96e5d30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:16.014948 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbd9a933-5763-4c81-a2b8-4c458c01842c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.147021 May 14 21:26:16.018103 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1904/4103] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:15 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:16.025069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:16.025948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:16.046687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.047418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.048422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.049050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.101266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:16.112018 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-afbe8174-8b8a-4bb2-ae17-4ec64e92b7b0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.422716 May 14 21:26:16.116074 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2200/4104] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:15 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:16.127131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:16.128061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:16.128973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lazy-loading 'flavor' on Instance uuid d052efd6-ef23-4eec-b96a-78cd75a193b1 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:16.137882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.138607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.139641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.145968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.483062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:16.491855 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-76d0de61-aa2a-4cc1-a775-ab55f2867cef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.376665 May 14 21:26:16.492882 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2201/4105] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:16 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:16.502125 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-15303fe6-bfa1-4e0f-97b0-54807ec2b212 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 202 len: 0 microversion: 2.1 time: 0.476160 May 14 21:26:16.502125 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1905/4106] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:16 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:26:16.511824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:16.512562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:16.525698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.526161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.526961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.528649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.718941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7f553d1a-fe6a-49f4-b2ea-acb2f883b1b8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:16.721156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7f553d1a-fe6a-49f4-b2ea-acb2f883b1b8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:16.746430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f553d1a-fe6a-49f4-b2ea-acb2f883b1b8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.747668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f553d1a-fe6a-49f4-b2ea-acb2f883b1b8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.749302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f553d1a-fe6a-49f4-b2ea-acb2f883b1b8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.750317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f553d1a-fe6a-49f4-b2ea-acb2f883b1b8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.836661 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7f553d1a-fe6a-49f4-b2ea-acb2f883b1b8 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "POST /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c/action" status: 200 len: 24566 microversion: 2.1 time: 0.123737 May 14 21:26:16.838332 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2202/4107] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:16 2022] POST /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c/action => generated 24566 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:26:16.856703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:16.859085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:16.879696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:16.881044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.882363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.884722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:16.885380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:16.894248 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-696b848b-61b9-4d78-8417-db817fc725c5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1512 microversion: 2.1 time: 0.392215 May 14 21:26:16.897474 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1906/4108] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:16 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:16.959777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:26:17.033679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-63d07e23-86a9-4219-8262-e09abd568654 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b97801f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:17.173233 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-63d07e23-86a9-4219-8262-e09abd568654 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.144503 May 14 21:26:17.179561 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1907/4109] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:17 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:17.188294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:17.191127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:17.206750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.207231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.208180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.208633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.429580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:17.448701 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-300d4e3f-7988-4da0-ac49-5f1bd01f95c8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.273212 May 14 21:26:17.469737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1908/4110] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:17 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:17.512874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:17.514030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:17.527012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.530990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.532981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.534317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.571000 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7210e662-f1d3-4a60-9dbf-e0429b3890bf tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 204 len: 0 microversion: 2.1 time: 0.722061 May 14 21:26:17.572441 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2203/4111] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:16 2022] DELETE /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:26:17.581085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:17.582964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:17.593726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.594207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.603415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.603415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.919056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:17.929685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d6ede74-1995-418a-b882-e670fe6dd34f tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1608 microversion: 2.1 time: 0.352664 May 14 21:26:17.941476 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2204/4112] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:17 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1608 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:17.959057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:17.960456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:17.969475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:17.976151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.979971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.981179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:17.981889 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-115a9527-5aaa-4cdd-a3a1-9e3bd34bccc9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.475440 May 14 21:26:17.982367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:17.993499 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1909/4113] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:17 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:18.188001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-62b0d1a0-b65b-4374-8e0a-f50d303467bb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1b97801f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:18.298830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:18.308522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-62b0d1a0-b65b-4374-8e0a-f50d303467bb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.123728 May 14 21:26:18.309164 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1910/4114] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:18 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:18.310215 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e924b7fc-5f70-4aa8-b6a2-7ce2999caa78 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1495 microversion: 2.1 time: 0.365532 May 14 21:26:18.313193 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2205/4115] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:17 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1495 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:18.337303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:18.337860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:18.354312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.354777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.360950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.361562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.425574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lazy-loading 'flavor' on Instance uuid d052efd6-ef23-4eec-b96a-78cd75a193b1 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:18.448887 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Cannot 'suspend' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state suspended May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action HTTP/1.1 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 15 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: {"suspend": {}} May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'suspend' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state suspended May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'suspend': {}}} May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 in vm_state suspended. Cannot suspend while the instance is in this state. May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 14 21:26:18.450921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state suspended May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state suspended May 14 21:26:18.455804 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:18.457605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 409 to user: Cannot 'suspend' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state suspended {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:18.458646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-660284fa-0efb-4bdc-9d22-cefa6cae7385 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 409 len: 148 microversion: 2.1 time: 0.131969 May 14 21:26:18.460207 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1911/4116] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:18 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 148 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:26:18.467589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:18.471233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:18.479648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.480348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.485509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.486184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.492563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-af0f0e7c-60db-47a9-9327-f3efa90f2b35 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:18.493553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-af0f0e7c-60db-47a9-9327-f3efa90f2b35 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:18.507810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af0f0e7c-60db-47a9-9327-f3efa90f2b35 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.508590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af0f0e7c-60db-47a9-9327-f3efa90f2b35 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.509591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af0f0e7c-60db-47a9-9327-f3efa90f2b35 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.512273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af0f0e7c-60db-47a9-9327-f3efa90f2b35 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.799380 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-af0f0e7c-60db-47a9-9327-f3efa90f2b35 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 202 len: 0 microversion: 2.1 time: 0.323308 May 14 21:26:18.809970 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1912/4117] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:18 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:26:18.811312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:18.813586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:18.839571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.842299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.845577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.848871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.882553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:18.894333 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15ee494e-e75e-4dd0-98cf-2d462c180a7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.431535 May 14 21:26:18.897449 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2206/4118] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:18 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:18.972748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:18.973635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:18.985754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.986721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:18.988448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:18.990289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:19.274133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:19.294195 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6e7b830-100a-4642-bad5-ace03feb6a64 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1608 microversion: 2.1 time: 0.321328 May 14 21:26:19.295378 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2207/4119] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:18 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1608 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:19.306053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:19.307885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:19.323586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:19.324475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:19.326644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:19.328011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:19.655124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:19.666475 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8bd52327-1033-471d-9602-d41e5b109c07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.369756 May 14 21:26:19.667522 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2208/4120] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:19 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:19.674511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3b51aa9-6e30-46cb-b424-bd729845aa68 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6ebac10>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:19.695713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:19.710946 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afe6bb8e-c005-45b7-8449-1fefa58a4a97 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1501 microversion: 2.1 time: 0.904534 May 14 21:26:19.715297 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1913/4121] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:18 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1501 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:19.761483 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3b51aa9-6e30-46cb-b424-bd729845aa68 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.092678 May 14 21:26:19.762149 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2209/4122] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:19 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:19.909113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-36b7fd72-cb1c-46f5-a66c-bfe3ee0bbef1 req-fe040857-0c6a-4ffb-a007-c78866f6439c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936e1550-0631-4554-ac76-155d45752fd2", "name": "network-vif-plugged", "status": "completed", "tag": "d7b1cab6-624b-468c-b548-316667b4aa2b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:19.918316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:19.919679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:19.924366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-36b7fd72-cb1c-46f5-a66c-bfe3ee0bbef1 req-fe040857-0c6a-4ffb-a007-c78866f6439c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:19.924829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-36b7fd72-cb1c-46f5-a66c-bfe3ee0bbef1 req-fe040857-0c6a-4ffb-a007-c78866f6439c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:19.930401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:19.933662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:19.938122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:19.939201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:19.963855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-36b7fd72-cb1c-46f5-a66c-bfe3ee0bbef1 req-fe040857-0c6a-4ffb-a007-c78866f6439c service nova] Creating event network-vif-plugged:d7b1cab6-624b-468c-b548-316667b4aa2b for instance 936e1550-0631-4554-ac76-155d45752fd2 on nch2-master-1 May 14 21:26:19.969877 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-36b7fd72-cb1c-46f5-a66c-bfe3ee0bbef1 req-fe040857-0c6a-4ffb-a007-c78866f6439c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065355 May 14 21:26:19.971004 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1914/4123] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:20.304240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:20.320274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:20.321332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:20.327102 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-79d80d11-a7c3-4933-a59f-1fffda296228 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.416771 May 14 21:26:20.334378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:20.334841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:20.335672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:20.336125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:20.339165 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2210/4124] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:19 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:20.693097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:20.694515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:20.704203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:20.710319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:20.715419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:20.715702 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ee1a0c5d-e515-4c97-b74c-d25e3eb74551 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1608 microversion: 2.1 time: 0.399035 May 14 21:26:20.715816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:20.717447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1915/4125] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:20 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1608 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:20.725096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:20.736406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:20.737333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:20.746629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:20.747446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:20.748541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:20.750891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:20.977947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:20.977947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d743fe0-84f5-43d1-83ed-9681f0274e67 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.259254 May 14 21:26:20.977947 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2211/4126] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:20 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:20.977947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-645584ad-c9ea-48f3-893a-55232de328ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6e60f70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:21.004658 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-645584ad-c9ea-48f3-893a-55232de328ec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.054540 May 14 21:26:21.005523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2212/4127] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:20 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:21.016540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:21.027903 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-41ecd6d3-6191-4fe3-9af9-c6cde36115cf tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1501 microversion: 2.1 time: 0.299236 May 14 21:26:21.028794 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1916/4128] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:20 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1501 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:21.277025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-48cd785f-dcf6-4d7b-ae60-1cb63941ac72 req-364a2238-cc08-41cc-abf8-82f906797c91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbed9277-7da0-4bf4-b27f-c647a23dcb2c", "name": "network-vif-deleted", "tag": "aa620ac9-bfdf-4a61-ae23-4f9baea1b233"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:21.290066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-48cd785f-dcf6-4d7b-ae60-1cb63941ac72 req-364a2238-cc08-41cc-abf8-82f906797c91 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:21.291174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-48cd785f-dcf6-4d7b-ae60-1cb63941ac72 req-364a2238-cc08-41cc-abf8-82f906797c91 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:21.305287 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-48cd785f-dcf6-4d7b-ae60-1cb63941ac72 req-364a2238-cc08-41cc-abf8-82f906797c91 service nova] Creating event network-vif-deleted:aa620ac9-bfdf-4a61-ae23-4f9baea1b233 for instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c on nch1-master-1 May 14 21:26:21.348731 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-48cd785f-dcf6-4d7b-ae60-1cb63941ac72 req-364a2238-cc08-41cc-abf8-82f906797c91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083348 May 14 21:26:21.349248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:21.349915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:21.351820 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2213/4129] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:21.378885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:21.379360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:21.380241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:21.380860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:21.733388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:21.734489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:21.746300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:21.747578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:21.752581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:21.753462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:21.761003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:21.769479 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a007975-debc-448b-8ab0-2fae0406844e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1292 microversion: 2.1 time: 0.424427 May 14 21:26:21.795085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1917/4130] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:21 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1292 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:21.953213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:21.966534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:21.966889 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8309a34f-6cd2-4742-ac53-af9d3b3444ce tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1252 microversion: 2.1 time: 0.235507 May 14 21:26:21.967392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:21.967879 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2214/4131] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:21 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1252 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:21.974466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:21.991069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:21.992255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:21.992703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:21.994171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-32429d77-5307-4f73-b6be-c18734c7fe95 req-cf3a96c3-19f1-46fb-a4f6-88c74ff23b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933ec720-1f55-478a-bac2-8f9e96aa692b", "name": "network-vif-plugged", "status": "completed", "tag": "b88ac6b1-d929-407f-bf99-94e2f2e3f04b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:22.008029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-32429d77-5307-4f73-b6be-c18734c7fe95 req-cf3a96c3-19f1-46fb-a4f6-88c74ff23b4c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.008784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-32429d77-5307-4f73-b6be-c18734c7fe95 req-cf3a96c3-19f1-46fb-a4f6-88c74ff23b4c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.030349 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-32429d77-5307-4f73-b6be-c18734c7fe95 req-cf3a96c3-19f1-46fb-a4f6-88c74ff23b4c service nova] Creating event network-vif-plugged:b88ac6b1-d929-407f-bf99-94e2f2e3f04b for instance 933ec720-1f55-478a-bac2-8f9e96aa692b on nch2-master-1 May 14 21:26:22.043641 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-32429d77-5307-4f73-b6be-c18734c7fe95 req-cf3a96c3-19f1-46fb-a4f6-88c74ff23b4c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050510 May 14 21:26:22.046162 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2215/4132] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:26:22.054704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f7833fc3-69bf-42b2-b1d4-0f9b1d4691e7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6ed64c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:22.147620 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f7833fc3-69bf-42b2-b1d4-0f9b1d4691e7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.099061 May 14 21:26:22.160635 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2216/4133] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:22 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:22.166786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:22.168623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:22.174825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.175614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.176592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.177255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.334653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:22.348000 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-66310585-677e-4188-b038-ceabccb654d3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.385821 May 14 21:26:22.361760 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1918/4134] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:21 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:22.480179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:22.488524 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d0f11fe-e4ab-4cd3-a829-db3fff62dcaa tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.326622 May 14 21:26:22.489257 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2217/4135] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:22 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:22.511834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:22.511834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:22.528742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.535272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.535272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.535272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.804904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:22.805743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:22.817591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.817761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:22.819119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.820563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.823251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.846853 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-67fab284-f556-4dfd-b0e3-a880b07f4af5 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.342497 May 14 21:26:22.848600 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1919/4136] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:22 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:22.865194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d668734f-0f8a-45c7-987d-2b2de9680ed2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:22.867029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d668734f-0f8a-45c7-987d-2b2de9680ed2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 65b50576-92e2-4a2d-9575-8f25e651c21b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:22.879379 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d668734f-0f8a-45c7-987d-2b2de9680ed2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 65b50576-92e2-4a2d-9575-8f25e651c21b could not be found. May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d668734f-0f8a-45c7-987d-2b2de9680ed2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/65b50576-92e2-4a2d-9575-8f25e651c21b/action HTTP/1.1 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 15 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: {"unpause": {}} May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 65b50576-92e2-4a2d-9575-8f25e651c21b could not be found. May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '65b50576-92e2-4a2d-9575-8f25e651c21b', 'body': {'unpause': {}}} May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65b50576-92e2-4a2d-9575-8f25e651c21b could not be found. May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65b50576-92e2-4a2d-9575-8f25e651c21b could not be found. May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:22.882308 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:22.887441 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:22.887441 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:22.887441 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65b50576-92e2-4a2d-9575-8f25e651c21b could not be found. May 14 21:26:22.887441 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:22.889322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d668734f-0f8a-45c7-987d-2b2de9680ed2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 65b50576-92e2-4a2d-9575-8f25e651c21b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:22.890463 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d668734f-0f8a-45c7-987d-2b2de9680ed2 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/65b50576-92e2-4a2d-9575-8f25e651c21b/action" status: 404 len: 111 microversion: 2.1 time: 0.030261 May 14 21:26:22.891663 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1920/4137] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:22 2022] POST /compute/v2.1/servers/65b50576-92e2-4a2d-9575-8f25e651c21b/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:26:22.905031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:22.905916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:22.925923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.926736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:22.928614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:22.929508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.183029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:23.199413 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2bf4572d-842c-4328-96f2-7b5eec75fa6a tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.303221 May 14 21:26:23.200845 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1921/4138] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:22 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:23.206314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:23.207837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:23.216600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.217856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.218946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.219647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.281484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:23.290263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.291105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.292014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lazy-loading 'fault' on Instance uuid cbed9277-7da0-4bf4-b27f-c647a23dcb2c {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:23.294824 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6549e6b3-f44f-47fd-aed3-b24210c0b8b5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1472 microversion: 2.1 time: 0.494379 May 14 21:26:23.299587 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2218/4139] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:22 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1472 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:23.316274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c496a246-c9f7-4ea6-953b-4a01dcfc7f59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a771ff70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:23.392280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e87a5a5713748b6a0d73984a279009b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef1f3155d52e42bb9c54f43a8360a74e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:23.400861 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7ab6ede-5333-49c5-84c1-0d92629db8b6 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 200 len: 1211 microversion: 2.1 time: 0.198564 May 14 21:26:23.406668 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1922/4140] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:23 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:23.409215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:23.409949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:23.411082 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c496a246-c9f7-4ea6-953b-4a01dcfc7f59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.108460 May 14 21:26:23.418031 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2219/4141] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:23 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:23.422365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.422837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.423694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.424215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:23.425541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.426037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:23.439398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.446401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.447695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.448359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.654208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:23.668880 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e01e91f5-b190-43ee-b1eb-905828fb0d56 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.264180 May 14 21:26:23.680518 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1923/4142] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:23 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:23.680518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-236488127", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:23.806416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:26:23.925649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:23.957531 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-18881aec-5618-4d16-8d7b-0a9cfd8bde87 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1367 microversion: 2.1 time: 0.535726 May 14 21:26:23.962453 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2220/4143] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:23 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1367 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:23.968061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:23.979986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:23.988406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.989159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:23.990436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:23.993705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.033274 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Cannot 'unpause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action HTTP/1.1 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 15 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: {"unpause": {}} May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: exception: Cannot 'unpause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'unpause': {}}} May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 in vm_state active. Cannot unpause while the instance is in this state. May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.035175 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:24.039288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:24.039288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:24.039288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:24.039288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:24.039288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.039288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 409 to user: Cannot 'unpause' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:24.039288 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4289834a-e214-43f2-b577-91e5be62c6bc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 409 len: 145 microversion: 2.1 time: 0.072523 May 14 21:26:24.040751 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2221/4144] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:23 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 145 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:26:24.045636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:24.046266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:24.061927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.062397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.065739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.065739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.289219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:24.301253 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3bb5099c-6d7d-45a5-a597-ae7574a84bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.259447 May 14 21:26:24.301763 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2222/4145] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:24 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:24.323146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:24.324151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:24.333212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.335127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.337540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.338229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.391292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:26:24.392435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:26:24.393123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:26:24.393728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:26:24.394361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:26:24.406275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.406963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.407955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.408582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.432533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:26:24.438413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:26:24.453236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:26:24.455826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: ab45b1e6-4517-4aea-a4f5-7f29b059ff65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:26:24.585067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:24.593546 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0786933-fdc4-4f60-a6bd-5e890153cded tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.274424 May 14 21:26:24.595136 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2223/4146] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:24 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:24.601790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:24.602714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] [instance: cbed9277-7da0-4bf4-b27f-c647a23dcb2c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:24.622445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.622918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.623790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:24.624236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:24.633923 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-35fd8ee6-6cd5-42fc-b71a-2584c544b0d9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962603 May 14 21:26:24.642356 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] HTTP exception thrown: Instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c could not be found. May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Request method failure captured: May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c HTTP/1.1 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigBxXKVWEK5IH0eCQnAXGLhqMpcJNMhzNd9LPN4joWj5BhnKS9P2RwZ8AxJPXh9KpOT_E2LDnEYpj7G_-T3qbO_nwGR5Xh8OvM-_M22s2ooxYYG9LtROkgfu_18PZOGSA-fFniX6_12LV1NOHcmr1ueoiblFkgPm8NBFWPz6J22a8ce4 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: ef1f3155d52e42bb9c54f43a8360a74e May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestBootFromVolume-823166955 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef1f3155d52e42bb9c54f43a8360a74e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ef1f3155d52e42bb9c54f43a8360a74e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ef1f3155d52e42bb9c54f43a8360a74e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ef1f3155d52e42bb9c54f43a8360a74e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestBootFromVolume-823166955 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: ef1f3155d52e42bb9c54f43a8360a74e May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestBootFromVolume-823166955 May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestBootFromVolume-823166955-project May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 4e87a5a5713748b6a0d73984a279009b May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestBootFromVolume-823166955-project May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c could not be found. May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'cbed9277-7da0-4bf4-b27f-c647a23dcb2c'} May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c could not be found. May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c could not be found. May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:24.645373 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.651167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.651167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:24.651167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:24.651167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:24.651167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:24.651167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c could not be found. May 14 21:26:24.651167 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.662696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Returning 404 to user: Instance cbed9277-7da0-4bf4-b27f-c647a23dcb2c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:24.662696 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-78162e4f-43d6-4704-b061-7c7a72d075f2 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c" status: 404 len: 111 microversion: 2.1 time: 0.062407 May 14 21:26:24.662696 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2224/4148] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:24 2022] GET /compute/v2.1/servers/cbed9277-7da0-4bf4-b27f-c647a23dcb2c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:24.663627 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1924/4147] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:26:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:26:24.667086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e2dae4dd-6b42-45ac-b70c-ebea6cbb3739 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6ed64c0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:24.743813 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e2dae4dd-6b42-45ac-b70c-ebea6cbb3739 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.082972 May 14 21:26:24.744377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2225/4149] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:24 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:24.753559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0aca86da-e73e-408a-99f8-e302dde5d9ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:24.754149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0aca86da-e73e-408a-99f8-e302dde5d9ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 68e7a52c-01c1-4e43-a1a9-5ee37fbac26d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:24.761747 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0aca86da-e73e-408a-99f8-e302dde5d9ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 68e7a52c-01c1-4e43-a1a9-5ee37fbac26d could not be found. May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0aca86da-e73e-408a-99f8-e302dde5d9ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/68e7a52c-01c1-4e43-a1a9-5ee37fbac26d/action HTTP/1.1 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 18 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: {"unshelve": null} May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 68e7a52c-01c1-4e43-a1a9-5ee37fbac26d could not be found. May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '68e7a52c-01c1-4e43-a1a9-5ee37fbac26d', 'body': {'unshelve': None}} May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e7a52c-01c1-4e43-a1a9-5ee37fbac26d could not be found. May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e7a52c-01c1-4e43-a1a9-5ee37fbac26d could not be found. May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:24.764270 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e7a52c-01c1-4e43-a1a9-5ee37fbac26d could not be found. May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0aca86da-e73e-408a-99f8-e302dde5d9ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 68e7a52c-01c1-4e43-a1a9-5ee37fbac26d could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0aca86da-e73e-408a-99f8-e302dde5d9ee tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/68e7a52c-01c1-4e43-a1a9-5ee37fbac26d/action" status: 404 len: 111 microversion: 2.1 time: 0.022306 May 14 21:26:24.774360 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2226/4150] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:24 2022] POST /compute/v2.1/servers/68e7a52c-01c1-4e43-a1a9-5ee37fbac26d/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:24.783189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c57e20d5-281a-46ee-9b81-f5a083000f38 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:24.784224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c57e20d5-281a-46ee-9b81-f5a083000f38 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: ab45b1e6-4517-4aea-a4f5-7f29b059ff65] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:24.811958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c57e20d5-281a-46ee-9b81-f5a083000f38 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: ab45b1e6-4517-4aea-a4f5-7f29b059ff65] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:26:25.011708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2034821009", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "1a97ccfe-3a73-4c17-845b-afa87d725b25"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:25.106531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] validate_networks() for [('1a97ccfe-3a73-4c17-845b-afa87d725b25', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:26:25.118661 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c57e20d5-281a-46ee-9b81-f5a083000f38 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65" status: 204 len: 0 microversion: 2.1 time: 0.347136 May 14 21:26:25.120115 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2227/4151] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:24 2022] DELETE /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:26:25.126788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d80a680-ebe2-4852-ab4d-8b33d39735b4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] Calling method '.version_select at 0x7fb1a6e40430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:25.212739 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d80a680-ebe2-4852-ab4d-8b33d39735b4 tempest-ServersTestBootFromVolume-823166955 tempest-ServersTestBootFromVolume-823166955-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727142335" status: 202 len: 0 microversion: 2.1 time: 0.091350 May 14 21:26:25.213603 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2228/4152] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:26:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727142335 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:26:25.222800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:25.223697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:25.244191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:25.245827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:25.248050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:25.249555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:25.490070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:25.501722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fbee5cd6-8eba-41d4-a663-ea67faf42c32 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.282593 May 14 21:26:25.503333 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2229/4153] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:25 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:25.509879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:25.510746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:25.517880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:25.519279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:25.520285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:25.520946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:25.742220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:25.751856 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd3bc118-e58a-4cd4-b239-380e2e4a6dcc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1557 microversion: 2.1 time: 0.246311 May 14 21:26:25.776842 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2230/4154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:25 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1557 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:25.782152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1525366d-b741-4005-a79e-749d9536d5b8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:25.783186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1525366d-b741-4005-a79e-749d9536d5b8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: ab45b1e6-4517-4aea-a4f5-7f29b059ff65] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:25.796056 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1525366d-b741-4005-a79e-749d9536d5b8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1525366d-b741-4005-a79e-749d9536d5b8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65 HTTP/1.1 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ab45b1e6-4517-4aea-a4f5-7f29b059ff65'} May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:25.798819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:25.804979 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:25.804979 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:25.804979 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:26:25.804979 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:25.807217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1525366d-b741-4005-a79e-749d9536d5b8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:25.809433 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1525366d-b741-4005-a79e-749d9536d5b8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65" status: 404 len: 111 microversion: 2.1 time: 0.031124 May 14 21:26:25.811247 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2231/4155] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:25 2022] GET /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:25.817880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:25.820241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:25.833505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:25.835560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:25.836703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:25.837571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.125971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:26.140667 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c54da11f-5fbb-4c64-8d42-6ff1217f8283 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.328014 May 14 21:26:26.141211 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2232/4156] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:25 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:26.169145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a22ec1b0-9dde-4295-b912-c5dc7df17b87 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6e60af0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:26.211335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:26:26.211831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:26:26.212274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:26:26.213290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:26:26.213290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:26:26.229861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.230349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.231184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.231673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.233734 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a22ec1b0-9dde-4295-b912-c5dc7df17b87 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.074692 May 14 21:26:26.234642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2233/4157] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:26 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:26.246849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-924d7e89-097f-4345-8464-d46974e32e90 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:26.248824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-924d7e89-097f-4345-8464-d46974e32e90 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:26.262158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Getting quotas for project ec5b6c73e5f14deca3371f8735b60f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:26:26.265349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-924d7e89-097f-4345-8464-d46974e32e90 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.267680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-924d7e89-097f-4345-8464-d46974e32e90 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.268364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Getting quotas for user b487bf2669c946b9935d9afb5d8e266a and project ec5b6c73e5f14deca3371f8735b60f5f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:26:26.268557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-924d7e89-097f-4345-8464-d46974e32e90 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.268968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-924d7e89-097f-4345-8464-d46974e32e90 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.282524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:26:26.285887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:26:26.384188 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-924d7e89-097f-4345-8464-d46974e32e90 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147657 May 14 21:26:26.385651 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2234/4158] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:26:26 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:26.391411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1058742296", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "8da851bf-8623-41cd-8e7e-e11152a2fef0"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:26.467076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:26:26.499906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-643e43ac-9e28-4fa8-bfde-e45a0dd83f5d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.838133 May 14 21:26:26.506864 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1925/4159] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:26:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:26:26.512659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:26.513710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:26.522276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.522966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.524309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.524953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.580355 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Cannot 'unshelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action HTTP/1.1 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 18 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: {"unshelve": null} May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'unshelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'unshelve': None}} May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 in vm_state active. Cannot unshelve while the instance is in this state. May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:26.587846 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active May 14 21:26:26.592381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:26.594402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 409 to user: Cannot 'unshelve' instance d052efd6-ef23-4eec-b96a-78cd75a193b1 while it is in vm_state active {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:26.595506 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ce38f4d-2492-4715-9cfd-0a9131cb989b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action" status: 409 len: 146 microversion: 2.1 time: 0.087267 May 14 21:26:26.599072 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1926/4160] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:26 2022] POST /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1/action => generated 146 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:26:26.612994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b185739e-7202-4a83-8df4-bda3dba1f7d4 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:26.615066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b185739e-7202-4a83-8df4-bda3dba1f7d4 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:26.946881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b185739e-7202-4a83-8df4-bda3dba1f7d4 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:26.963113 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b185739e-7202-4a83-8df4-bda3dba1f7d4 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1217 microversion: 2.1 time: 0.358112 May 14 21:26:26.963113 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1927/4161] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:26 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1217 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:26.968605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:26.969678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:26.979833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.980922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:26.990803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:26.991962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.191625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:27.201247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-91a45a6f-7beb-40de-b954-b86b8a4b089b tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.238986 May 14 21:26:27.201863 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1928/4162] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:26 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:27.328332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:27.328332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:27.328332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.328332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.328332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.328332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.330753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:26:27.338655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:26:27.353693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:26:27.357576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:26:27.377483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:27.387067 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f35bfca5-763b-443e-85ca-89fd11425dc1 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.169218 May 14 21:26:27.387957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1929/4163] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:27 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:27.393303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcb651a3-f159-4d83-9ef9-464e0639fb46 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6cf79d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:27.442095 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bcb651a3-f159-4d83-9ef9-464e0639fb46 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.048929 May 14 21:26:27.442095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1930/4164] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:27 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:27.444666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fd7d303-cfe7-4cdb-836c-0b5cbb624bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-376022196_updated"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:27.446007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9fd7d303-cfe7-4cdb-836c-0b5cbb624bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: c8195cef-ed84-4bea-8948-aaf630e77d65] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:27.453960 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9fd7d303-cfe7-4cdb-836c-0b5cbb624bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance c8195cef-ed84-4bea-8948-aaf630e77d65 could not be found. May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fd7d303-cfe7-4cdb-836c-0b5cbb624bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: request: PUT /compute/v2.1/servers/c8195cef-ed84-4bea-8948-aaf630e77d65 HTTP/1.1 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 80 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-376022196_updated"}} May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance c8195cef-ed84-4bea-8948-aaf630e77d65 could not be found. May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'c8195cef-ed84-4bea-8948-aaf630e77d65', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-376022196_updated'}}} May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8195cef-ed84-4bea-8948-aaf630e77d65 could not be found. May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 14 21:26:27.456669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8195cef-ed84-4bea-8948-aaf630e77d65 could not be found. May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8195cef-ed84-4bea-8948-aaf630e77d65 could not be found. May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fd7d303-cfe7-4cdb-836c-0b5cbb624bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance c8195cef-ed84-4bea-8948-aaf630e77d65 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9fd7d303-cfe7-4cdb-836c-0b5cbb624bef tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "PUT /compute/v2.1/servers/c8195cef-ed84-4bea-8948-aaf630e77d65" status: 404 len: 111 microversion: 2.1 time: 0.018447 May 14 21:26:27.463996 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1931/4165] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:26:27 2022] PUT /compute/v2.1/servers/c8195cef-ed84-4bea-8948-aaf630e77d65 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:27.467314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:27.468028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:27.475386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.475882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.476662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.477107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.622450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:27.635232 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c96faaa4-ba82-4fac-9a5a-33006bce1923 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.171818 May 14 21:26:27.648542 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1932/4166] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:27 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:27.660848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:27.663819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:27.683255 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8960999e-6890-4756-8404-f2f3234b0d35 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294659 May 14 21:26:27.690255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.692067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.693850 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2235/4167] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:26:27.697889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:27.698775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:27.713558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-38837996-3edf-40c0-a33a-a4f95fee0324 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:27.716649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-38837996-3edf-40c0-a33a-a4f95fee0324 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:27.982665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-38837996-3edf-40c0-a33a-a4f95fee0324 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:27.992268 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-38837996-3edf-40c0-a33a-a4f95fee0324 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1221 microversion: 2.1 time: 0.292574 May 14 21:26:27.998903 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2236/4168] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:27 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1221 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:28.025914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-40b1e348-7ce0-4900-b835-46d4975c5b71 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:28.028733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-40b1e348-7ce0-4900-b835-46d4975c5b71 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:28.186728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-40b1e348-7ce0-4900-b835-46d4975c5b71 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:28.197471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-40b1e348-7ce0-4900-b835-46d4975c5b71 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1217 microversion: 2.1 time: 0.196138 May 14 21:26:28.199788 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2237/4169] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:27 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:28.390077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:28.405874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b960e05d-0e7e-4ee5-b87c-bad357888d49 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.753962 May 14 21:26:28.416049 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1933/4170] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:27 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:28.428879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78db8719-d024-4fc7-9501-191f2ae4b208 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78db8719-d024-4fc7-9501-191f2ae4b208 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 HTTP/1.1 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 280 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:28.434597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-78db8719-d024-4fc7-9501-191f2ae4b208 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:28.440646 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-78db8719-d024-4fc7-9501-191f2ae4b208 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "PUT /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 400 len: 619 microversion: 2.1 time: 0.013221 May 14 21:26:28.447280 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2238/4171] 10.222.0.52 () {60 vars in 1256 bytes} [Sat May 14 21:26:28 2022] PUT /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:26:28.451633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:28.452551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:28.468223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d7f0bacb-eb01-4fc2-9b4e-9ed7cb981c8d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a77c1ee0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:28.469867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:28.470454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:28.471344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:28.473038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:28.584243 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d7f0bacb-eb01-4fc2-9b4e-9ed7cb981c8d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1413 microversion: 2.1 time: 0.128983 May 14 21:26:28.585301 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2239/4172] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:28 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:28.855031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:28.863318 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8210d4be-215c-4a7b-b193-8bf7216afc08 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.416023 May 14 21:26:28.863950 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1934/4173] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:28 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:28.880331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:28.880991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:28.887293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:28.887704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:28.888729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:28.889165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:29.018626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6255b7cf-d305-4ae8-adc2-e96a1528ef2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:29.019683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6255b7cf-d305-4ae8-adc2-e96a1528ef2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:29.123615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6255b7cf-d305-4ae8-adc2-e96a1528ef2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:29.131346 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6255b7cf-d305-4ae8-adc2-e96a1528ef2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1221 microversion: 2.1 time: 0.121281 May 14 21:26:29.132128 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1935/4174] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:29 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:29.202774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:29.211114 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d2556bf-b639-414b-8984-2c1c39ebd7db tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.332125 May 14 21:26:29.211114 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2240/4175] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:28 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:29.237137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:29.245748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecaf9b5c-7229-4bce-a916-2aa11a59e48e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecaf9b5c-7229-4bce-a916-2aa11a59e48e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 HTTP/1.1 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 24 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": ""}} May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute name. Value: . '' is too short May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1', 'body': {'server': {'name': ''}}} May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi '' May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:26:29.248288 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecaf9b5c-7229-4bce-a916-2aa11a59e48e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ecaf9b5c-7229-4bce-a916-2aa11a59e48e tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "PUT /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 400 len: 108 microversion: 2.1 time: 0.022747 May 14 21:26:29.252574 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2241/4176] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:26:29 2022] PUT /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:26:29.254704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:29.265195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:29.265665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:29.266466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:29.276543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:29.277475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:29.280218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:29.309791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:29.310254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:29.311046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:29.311522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:29.373654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:29.388831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-faa5f7c8-a213-4f76-a7a5-fa56358bc28f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1213 microversion: 2.1 time: 0.164303 May 14 21:26:29.398834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1936/4177] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:29 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1213 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:29.598928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-65958ac5-5d32-4749-9f42-0dccc1e52675 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6ce85e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:29.660245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:29.662157 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-65958ac5-5d32-4749-9f42-0dccc1e52675 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1422 microversion: 2.1 time: 0.067581 May 14 21:26:29.671691 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1937/4178] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:29 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1422 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:29.676438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-099f4fc7-921b-40e1-918b-46b484e86103 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1504 microversion: 2.1 time: 0.411972 May 14 21:26:29.680479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-de0b9c0f-093b-4971-9c63-bee6b8dd394d req-9e2a466d-7b65-47fd-96d0-efe2cd57b30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933ec720-1f55-478a-bac2-8f9e96aa692b", "tag": "b88ac6b1-d929-407f-bf99-94e2f2e3f04b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:29.680637 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2242/4179] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:29 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:29.689633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-de0b9c0f-093b-4971-9c63-bee6b8dd394d req-9e2a466d-7b65-47fd-96d0-efe2cd57b30e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:29.694376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efe54c2b-74dc-4c7e-959f-eaab6f6a3c85 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6e23430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:29.697751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-de0b9c0f-093b-4971-9c63-bee6b8dd394d req-9e2a466d-7b65-47fd-96d0-efe2cd57b30e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:29.714153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-de0b9c0f-093b-4971-9c63-bee6b8dd394d req-9e2a466d-7b65-47fd-96d0-efe2cd57b30e service nova] Creating event network-changed:b88ac6b1-d929-407f-bf99-94e2f2e3f04b for instance 933ec720-1f55-478a-bac2-8f9e96aa692b on nch2-master-1 May 14 21:26:29.721517 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-de0b9c0f-093b-4971-9c63-bee6b8dd394d req-9e2a466d-7b65-47fd-96d0-efe2cd57b30e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048016 May 14 21:26:29.722995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1938/4180] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:29.772999 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-efe54c2b-74dc-4c7e-959f-eaab6f6a3c85 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 200 len: 1422 microversion: 2.1 time: 0.092072 May 14 21:26:29.775825 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2243/4181] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:29 2022] GET /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 1422 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:29.788986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aee1882b-72fd-46f9-9c2e-bdac61dbd23b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a768f0d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:30.157403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:30.157403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:30.169291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:30.169738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:30.171977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:30.172398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:30.375142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:30.385415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-39d01db6-8b48-46c7-be09-6b15ec972348 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1273 microversion: 2.1 time: 0.234769 May 14 21:26:30.398413 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2244/4182] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:30 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:30.425579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:30.426399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:30.448583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:30.450901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:30.457694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:30.458174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:30.660032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:30.685756 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9901cbee-49b0-4bdf-990a-e94e0667b292 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1277 microversion: 2.1 time: 0.275109 May 14 21:26:30.700182 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2245/4183] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:30 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:31.415969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:31.416904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:31.430471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:31.430471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:31.430471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:31.430471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:31.432931 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aee1882b-72fd-46f9-9c2e-bdac61dbd23b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 204 len: 0 microversion: 2.1 time: 1.649161 May 14 21:26:31.435635 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1939/4184] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:29 2022] DELETE /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 0 bytes in 1654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:26:31.446500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:31.455937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:31.468284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:31.469200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:31.470371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:31.476854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:31.520160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:26:31.606302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:31.614333 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5efb157-2242-4482-9e97-5a2131d986be tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1279 microversion: 2.1 time: 0.203993 May 14 21:26:31.616094 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2246/4185] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:31 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1279 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:31.707851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:31.708668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:31.716459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:31.717549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:31.718729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:31.719594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:31.898158 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae5bba1e-6f29-42c3-bc8d-932153bd5d8c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 204 len: 0 microversion: 2.1 time: 0.457241 May 14 21:26:31.904071 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1940/4186] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:31 2022] DELETE /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:26:32.034355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-774035788", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "af5a4b8e-1df1-4780-a149-63d1d293e5bd"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:32.113769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] validate_networks() for [('af5a4b8e-1df1-4780-a149-63d1d293e5bd', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:26:32.164741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:32.176621 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-36cbaa5b-a2f5-427a-b824-fb70d5bd7f73 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1275 microversion: 2.1 time: 0.473674 May 14 21:26:32.186935 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2247/4187] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:31 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1275 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:32.635055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:32.636206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:32.652905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:32.653614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:32.659374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:32.660116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:32.870045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:32.879181 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f8bef86-83e1-4e8b-b63e-5249211a1893 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.249176 May 14 21:26:32.880289 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2248/4188] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:32 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:33.195761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:33.196532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:33.205518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:33.205983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:33.206781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:33.207289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:33.518503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:33.532776 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1317829b-4609-4092-aec7-add6b30e6cb3 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.335167 May 14 21:26:33.544675 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2249/4189] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:33 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:33.560334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1e47d1c3-59c2-44b9-b1e4-ab8d8c7add5b req-93eb9217-cc21-412d-b1bf-15c5b048d2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090443ee-e680-4d1b-af54-a8c89476868e", "name": "network-vif-unplugged", "status": "completed", "tag": "55bb719e-4e9c-4bcf-92d2-43a23d4716f4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:33.614221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1e47d1c3-59c2-44b9-b1e4-ab8d8c7add5b req-93eb9217-cc21-412d-b1bf-15c5b048d2e2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:33.618715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1e47d1c3-59c2-44b9-b1e4-ab8d8c7add5b req-93eb9217-cc21-412d-b1bf-15c5b048d2e2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:33.647197 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1e47d1c3-59c2-44b9-b1e4-ab8d8c7add5b req-93eb9217-cc21-412d-b1bf-15c5b048d2e2 service nova] Creating event network-vif-unplugged:55bb719e-4e9c-4bcf-92d2-43a23d4716f4 for instance 090443ee-e680-4d1b-af54-a8c89476868e on nch2-master-1 May 14 21:26:33.660657 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1e47d1c3-59c2-44b9-b1e4-ab8d8c7add5b req-93eb9217-cc21-412d-b1bf-15c5b048d2e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108602 May 14 21:26:33.663263 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2250/4190] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:33.842223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:26:33.843273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:26:33.844610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:26:33.845423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:26:33.846071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:26:33.862313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:33.862882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:33.865533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:33.867444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:33.889487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:26:33.896970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for user ed0a76be93e44fa887cb813a8879e04d and project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:26:33.897789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:33.899126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:33.905652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:33.906418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:33.907415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:33.908114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:33.912979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:26:33.915447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:26:34.053622 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-02020c35-ecc5-4db9-9e18-ef77d6346f6e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.032271 May 14 21:26:34.054478 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1941/4191] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:26:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:26:34.069794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d35af4ad-068b-4495-9b51-f72d6cb2120b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:34.070503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d35af4ad-068b-4495-9b51-f72d6cb2120b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:34.248401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d35af4ad-068b-4495-9b51-f72d6cb2120b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:34.255822 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d35af4ad-068b-4495-9b51-f72d6cb2120b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1207 microversion: 2.1 time: 0.193037 May 14 21:26:34.259854 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1942/4192] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:34 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1207 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:34.307866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:34.318509 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2bb8daf8-ac9f-4536-be22-e46b018beb3b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.424854 May 14 21:26:34.319103 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2251/4193] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:33 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:34.550669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:34.551592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:34.560961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:34.567081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:34.570229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:34.571077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:34.855608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-520ea6f2-53eb-491b-b0db-77441fe75a5d req-be39a141-e4f0-4b7c-9873-a86452600ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "090443ee-e680-4d1b-af54-a8c89476868e", "name": "network-vif-deleted", "tag": "55bb719e-4e9c-4bcf-92d2-43a23d4716f4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:34.869395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-520ea6f2-53eb-491b-b0db-77441fe75a5d req-be39a141-e4f0-4b7c-9873-a86452600ff1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:34.876294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-520ea6f2-53eb-491b-b0db-77441fe75a5d req-be39a141-e4f0-4b7c-9873-a86452600ff1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:34.893445 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-520ea6f2-53eb-491b-b0db-77441fe75a5d req-be39a141-e4f0-4b7c-9873-a86452600ff1 service nova] Creating event network-vif-deleted:55bb719e-4e9c-4bcf-92d2-43a23d4716f4 for instance 090443ee-e680-4d1b-af54-a8c89476868e on nch2-master-1 May 14 21:26:34.900250 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-520ea6f2-53eb-491b-b0db-77441fe75a5d req-be39a141-e4f0-4b7c-9873-a86452600ff1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048699 May 14 21:26:34.905845 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2252/4194] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:26:35.273879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:35.274594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:35.281621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:35.288688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:35.288688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:35.288688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:35.288688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:35.291855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2873fcc9-e803-4194-a5cf-42f48185f32e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.745260 May 14 21:26:35.296623 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1943/4195] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:34 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:35.340762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:35.341484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:35.352651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:35.353109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:35.353896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:35.354338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:35.409770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:35.429181 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d699ea1-50f8-40db-b3f2-fb1e9e715f5c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1211 microversion: 2.1 time: 0.159283 May 14 21:26:35.430593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2253/4196] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:35 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1211 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:35.999460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:36.008925 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-322e39d6-e101-4d2b-b92b-03fbc360b54b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.672423 May 14 21:26:36.010254 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1944/4197] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:35 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:36.313350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:36.313985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:36.325070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:36.325832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:36.326872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:36.332752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:36.456505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:36.460266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:36.497144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:36.498962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:36.501116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:36.503584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:36.531518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:36.549187 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fb444ff4-3f2c-46dc-87cc-9da8096d5fd1 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.238884 May 14 21:26:36.550890 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2254/4198] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:36 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:36.658920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:36.679732 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0d24cd5-a167-4ef3-b2db-cc72f7d36326 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1259 microversion: 2.1 time: 0.227027 May 14 21:26:36.694627 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1945/4199] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:36 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:37.026737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:37.027762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:37.034648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:37.035386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:37.042469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:37.045243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:37.241894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b8f286a7-0d59-40e4-8d4d-39be18f1e987 req-936fdcb1-8e24-45a3-82b3-2b41eba8108e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41bf56f-6709-4440-9000-ff973790c078", "tag": "444a8ce5-4743-43c5-a34a-1c087f0c1eb9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:37.259490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b8f286a7-0d59-40e4-8d4d-39be18f1e987 req-936fdcb1-8e24-45a3-82b3-2b41eba8108e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:37.259968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b8f286a7-0d59-40e4-8d4d-39be18f1e987 req-936fdcb1-8e24-45a3-82b3-2b41eba8108e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:37.295742 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b8f286a7-0d59-40e4-8d4d-39be18f1e987 req-936fdcb1-8e24-45a3-82b3-2b41eba8108e service nova] Creating event network-changed:444a8ce5-4743-43c5-a34a-1c087f0c1eb9 for instance c41bf56f-6709-4440-9000-ff973790c078 on nch1-master-1 May 14 21:26:37.310528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b8f286a7-0d59-40e4-8d4d-39be18f1e987 req-936fdcb1-8e24-45a3-82b3-2b41eba8108e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073814 May 14 21:26:37.311282 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1946/4200] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:26:37.567794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:37.568761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:37.580108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:37.581107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:37.582813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:37.583270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:37.875666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:37.904702 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-16defb66-221d-46b8-90e9-432740510928 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.872077 May 14 21:26:37.904702 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2255/4201] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:37 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:37.904702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:37.904702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:37.911101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:37.912209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:37.913463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:37.914089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:37.992594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:38.000657 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d69e1e01-6420-402e-933e-1d25553faa64 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1265 microversion: 2.1 time: 0.103738 May 14 21:26:38.001352 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2256/4202] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:37 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:38.106863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:38.115911 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2839f77c-eb69-4f69-867c-cdfa5ad568f7 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.552961 May 14 21:26:38.122112 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1947/4203] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:37 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:38.914480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:38.915819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:38.923091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:38.923904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:38.924939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:38.925667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:39.018909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:39.019541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:39.028867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:39.029735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:39.030704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:39.031302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:39.362458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:39.376111 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c359506b-fb5f-43f6-becb-3846216b6bbf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.465489 May 14 21:26:39.376698 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2257/4204] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:38 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:39.377996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:39.388111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:39.389080 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6904b1d7-d8e7-4dbd-81d7-911b00b68f30 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1307 microversion: 2.1 time: 0.373932 May 14 21:26:39.389195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:39.389969 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1948/4205] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:39 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1307 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:39.395250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:39.395827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:39.397289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:39.397731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:39.402833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-13bb6429-248f-4591-b796-17cc2bfa38a4 req-f277ccfc-6f83-4945-b214-c34719cbdb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4caf8900-4253-4d9b-b3bc-c45824e00b7f", "tag": "ee6b1fda-7102-4018-8f5a-8e24d000b0a8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:39.411378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-13bb6429-248f-4591-b796-17cc2bfa38a4 req-f277ccfc-6f83-4945-b214-c34719cbdb71 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:39.412717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-13bb6429-248f-4591-b796-17cc2bfa38a4 req-f277ccfc-6f83-4945-b214-c34719cbdb71 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:39.426539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-13bb6429-248f-4591-b796-17cc2bfa38a4 req-f277ccfc-6f83-4945-b214-c34719cbdb71 service nova] Creating event network-changed:ee6b1fda-7102-4018-8f5a-8e24d000b0a8 for instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f on nch1-master-1 May 14 21:26:39.433264 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-13bb6429-248f-4591-b796-17cc2bfa38a4 req-f277ccfc-6f83-4945-b214-c34719cbdb71 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041912 May 14 21:26:39.433878 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1949/4206] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:39.679153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:39.686677 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f0dc65ad-37c4-4a2b-aeaa-ff0a3eab5638 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.304446 May 14 21:26:39.687253 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2258/4207] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:39 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:40.257759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5142fb5e-d8d3-4f8a-83b9-a7385dc90ece req-24ffd3bc-1f2a-4ba0-85d5-dc8e304798bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be7b4d89-571b-4124-b5ec-918394447fda", "tag": "d7583ddb-f64e-4f06-a05b-22682e8fc3b2"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:40.259103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5142fb5e-d8d3-4f8a-83b9-a7385dc90ece req-24ffd3bc-1f2a-4ba0-85d5-dc8e304798bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:40.259595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5142fb5e-d8d3-4f8a-83b9-a7385dc90ece req-24ffd3bc-1f2a-4ba0-85d5-dc8e304798bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:40.272118 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5142fb5e-d8d3-4f8a-83b9-a7385dc90ece req-24ffd3bc-1f2a-4ba0-85d5-dc8e304798bf service nova] Creating event network-changed:d7583ddb-f64e-4f06-a05b-22682e8fc3b2 for instance be7b4d89-571b-4124-b5ec-918394447fda on nch2-master-1 May 14 21:26:40.278284 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5142fb5e-d8d3-4f8a-83b9-a7385dc90ece req-24ffd3bc-1f2a-4ba0-85d5-dc8e304798bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032535 May 14 21:26:40.279624 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1950/4208] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:40.394761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:40.396732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:40.409926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:40.410031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:40.410121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:40.410121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:40.410121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:40.410928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:40.425770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:40.426631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:40.429747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:40.430270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:40.593094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:40.602303 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a01a113-c3ff-4a19-9d06-f82e4d5da5a7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1307 microversion: 2.1 time: 0.199682 May 14 21:26:40.603180 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1951/4209] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:40 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1307 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:40.704739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:40.705472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:40.713267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:40.713829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:40.714754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:40.715222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:40.801669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:40.812886 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b440f49-4764-46df-a1a9-8121a13f99c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.422958 May 14 21:26:40.816689 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2259/4210] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:40 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:41.121470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:41.148534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-167b9073-c997-45f0-996b-0004778c6b09 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.442046 May 14 21:26:41.151085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1952/4211] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:40 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:41.620335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:41.620894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:41.628681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:41.629133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:41.634877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:41.634877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:41.830384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:41.831674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:41.844706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:41.845787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:41.853408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:41.860766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:42.139398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:42.146817 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b90c43b8-5f58-4bcb-a321-1ef8fba9dbe2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1307 microversion: 2.1 time: 0.528418 May 14 21:26:42.155763 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2260/4212] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:41 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1307 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:42.166156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:42.166772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:42.180892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:42.183060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:42.184236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:42.185009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:42.410098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:42.420064 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd5aada5-b812-4089-b8ab-2dc4e9088372 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.593551 May 14 21:26:42.428469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1953/4213] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:41 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:42.457875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:42.467465 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fe358c36-b28a-4372-9533-63629e72982e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.305166 May 14 21:26:42.468942 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2261/4214] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:42 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:43.165128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:43.165744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:43.177774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:43.178735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:43.180387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:43.181100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:43.373579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:43.395967 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7977fb37-b7dc-4ed6-8116-0f222f7318d9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1307 microversion: 2.1 time: 0.232636 May 14 21:26:43.412337 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1954/4215] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:43 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:43.438454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:43.439906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:43.453691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:43.455287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:43.456552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:43.457221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:43.495033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:43.497051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:43.510360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:43.511116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:43.515424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:43.516757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:43.755862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:43.763894 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e23d0fb5-62fd-456c-8295-6bc7612fad94 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.329333 May 14 21:26:43.764484 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2262/4216] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:43 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:43.838601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:43.848041 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-939cd687-64c4-4232-ad9b-e0b791ac200c tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.367318 May 14 21:26:43.849906 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1955/4217] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:43 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:44.412688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:44.416009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:44.422525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:44.423061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:44.424037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:44.424531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:44.657875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:44.672917 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ad983100-ac94-4cb9-9567-836f456f9cea tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1307 microversion: 2.1 time: 0.264557 May 14 21:26:44.683809 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2263/4218] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:44 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:44.781804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:44.782434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:44.790352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:44.790815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:44.791633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:44.792088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:44.866149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:44.866988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:44.873459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:44.874166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:44.875166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:44.875851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:44.998097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:45.011774 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-91977f6d-a2e5-4d4f-b70a-3be28b9ad50c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.233853 May 14 21:26:45.024754 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1956/4219] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:44 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:45.105075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:45.115444 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1cc73cbd-a05b-44bf-84b3-99cad0f9d14e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.252841 May 14 21:26:45.116528 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2264/4220] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:44 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:45.692024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:45.695506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:45.710291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:45.711793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:45.715124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:45.732616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:45.838395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-db14ee5a-6817-40d0-9696-4c810e3e19e0 req-a550d67c-179d-4ff9-9fb0-dbe664f658c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7b4d89-571b-4124-b5ec-918394447fda", "name": "network-vif-plugged", "status": "completed", "tag": "d7583ddb-f64e-4f06-a05b-22682e8fc3b2"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:45.852190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-db14ee5a-6817-40d0-9696-4c810e3e19e0 req-a550d67c-179d-4ff9-9fb0-dbe664f658c5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:45.852900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-db14ee5a-6817-40d0-9696-4c810e3e19e0 req-a550d67c-179d-4ff9-9fb0-dbe664f658c5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:45.878607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-db14ee5a-6817-40d0-9696-4c810e3e19e0 req-a550d67c-179d-4ff9-9fb0-dbe664f658c5 service nova] Creating event network-vif-plugged:d7583ddb-f64e-4f06-a05b-22682e8fc3b2 for instance be7b4d89-571b-4124-b5ec-918394447fda on nch2-master-1 May 14 21:26:45.899350 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-db14ee5a-6817-40d0-9696-4c810e3e19e0 req-a550d67c-179d-4ff9-9fb0-dbe664f658c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070820 May 14 21:26:45.900017 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2265/4221] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:46.030977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:46.031717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:46.038345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.039057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.040066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.040663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.044909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:46.058778 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2c4ba3e1-40c2-40a1-a40d-576397b41de6 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1307 microversion: 2.1 time: 0.372397 May 14 21:26:46.060121 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1957/4222] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:45 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1307 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:46.135718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:46.136570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:46.143518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.143996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.144731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.145162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.357674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:46.376785 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76d2bb2e-735c-4066-9be6-31a06df69668 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.245236 May 14 21:26:46.377399 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1958/4223] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:46 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:46.377541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:46.410899 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf57cfe0-5258-4709-aa8d-98721250bfd7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.384149 May 14 21:26:46.415014 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2266/4224] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:46 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:46.655853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:46.655853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:46.656484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.657450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.659142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.660019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.696704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c HTTP/1.1 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c'} May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:46.705063 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.710320 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:46.713395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:46.717562 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ef976ff-d665-4d08-a452-6fab1a139d40 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 404 len: 111 microversion: 2.1 time: 0.075351 May 14 21:26:46.718592 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1959/4225] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:46 2022] DELETE /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:46.742868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:46.743711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:46.774199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.789478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.790551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.791889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.812191 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c HTTP/1.1 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c'} May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:46.813869 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance 6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:46.819587 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-32c0f428-1e88-4a53-b919-941debc96d2c tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c" status: 404 len: 111 microversion: 2.1 time: 0.093494 May 14 21:26:46.827955 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2267/4226] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:46 2022] GET /compute/v2.1/servers/6ea95bcc-7fcb-4669-aa6a-e2bc7e40924c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:46.828693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:46.829375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:46.839175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.839679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.840469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:46.840917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:46.877218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:26:47.076238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:47.076865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:47.085638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.086366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.089828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.089828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.215656 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7294c2de-1b53-464e-845f-56991cf56a3f tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 204 len: 0 microversion: 2.1 time: 0.392810 May 14 21:26:47.220752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1960/4227] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:46 2022] DELETE /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:26:47.227312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:47.228404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:47.235523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.236306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.237137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.237582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.439617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:47.449918 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9897dbee-37c9-457d-a0b2-aeab9c0bfde7 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.227504 May 14 21:26:47.462309 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1961/4228] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:47 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:47.468395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:47.478795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:47.495306 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1e54421-bde2-4286-a6c0-5f6584fc3344 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1307 microversion: 2.1 time: 0.421144 May 14 21:26:47.495979 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2268/4229] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:47 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:47.497526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:47.532701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:47.533369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.534088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.540122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.540986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.541395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:47.553500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.554037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.554849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.555519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:47.884633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:47.897032 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a143ab8-6409-4858-8517-21b4b080af0c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.396354 May 14 21:26:47.899046 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2269/4230] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:47 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:47.977182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-588d5011-cce7-429b-b7d8-a82f78b4bf21 req-0538cef0-8c64-4b67-b441-4a847ea517f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41bf56f-6709-4440-9000-ff973790c078", "name": "network-vif-plugged", "status": "completed", "tag": "444a8ce5-4743-43c5-a34a-1c087f0c1eb9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:47.992512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-588d5011-cce7-429b-b7d8-a82f78b4bf21 req-0538cef0-8c64-4b67-b441-4a847ea517f1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:47.992969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-588d5011-cce7-429b-b7d8-a82f78b4bf21 req-0538cef0-8c64-4b67-b441-4a847ea517f1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.006632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:48.022185 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec3c1a29-dd9f-4a0c-b365-eb6eb58988ee tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.558625 May 14 21:26:48.024761 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-588d5011-cce7-429b-b7d8-a82f78b4bf21 req-0538cef0-8c64-4b67-b441-4a847ea517f1 service nova] Creating event network-vif-plugged:444a8ce5-4743-43c5-a34a-1c087f0c1eb9 for instance c41bf56f-6709-4440-9000-ff973790c078 on nch1-master-1 May 14 21:26:48.025268 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1962/4231] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:47 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:48.040648 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-588d5011-cce7-429b-b7d8-a82f78b4bf21 req-0538cef0-8c64-4b67-b441-4a847ea517f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066092 May 14 21:26:48.042318 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2270/4232] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:26:48.470989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:48.472419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:48.480598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.486311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.487828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.489206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.534004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:48.537889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:48.558167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.559579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.560468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.560987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.780667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:48.789899 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f515b052-ba4e-49fc-9546-5cd5f049a2f3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1488 microversion: 2.1 time: 0.277081 May 14 21:26:48.793734 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2271/4233] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:48 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1488 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:48.817099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:48.818326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:48.825926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.832869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:48.833265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.833760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.834690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.855679 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-024f6241-d15a-44cb-ab36-ebda71893bae tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1510 microversion: 2.1 time: 0.389338 May 14 21:26:48.856914 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1963/4234] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:48 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1510 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:48.871947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lazy-loading 'flavor' on Instance uuid be7b4d89-571b-4124-b5ec-918394447fda {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:48.925249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:48.926296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:48.938061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.938923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:48.939931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:48.940645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.214855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:49.229254 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46a87a33-9025-4619-8419-fef36e6520c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.315742 May 14 21:26:49.239751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1964/4235] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:48 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:49.249764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:49.249887 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0dc7b68b-2d8e-432f-9118-f57b6f15c0e1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda/action" status: 202 len: 0 microversion: 2.1 time: 0.441410 May 14 21:26:49.249887 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2272/4236] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:48 2022] POST /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:26:49.251913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:49.258538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:49.259238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:49.266507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:49.266726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:49.266961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.268150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:49.268816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.269637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.272264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:49.275935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.481768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:49.491662 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02d29cb9-acbf-4b3b-838b-d7147d53f210 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1496 microversion: 2.1 time: 0.238538 May 14 21:26:49.502018 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2273/4237] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:49 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1496 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:49.563084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:49.577336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-811eb80a-20f3-49f2-9346-62120b13f658 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1317 microversion: 2.1 time: 0.342528 May 14 21:26:49.579062 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1965/4238] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:49 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:49.839422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-aa98a826-c907-4dcc-b5c5-ac9f1ed7fd5a req-a64f6fb5-15d2-478f-bbc8-d62e5359ab45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d052efd6-ef23-4eec-b96a-78cd75a193b1", "name": "network-vif-deleted", "tag": "d14fe5ed-9ab8-4c6c-893f-768a8f7db696"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:49.858762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-aa98a826-c907-4dcc-b5c5-ac9f1ed7fd5a req-a64f6fb5-15d2-478f-bbc8-d62e5359ab45 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:49.874300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:49.874908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:49.879086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-aa98a826-c907-4dcc-b5c5-ac9f1ed7fd5a req-a64f6fb5-15d2-478f-bbc8-d62e5359ab45 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.882691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:49.883166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.884943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:49.885402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:49.903368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-aa98a826-c907-4dcc-b5c5-ac9f1ed7fd5a req-a64f6fb5-15d2-478f-bbc8-d62e5359ab45 service nova] Creating event network-vif-deleted:d14fe5ed-9ab8-4c6c-893f-768a8f7db696 for instance d052efd6-ef23-4eec-b96a-78cd75a193b1 on nch1-master-1 May 14 21:26:49.918317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-aa98a826-c907-4dcc-b5c5-ac9f1ed7fd5a req-a64f6fb5-15d2-478f-bbc8-d62e5359ab45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093070 May 14 21:26:49.919522 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2274/4239] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:49.998788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:50.035913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1b9bbd69-d84b-442f-bb78-60d1891bcbb6 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1468 microversion: 2.1 time: 0.151672 May 14 21:26:50.041755 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1966/4240] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:49 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1468 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:50.078879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8139ee0a-ebf7-4e60-91f2-36e9cb9866bc req-97725c77-aa02-44d8-a70e-2fe884cac4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4caf8900-4253-4d9b-b3bc-c45824e00b7f", "name": "network-vif-plugged", "status": "completed", "tag": "ee6b1fda-7102-4018-8f5a-8e24d000b0a8"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:50.110761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8139ee0a-ebf7-4e60-91f2-36e9cb9866bc req-97725c77-aa02-44d8-a70e-2fe884cac4dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.111247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8139ee0a-ebf7-4e60-91f2-36e9cb9866bc req-97725c77-aa02-44d8-a70e-2fe884cac4dc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.147615 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8139ee0a-ebf7-4e60-91f2-36e9cb9866bc req-97725c77-aa02-44d8-a70e-2fe884cac4dc service nova] Creating event network-vif-plugged:ee6b1fda-7102-4018-8f5a-8e24d000b0a8 for instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f on nch1-master-1 May 14 21:26:50.152632 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8139ee0a-ebf7-4e60-91f2-36e9cb9866bc req-97725c77-aa02-44d8-a70e-2fe884cac4dc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085507 May 14 21:26:50.153873 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2275/4241] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:50.250804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:50.251737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:50.263144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.266852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.269703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.270298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.511753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:50.514400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:50.531027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.533882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.537661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.539535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.603290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:50.615722 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8e255265-e1b6-403c-afc1-cccb456471d8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.370342 May 14 21:26:50.639241 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1967/4242] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:50 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:50.660335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:50.668612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:50.694162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.697144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.698393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.700033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.839130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:50.849600 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-da94ba80-1de1-49ab-bf4a-e983a0370da7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 200 len: 1479 microversion: 2.1 time: 0.343109 May 14 21:26:50.853455 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2276/4243] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:50 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 1479 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:50.887399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e260a433-09a5-4ad9-a05c-979a27e1747b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-418566144"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:50.890951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e260a433-09a5-4ad9-a05c-979a27e1747b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:50.900948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e260a433-09a5-4ad9-a05c-979a27e1747b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.901408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e260a433-09a5-4ad9-a05c-979a27e1747b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:50.902206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e260a433-09a5-4ad9-a05c-979a27e1747b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:50.902655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e260a433-09a5-4ad9-a05c-979a27e1747b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.537466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:51.551706 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8cda9fca-6a73-41d2-beed-8c9cd065bdb6 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1506 microversion: 2.1 time: 0.904535 May 14 21:26:51.551706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1968/4244] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:50 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1506 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:51.556190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:51.556816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:51.563819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.564286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.565487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.565950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.601357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.601826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.602298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lazy-loading 'fault' on Instance uuid d052efd6-ef23-4eec-b96a-78cd75a193b1 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:51.695562 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e260a433-09a5-4ad9-a05c-979a27e1747b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda/action" status: 202 len: 0 microversion: 2.1 time: 0.819919 May 14 21:26:51.696593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2277/4245] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:26:50 2022] POST /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda/action => generated 0 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:26:51.720943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-88e90c70-e3be-404f-8269-059b00fa034d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:51.724369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-88e90c70-e3be-404f-8269-059b00fa034d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:51.732420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '87538f2309714545bd47f228b6505883', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe513cd0819f40d7866ce2aaa1b8ea8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:51.749457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88e90c70-e3be-404f-8269-059b00fa034d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.750842 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-485bcb84-f6ac-4045-87ba-3cdd710bf954 tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 200 len: 1306 microversion: 2.1 time: 0.201933 May 14 21:26:51.754157 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1969/4246] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:51 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 1306 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:51.758141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88e90c70-e3be-404f-8269-059b00fa034d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.758995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88e90c70-e3be-404f-8269-059b00fa034d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.761242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88e90c70-e3be-404f-8269-059b00fa034d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.771922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:51.773339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:51.804007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.805460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.813776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.814593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.843546 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-88e90c70-e3be-404f-8269-059b00fa034d tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078/ips" status: 200 len: 109 microversion: 2.1 time: 0.144402 May 14 21:26:51.846843 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2278/4247] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:26:51 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078/ips => generated 109 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:51.869885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc421d46-061b-4ee3-aae0-794f17849a86 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6dea3a0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:51.960800 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc421d46-061b-4ee3-aae0-794f17849a86 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.101491 May 14 21:26:51.961639 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2279/4248] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:51 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:51.975218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c786938a-3887-49ce-b3a5-abeca1a5c389 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:51.976022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c786938a-3887-49ce-b3a5-abeca1a5c389 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:51.993816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c786938a-3887-49ce-b3a5-abeca1a5c389 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.993816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c786938a-3887-49ce-b3a5-abeca1a5c389 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:51.993816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c786938a-3887-49ce-b3a5-abeca1a5c389 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:51.993816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c786938a-3887-49ce-b3a5-abeca1a5c389 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.041912 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c786938a-3887-49ce-b3a5-abeca1a5c389 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078/ips" status: 200 len: 109 microversion: 2.1 time: 0.079052 May 14 21:26:52.048710 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2280/4249] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:26:51 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078/ips => generated 109 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:52.055798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-996e0be4-cc87-40ff-951d-e92158e7c70e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:52.056227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-996e0be4-cc87-40ff-951d-e92158e7c70e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:52.067148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-996e0be4-cc87-40ff-951d-e92158e7c70e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.068560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-996e0be4-cc87-40ff-951d-e92158e7c70e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.069736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-996e0be4-cc87-40ff-951d-e92158e7c70e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.070351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-996e0be4-cc87-40ff-951d-e92158e7c70e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.110064 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-996e0be4-cc87-40ff-951d-e92158e7c70e tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078/ips/tempest-ServerAddressesTestJSON-1521670833-network" status: 200 len: 94 microversion: 2.1 time: 0.059677 May 14 21:26:52.111347 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2281/4250] 10.222.0.52 () {58 vars in 1400 bytes} [Sat May 14 21:26:52 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078/ips/tempest-ServerAddressesTestJSON-1521670833-network => generated 94 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:26:52.127415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:52.128233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:52.140512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.142735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.143905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.144416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.178308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:26:52.295636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:52.306213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8aa4ef0e-532a-40c7-af56-f21af239c9fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1321 microversion: 2.1 time: 0.548897 May 14 21:26:52.309078 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1970/4251] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:51 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:52.501360 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-715da28c-ec33-40da-8de6-17e5f4d73671 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 204 len: 0 microversion: 2.1 time: 0.382654 May 14 21:26:52.502264 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2282/4252] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:52 2022] DELETE /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:26:52.510926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:52.511809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:52.520221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.520745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.521726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.522180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.770947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:52.771702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] [instance: d052efd6-ef23-4eec-b96a-78cd75a193b1] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:52.784706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.784706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.786033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:52.786472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:52.790678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:52.804902 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2da0a67d-a62b-4b01-b78e-8f9e300044de tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1512 microversion: 2.1 time: 0.297893 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] HTTP exception thrown: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 could not be found. May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Request method failure captured: May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 HTTP/1.1 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB3R1x4Vq8vxtd4hir-AgjXCODZqjJKVLLqGbajnTaz3Z9tcW0uKNOIjRb7mZV-ar4CdrnO4Lh7cdL_hEtxUyTkVK4s85k4h8dlo-oKxCn-dg7s3is1ZYh2tP5GH2-lcpZ0-xhvud7oBMFSxYjayuAG0I9x0FvGzHxmdC-lYDfv50OE May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fe513cd0819f40d7866ce2aaa1b8ea8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fe513cd0819f40d7866ce2aaa1b8ea8d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: fe513cd0819f40d7866ce2aaa1b8ea8d May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestJSON-663937628 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 87538f2309714545bd47f228b6505883 May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestJSON-663937628-project May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 could not be found. May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd052efd6-ef23-4eec-b96a-78cd75a193b1'} May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 could not be found. May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:52.809981 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 could not be found. May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 could not be found. May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:52.816622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] Returning 404 to user: Instance d052efd6-ef23-4eec-b96a-78cd75a193b1 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:52.818341 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1971/4253] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:52 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1512 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:52.829211 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a0fb9302-c7dc-4a8a-a323-24ab0582ebcc tempest-ServersNegativeTestJSON-663937628 tempest-ServersNegativeTestJSON-663937628-project] 10.222.0.52 "GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1" status: 404 len: 111 microversion: 2.1 time: 0.042714 May 14 21:26:52.844006 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2283/4254] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:52 2022] GET /compute/v2.1/servers/d052efd6-ef23-4eec-b96a-78cd75a193b1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:26:52.983111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f5e7d381-abd1-492c-a6a0-77ec4cbe114a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6cb9c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:53.059521 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f5e7d381-abd1-492c-a6a0-77ec4cbe114a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.086926 May 14 21:26:53.061734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1972/4255] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:52 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:53.324731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:53.325387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:53.332426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:53.332981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:53.333882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:53.334334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:53.493196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:53.502428 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-916ca96b-e6c4-4133-b70f-7d98dce43e4e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1502 microversion: 2.1 time: 0.181509 May 14 21:26:53.510179 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2284/4256] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:53 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:26:53.520063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:53.521462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:53.529178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:53.531290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:53.531753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:53.532367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:53.825650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:53.826288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:53.845611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:53.845990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:53.846794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:53.847245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:54.030803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:54.048406 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1be64032-c4ad-4b0e-ab83-2975b2cfc1f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1502 microversion: 2.1 time: 0.532607 May 14 21:26:54.049994 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1973/4257] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:53 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1502 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:54.074204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:54.082165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:54.099361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:54.099918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:54.100842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:54.102536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:54.146315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:54.159342 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d90fca5-54ff-48ba-a849-df78ad698251 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1512 microversion: 2.1 time: 0.337484 May 14 21:26:54.164417 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2285/4258] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:53 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:54.178384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cea91e7e-dc88-4b48-b8dc-ba89643d776f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6d81b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:54.194502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:26:54.255888 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cea91e7e-dc88-4b48-b8dc-ba89643d776f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.089152 May 14 21:26:54.257025 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2286/4259] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:54 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:54.581445 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e462f87-31f0-4ab9-aeea-5f7847012b7b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 204 len: 0 microversion: 2.1 time: 0.516328 May 14 21:26:54.582287 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1974/4260] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:26:54 2022] DELETE /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:26:54.591943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:54.593226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:54.601255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:54.602196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:54.603782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:54.604547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:54.773587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:54.784183 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6f4b7c6-9751-45a2-bfb2-4072d0021db4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1508 microversion: 2.1 time: 0.194140 May 14 21:26:54.792031 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2287/4261] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:54 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:55.182632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:55.183517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:55.191278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:55.191847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:55.193548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:55.194069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:55.269474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65ed933b-d582-406c-b57e-58c646c2ec63 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6d81ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:55.357840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:55.362355 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5a021638-ec5a-40aa-8efc-aba5e826549f tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1470 microversion: 2.1 time: 0.184908 May 14 21:26:55.369310 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65ed933b-d582-406c-b57e-58c646c2ec63 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.103621 May 14 21:26:55.369540 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1975/4262] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:55 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1470 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:55.370303 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2288/4263] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:55 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:55.576825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b0f4a8c5-a6f2-428d-bbfe-708fc2cba4fc req-aaa50f96-3c3a-47b2-9b94-d4bfa785fe40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41bf56f-6709-4440-9000-ff973790c078", "name": "network-vif-deleted", "tag": "444a8ce5-4743-43c5-a34a-1c087f0c1eb9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:55.596643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b0f4a8c5-a6f2-428d-bbfe-708fc2cba4fc req-aaa50f96-3c3a-47b2-9b94-d4bfa785fe40 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:55.597329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b0f4a8c5-a6f2-428d-bbfe-708fc2cba4fc req-aaa50f96-3c3a-47b2-9b94-d4bfa785fe40 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:55.614425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b0f4a8c5-a6f2-428d-bbfe-708fc2cba4fc req-aaa50f96-3c3a-47b2-9b94-d4bfa785fe40 service nova] Creating event network-vif-deleted:444a8ce5-4743-43c5-a34a-1c087f0c1eb9 for instance c41bf56f-6709-4440-9000-ff973790c078 on nch1-master-1 May 14 21:26:55.622794 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b0f4a8c5-a6f2-428d-bbfe-708fc2cba4fc req-aaa50f96-3c3a-47b2-9b94-d4bfa785fe40 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230830 May 14 21:26:55.624365 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1976/4264] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:55.804411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:55.804411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:55.814380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:55.814838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:55.817877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:55.817877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:56.296368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:56.307784 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-243a2e71-5678-4d55-9447-cabff7717812 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1508 microversion: 2.1 time: 0.511600 May 14 21:26:56.309413 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2289/4265] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:55 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1508 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:56.384676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffaa2283-6056-41a3-8c58-e6a8295aede2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6deadc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:56.387565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:56.388824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:56.424630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:56.426065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:56.430789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:56.431623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:56.494584 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ffaa2283-6056-41a3-8c58-e6a8295aede2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.112619 May 14 21:26:56.496206 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2290/4266] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:56 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:56.530356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:56.532003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:56.532738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lazy-loading 'fault' on Instance uuid c41bf56f-6709-4440-9000-ff973790c078 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:56.617478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b487bf2669c946b9935d9afb5d8e266a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5b6c73e5f14deca3371f8735b60f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:56.629229 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93ffa789-94c9-42ae-bd42-acacfea8a216 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 200 len: 1307 microversion: 2.1 time: 0.253600 May 14 21:26:56.630557 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1977/4267] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:56 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 1307 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:57.324681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:57.325995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:57.340292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:57.344709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:57.352660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:57.353468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:57.441735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:57.442728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:57.443360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lazy-loading 'fault' on Instance uuid 4caf8900-4253-4d9b-b3bc-c45824e00b7f {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:26:57.509830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b707b1c1-fedb-4c9d-990d-1bc4ed506244 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a7d823a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:57.517069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:26:57.528721 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b23d803d-e725-44ce-a436-b45e41051724 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 200 len: 1311 microversion: 2.1 time: 0.206333 May 14 21:26:57.542901 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2291/4268] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:57 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 1311 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:57.602229 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b707b1c1-fedb-4c9d-990d-1bc4ed506244 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.096472 May 14 21:26:57.603301 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1978/4269] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:57 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:57.646872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-752dfcfe-bc51-4090-b4c1-cf32a4f65a15 req-159fe8d2-d866-4224-b956-fdebafeaca13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4caf8900-4253-4d9b-b3bc-c45824e00b7f", "name": "network-vif-deleted", "tag": "ee6b1fda-7102-4018-8f5a-8e24d000b0a8"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:57.674072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-752dfcfe-bc51-4090-b4c1-cf32a4f65a15 req-159fe8d2-d866-4224-b956-fdebafeaca13 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:57.674816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-752dfcfe-bc51-4090-b4c1-cf32a4f65a15 req-159fe8d2-d866-4224-b956-fdebafeaca13 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:57.677011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:57.678206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] [instance: c41bf56f-6709-4440-9000-ff973790c078] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:57.694707 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-752dfcfe-bc51-4090-b4c1-cf32a4f65a15 req-159fe8d2-d866-4224-b956-fdebafeaca13 service nova] Creating event network-vif-deleted:ee6b1fda-7102-4018-8f5a-8e24d000b0a8 for instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f on nch1-master-1 May 14 21:26:57.696037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:57.696706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:57.698172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:57.699798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:57.701824 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-752dfcfe-bc51-4090-b4c1-cf32a4f65a15 req-159fe8d2-d866-4224-b956-fdebafeaca13 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059261 May 14 21:26:57.703044 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2292/4270] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:57.770163 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] HTTP exception thrown: Instance c41bf56f-6709-4440-9000-ff973790c078 could not be found. May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Request method failure captured: May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 HTTP/1.1 May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB6AfXPob0Vr3JjjmngVaAU88MoUKhdZymLWRx7bLTyTrbJkfV2EDMrNR4stwqFsv6gO8VOUonbXXq11lXkHDSYQOk-7o0S5_PL_Mv_zW7YRB_anmARmHAY1bCTj1uO-OnRViq0y4YIZC487KpqPDyJooKcWwsPLNpej-0Y0o1IYsrU May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: ec5b6c73e5f14deca3371f8735b60f5f May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerAddressesTestJSON-325476692 May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec5b6c73e5f14deca3371f8735b60f5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ec5b6c73e5f14deca3371f8735b60f5f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ec5b6c73e5f14deca3371f8735b60f5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ec5b6c73e5f14deca3371f8735b60f5f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerAddressesTestJSON-325476692 May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: ec5b6c73e5f14deca3371f8735b60f5f May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerAddressesTestJSON-325476692 May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerAddressesTestJSON-325476692-project May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b487bf2669c946b9935d9afb5d8e266a May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerAddressesTestJSON-325476692-project May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance c41bf56f-6709-4440-9000-ff973790c078 could not be found. May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'c41bf56f-6709-4440-9000-ff973790c078'} May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41bf56f-6709-4440-9000-ff973790c078 could not be found. May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41bf56f-6709-4440-9000-ff973790c078 could not be found. May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:57.772860 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41bf56f-6709-4440-9000-ff973790c078 could not be found. May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:26:57.787663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] Returning 404 to user: Instance c41bf56f-6709-4440-9000-ff973790c078 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:57.803266 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c40f3787-0bc1-4cf8-8431-013edb809b48 tempest-ServerAddressesTestJSON-325476692 tempest-ServerAddressesTestJSON-325476692-project] 10.222.0.52 "GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078" status: 404 len: 111 microversion: 2.1 time: 0.148547 May 14 21:26:57.806683 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1979/4271] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:57 2022] GET /compute/v2.1/servers/c41bf56f-6709-4440-9000-ff973790c078 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:57.974850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7f664a46-91e8-4749-957f-99d969be5563 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Calling method '.version_select at 0x7fb1a6d81dc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.211959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7f664a46-91e8-4749-957f-99d969be5563 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.491969 May 14 21:26:58.218613 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2293/4272] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:26:57 2022] GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd/defaults => generated 371 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:58.227884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eaf95355-fd1f-4310-b773-e35fb64a9d72 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Calling method '.version_select at 0x7fb1a6cbc160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.386281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8b63e517-1b53-4fdf-b56c-bfe2cad1ea47 req-06fc59e7-d11f-40cc-87e4-d6d7db4a1199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7b4d89-571b-4124-b5ec-918394447fda", "name": "network-vif-plugged", "status": "completed", "tag": "d7583ddb-f64e-4f06-a05b-22682e8fc3b2"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:58.399740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8b63e517-1b53-4fdf-b56c-bfe2cad1ea47 req-06fc59e7-d11f-40cc-87e4-d6d7db4a1199 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:58.400305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8b63e517-1b53-4fdf-b56c-bfe2cad1ea47 req-06fc59e7-d11f-40cc-87e4-d6d7db4a1199 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:58.412398 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8b63e517-1b53-4fdf-b56c-bfe2cad1ea47 req-06fc59e7-d11f-40cc-87e4-d6d7db4a1199 service nova] Creating event network-vif-plugged:d7583ddb-f64e-4f06-a05b-22682e8fc3b2 for instance be7b4d89-571b-4124-b5ec-918394447fda on nch2-master-1 May 14 21:26:58.418643 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8b63e517-1b53-4fdf-b56c-bfe2cad1ea47 req-06fc59e7-d11f-40cc-87e4-d6d7db4a1199 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038262 May 14 21:26:58.419755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2294/4273] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:26:58.559810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.559810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:26:58.569364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:58.572068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:58.575243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:26:58.576594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:26:58.588040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eaf95355-fd1f-4310-b773-e35fb64a9d72 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd" status: 200 len: 371 microversion: 2.1 time: 0.365520 May 14 21:26:58.588040 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1980/4274] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:26:58 2022] GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd => generated 371 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:58.602965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2a62a5a-7161-4af3-bc31-e4cd7b80fee3 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Calling method '.version_select at 0x7fb1a77b19d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.609653 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f HTTP/1.1 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '4caf8900-4253-4d9b-b3bc-c45824e00b7f'} May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:58.611761 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:26:58.617922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:26:58.617922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:26:58.617922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:26:58.617922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:26:58.617922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:26:58.617922 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:26:58.621422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:26:58.625898 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-46b97694-301b-44da-a050-c68fe6b75cf9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 404 len: 111 microversion: 2.1 time: 0.073890 May 14 21:26:58.625898 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2295/4275] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:26:58 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:26:58.631912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a39499ce-a255-4392-b861-9a798d249f96 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6db4b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.693332 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a39499ce-a255-4392-b861-9a798d249f96 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.068100 May 14 21:26:58.693921 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2296/4276] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:58 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:26:58.701715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9b2a6579-093a-4c68-98f9-b07d4d9b0816 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: .version_select at 0x7fb1a6d815e0>, body: {"keypair": {"name": "tempest-key-1065171388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNd+0xORskwfiWB25ZSXgAuJOOmiOKP+e6hsaFSoMQZlvYsMpS2ovrtzP9MoZ8G8+rG4DLfPb8EFVzYM2UlA6axU1oJB5EH7ReFZ7WoXfFHUzB737FGzv0lV/mZKZgkkCQ=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:58.740917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-9b2a6579-093a-4c68-98f9-b07d4d9b0816 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:26:58.758483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-9b2a6579-093a-4c68-98f9-b07d4d9b0816 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:26:58.826080 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b2a62a5a-7161-4af3-bc31-e4cd7b80fee3 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd/defaults" status: 200 len: 371 microversion: 2.1 time: 0.230771 May 14 21:26:58.834768 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1981/4277] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:26:58 2022] GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd/defaults => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:58.854368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd192b7d-2b02-42fa-b04d-d24d63908c07 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Calling method '.version_select at 0x7fb1a6c565e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.936215 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9b2a6579-093a-4c68-98f9-b07d4d9b0816 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.241055 May 14 21:26:58.937509 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2297/4278] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:26:58 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:58.960067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fe83642b-b399-451d-8947-d602975495c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '.version_select at 0x7fb1a6db4e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.966832 ncdv-master-1 devstack@n-api.service[130638]: WARNING oslo_db.sqlalchemy.utils [None req-fe83642b-b399-451d-8947-d602975495c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Unique keys not in sort_keys. The sorting order may be unstable. May 14 21:26:58.972729 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd192b7d-2b02-42fa-b04d-d24d63908c07 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd" status: 200 len: 371 microversion: 2.1 time: 0.134799 May 14 21:26:58.976233 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1982/4279] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 21:26:58 2022] GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:58.992475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e78fc61-9c8f-46b7-8eda-96828531e144 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] Calling method '.version_select at 0x7fb1a6fc71f0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:58.993260 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fe83642b-b399-451d-8947-d602975495c4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.040990 May 14 21:26:59.003669 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2298/4280] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:26:58 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:26:59.205731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-576967224", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "key_name": "tempest-key-1065171388", "networks": [{"uuid": "8da851bf-8623-41cd-8e7e-e11152a2fef0"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:26:59.226852 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e78fc61-9c8f-46b7-8eda-96828531e144 tempest-QuotasTestJSON-1472162625 tempest-QuotasTestJSON-1472162625-project] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd?user_id=cd41bd6980b8449aae43239ff1ef8557" status: 200 len: 371 microversion: 2.1 time: 0.230247 May 14 21:26:59.227560 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1983/4281] 10.222.0.52 () {58 vars in 1322 bytes} [Sat May 14 21:26:58 2022] GET /compute/v2.1/os-quota-sets/2e178a6743a947c0810f64d90d260ebd?user_id=cd41bd6980b8449aae43239ff1ef8557 => generated 371 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:26:59.309587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:26:59.710142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b80a27ea-2b33-4c33-b798-079d42bcef7b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c690d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:26:59.820248 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b80a27ea-2b33-4c33-b798-079d42bcef7b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.115328 May 14 21:26:59.823090 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1984/4282] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:26:59 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:00.839103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34c2139e-2b32-4d5c-a50b-6f8f291ce479 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c88a60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:00.965747 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34c2139e-2b32-4d5c-a50b-6f8f291ce479 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.133887 May 14 21:27:00.971714 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1985/4283] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:00 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:01.152824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:01.153814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:01.154315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:01.154741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:01.155195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:01.173547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:01.173996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:01.186027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:01.186496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:01.229323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:01.241742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:01.296293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:01.303026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:01.602776 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0bd0c014-79d9-4585-a40e-2147b6823557 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.400959 May 14 21:27:01.603435 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2299/4284] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:26:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:27:01.614607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-587fd772-cb71-4e0a-9452-43441266a18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:01.616028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-587fd772-cb71-4e0a-9452-43441266a18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:01.760459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-587fd772-cb71-4e0a-9452-43441266a18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:01.782215 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-587fd772-cb71-4e0a-9452-43441266a18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1228 microversion: 2.1 time: 0.168504 May 14 21:27:01.782215 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1986/4285] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:01 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1228 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:01.983756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8ff28e9f-bf9c-4d41-aeb0-c9227d2cc406 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6d815e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:02.070323 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8ff28e9f-bf9c-4d41-aeb0-c9227d2cc406 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.095787 May 14 21:27:02.071376 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2300/4286] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:01 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:02.798764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9b10868-a72b-4f33-8ea4-70dcdfd2b8ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:02.800741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9b10868-a72b-4f33-8ea4-70dcdfd2b8ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:02.905349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9b10868-a72b-4f33-8ea4-70dcdfd2b8ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:02.912236 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9b10868-a72b-4f33-8ea4-70dcdfd2b8ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1228 microversion: 2.1 time: 0.119435 May 14 21:27:02.912743 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1987/4287] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:02 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1228 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:03.065017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3be5cb73-afcb-4a55-afdd-bc4d1ae1fb63 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:03.066126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3be5cb73-afcb-4a55-afdd-bc4d1ae1fb63 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:03.075670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3be5cb73-afcb-4a55-afdd-bc4d1ae1fb63 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:03.076430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3be5cb73-afcb-4a55-afdd-bc4d1ae1fb63 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:03.081049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3be5cb73-afcb-4a55-afdd-bc4d1ae1fb63 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:03.081049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3be5cb73-afcb-4a55-afdd-bc4d1ae1fb63 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:03.090698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8b391977-73e4-43b5-a01e-ca75173a04d3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c56430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:03.120979 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3be5cb73-afcb-4a55-afdd-bc4d1ae1fb63 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/ips" status: 200 len: 150 microversion: 2.1 time: 0.060546 May 14 21:27:03.121583 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2301/4288] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:27:03 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:27:03.194684 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8b391977-73e4-43b5-a01e-ca75173a04d3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.114486 May 14 21:27:03.201327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1988/4289] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:03 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:03.937675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:03.939101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:03.958816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:03.959286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:03.960125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:03.960569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:04.185494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:04.213627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5b675d2d-9315-43ce-a541-93c61a2279e4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1232 microversion: 2.1 time: 0.274656 May 14 21:27:04.219841 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1989/4290] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:03 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1232 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:04.260871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f97d5bc-d7fe-49ce-b2b8-3b5502aefb11 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c56f70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:04.324695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65c767da-4767-4249-b4a0-f2954d221ed9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:04.325690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65c767da-4767-4249-b4a0-f2954d221ed9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:04.336489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65c767da-4767-4249-b4a0-f2954d221ed9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:04.338522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65c767da-4767-4249-b4a0-f2954d221ed9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:04.339564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65c767da-4767-4249-b4a0-f2954d221ed9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:04.343745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65c767da-4767-4249-b4a0-f2954d221ed9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:04.364984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f97d5bc-d7fe-49ce-b2b8-3b5502aefb11 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.140505 May 14 21:27:04.365629 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1990/4291] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:04 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:04.440265 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65c767da-4767-4249-b4a0-f2954d221ed9 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "POST /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90/action" status: 200 len: 24588 microversion: 2.42 time: 0.678785 May 14 21:27:04.441431 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2302/4292] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:27:03 2022] POST /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90/action => generated 24588 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 14 21:27:05.231570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:05.232797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:05.245090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:05.252152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:05.253369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:05.253996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:05.380326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ec599cc-8b46-4fd5-af86-ae14a822699d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6ed6040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:05.455305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:05.471063 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa4bbd93-2043-4bd3-9581-d8f2d8140858 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1288 microversion: 2.1 time: 0.244560 May 14 21:27:05.475581 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1991/4293] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:05 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1288 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:05.521237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ec599cc-8b46-4fd5-af86-ae14a822699d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.146366 May 14 21:27:05.525505 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2303/4294] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:05 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:05.892302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1571758701", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:05.976243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] validate_networks() for [('97063dec-be1a-44ad-8306-0607d2b2da93', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:06.493369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:06.494115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:06.520819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:06.521460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:06.522325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:06.522782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:06.711982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:06.724633 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3e2b12f3-1236-4759-9e0c-60f0830e5bac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1286 microversion: 2.1 time: 0.237024 May 14 21:27:06.725759 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2304/4295] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:06 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1286 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:06.738663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-01d62a97-c9c1-4083-83e3-e25858e2a263 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6d3fd30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:06.817736 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-01d62a97-c9c1-4083-83e3-e25858e2a263 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.090630 May 14 21:27:06.819154 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2305/4296] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:06 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:07.035362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:07.036649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:07.036649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:07.037229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:07.037766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:07.056093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:07.056665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:07.057792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:07.058491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:07.079177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Getting quotas for project c39236c4fcb74ea2838acddd315e00ff. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:07.085960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Getting quotas for user 1a51643a51af4175b40a61a726eac80a and project c39236c4fcb74ea2838acddd315e00ff. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:07.112713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:07.116631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:07.389902 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5a70264a-bdff-413d-b4fb-8dddaea20e06 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596204 May 14 21:27:07.392979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1992/4297] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:27:07.404840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fb82aaa-ee99-4315-be99-13d8ed7eec20 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:07.405472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9fb82aaa-ee99-4315-be99-13d8ed7eec20 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:07.605110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9fb82aaa-ee99-4315-be99-13d8ed7eec20 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:07.618330 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9fb82aaa-ee99-4315-be99-13d8ed7eec20 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1224 microversion: 2.1 time: 0.213931 May 14 21:27:07.622292 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2306/4298] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:07 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1224 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:07.742226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:07.743100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:07.765010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:07.769373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:07.771841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:07.774531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:07.832184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bdc1dc32-2f81-4053-8b5a-901df5402297 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6db0790>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:07.937041 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bdc1dc32-2f81-4053-8b5a-901df5402297 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.108921 May 14 21:27:07.943990 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2307/4299] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:07 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:08.183123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:08.194176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9415bf07-606a-400f-807e-7565a007d673 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.456620 May 14 21:27:08.197890 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1993/4300] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:07 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:08.641693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23d8c3aa-67e5-4d8f-a3d5-fef294961645 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:08.644698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-23d8c3aa-67e5-4d8f-a3d5-fef294961645 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:08.874379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-23d8c3aa-67e5-4d8f-a3d5-fef294961645 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:08.874379 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-23d8c3aa-67e5-4d8f-a3d5-fef294961645 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1224 microversion: 2.1 time: 0.233280 May 14 21:27:08.874379 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2308/4301] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:08 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1224 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:08.954380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf579126-fee5-424a-ba9c-f31212b1c5d3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6cb9040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:09.099191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf579126-fee5-424a-ba9c-f31212b1c5d3 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.150755 May 14 21:27:09.100521 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1994/4302] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:08 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:09.225996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:09.225996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:09.228013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:09.230159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:09.231186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:09.232798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:09.403182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:09.411661 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4078422a-eaf8-4b99-8e7d-5d0662f35ade tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.199785 May 14 21:27:09.412335 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2309/4303] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:09 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:09.671788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a67d478a-9e91-4879-90d3-e79628a4d441 req-d2248c97-4679-48a9-af47-13edf930a646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a0cb80c-e155-4079-9b66-51a732c612d8", "tag": "470ac4c0-45d1-472b-8971-fb692aca940e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:09.684797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a67d478a-9e91-4879-90d3-e79628a4d441 req-d2248c97-4679-48a9-af47-13edf930a646 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:09.685611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a67d478a-9e91-4879-90d3-e79628a4d441 req-d2248c97-4679-48a9-af47-13edf930a646 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:09.700909 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a67d478a-9e91-4879-90d3-e79628a4d441 req-d2248c97-4679-48a9-af47-13edf930a646 service nova] Creating event network-changed:470ac4c0-45d1-472b-8971-fb692aca940e for instance 1a0cb80c-e155-4079-9b66-51a732c612d8 on nch1-master-1 May 14 21:27:09.706425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a67d478a-9e91-4879-90d3-e79628a4d441 req-d2248c97-4679-48a9-af47-13edf930a646 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049309 May 14 21:27:09.708780 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1995/4304] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:09.887130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:09.887787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:09.943733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:09.944199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:09.960592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:09.961059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:10.122591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef4e8880-b31b-4abe-ae1f-461dd1cac51a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6cb9430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:10.227452 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ef4e8880-b31b-4abe-ae1f-461dd1cac51a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.117788 May 14 21:27:10.229521 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1996/4305] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:10 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:10.281344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:10.291733 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a462a0d1-45ca-4c5e-8e47-97ddbbc52902 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1228 microversion: 2.1 time: 0.409087 May 14 21:27:10.301164 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2310/4306] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:09 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1228 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:10.430161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:10.431238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:10.452508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:10.458551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:10.460231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:10.462051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:10.845901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:10.855284 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b6701d8c-0579-45e9-a6ab-dc1223d379b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.429795 May 14 21:27:10.866285 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1997/4307] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:10 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:11.208499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b8411ae-9ce5-4607-88f6-5fd96a25a414 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ba2acd5-df14-446f-a4d1-701795380c04"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:11.210349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b8411ae-9ce5-4607-88f6-5fd96a25a414 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:11.222707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b8411ae-9ce5-4607-88f6-5fd96a25a414 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:11.231527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b8411ae-9ce5-4607-88f6-5fd96a25a414 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:11.232420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b8411ae-9ce5-4607-88f6-5fd96a25a414 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:11.236762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b8411ae-9ce5-4607-88f6-5fd96a25a414 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:11.251882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b608e1c9-82f8-40ab-96da-c18bd5e674ff tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c693a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:11.351964 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b608e1c9-82f8-40ab-96da-c18bd5e674ff tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.104717 May 14 21:27:11.354139 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1998/4308] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:11 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:11.373213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:11.377961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:11.402264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:11.402723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:11.411223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:11.411223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:11.619999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:11.636681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab55a5f8-3d77-489e-9a4b-13982cdef442 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1284 microversion: 2.1 time: 0.279354 May 14 21:27:11.637718 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 1999/4309] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:11 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:11.873217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:11.874787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:11.885550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:11.886314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:11.887727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:11.888347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:12.235461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:12.248451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c24f9d4-6664-447c-ad3e-87e605ceedc3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.379776 May 14 21:27:12.249638 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2000/4310] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:11 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:12.366359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c9ec6168-d403-4ded-a0d1-39084401e4ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6cbc3a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:12.452022 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c9ec6168-d403-4ded-a0d1-39084401e4ab tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.089850 May 14 21:27:12.452628 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2001/4311] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:12 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:12.574657 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b8411ae-9ce5-4607-88f6-5fd96a25a414 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.371783 May 14 21:27:12.575414 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2311/4312] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:27:11 2022] POST /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments => generated 194 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:12.660974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:12.661765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:12.688110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:12.688583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:12.689399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:12.713978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:12.902699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:12.924817 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-57f1e017-f2bf-4cfa-8b78-ea3cc8116cfb tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1282 microversion: 2.1 time: 0.269768 May 14 21:27:12.925681 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2002/4313] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:12 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1282 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:13.288763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:13.290467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:13.325358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:13.325833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:13.329191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:13.329660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:13.466591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f6ed3611-70a5-4db7-a2f7-1874b6f9a697 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a766a310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:13.576676 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f6ed3611-70a5-4db7-a2f7-1874b6f9a697 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.114382 May 14 21:27:13.585952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2003/4314] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:13 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:13.740433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:13.757468 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e77187e3-8fa1-401b-83cb-d5eb8b60d041 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.484403 May 14 21:27:13.761565 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2312/4315] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:13 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:13.944245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:13.946214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:13.961097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:13.964727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:13.966993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:13.969192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:14.288388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:14.301129 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a87e1f2d-680b-4b76-bf26-9b82bcea679c tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 0.362503 May 14 21:27:14.302136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2004/4316] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:13 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:14.597210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7a093ee-b97a-448d-b007-e4d6c36eafec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6d815e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:14.744239 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7a093ee-b97a-448d-b007-e4d6c36eafec tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.157610 May 14 21:27:14.752072 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2313/4317] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:14 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:14.776207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:14.777196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:14.791198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:14.792046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:14.797813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:14.800672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:15.130536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:15.150274 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db922817-4e93-4f3e-8f4b-ad5aa4645cc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.377965 May 14 21:27:15.154930 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2005/4318] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:14 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:15.344909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-3837190b-803a-4b89-b05b-e186a810760f req-432f2a69-4dda-43de-9b49-70f82c74e670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4380973-d902-4e88-b97e-a89b812298ac", "tag": "bc2f7589-7d26-40da-b194-9726e513185a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:15.348318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:15.356478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:15.397527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:15.398497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:15.399682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:15.400387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:15.437573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3837190b-803a-4b89-b05b-e186a810760f req-432f2a69-4dda-43de-9b49-70f82c74e670 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:15.438618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-3837190b-803a-4b89-b05b-e186a810760f req-432f2a69-4dda-43de-9b49-70f82c74e670 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:15.451466 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-3837190b-803a-4b89-b05b-e186a810760f req-432f2a69-4dda-43de-9b49-70f82c74e670 service nova] Creating event network-changed:bc2f7589-7d26-40da-b194-9726e513185a for instance e4380973-d902-4e88-b97e-a89b812298ac on nch1-master-1 May 14 21:27:15.459702 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-3837190b-803a-4b89-b05b-e186a810760f req-432f2a69-4dda-43de-9b49-70f82c74e670 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149424 May 14 21:27:15.463827 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2314/4319] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:15.760412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b493b1ac-1c23-46fb-8b1c-49b3e36ae9b2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6df1dc0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:15.855257 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b493b1ac-1c23-46fb-8b1c-49b3e36ae9b2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.100632 May 14 21:27:15.856037 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2315/4320] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:15 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:16.171348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:16.172502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:16.194443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:16.195069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:16.196006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:16.196857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:16.459505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:16.482125 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-45eb6483-72de-48ea-850b-bccb648dd8f5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.310724 May 14 21:27:16.485902 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2316/4321] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:16 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:16.676882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ec2c3bb9-b012-4389-ac87-4340c741440b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'create', calling method: .version_select at 0x7fb1a6df1040>, body: {"keypair": {"name": "tempest-keypair-973558508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOkypubtO1seh+gIrhpOuJEPRVHiyNI5N961hbEbSiSvz53awhEMDT4QlY2KhMHhy5YR6vNS6UygW8qF5CygDmoEpPMSvj39KWuBDgK9OPzkL6omWwXDhiESJEFTLfbmGg=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:16.704595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ec2c3bb9-b012-4389-ac87-4340c741440b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:16.721031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ec2c3bb9-b012-4389-ac87-4340c741440b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for user 04e48304473d40ebb8c0c5386c4c3592 and project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:16.762787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:16.776750 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3f1535ac-62b2-41d4-8127-195ed041d18b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 1.452490 May 14 21:27:16.777648 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2006/4322] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:15 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:16.846486 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ec2c3bb9-b012-4389-ac87-4340c741440b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.352957 May 14 21:27:16.852790 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2317/4323] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:27:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 362 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 21:27:16.874656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcf6ff62-272c-4adf-8b64-d8d919e0aa13 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6cae430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:16.976366 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bcf6ff62-272c-4adf-8b64-d8d919e0aa13 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1439 microversion: 2.1 time: 0.108664 May 14 21:27:16.982042 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2007/4324] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:16 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1439 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:17.381618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d99865c4-b1bb-4dd5-8fb2-7b934eb4e980 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: .version_select at 0x7fb1a6da71f0>, body: {"keypair": {"name": "tempest-keypair-42538759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF44GztqWLGWEvGBPtSiempw9GaFtNAUZ3juEi+8s0F/6Oy2Zd17ik0Jl/Sccz0AWnInxap6fMhF7+/4KuenN2m7YCdPJdyqMzG77k1KtotXVjnnPb9ta2gLDiIosEBD8A=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:17.398004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d99865c4-b1bb-4dd5-8fb2-7b934eb4e980 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:17.403541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d99865c4-b1bb-4dd5-8fb2-7b934eb4e980 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:17.487109 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d99865c4-b1bb-4dd5-8fb2-7b934eb4e980 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.111138 May 14 21:27:17.488336 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2318/4325] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:27:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:17.501293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:17.501914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:17.508403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:17.509491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:17.510281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:17.510743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:17.678254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:17.687008 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ce116fc-f986-46aa-a6c5-aa102ab56917 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.189583 May 14 21:27:17.697822 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2008/4326] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:17 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:17.794601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:17.795817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:17.804150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-486de151-d045-4b67-adaf-8d1c2b2e1cc1 req-12b03e1e-ab5a-4371-b747-13be8523fbfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0cb80c-e155-4079-9b66-51a732c612d8", "name": "network-vif-plugged", "status": "completed", "tag": "470ac4c0-45d1-472b-8971-fb692aca940e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:17.806458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:17.807111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:17.808182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:17.809030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:17.825197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-486de151-d045-4b67-adaf-8d1c2b2e1cc1 req-12b03e1e-ab5a-4371-b747-13be8523fbfc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:17.825197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-486de151-d045-4b67-adaf-8d1c2b2e1cc1 req-12b03e1e-ab5a-4371-b747-13be8523fbfc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:17.838304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-486de151-d045-4b67-adaf-8d1c2b2e1cc1 req-12b03e1e-ab5a-4371-b747-13be8523fbfc service nova] Creating event network-vif-plugged:470ac4c0-45d1-472b-8971-fb692aca940e for instance 1a0cb80c-e155-4079-9b66-51a732c612d8 on nch1-master-1 May 14 21:27:17.844713 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-486de151-d045-4b67-adaf-8d1c2b2e1cc1 req-12b03e1e-ab5a-4371-b747-13be8523fbfc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045573 May 14 21:27:17.845622 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2009/4327] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:27:17.993529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b11a95b9-47b7-4ff8-bdb4-b9d8ff4fd054 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c56700>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:18.015015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:18.037316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e439065a-bddb-4c47-8f11-0515e7900b3b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 0.246952 May 14 21:27:18.037927 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2319/4328] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:17 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:18.088704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b11a95b9-47b7-4ff8-bdb4-b9d8ff4fd054 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1448 microversion: 2.1 time: 0.103052 May 14 21:27:18.095985 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2010/4329] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:17 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1448 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:18.103267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e2f0f0b9-fcce-4f0c-bc42-b45b1d50fe05 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6ed6700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:18.159170 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e2f0f0b9-fcce-4f0c-bc42-b45b1d50fe05 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 200 len: 1448 microversion: 2.1 time: 0.061476 May 14 21:27:18.160079 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2320/4330] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:18 2022] GET /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 1448 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:18.178464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50ac5374-d02e-4c39-a7e1-6bfb14e35b03 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c56430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:18.712361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:18.713001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:18.731335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:18.733665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:18.734574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:18.734901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:18.995976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:19.002495 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd79ba9e-79bb-4498-909d-92d803835ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1328 microversion: 2.1 time: 0.301669 May 14 21:27:19.004755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2321/4331] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:18 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1328 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:19.059369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:19.060778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:19.070656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:19.071117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:19.071996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:19.072832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:19.557252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:19.568368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98cb4634-2367-4e60-b3fa-504482cd6ce4 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 0.515092 May 14 21:27:19.569008 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2322/4332] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:19 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:20.020949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:20.021749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:20.032866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.033322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.041442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.044170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.133190 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-50ac5374-d02e-4c39-a7e1-6bfb14e35b03 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 204 len: 0 microversion: 2.1 time: 1.964394 May 14 21:27:20.138264 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2011/4333] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:18 2022] DELETE /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 0 bytes in 1966 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:27:20.148414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:20.149357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:20.157127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.157762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.158762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.159374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.192616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:27:20.630231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:20.639951 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4fddddac-ecf0-4d76-b60b-129f2308c2b3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1508 microversion: 2.1 time: 0.623210 May 14 21:27:20.640820 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2323/4334] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:20 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1508 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:20.646025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:20.646877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:20.656236 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb9cbd38-b4f3-433b-8c4b-48b0eefb6c92 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 204 len: 0 microversion: 2.1 time: 0.513666 May 14 21:27:20.656865 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2012/4335] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:20 2022] DELETE /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:27:20.667573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:20.669239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.670299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:20.672404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.674705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.675189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.683871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.684136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.685636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:20.685636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:20.974463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:20.991505 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43d85bcf-1398-4bf8-8c81-e9a0dc83422b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 0.349284 May 14 21:27:20.992912 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2324/4336] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:20 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:20.998104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-313048228", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "af5a4b8e-1df1-4780-a149-63d1d293e5bd"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:21.063932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] validate_networks() for [('af5a4b8e-1df1-4780-a149-63d1d293e5bd', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:21.102608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:21.110631 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-17c366e8-83b4-433a-bf51-98b3eec946ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1508 microversion: 2.1 time: 0.452083 May 14 21:27:21.111277 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2013/4337] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:20 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1508 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:21.127582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:21.129342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:21.135511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:21.136175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:21.136771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:21.137221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:21.165529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:27:21.542506 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-997c2619-897f-4ee4-bb0b-72ed4cdefa25 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 204 len: 0 microversion: 2.1 time: 0.418563 May 14 21:27:21.548537 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2014/4338] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:21 2022] DELETE /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:27:21.555846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1691838228", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cc7003c-2823-48d0-8842-9a2e7e084a2e"}], "security_groups": [{"name": "tempest-securitygroup--788486948"}], "key_name": "tempest-keypair-973558508", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:21.780565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] validate_networks() for [('4cc7003c-2823-48d0-8842-9a2e7e084a2e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:22.178822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:22.179359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:22.181214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:22.181436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:22.181923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:22.193276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.193967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.195955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.196965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.221999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:22.230190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Getting quotas for user ed0a76be93e44fa887cb813a8879e04d and project c4fe0b96d43b41aaaa0e8e238888786a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:22.250643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:22.253615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:22.423459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:22.424725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:22.425386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:22.426373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:22.426791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:22.437329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.438067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.439034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.439696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.440796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b1dbd093-97eb-45d5-bce5-fe59cfabb1dd tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.447101 May 14 21:27:22.445219 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2325/4339] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:27:22.453526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:22.455068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:22.468551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.469443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.470514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.471109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.483617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:22.489880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for user 04e48304473d40ebb8c0c5386c4c3592 and project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:22.509825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:22.513254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:22.688919 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e4a548f3-1bfa-4fbe-abd0-672163beb088 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.138608 May 14 21:27:22.695405 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2015/4340] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:27:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:27:22.723712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:22.724361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:22.744132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.744599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.745400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:22.745849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:22.802071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:22.813759 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d4bd2236-5054-4331-9b26-3399a84c1dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1514 microversion: 2.1 time: 0.365972 May 14 21:27:22.814429 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2326/4341] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:22 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1514 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:22.820703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7195957-dd26-43a8-bb0e-6776c36f08d4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:22.822663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7195957-dd26-43a8-bb0e-6776c36f08d4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:22.950087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7195957-dd26-43a8-bb0e-6776c36f08d4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:22.956719 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7195957-dd26-43a8-bb0e-6776c36f08d4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1207 microversion: 2.1 time: 0.140222 May 14 21:27:22.957489 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2327/4342] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:22 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1207 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:22.970862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-249931324", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd341be-651f-4dc3-82bf-83f603d58628"}], "security_groups": [{"name": "tempest-securitygroup--1780073977"}], "key_name": "tempest-keypair-42538759", "user_data": "}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:23.173182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] validate_networks() for [('afd341be-651f-4dc3-82bf-83f603d58628', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:23.302373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:23.311419 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5eb443b7-68f2-448f-955c-25dfd860e014 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 0.614844 May 14 21:27:23.312571 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2016/4343] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:22 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:23.326117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eeb71acc-b249-4bb2-8271-e695dc561bab tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:23.327256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eeb71acc-b249-4bb2-8271-e695dc561bab tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:23.447330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eeb71acc-b249-4bb2-8271-e695dc561bab tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:23.454947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eeb71acc-b249-4bb2-8271-e695dc561bab tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:23.456576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eeb71acc-b249-4bb2-8271-e695dc561bab tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:23.458227 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eeb71acc-b249-4bb2-8271-e695dc561bab tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1281 microversion: 2.20 time: 0.144264 May 14 21:27:23.458808 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2017/4344] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:23 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1281 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:23.484231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-91143949-45bc-4df3-be31-92d9636d044e req-a24c18e4-44dd-47a8-9c49-703235d0ba5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7b4d89-571b-4124-b5ec-918394447fda", "name": "network-vif-deleted", "tag": "d7583ddb-f64e-4f06-a05b-22682e8fc3b2"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:23.500141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-91143949-45bc-4df3-be31-92d9636d044e req-a24c18e4-44dd-47a8-9c49-703235d0ba5d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:23.502643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-91143949-45bc-4df3-be31-92d9636d044e req-a24c18e4-44dd-47a8-9c49-703235d0ba5d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:23.558278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-91143949-45bc-4df3-be31-92d9636d044e req-a24c18e4-44dd-47a8-9c49-703235d0ba5d service nova] Creating event network-vif-deleted:d7583ddb-f64e-4f06-a05b-22682e8fc3b2 for instance be7b4d89-571b-4124-b5ec-918394447fda on nch2-master-1 May 14 21:27:23.564365 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-91143949-45bc-4df3-be31-92d9636d044e req-a24c18e4-44dd-47a8-9c49-703235d0ba5d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088192 May 14 21:27:23.565663 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2018/4345] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:23.766768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:23.767307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:23.767655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:23.768084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:23.768513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:23.783186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:23.783856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:23.787989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:23.787989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:23.814926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:23.832429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:23.833399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:23.840109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:23.862451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:23.862566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:23.862741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:23.865138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:23.866312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:23.868317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.036780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:24.051590 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bafcf39e-f69f-45ea-9998-7c5ced401ffd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1472 microversion: 2.1 time: 0.224378 May 14 21:27:24.052443 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2019/4346] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:23 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:24.057637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:24.058232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:24.065317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.068369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.068369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.068768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.122801 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ceb21bf-451b-41e9-88ac-4c68eac83c38 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.161231 May 14 21:27:24.127823 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2328/4347] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:27:24.139574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-29fbcc21-31f3-477b-8271-ea7c8d8a897c req-f5d53e52-dd3d-40d0-955a-fd412862ef67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a0cb80c-e155-4079-9b66-51a732c612d8", "name": "network-vif-deleted", "tag": "470ac4c0-45d1-472b-8971-fb692aca940e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:24.151939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-29fbcc21-31f3-477b-8271-ea7c8d8a897c req-f5d53e52-dd3d-40d0-955a-fd412862ef67 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.152749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-29fbcc21-31f3-477b-8271-ea7c8d8a897c req-f5d53e52-dd3d-40d0-955a-fd412862ef67 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.159153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:24.168219 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-29fbcc21-31f3-477b-8271-ea7c8d8a897c req-f5d53e52-dd3d-40d0-955a-fd412862ef67 service nova] Creating event network-vif-deleted:470ac4c0-45d1-472b-8971-fb692aca940e for instance 1a0cb80c-e155-4079-9b66-51a732c612d8 on nch1-master-1 May 14 21:27:24.172627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4fdceec0-853d-410f-afdc-a040ab2badd0 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1211 microversion: 2.1 time: 0.118781 May 14 21:27:24.173831 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-29fbcc21-31f3-477b-8271-ea7c8d8a897c req-f5d53e52-dd3d-40d0-955a-fd412862ef67 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043981 May 14 21:27:24.174564 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2020/4348] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:24 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1211 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:24.181130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c90c6f2-3ff8-460a-8b1f-b2e998083f29 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:24.182335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c90c6f2-3ff8-460a-8b1f-b2e998083f29 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:24.196008 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2329/4349] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:24.264871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c90c6f2-3ff8-460a-8b1f-b2e998083f29 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:24.273255 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c90c6f2-3ff8-460a-8b1f-b2e998083f29 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1239 microversion: 2.1 time: 0.096690 May 14 21:27:24.274306 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2021/4350] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:24 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1239 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:24.334297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:24.336647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:24.387797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.387985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.392253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.393825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.477293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:24.478828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:24.486951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.490195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.492654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.495601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.585963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:24.596400 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6acd717-a3fc-45e1-b65a-5f2c09f49bf2 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 0.269404 May 14 21:27:24.609506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:24.623594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:24.623946 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2330/4351] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:24 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:24.643382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:24.643382 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-866f5c4e-cc35-45dc-a71f-4c92cafb1659 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1285 microversion: 2.20 time: 0.165710 May 14 21:27:24.643382 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2022/4352] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:24 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1285 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:24.658844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-bce7a09f-9ec7-4cec-9905-1def273d97c3 req-9cdf0076-fa38-4082-8697-a97b35f9b04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4380973-d902-4e88-b97e-a89b812298ac", "name": "network-vif-plugged", "status": "completed", "tag": "bc2f7589-7d26-40da-b194-9726e513185a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:24.700499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bce7a09f-9ec7-4cec-9905-1def273d97c3 req-9cdf0076-fa38-4082-8697-a97b35f9b04e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:24.701440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-bce7a09f-9ec7-4cec-9905-1def273d97c3 req-9cdf0076-fa38-4082-8697-a97b35f9b04e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:24.724478 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-bce7a09f-9ec7-4cec-9905-1def273d97c3 req-9cdf0076-fa38-4082-8697-a97b35f9b04e service nova] Creating event network-vif-plugged:bc2f7589-7d26-40da-b194-9726e513185a for instance e4380973-d902-4e88-b97e-a89b812298ac on nch1-master-1 May 14 21:27:24.737581 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-bce7a09f-9ec7-4cec-9905-1def273d97c3 req-9cdf0076-fa38-4082-8697-a97b35f9b04e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110644 May 14 21:27:24.738654 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2331/4353] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:25.071755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:25.072268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:25.108651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.109350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.109939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.110355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.197035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:25.198422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:25.205997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.207315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.208013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lazy-loading 'fault' on Instance uuid 1a0cb80c-e155-4079-9b66-51a732c612d8 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:27:25.211969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.213158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.213982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.214435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.304499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:25.331288 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-926bfc3e-0f8f-4c07-81af-5f77aca56f9d tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1259 microversion: 2.1 time: 0.144494 May 14 21:27:25.337425 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2332/4354] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:25 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:25.342671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72351f1f-8452-45f5-9dc1-a1fc7cc04275 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:25.351519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-72351f1f-8452-45f5-9dc1-a1fc7cc04275 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:25.455185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-72351f1f-8452-45f5-9dc1-a1fc7cc04275 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:25.474862 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72351f1f-8452-45f5-9dc1-a1fc7cc04275 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1239 microversion: 2.1 time: 0.133517 May 14 21:27:25.477459 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2333/4355] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:25 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1239 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:25.617737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:25.635243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:25.635925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:25.647079 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c8123ef-b1ce-49b0-a5c2-2bb46a529ff2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 200 len: 1318 microversion: 2.1 time: 0.579796 May 14 21:27:25.647750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2023/4356] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:25 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:25.655261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.657632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.663060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.663560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.665007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:25.665636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:25.677732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.678183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.682208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:25.683414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:25.843684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:25.857460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:25.862032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:25.864883 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb1d2145-c881-4904-82db-5ac0c5975221 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1333 microversion: 2.20 time: 0.210518 May 14 21:27:25.865348 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2024/4357] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:25 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:26.199384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:26.219785 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2e55281-8e8c-473b-8407-c4a9e7a0493b tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1324 microversion: 2.1 time: 0.608901 May 14 21:27:26.225107 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2334/4358] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:25 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1324 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:26.359464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:26.360105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:26.369284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.369746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:26.381984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.385758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:26.494088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:26.494723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:26.512327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.513181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:26.514491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.515107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:26.625780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:26.638089 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c80660f-ba48-4a69-a8de-8a7be0a81407 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1235 microversion: 2.1 time: 0.147910 May 14 21:27:26.639746 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2335/4359] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:26 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1235 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:26.667830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:26.669773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:26.673770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:26.680124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.680929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:26.682327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.683587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:26.705659 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 HTTP/1.1 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1a0cb80c-e155-4079-9b66-51a732c612d8'} May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:26.709148 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:26.714361 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:26.714361 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:26.714361 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:26.714361 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:26.714361 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:27:26.714361 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:26.716792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:26.717267 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f16b660-001d-4ee2-a879-7aea19a89c78 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1277 microversion: 2.1 time: 0.361834 May 14 21:27:26.720117 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae0e4051-1f94-48d4-8265-a0e88f9758d1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 404 len: 111 microversion: 2.1 time: 0.056790 May 14 21:27:26.722958 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2025/4360] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:26 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1277 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:26.724241 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2336/4361] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:26 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:26.743203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c18b832-d340-490f-b70c-a99b9b68082b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '.version_select at 0x7fb1b9780040>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:26.884814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:26.885124 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c18b832-d340-490f-b70c-a99b9b68082b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-key-1065171388" status: 202 len: 0 microversion: 2.1 time: 0.158697 May 14 21:27:26.885590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:26.886072 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2026/4362] 10.222.0.52 () {58 vars in 1208 bytes} [Sat May 14 21:27:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1065171388 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:27:26.903172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.903768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:26.906025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:26.906591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:27.076557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1611474638", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8da851bf-8623-41cd-8e7e-e11152a2fef0"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:27.079273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:27.105110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:27.106667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:27.113868 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cb223dcd-8fc9-4811-80a9-5214324461e8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1339 microversion: 2.20 time: 0.235049 May 14 21:27:27.115818 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2337/4363] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:26 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1339 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:27.177421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:27.242396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:27.243023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:27.250582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:27.251465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:27.252432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:27.253037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:27.450827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:27.466329 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-09b9e1fe-f54c-4e1a-9efa-a524d4c508c6 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1519 microversion: 2.1 time: 0.228699 May 14 21:27:27.466980 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2338/4364] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:27 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:27.544952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71889931-b9c1-4b09-94fc-2430f96aafb8 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-832396174", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71889931-b9c1-4b09-94fc-2430f96aafb8 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 242 May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-832396174", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-832396174', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '97063dec-be1a-44ad-8306-0607d2b2da93'}]}}} May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:27:27.549467 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71889931-b9c1-4b09-94fc-2430f96aafb8 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71889931-b9c1-4b09-94fc-2430f96aafb8 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.009975 May 14 21:27:27.559894 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2339/4365] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:27 2022] POST /compute/v2.1/servers => generated 175 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:27:27.573222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-501b9377-0ec7-4d9c-bc6d-8b3992a8587e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:27.573222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-501b9377-0ec7-4d9c-bc6d-8b3992a8587e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: 63bcfb71-437d-4fdf-8e33-68f78d13c29a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:27.585540 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-501b9377-0ec7-4d9c-bc6d-8b3992a8587e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] HTTP exception thrown: Instance 63bcfb71-437d-4fdf-8e33-68f78d13c29a could not be found. May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-501b9377-0ec7-4d9c-bc6d-8b3992a8587e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/63bcfb71-437d-4fdf-8e33-68f78d13c29a/metadata HTTP/1.1 May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 63bcfb71-437d-4fdf-8e33-68f78d13c29a could not be found. May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': '63bcfb71-437d-4fdf-8e33-68f78d13c29a'} May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63bcfb71-437d-4fdf-8e33-68f78d13c29a could not be found. May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63bcfb71-437d-4fdf-8e33-68f78d13c29a could not be found. May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:27.593358 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:27.604755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:27.604755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:27.604755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63bcfb71-437d-4fdf-8e33-68f78d13c29a could not be found. May 14 21:27:27.604755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.604755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-501b9377-0ec7-4d9c-bc6d-8b3992a8587e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 404 to user: Instance 63bcfb71-437d-4fdf-8e33-68f78d13c29a could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:27.604755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-501b9377-0ec7-4d9c-bc6d-8b3992a8587e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/63bcfb71-437d-4fdf-8e33-68f78d13c29a/metadata" status: 404 len: 111 microversion: 2.1 time: 0.038871 May 14 21:27:27.604755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2340/4366] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 21:27:27 2022] GET /compute/v2.1/servers/63bcfb71-437d-4fdf-8e33-68f78d13c29a/metadata => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:27.672795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:27.672795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:27.683165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:27.684053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:27.699967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:27.701119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:27.795459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:27.811002 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-69fe9528-e72b-4f9a-b492-f437041dc2c8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1309 microversion: 2.1 time: 0.150535 May 14 21:27:27.835801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2341/4367] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:27 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1309 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:27.850576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab5403a3-4a5b-4a9e-8ec8-7c57440a1b1e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1650759277", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab5403a3-4a5b-4a9e-8ec8-7c57440a1b1e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 499 May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1650759277", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1650759277', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '97063dec-be1a-44ad-8306-0607d2b2da93'}]}}} May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 14 21:27:27.857056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab5403a3-4a5b-4a9e-8ec8-7c57440a1b1e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab5403a3-4a5b-4a9e-8ec8-7c57440a1b1e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.024329 May 14 21:27:27.869610 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2342/4368] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:27 2022] POST /compute/v2.1/servers => generated 687 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:27:27.902588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:27.931699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:27.948165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:27.948959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:27.949978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:27.951206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:28.243469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:28.266933 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37484c9d-ccaf-4f1e-9d6a-05ede7175a5e tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.383563 May 14 21:27:28.272002 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2343/4369] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:27 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:28.282362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b43b750-8c25-4dda-8092-c032c4b68567 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1424363666", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b43b750-8c25-4dda-8092-c032c4b68567 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 500 May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1424363666", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1424363666', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '97063dec-be1a-44ad-8306-0607d2b2da93'}]}}} May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 14 21:27:28.300872 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.305521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.310027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b43b750-8c25-4dda-8092-c032c4b68567 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:28.311245 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b43b750-8c25-4dda-8092-c032c4b68567 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.035069 May 14 21:27:28.312180 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2344/4370] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:28 2022] POST /compute/v2.1/servers => generated 689 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:27:28.327146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:28.332404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:28.348786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:28.350217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:28.355910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:28.356387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:28.495326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:28.503069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:28.505048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:28.506406 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-602e748d-81ce-43a5-98e1-955025fcd321 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1339 microversion: 2.20 time: 0.193122 May 14 21:27:28.507149 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2345/4371] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:28 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:28.522121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66e112d4-e10f-4093-9209-7f39cc95ccfd tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2102108245", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66e112d4-e10f-4093-9209-7f39cc95ccfd tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 754 May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2102108245", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2102108245', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '97063dec-be1a-44ad-8306-0607d2b2da93'}]}}} May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:27:28.525769 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:27:28.529056 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:27:28.532047 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.532047 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.533280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66e112d4-e10f-4093-9209-7f39cc95ccfd tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:28.534359 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66e112d4-e10f-4093-9209-7f39cc95ccfd tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.026063 May 14 21:27:28.536344 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2346/4372] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:28 2022] POST /compute/v2.1/servers => generated 1197 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 14 21:27:28.592525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b042d0fa-72ef-4720-bc76-95a1dfe7898e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-663094402", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b042d0fa-72ef-4720-bc76-95a1dfe7898e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers HTTP/1.1 May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 1265 May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-663094402", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "97063dec-be1a-44ad-8306-0607d2b2da93"}]}} May 14 21:27:28.597839 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-663094402', 'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '97063dec-be1a-44ad-8306-0607d2b2da93'}]}}} May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.600987 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['server']: May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:27:28.603824 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:27:28.607753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:27:28.607753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.608426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b042d0fa-72ef-4720-bc76-95a1dfe7898e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:28.609616 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b042d0fa-72ef-4720-bc76-95a1dfe7898e tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.021091 May 14 21:27:28.620323 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2347/4373] 10.222.0.52 () {60 vars in 1147 bytes} [Sat May 14 21:27:28 2022] POST /compute/v2.1/servers => generated 2221 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 14 21:27:28.627275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c03b30cc-b1bf-49c3-95a0-276787d0f235 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:28.628960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c03b30cc-b1bf-49c3-95a0-276787d0f235 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: c3ce15e2-bf91-4962-b428-69435c6b77a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:28.635560 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c03b30cc-b1bf-49c3-95a0-276787d0f235 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] HTTP exception thrown: Instance c3ce15e2-bf91-4962-b428-69435c6b77a7 could not be found. May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c03b30cc-b1bf-49c3-95a0-276787d0f235 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/c3ce15e2-bf91-4962-b428-69435c6b77a7/metadata/test2 HTTP/1.1 May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance c3ce15e2-bf91-4962-b428-69435c6b77a7 could not be found. May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': 'c3ce15e2-bf91-4962-b428-69435c6b77a7', 'id': 'test2'} May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ce15e2-bf91-4962-b428-69435c6b77a7 could not be found. May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ce15e2-bf91-4962-b428-69435c6b77a7 could not be found. May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:28.637225 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:28.642364 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:28.642364 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:28.642364 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ce15e2-bf91-4962-b428-69435c6b77a7 could not be found. May 14 21:27:28.642364 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:28.643841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c03b30cc-b1bf-49c3-95a0-276787d0f235 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 404 to user: Instance c3ce15e2-bf91-4962-b428-69435c6b77a7 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:28.643841 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c03b30cc-b1bf-49c3-95a0-276787d0f235 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/c3ce15e2-bf91-4962-b428-69435c6b77a7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.022265 May 14 21:27:28.664686 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2348/4374] 10.222.0.52 () {58 vars in 1280 bytes} [Sat May 14 21:27:28 2022] GET /compute/v2.1/servers/c3ce15e2-bf91-4962-b428-69435c6b77a7/metadata/test2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:28.672495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:28.673311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:28.680501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:28.681244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:28.682237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:28.682851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:28.712288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:28.712820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:28.713216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:28.713909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:28.714454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:28.718081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:27:28.729684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:28.730618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:28.732999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:28.734025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:28.759008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:28.766178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:28.784646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:28.787966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:29.015738 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53af004c-0191-4a84-ba1e-93f5f90192fb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944012 May 14 21:27:29.017381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2027/4375] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:27:29.026772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:29.029520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:29.054132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.054594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.056027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.056643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.184114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:29.194850 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b02454f-79f2-4a1e-ad2b-3830c9765b72 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1297 microversion: 2.1 time: 0.174112 May 14 21:27:29.205878 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2028/4376] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:29 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1297 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:29.212264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bed22aea-b012-4d45-9650-79d4488ef5c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:29.213001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bed22aea-b012-4d45-9650-79d4488ef5c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:29.361887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bed22aea-b012-4d45-9650-79d4488ef5c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:29.374020 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bed22aea-b012-4d45-9650-79d4488ef5c0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1209 microversion: 2.1 time: 0.166907 May 14 21:27:29.375161 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2029/4377] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:29 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1209 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:29.381948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:29.382575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:29.390633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.391612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.392658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.393349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.486676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0d02081-b4f3-43f9-8f6b-3d3f34eca522 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 204 len: 0 microversion: 2.1 time: 0.822568 May 14 21:27:29.487361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2349/4378] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:28 2022] DELETE /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:27:29.492974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-81961dc3-7f76-4f42-8027-b9774c11755a req-6484c8b8-ea81-4e9c-894f-a998c08d5ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67b8177-e7c2-4706-ab78-e147bd9817c7", "tag": "02a58b33-a548-4458-8133-d96c60744b6d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:29.501796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-81961dc3-7f76-4f42-8027-b9774c11755a req-6484c8b8-ea81-4e9c-894f-a998c08d5ad0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.502514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-81961dc3-7f76-4f42-8027-b9774c11755a req-6484c8b8-ea81-4e9c-894f-a998c08d5ad0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.517797 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-81961dc3-7f76-4f42-8027-b9774c11755a req-6484c8b8-ea81-4e9c-894f-a998c08d5ad0 service nova] Creating event network-changed:02a58b33-a548-4458-8133-d96c60744b6d for instance f67b8177-e7c2-4706-ab78-e147bd9817c7 on nch2-master-1 May 14 21:27:29.525154 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-81961dc3-7f76-4f42-8027-b9774c11755a req-6484c8b8-ea81-4e9c-894f-a998c08d5ad0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036210 May 14 21:27:29.526347 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2350/4379] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:29.537839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:29.539624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:29.562312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.564481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.564481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.564481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.685102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:29.695312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d733277b-2def-42fa-92fe-d60a102265f9 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.317613 May 14 21:27:29.705807 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2030/4380] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:29 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:29.718607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:29.720933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:29.729352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.730938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.731527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:29.732352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:29.864981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:29.874578 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-241a4c3f-ae2b-493c-9b03-9707913837f7 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1525 microversion: 2.1 time: 0.346806 May 14 21:27:29.875877 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2351/4381] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:29 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1525 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:29.884504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a69acba8-6bbd-4e45-a5c0-aea8bace5b6c tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Action: 'create', calling method: .version_select at 0x7fb1a6da73a0>, body: {"keypair": {"name": "tempest-keypair-1027249644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJj5KxRg8vK5awS6ZPIk8SgQaWYtiARkrSnymptcTxFdZnJMY1qzq7swGL5jY/Tml+l+IJeHzGoA7H6tfdgTiZMQ5jt9l+xkcmb/SaBIjnNKmPwzdx5Dr93hgNVo01wzQ=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:29.902450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a69acba8-6bbd-4e45-a5c0-aea8bace5b6c tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Getting quotas for project 1df1ae61bf82472dadc4830840421a63. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:29.910051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a69acba8-6bbd-4e45-a5c0-aea8bace5b6c tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Getting quotas for user 22a06bece449427d91289ade79c94822 and project 1df1ae61bf82472dadc4830840421a63. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:30.101174 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a69acba8-6bbd-4e45-a5c0-aea8bace5b6c tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.221048 May 14 21:27:30.104758 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2352/4382] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:27:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 228 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 21:27:30.213712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:30.215328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:30.226292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.226502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:30.230089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.230696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:30.275663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:30.293103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:30.294632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:30.296167 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8b982f71-f640-42fc-b041-95400746e289 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.588338 May 14 21:27:30.296925 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2031/4383] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:29 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:30.401146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:30.409213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:30.413698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.424406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:30.427041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.427716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:30.467654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:30.512158 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b4378c47-739f-4feb-8f5a-c1843950c5f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.300145 May 14 21:27:30.515300 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2353/4384] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:30 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:30.601421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:30.619679 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79577088-4b5f-46ec-bf80-f99341c140bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1213 microversion: 2.1 time: 0.227211 May 14 21:27:30.622022 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2032/4385] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:30 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:30.713326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:30.714430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:30.727085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.728615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:30.729681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.730461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:30.895689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:30.898404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:30.932031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.933612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:30.938814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:30.940879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:31.027464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:31.047065 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca75b0f9-30ee-4161-ac02-08251845e180 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.337367 May 14 21:27:31.048179 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2354/4386] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:30 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:31.315232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:31.316284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:31.324038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:31.324733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:31.325542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:31.325985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:31.518101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:31.527760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:31.529288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:31.530509 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ecde9190-309e-41a9-904f-f19b22c301d9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.219625 May 14 21:27:31.531098 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2355/4387] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:31 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:31.536754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:31.537522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:31.543621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:31.550758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:31.550758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:31.550758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:31.696573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:31.704485 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5fa5f76-e5a5-4ce3-97e8-1e3bdef77162 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.172175 May 14 21:27:31.705186 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2356/4388] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:31 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:31.710382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:31.711298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:31.718901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:31.719698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:31.720134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:31.721012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:31.721713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:31.728449 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96c2643e-6341-4548-a9b2-e55c1b529733 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1525 microversion: 2.1 time: 0.838829 May 14 21:27:31.729086 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2033/4389] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:30 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1525 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:31.798394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:31.816487 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8185a0c4-5fdb-4a12-aa88-a70d116ee99d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1269 microversion: 2.1 time: 0.102973 May 14 21:27:31.816487 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2357/4390] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:31 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1269 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:32.064587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:32.065357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:32.098405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:32.099384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:32.101964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:32.102642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:32.147934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ec086eee-11e1-4ae7-83a1-96b09d1c6c08 req-de062af5-7c41-45ba-a15e-205437854cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4097156a-300a-4d17-87df-60620c836925", "tag": "5c660063-0f23-4b2d-b5ca-12d4f3ea2036"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:32.164007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ec086eee-11e1-4ae7-83a1-96b09d1c6c08 req-de062af5-7c41-45ba-a15e-205437854cb3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:32.164448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ec086eee-11e1-4ae7-83a1-96b09d1c6c08 req-de062af5-7c41-45ba-a15e-205437854cb3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:32.212437 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ec086eee-11e1-4ae7-83a1-96b09d1c6c08 req-de062af5-7c41-45ba-a15e-205437854cb3 service nova] Creating event network-changed:5c660063-0f23-4b2d-b5ca-12d4f3ea2036 for instance 4097156a-300a-4d17-87df-60620c836925 on nch2-master-1 May 14 21:27:32.221848 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ec086eee-11e1-4ae7-83a1-96b09d1c6c08 req-de062af5-7c41-45ba-a15e-205437854cb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079993 May 14 21:27:32.226277 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2358/4391] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:27:32.550645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:32.552356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:32.562997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:32.563596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:32.566552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:32.567242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:32.653915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:32.668699 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ea64e88-c2c0-4763-a9d2-451ca716e2aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.608151 May 14 21:27:32.671051 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2034/4392] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:32 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:32.735115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:32.736090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:32.745136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:32.745729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:32.746443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:32.747785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:33.076431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:33.088642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:33.090555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:33.092145 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-30c14272-5a86-4b83-9b12-2526af6b48fe tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.546760 May 14 21:27:33.094875 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2359/4393] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:32 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:33.098685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:33.099559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:33.106855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:33.119139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:33.123671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:33.123671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:33.165300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:33.168747 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-abdc25ac-2cbc-4b9d-8bcb-ca4bcd181934 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.450817 May 14 21:27:33.169903 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2035/4394] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:32 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:33.183069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:33.184026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:33.194822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:33.195628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:33.196636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:33.197260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:33.244821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a51643a51af4175b40a61a726eac80a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c39236c4fcb74ea2838acddd315e00ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:33.256075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-26814219-be80-44c6-8610-c2759b9a24ba tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 200 len: 1483 microversion: 2.1 time: 0.161705 May 14 21:27:33.257453 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2360/4395] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:33 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 1483 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:33.373094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:33.376855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-060e6e46-f36b-4fdc-8053-93902dae34eb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1267 microversion: 2.1 time: 0.205612 May 14 21:27:33.377447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2036/4396] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:33 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:33.686456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:33.687082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:33.698296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:33.699139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:33.700112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:33.700735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:33.937492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:33.948787 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9722b177-9dcc-462e-beda-405128540ccc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.266171 May 14 21:27:33.950426 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2361/4397] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:33 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:34.048783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-173689002", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ef572d9b-20a4-4311-9582-fea3efbf759e"}, {"port": "ebe73789-12d4-4374-8e71-4e93c4257d27", "tag": "port-1"}, {"port": "63396429-e743-49a6-a83f-427d96ffbf18", "tag": "port-2"}, {"uuid": "d997121d-d5fd-4dda-af06-15496863df8e", "tag": "net-1"}, {"uuid": "d997121d-d5fd-4dda-af06-15496863df8e"}, {"uuid": "2379f3be-5962-40d1-834f-0e520eee96e4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "2379f3be-5962-40d1-834f-0e520eee96e4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "252f69af-c210-4b9b-8b32-e9dc857c2b60", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "12a0e3c5-2efb-4eb6-a302-15e9e7d28509", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7d2d29a8-c865-4570-a305-7473b65a3efb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1769857056"}], "key_name": "tempest-keypair-1027249644", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:34.110265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:34.110889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:34.124492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.125192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.126492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.127162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.239009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] validate_networks() for [('ef572d9b-20a4-4311-9582-fea3efbf759e', None, None, None, None, None), (None, None, 'ebe73789-12d4-4374-8e71-4e93c4257d27', None, None, None), (None, None, '63396429-e743-49a6-a83f-427d96ffbf18', None, None, None), ('d997121d-d5fd-4dda-af06-15496863df8e', None, None, None, None, None), ('d997121d-d5fd-4dda-af06-15496863df8e', None, None, None, None, None), ('2379f3be-5962-40d1-834f-0e520eee96e4', '10.2.2.100', None, None, None, None), ('2379f3be-5962-40d1-834f-0e520eee96e4', '10.2.2.200', None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:34.321095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:34.329984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:34.332728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:34.345087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-308076f4-1f45-4b70-9772-9e8c41c928f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.227833 May 14 21:27:34.345087 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2362/4398] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:34 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:34.351327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:34.351991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:34.358310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.366103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.366103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.366103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.555080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:34.562904 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1cfcbd8-7281-4335-96a3-a00bfea6479e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.215948 May 14 21:27:34.563518 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2363/4399] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:34 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:34.569653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:34.570541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] [instance: e4380973-d902-4e88-b97e-a89b812298ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:34.579730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.580208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.581067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.582046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.602062 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] HTTP exception thrown: Instance e4380973-d902-4e88-b97e-a89b812298ac could not be found. May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Request method failure captured: May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac HTTP/1.1 May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB6pLuLS83gCjTU3RGwr7NYUzdk2er0DzfMj9XEIRfAHSH3RIyaBfuTFUJS3awlN4A17idLBApbLbKOX-qHibs11eQeN85ibyll4Jf-t2AFZGwcgZ5Rs1C5YXj9XIcgC31BRJlqyHVzG4ypCbLu_yXSwEjTkizrCsKtQhDnuEI84PxY May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c39236c4fcb74ea2838acddd315e00ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c39236c4fcb74ea2838acddd315e00ff", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c39236c4fcb74ea2838acddd315e00ff May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-889405770 May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1a51643a51af4175b40a61a726eac80a May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-889405770-project May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance e4380973-d902-4e88-b97e-a89b812298ac could not be found. May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'e4380973-d902-4e88-b97e-a89b812298ac'} May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4380973-d902-4e88-b97e-a89b812298ac could not be found. May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4380973-d902-4e88-b97e-a89b812298ac could not be found. May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:34.606681 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4380973-d902-4e88-b97e-a89b812298ac could not be found. May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] Returning 404 to user: Instance e4380973-d902-4e88-b97e-a89b812298ac could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:34.612138 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97f57621-4031-4173-8ab7-8acea71573f5 tempest-ServerMetadataNegativeTestJSON-889405770 tempest-ServerMetadataNegativeTestJSON-889405770-project] 10.222.0.52 "GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac" status: 404 len: 111 microversion: 2.1 time: 0.040630 May 14 21:27:34.614483 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2364/4400] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:34 2022] GET /compute/v2.1/servers/e4380973-d902-4e88-b97e-a89b812298ac => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:34.619926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-cd8bfcfd-e749-4a0d-b8d8-c51c12c85329 req-22b19177-7d46-4ce0-872e-67ec41dc8533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4380973-d902-4e88-b97e-a89b812298ac", "name": "network-vif-deleted", "tag": "bc2f7589-7d26-40da-b194-9726e513185a"}, {"name": "network-changed", "server_uuid": "512524da-bcba-4fde-ac6e-ba6748e659e9", "tag": "a540ba33-d93a-4e5d-bf81-61d3d93287c8"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:34.629960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cd8bfcfd-e749-4a0d-b8d8-c51c12c85329 req-22b19177-7d46-4ce0-872e-67ec41dc8533 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.632801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cd8bfcfd-e749-4a0d-b8d8-c51c12c85329 req-22b19177-7d46-4ce0-872e-67ec41dc8533 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.645859 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-cd8bfcfd-e749-4a0d-b8d8-c51c12c85329 req-22b19177-7d46-4ce0-872e-67ec41dc8533 service nova] Creating event network-vif-deleted:bc2f7589-7d26-40da-b194-9726e513185a for instance e4380973-d902-4e88-b97e-a89b812298ac on nch1-master-1 May 14 21:27:34.646384 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-cd8bfcfd-e749-4a0d-b8d8-c51c12c85329 req-22b19177-7d46-4ce0-872e-67ec41dc8533 service nova] Creating event network-changed:a540ba33-d93a-4e5d-bf81-61d3d93287c8 for instance 512524da-bcba-4fde-ac6e-ba6748e659e9 on nch2-master-1 May 14 21:27:34.655548 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-cd8bfcfd-e749-4a0d-b8d8-c51c12c85329 req-22b19177-7d46-4ce0-872e-67ec41dc8533 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039557 May 14 21:27:34.656640 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2365/4401] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:34.666084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:34.669401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:34.676763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.677539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.678441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.678970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.918869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:34.938514 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6291d07-889e-46c7-9fcd-711bb371bbaf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.279565 May 14 21:27:34.938514 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2366/4402] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:34 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:34.966926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:34.967604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:34.977849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.978308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:34.979098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:34.979566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:35.239519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:35.250078 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e6f6156a-e8e4-468a-b7d4-cc40f5f6e13f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.287601 May 14 21:27:35.251394 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2367/4403] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:34 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:35.352392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:35.360911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:35.360911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:35.360911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:35.360911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:35.361564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:35.571148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:35.584131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:35.584131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:35.584131 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3bccb62-05c1-4c5b-ae8d-f94909dddfbc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.235380 May 14 21:27:35.592428 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2368/4404] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:35 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:35.597206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:35.597837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:35.604216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:35.606323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:35.606323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:35.606323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:35.892740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:35.901302 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fccc111f-ba06-4388-bdee-21b428ab85b7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.315135 May 14 21:27:35.901868 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2369/4405] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:35 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:35.954990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:35.956576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:35.963143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:35.963784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:35.965172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:35.965801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:36.185797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:36.197773 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-06f63159-4d95-4a33-a6f0-5057eb9514ea tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.247242 May 14 21:27:36.199249 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2370/4406] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:35 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:36.269398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:36.270045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:36.277251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:36.278145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:36.279324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:36.279791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:36.515357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:36.525378 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7376614e-0444-45f1-820d-aff2319984d7 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.260577 May 14 21:27:36.530456 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2371/4407] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:36 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:36.602871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:36.603849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:36.613116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:36.613533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:36.614448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:36.614892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:36.837734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:36.854855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:36.856810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:36.858444 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6d8c944-9906-439a-9f64-703967ae0ec0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.259699 May 14 21:27:36.875368 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2372/4408] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:36 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:36.920722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:36.922773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:36.937460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:36.937460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:36.937460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:36.937460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:37.076380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:37.085246 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f52dc926-6ab5-4125-b4a1-02a3215c0571 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.170537 May 14 21:27:37.085829 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2373/4409] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:36 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:37.090264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-9030d21c-9772-4f72-b21d-7df8e14bc630 req-6413612d-e99f-43c9-a7c6-dfaeda776212 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "441f55e9-7d61-4fe1-824f-b109de8af293", "tag": "639111d9-ddb5-416d-9307-f0c501e35589"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:37.098366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9030d21c-9772-4f72-b21d-7df8e14bc630 req-6413612d-e99f-43c9-a7c6-dfaeda776212 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:37.103822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9030d21c-9772-4f72-b21d-7df8e14bc630 req-6413612d-e99f-43c9-a7c6-dfaeda776212 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:37.109771 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9030d21c-9772-4f72-b21d-7df8e14bc630 req-6413612d-e99f-43c9-a7c6-dfaeda776212 service nova] Creating event network-changed:639111d9-ddb5-416d-9307-f0c501e35589 for instance 441f55e9-7d61-4fe1-824f-b109de8af293 on nch1-master-1 May 14 21:27:37.115358 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-9030d21c-9772-4f72-b21d-7df8e14bc630 req-6413612d-e99f-43c9-a7c6-dfaeda776212 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028412 May 14 21:27:37.116019 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2374/4410] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:37.218345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:37.218345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:37.233545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:37.234957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:37.236043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:37.236483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:37.429385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:37.437238 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a4777f9-ca28-4dbd-b09b-4a419b3c6649 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.224607 May 14 21:27:37.438129 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2375/4411] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:37 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:37.548074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:37.548768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:37.574197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:37.574197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:37.574197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:37.574197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:37.780474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:37.789659 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b73d21a7-dd03-43ad-a9c1-8ba795a0534a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.247139 May 14 21:27:37.792220 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2376/4412] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:37 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:37.893237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:37.894495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:37.901061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:37.901518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:37.902498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:37.903107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.129042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:38.148744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:38.149827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:38.150303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:38.150603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:38.150758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:38.151225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:38.151931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:38.153188 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce9b49bc-a6b8-4fb3-8580-554f645ae10c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.264233 May 14 21:27:38.155472 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2377/4413] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:37 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:38.165808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.165808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.165808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.165808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.188424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Getting quotas for project 1df1ae61bf82472dadc4830840421a63. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:38.194591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Getting quotas for user 22a06bece449427d91289ade79c94822 and project 1df1ae61bf82472dadc4830840421a63. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:38.372585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:38.376800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='252f69af-c210-4b9b-8b32-e9dc857c2b60',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='12a0e3c5-2efb-4eb6-a302-15e9e7d28509',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7d2d29a8-c865-4570-a305-7473b65a3efb',volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:38.427959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-6c108ceb-d4df-4716-9fb0-e0f6526d6e8c req-4959dab9-5df0-4fd5-85b4-75ec0dc03e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67b8177-e7c2-4706-ab78-e147bd9817c7", "name": "network-vif-plugged", "status": "completed", "tag": "02a58b33-a548-4458-8133-d96c60744b6d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:38.436679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6c108ceb-d4df-4716-9fb0-e0f6526d6e8c req-4959dab9-5df0-4fd5-85b4-75ec0dc03e18 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.437238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-6c108ceb-d4df-4716-9fb0-e0f6526d6e8c req-4959dab9-5df0-4fd5-85b4-75ec0dc03e18 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.450612 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-6c108ceb-d4df-4716-9fb0-e0f6526d6e8c req-4959dab9-5df0-4fd5-85b4-75ec0dc03e18 service nova] Creating event network-vif-plugged:02a58b33-a548-4458-8133-d96c60744b6d for instance f67b8177-e7c2-4706-ab78-e147bd9817c7 on nch2-master-1 May 14 21:27:38.457313 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-6c108ceb-d4df-4716-9fb0-e0f6526d6e8c req-4959dab9-5df0-4fd5-85b4-75ec0dc03e18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.287649 May 14 21:27:38.459163 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2378/4414] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:38.478310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:38.479435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:38.488746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.489550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.490710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.491378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.708950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:38.720128 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac6f23c0-6d24-4332-8fe2-5473282be0bb tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.259381 May 14 21:27:38.721006 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2379/4415] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:38 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:38.726819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:38.727835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:38.734317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.734969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.737943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.737943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.914643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:38.923514 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7ebdc14-8b3b-4a02-b8da-cca52ef13cb3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.201265 May 14 21:27:38.924415 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2380/4416] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:38 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:38.938015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:38.938656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:38.949023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.949897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:38.957059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:38.957059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:39.109056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.116825 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-60396a3b-9aa8-4f5a-8db9-cd1335e44a8b tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1307 microversion: 2.1 time: 0.190436 May 14 21:27:39.117478 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2381/4417] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:38 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1307 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:39.173238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:39.175541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:39.181301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:39.181764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:39.182549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:39.182987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:39.333180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.343276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.344925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.346228 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5313de16-55b3-4e47-8f97-e76dfe179aac tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.176888 May 14 21:27:39.347839 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2382/4418] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:39 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:39.622965 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f6d64d2f-110d-4b97-b4ac-b9f5f16b4419 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 5.579171 May 14 21:27:39.625985 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2037/4419] 10.222.0.52 () {62 vars in 1188 bytes} [Sat May 14 21:27:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 5583 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:27:39.635062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8780969-c1f5-4b13-9358-c14bff0f322b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:39.635718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8780969-c1f5-4b13-9358-c14bff0f322b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:39.738578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:39.739908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:39.747274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:39.753576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:39.753576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:39.753576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:39.759510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8780969-c1f5-4b13-9358-c14bff0f322b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.771693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8780969-c1f5-4b13-9358-c14bff0f322b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.777474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8780969-c1f5-4b13-9358-c14bff0f322b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.782463 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8780969-c1f5-4b13-9358-c14bff0f322b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1285 microversion: 2.32 time: 0.151979 May 14 21:27:39.783605 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2383/4420] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:39 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:39.942489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:39.943205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:39.957327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:39.963933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:39.963933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:39.966904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:39.975174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:39.984533 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bb82e13-797d-4de5-b092-1131f34287b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.250707 May 14 21:27:39.985410 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2038/4421] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:39 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:40.140668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:40.140668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:40.147959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:40.148623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:40.152904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:40.153643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:40.220908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.234611 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e531789-9718-4623-bf66-c3f0a1b57667 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.297710 May 14 21:27:40.239910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2384/4422] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:39 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:40.323512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.332114 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4d90d2e-6d52-498c-9fc0-d27ac533c8b1 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1487 microversion: 2.1 time: 0.200837 May 14 21:27:40.332705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2039/4423] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:40 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1487 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:40.351286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41e5d69a-33fd-48e4-a827-1dbcc5bed31a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-265428378"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:40.352560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-41e5d69a-33fd-48e4-a827-1dbcc5bed31a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:40.358553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41e5d69a-33fd-48e4-a827-1dbcc5bed31a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:40.359011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41e5d69a-33fd-48e4-a827-1dbcc5bed31a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:40.359823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41e5d69a-33fd-48e4-a827-1dbcc5bed31a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:40.360262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41e5d69a-33fd-48e4-a827-1dbcc5bed31a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:40.368918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:40.369643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:40.375867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:40.376393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:40.377245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:40.377849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:40.570926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.579018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.580691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.582150 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a36cb1b0-a090-4251-a30a-f4237ae22065 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.217231 May 14 21:27:40.582802 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2040/4424] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:40 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:40.587624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c15efb30-1c67-4d7f-8a02-795f67072d1a req-ad32e9f8-ea26-44a6-aaa8-78a03603891e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4097156a-300a-4d17-87df-60620c836925", "name": "network-vif-plugged", "status": "completed", "tag": "5c660063-0f23-4b2d-b5ca-12d4f3ea2036"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:40.597232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c15efb30-1c67-4d7f-8a02-795f67072d1a req-ad32e9f8-ea26-44a6-aaa8-78a03603891e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:40.597730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c15efb30-1c67-4d7f-8a02-795f67072d1a req-ad32e9f8-ea26-44a6-aaa8-78a03603891e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:40.624039 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c15efb30-1c67-4d7f-8a02-795f67072d1a req-ad32e9f8-ea26-44a6-aaa8-78a03603891e service nova] Creating event network-vif-plugged:5c660063-0f23-4b2d-b5ca-12d4f3ea2036 for instance 4097156a-300a-4d17-87df-60620c836925 on nch2-master-1 May 14 21:27:40.630263 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c15efb30-1c67-4d7f-8a02-795f67072d1a req-ad32e9f8-ea26-44a6-aaa8-78a03603891e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045923 May 14 21:27:40.631227 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2041/4425] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:40.790440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c15efb30-1c67-4d7f-8a02-795f67072d1a req-ad32e9f8-ea26-44a6-aaa8-78a03603891e service nova] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:40.791660 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c15efb30-1c67-4d7f-8a02-795f67072d1a req-ad32e9f8-ea26-44a6-aaa8-78a03603891e service nova] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001728 May 14 21:27:40.792247 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2042/4426] 10.222.0.52 () {56 vars in 885 bytes} [Sat May 14 21:27:40 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) May 14 21:27:40.816650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-80d2eb02-8bc4-4166-af18-46e0a3ed8060 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:40.817468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-80d2eb02-8bc4-4166-af18-46e0a3ed8060 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:40.877736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80d2eb02-8bc4-4166-af18-46e0a3ed8060 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.885739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80d2eb02-8bc4-4166-af18-46e0a3ed8060 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.887349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80d2eb02-8bc4-4166-af18-46e0a3ed8060 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:40.888594 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-80d2eb02-8bc4-4166-af18-46e0a3ed8060 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1285 microversion: 2.32 time: 0.088578 May 14 21:27:40.889610 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2043/4427] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:40 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:40.988631 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-41e5d69a-33fd-48e4-a827-1dbcc5bed31a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "POST /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7/action" status: 202 len: 0 microversion: 2.1 time: 0.642052 May 14 21:27:40.989548 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2385/4428] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:27:40 2022] POST /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:27:41.003096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.004153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:41.006898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3670d6ca-b9ff-4d4a-a7cd-c95c8a610d96 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c68310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.010641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.011101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.012042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.012702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.072298 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3670d6ca-b9ff-4d4a-a7cd-c95c8a610d96 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d" status: 200 len: 1413 microversion: 2.1 time: 0.076225 May 14 21:27:41.079887 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2044/4429] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:40 2022] GET /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:41.085472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a7ffaa4-97f9-43e5-b1d1-5023a0710b2f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6c03ee0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.140755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a7ffaa4-97f9-43e5-b1d1-5023a0710b2f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d" status: 200 len: 1413 microversion: 2.1 time: 0.059643 May 14 21:27:41.144095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2045/4430] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:41 2022] GET /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:41.154900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ea4b12db-06be-49ce-9c51-0b1d4f26f157 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6cc75e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.248723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.258771 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2fa50548-87f4-49a3-a09d-5f011b9c2fcd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.259292 May 14 21:27:41.258771 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2386/4431] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:40 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:41.264073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.264791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:41.271691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.275921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.275921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.275921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.430459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.439980 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c5b80444-24b8-4967-b7ca-f31b9a903f2d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.179511 May 14 21:27:41.440870 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2387/4432] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:41 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:41.471011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ea4b12db-06be-49ce-9c51-0b1d4f26f157 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d" status: 204 len: 0 microversion: 2.1 time: 0.319691 May 14 21:27:41.471710 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2046/4433] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:41 2022] DELETE /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:27:41.480851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cbf9e6d-3891-4c70-aa05-6ac74ba8ab00 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6d12430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.502916 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1cbf9e6d-3891-4c70-aa05-6ac74ba8ab00 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Image not found. May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cbf9e6d-3891-4c70-aa05-6ac74ba8ab00 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d HTTP/1.1 May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'e8fc0e9d-9b27-463b-b318-eb4b540e734d'} May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e8fc0e9d-9b27-463b-b318-eb4b540e734d May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:27:41.505353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8fc0e9d-9b27-463b-b318-eb4b540e734d could not be found. May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1cbf9e6d-3891-4c70-aa05-6ac74ba8ab00 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1cbf9e6d-3891-4c70-aa05-6ac74ba8ab00 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d" status: 404 len: 62 microversion: 2.1 time: 0.030487 May 14 21:27:41.516000 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2388/4434] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:27:41 2022] GET /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:27:41.521976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.521976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:41.524511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.525031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.525759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.526250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.603236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.603911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:41.614134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.614615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.615383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.615853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.792229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.805547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.807289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.808976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-92e579d8-1d55-441a-a490-c6b45347b824 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1406 microversion: 2.20 time: 0.209543 May 14 21:27:41.810085 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2389/4435] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:41 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:41.856890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.866036 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de5f2106-6e41-4fdf-8a27-da6b4863f39a tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1499 microversion: 2.1 time: 0.353733 May 14 21:27:41.867357 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2047/4436] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:41 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1499 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:41.907371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:41.908060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:41.915485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.923608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.923608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:41.923608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:41.982012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.992371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.993948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:41.995140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c3c7f55-0426-4ffa-8cba-3a8b829eb955 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1527 microversion: 2.32 time: 0.091871 May 14 21:27:41.995706 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2390/4437] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:41 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1527 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:42.278133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:42.279096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:42.286235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.286844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.287968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.288429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.457842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:42.458449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:42.465860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:42.475317 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-08261b2a-b86d-4e4c-86de-58c794e113a2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.203386 May 14 21:27:42.476281 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2048/4438] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:42 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:42.478039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.478806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.479647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.480085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.620434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:42.628447 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bbe4f06b-70d8-4f2f-b35b-9a03dca2421f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.174452 May 14 21:27:42.629022 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2391/4439] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:42 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:42.655049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5401db1d-c3e6-42e4-8372-2bd68b75bc48 req-d036a86d-b704-4bb5-93c3-9ef3d5a73c65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512524da-bcba-4fde-ac6e-ba6748e659e9", "name": "network-vif-plugged", "status": "completed", "tag": "a540ba33-d93a-4e5d-bf81-61d3d93287c8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:42.663209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5401db1d-c3e6-42e4-8372-2bd68b75bc48 req-d036a86d-b704-4bb5-93c3-9ef3d5a73c65 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.664260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5401db1d-c3e6-42e4-8372-2bd68b75bc48 req-d036a86d-b704-4bb5-93c3-9ef3d5a73c65 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.675862 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5401db1d-c3e6-42e4-8372-2bd68b75bc48 req-d036a86d-b704-4bb5-93c3-9ef3d5a73c65 service nova] Creating event network-vif-plugged:a540ba33-d93a-4e5d-bf81-61d3d93287c8 for instance 512524da-bcba-4fde-ac6e-ba6748e659e9 on nch2-master-1 May 14 21:27:42.680632 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5401db1d-c3e6-42e4-8372-2bd68b75bc48 req-d036a86d-b704-4bb5-93c3-9ef3d5a73c65 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029291 May 14 21:27:42.681240 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2049/4440] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:42.828801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:42.829997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:42.846374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.846374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.846374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.846374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.884695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:42.886051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:42.895829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.896579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:42.897632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:42.898249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.102986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.114068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.116823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.118761 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f808f147-2fd3-4a23-adc1-0213611c0b65 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1598 microversion: 2.20 time: 0.295299 May 14 21:27:43.119718 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2392/4441] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:42 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1598 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:43.137028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:43.137754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:43.150620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.151396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.152389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.152826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.224670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.235446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.236994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.237230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.238178 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-09e7f116-d1bb-477b-afaa-430be58e11d4 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1593 microversion: 2.32 time: 0.105591 May 14 21:27:43.239178 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2393/4442] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:43 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1593 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:43.249191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a9d80d4e-ca1c-4af3-9654-1db0037dfa39 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:43.249191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a9d80d4e-ca1c-4af3-9654-1db0037dfa39 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:43.251437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9d80d4e-ca1c-4af3-9654-1db0037dfa39 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.251931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9d80d4e-ca1c-4af3-9654-1db0037dfa39 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.252706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9d80d4e-ca1c-4af3-9654-1db0037dfa39 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.253368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9d80d4e-ca1c-4af3-9654-1db0037dfa39 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.260018 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ae71779-372a-41df-94c0-59d85568a258 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1505 microversion: 2.1 time: 0.379663 May 14 21:27:43.262700 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2050/4443] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:42 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:43.340020 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a9d80d4e-ca1c-4af3-9654-1db0037dfa39 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099480 May 14 21:27:43.341031 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2394/4444] 10.222.0.52 () {60 vars in 1315 bytes} [Sat May 14 21:27:43 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:27:43.495594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:43.496273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:43.504122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.504596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.505374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.505814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.646823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:43.650554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:43.655989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.656684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.657278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:43.657785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:43.823070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.832595 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e9b5e7a6-6719-4eee-b225-19be87e870f1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.190512 May 14 21:27:43.833539 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2395/4445] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:43 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:43.891844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:43.902727 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3953b51c-9ddd-402f-b5e1-a5eb9d83384f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1365 microversion: 2.1 time: 0.412983 May 14 21:27:43.907381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2051/4446] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:43 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:44.258799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:44.259660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:44.269290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.270398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.271492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.272439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.282320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:44.282930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:44.290197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.290654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.291423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.291886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.355377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:44.367394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:44.370129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:44.371470 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-67f0dd5e-bd61-4b24-a3f1-ae8de9d4eefe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1593 microversion: 2.32 time: 0.118599 May 14 21:27:44.372416 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2396/4447] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:44 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1593 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:44.636816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:44.647624 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ca9ebac-2a17-4faf-87ad-1d0c19e2c319 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1505 microversion: 2.1 time: 0.369118 May 14 21:27:44.648223 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2052/4448] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:44 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:44.697518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-13e68c0b-d953-4c6a-8b01-7d50bf110a7b req-b858e26f-5d23-4480-8e7a-d384433de70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441f55e9-7d61-4fe1-824f-b109de8af293", "name": "network-vif-plugged", "status": "completed", "tag": "639111d9-ddb5-416d-9307-f0c501e35589"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:44.711807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-13e68c0b-d953-4c6a-8b01-7d50bf110a7b req-b858e26f-5d23-4480-8e7a-d384433de70b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.714387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-13e68c0b-d953-4c6a-8b01-7d50bf110a7b req-b858e26f-5d23-4480-8e7a-d384433de70b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.814717 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-13e68c0b-d953-4c6a-8b01-7d50bf110a7b req-b858e26f-5d23-4480-8e7a-d384433de70b service nova] Creating event network-vif-plugged:639111d9-ddb5-416d-9307-f0c501e35589 for instance 441f55e9-7d61-4fe1-824f-b109de8af293 on nch1-master-1 May 14 21:27:44.824953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-13e68c0b-d953-4c6a-8b01-7d50bf110a7b req-b858e26f-5d23-4480-8e7a-d384433de70b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131851 May 14 21:27:44.830155 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2397/4449] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:44.856106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:44.857177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:44.873903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.876650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.880461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.881221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.926667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:44.927930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:44.942722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.943453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:44.944966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:44.945915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.207168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:45.220444 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3933c102-e815-40b0-9e04-2f4d5a936de5 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1554 microversion: 2.1 time: 0.299815 May 14 21:27:45.227963 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2398/4450] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:44 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:45.238319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71469bbb-b7eb-4317-98ca-6ae97070ce07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:45.238971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71469bbb-b7eb-4317-98ca-6ae97070ce07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:45.245846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71469bbb-b7eb-4317-98ca-6ae97070ce07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:45.246800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71469bbb-b7eb-4317-98ca-6ae97070ce07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.247874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71469bbb-b7eb-4317-98ca-6ae97070ce07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:45.248390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71469bbb-b7eb-4317-98ca-6ae97070ce07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.371363 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71469bbb-b7eb-4317-98ca-6ae97070ce07 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137247 May 14 21:27:45.379737 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2399/4451] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:27:45 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:45.394254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:45.395032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:45.411375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:45.412088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.413348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:45.415020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.633924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:45.650240 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d43f1352-56ff-4743-9987-202c5fc313c6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.802918 May 14 21:27:45.652423 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2053/4452] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:44 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:45.665701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:45.666319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:45.672876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:45.673484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.674260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:45.674977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.771081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:45.788960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:45.792067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:45.793561 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e47a82b5-a32b-44c4-b5b5-32d968f12541 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1661 microversion: 2.32 time: 0.406381 May 14 21:27:45.795176 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2400/4453] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:45 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1661 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:45.843465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8c29628a-4b18-4c23-a2eb-e0290da50caf req-0c841c1e-4eef-4cbb-80f9-7b84a7a0bfba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4097156a-300a-4d17-87df-60620c836925", "tag": "5c660063-0f23-4b2d-b5ca-12d4f3ea2036"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:45.859268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8c29628a-4b18-4c23-a2eb-e0290da50caf req-0c841c1e-4eef-4cbb-80f9-7b84a7a0bfba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:45.860860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8c29628a-4b18-4c23-a2eb-e0290da50caf req-0c841c1e-4eef-4cbb-80f9-7b84a7a0bfba service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:45.981478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:45.992632 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-02ac5c66-90d7-435b-b730-f8dc5b0ad4aa tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1487 microversion: 2.1 time: 0.332584 May 14 21:27:45.993249 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2054/4454] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:45 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1487 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:46.013304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:46.014077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:46.040475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.041108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.042045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.042490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.110267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:27:46.249371 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8c29628a-4b18-4c23-a2eb-e0290da50caf req-0c841c1e-4eef-4cbb-80f9-7b84a7a0bfba service nova] Creating event network-changed:5c660063-0f23-4b2d-b5ca-12d4f3ea2036 for instance 4097156a-300a-4d17-87df-60620c836925 on nch2-master-1 May 14 21:27:46.255329 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8c29628a-4b18-4c23-a2eb-e0290da50caf req-0c841c1e-4eef-4cbb-80f9-7b84a7a0bfba service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415498 May 14 21:27:46.255986 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2401/4455] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:27:46.526336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f12518e-60fd-48b0-bfeb-81eb5aeb8d59 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 204 len: 0 microversion: 2.1 time: 0.516570 May 14 21:27:46.530676 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2055/4456] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:46 2022] DELETE /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:27:46.543198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f891379-7e4d-439a-81b6-3a970b61ae1c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6d788b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:46.576256 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2f891379-7e4d-439a-81b6-3a970b61ae1c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Image not found. May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f891379-7e4d-439a-81b6-3a970b61ae1c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d HTTP/1.1 May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'e8fc0e9d-9b27-463b-b318-eb4b540e734d'} May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e8fc0e9d-9b27-463b-b318-eb4b540e734d to delete May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e8fc0e9d-9b27-463b-b318-eb4b540e734d could not be found. May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:46.581291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f891379-7e4d-439a-81b6-3a970b61ae1c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f891379-7e4d-439a-81b6-3a970b61ae1c tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d" status: 404 len: 62 microversion: 2.1 time: 0.049317 May 14 21:27:46.591183 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2402/4457] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:46 2022] DELETE /compute/v2.1/images/e8fc0e9d-9b27-463b-b318-eb4b540e734d => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:27:46.597270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:46.597860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:46.606873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.607594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.616138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.616138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.639773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:27:46.669428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:46.670202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:46.682629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.685098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.685940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.686386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.833225 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Instance is already in deleting state, ignoring this request May 14 21:27:46.835197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01f0bd5c-b625-48b0-8b2f-e8ec1948f786 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 204 len: 0 microversion: 2.1 time: 0.242156 May 14 21:27:46.840192 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2056/4458] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:46 2022] DELETE /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:27:46.851013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:46.854770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:46.865601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.866501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.867620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:46.868287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:46.986461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:46.999053 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2b2b918-2a1c-4669-9b09-b54d55305637 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1309 microversion: 2.1 time: 0.334219 May 14 21:27:47.001555 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2403/4459] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:46 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1309 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:47.009802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:47.012858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:47.026563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:47.035912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:47.035912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:47.035912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:47.487556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:47.504826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:47.506368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:47.507616 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14a6144c-3537-4cc0-85a8-8606eb0df546 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1708 microversion: 2.32 time: 0.666108 May 14 21:27:47.508209 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2057/4460] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:46 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1708 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:47.885984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c67b8cbe-2e9f-4cb4-a5c1-818cbc53f8cb req-fd4d5585-6307-4d98-a095-347e9902ca2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "512524da-bcba-4fde-ac6e-ba6748e659e9", "tag": "a540ba33-d93a-4e5d-bf81-61d3d93287c8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:47.898463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:47.901555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c67b8cbe-2e9f-4cb4-a5c1-818cbc53f8cb req-fd4d5585-6307-4d98-a095-347e9902ca2f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:47.902520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c67b8cbe-2e9f-4cb4-a5c1-818cbc53f8cb req-fd4d5585-6307-4d98-a095-347e9902ca2f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:47.925122 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de40c7c1-15cf-47f9-9625-c846c153eae2 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1493 microversion: 2.1 time: 0.921901 May 14 21:27:47.934447 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2404/4461] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:46 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1493 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:47.939847 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c67b8cbe-2e9f-4cb4-a5c1-818cbc53f8cb req-fd4d5585-6307-4d98-a095-347e9902ca2f service nova] Creating event network-changed:a540ba33-d93a-4e5d-bf81-61d3d93287c8 for instance 512524da-bcba-4fde-ac6e-ba6748e659e9 on nch2-master-1 May 14 21:27:47.948581 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c67b8cbe-2e9f-4cb4-a5c1-818cbc53f8cb req-fd4d5585-6307-4d98-a095-347e9902ca2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065027 May 14 21:27:47.953725 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2058/4462] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:27:48.020259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:48.021517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:48.027800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:48.032249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:48.032249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:48.032249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:48.213009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:48.228121 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c1b77f4-582e-4463-a4cb-38a8c91d7635 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1490 microversion: 2.1 time: 0.215181 May 14 21:27:48.229027 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2405/4463] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:48 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1490 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:48.428120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1611474638", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8da851bf-8623-41cd-8e7e-e11152a2fef0"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:48.530818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:48.531995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:48.552225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:48.555824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:48.563507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:48.570669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:48.573462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:48.979610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:49.011064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:49.022880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:49.037547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cc63fc07-2d87-4d36-bf59-f2a16ab733eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1708 microversion: 2.32 time: 0.500948 May 14 21:27:49.044827 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2406/4464] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:48 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1708 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:49.062098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:49.064461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:49.101458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:49.106278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:49.111018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:49.115552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:49.444930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:49.455149 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-67ad17b1-3f13-4d83-bbd0-d669d4b88525 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1493 microversion: 2.1 time: 0.406336 May 14 21:27:49.457245 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2407/4465] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:49 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1493 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:49.969439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-537f7760-d14a-4672-80e4-fb8b539fa415 req-f5047696-9d76-4d5f-9083-3d39bc9a21eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67b8177-e7c2-4706-ab78-e147bd9817c7", "name": "network-vif-deleted", "tag": "02a58b33-a548-4458-8133-d96c60744b6d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:49.986462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-537f7760-d14a-4672-80e4-fb8b539fa415 req-f5047696-9d76-4d5f-9083-3d39bc9a21eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:49.988972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-537f7760-d14a-4672-80e4-fb8b539fa415 req-f5047696-9d76-4d5f-9083-3d39bc9a21eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:50.010214 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-537f7760-d14a-4672-80e4-fb8b539fa415 req-f5047696-9d76-4d5f-9083-3d39bc9a21eb service nova] Creating event network-vif-deleted:02a58b33-a548-4458-8133-d96c60744b6d for instance f67b8177-e7c2-4706-ab78-e147bd9817c7 on nch2-master-1 May 14 21:27:50.016646 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-537f7760-d14a-4672-80e4-fb8b539fa415 req-f5047696-9d76-4d5f-9083-3d39bc9a21eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054585 May 14 21:27:50.019157 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2408/4466] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:27:50.086146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:50.087057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:50.101116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:50.104056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:50.112927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:50.112927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:50.394380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:50.403955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:50.419657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:50.421275 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3288f823-b2cb-4aed-bee0-e2d26085513e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1755 microversion: 2.32 time: 0.341002 May 14 21:27:50.422575 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2409/4467] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:50 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1755 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:50.479112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:50.480283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:50.495569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:50.496341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:50.497321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:50.498372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:50.545045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:50.545779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:50.546471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lazy-loading 'fault' on Instance uuid f67b8177-e7c2-4706-ab78-e147bd9817c7 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:27:50.597618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed0a76be93e44fa887cb813a8879e04d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4fe0b96d43b41aaaa0e8e238888786a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:50.607854 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4a428d3d-31b1-4919-b770-04af13ca8831 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 200 len: 1297 microversion: 2.1 time: 0.136193 May 14 21:27:50.608441 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2410/4468] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:50 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 1297 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:51.008661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:51.011068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:51.012461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:51.013181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:51.014036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:51.025867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.026439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.027419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.028038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.048153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:51.055647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:51.072048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:51.076003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:51.240344 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-38315a52-81f9-4f5d-952c-3866c95fa07d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.821099 May 14 21:27:51.241418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2059/4469] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:27:51.255958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6872f6b8-e3dd-4963-8a44-1a6c7bba271a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.256890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6872f6b8-e3dd-4963-8a44-1a6c7bba271a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.326814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6872f6b8-e3dd-4963-8a44-1a6c7bba271a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:51.336708 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6872f6b8-e3dd-4963-8a44-1a6c7bba271a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1209 microversion: 2.1 time: 0.088840 May 14 21:27:51.346693 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2411/4470] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:51 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:51.445001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.445972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.453205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.453790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.454707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.455254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.625890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.626633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: f67b8177-e7c2-4706-ab78-e147bd9817c7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.634130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.634589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.635368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.635861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.649955 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Instance f67b8177-e7c2-4706-ab78-e147bd9817c7 could not be found. May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 HTTP/1.1 May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance f67b8177-e7c2-4706-ab78-e147bd9817c7 could not be found. May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'f67b8177-e7c2-4706-ab78-e147bd9817c7'} May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67b8177-e7c2-4706-ab78-e147bd9817c7 could not be found. May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67b8177-e7c2-4706-ab78-e147bd9817c7 could not be found. May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.651700 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67b8177-e7c2-4706-ab78-e147bd9817c7 could not be found. May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Instance f67b8177-e7c2-4706-ab78-e147bd9817c7 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f11eab44-24e4-49d2-bb3c-e8a85c2910ad tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7" status: 404 len: 111 microversion: 2.1 time: 0.031481 May 14 21:27:51.657063 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2412/4471] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:51 2022] GET /compute/v2.1/servers/f67b8177-e7c2-4706-ab78-e147bd9817c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:27:51.671944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99a3a30c-ac23-42f9-b27d-0531ad2bddbe tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6db0430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.700142 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-99a3a30c-ac23-42f9-b27d-0531ad2bddbe tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Image not found. May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99a3a30c-ac23-42f9-b27d-0531ad2bddbe tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 HTTP/1.1 May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '7bb56af0-4cd9-4a0b-a82c-c94c69635e05'} May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7bb56af0-4cd9-4a0b-a82c-c94c69635e05 to delete May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7bb56af0-4cd9-4a0b-a82c-c94c69635e05 could not be found. May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.702063 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99a3a30c-ac23-42f9-b27d-0531ad2bddbe tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99a3a30c-ac23-42f9-b27d-0531ad2bddbe tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05" status: 404 len: 62 microversion: 2.1 time: 0.046706 May 14 21:27:51.713540 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2413/4472] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:51 2022] DELETE /compute/v2.1/images/7bb56af0-4cd9-4a0b-a82c-c94c69635e05 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:27:51.717792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.718373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.727033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.727613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.728462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.728972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.744188 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda HTTP/1.1 May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'be7b4d89-571b-4124-b5ec-918394447fda'} May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:51.745851 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50510bb6-e91c-4263-9b0a-3a28227d66fb tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 404 len: 111 microversion: 2.1 time: 0.037186 May 14 21:27:51.751448 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2414/4473] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:51 2022] DELETE /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:27:51.756748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.757365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: be7b4d89-571b-4124-b5ec-918394447fda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.763652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.764500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.765295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.765736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.780739 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda HTTP/1.1 May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'be7b4d89-571b-4124-b5ec-918394447fda'} May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.782287 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Instance be7b4d89-571b-4124-b5ec-918394447fda could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ed36a1fe-f4a9-4241-9103-f7a93b776b19 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda" status: 404 len: 111 microversion: 2.1 time: 0.031731 May 14 21:27:51.790097 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2415/4474] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:51 2022] GET /compute/v2.1/servers/be7b4d89-571b-4124-b5ec-918394447fda => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:51.793985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43a5b73b-8044-437d-9b1c-503e644a202f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6db8e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-43a5b73b-8044-437d-9b1c-503e644a202f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Image not found. May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43a5b73b-8044-437d-9b1c-503e644a202f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 HTTP/1.1 May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '41bd1aca-7f50-4987-8d43-e6a8249b6ce4'} May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 41bd1aca-7f50-4987-8d43-e6a8249b6ce4 to delete May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 41bd1aca-7f50-4987-8d43-e6a8249b6ce4 could not be found. May 14 21:27:51.819619 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43a5b73b-8044-437d-9b1c-503e644a202f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43a5b73b-8044-437d-9b1c-503e644a202f tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4" status: 404 len: 62 microversion: 2.1 time: 0.031293 May 14 21:27:51.826267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2416/4475] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:51 2022] DELETE /compute/v2.1/images/41bd1aca-7f50-4987-8d43-e6a8249b6ce4 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:27:51.832461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.833058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.840988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.841546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.843396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.843396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.854362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:51.860458 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e HTTP/1.1 May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '090443ee-e680-4d1b-af54-a8c89476868e'} May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:51.863382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15802686-f03a-4336-9044-16e8d39743db tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 404 len: 111 microversion: 2.1 time: 0.039958 May 14 21:27:51.871391 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2417/4476] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:51 2022] DELETE /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:51.874022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:51.876532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:51.877595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.877780 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c7aaf200-3943-437b-852f-2c5cad8edc2a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1755 microversion: 2.32 time: 0.439768 May 14 21:27:51.878552 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2060/4477] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:51 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1755 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:51.878824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 090443ee-e680-4d1b-af54-a8c89476868e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.885691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.886487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.887266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.887959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.903554 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e HTTP/1.1 May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '090443ee-e680-4d1b-af54-a8c89476868e'} May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.905230 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Instance 090443ee-e680-4d1b-af54-a8c89476868e could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-539f55f9-aeae-40c0-adc9-d0f996fe5444 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e" status: 404 len: 111 microversion: 2.1 time: 0.033183 May 14 21:27:51.911382 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2418/4478] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:51 2022] GET /compute/v2.1/servers/090443ee-e680-4d1b-af54-a8c89476868e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:51.916158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe10c746-0140-4315-9291-877a14e89fd4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '.version_select at 0x7fb1a6bc9c10>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.948074 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-fe10c746-0140-4315-9291-877a14e89fd4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Image not found. May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe10c746-0140-4315-9291-877a14e89fd4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 HTTP/1.1 May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: exception: Image not found. May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'b031cdf6-be84-475f-a358-bdd8253aedb8'} May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b031cdf6-be84-475f-a358-bdd8253aedb8 to delete May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b031cdf6-be84-475f-a358-bdd8253aedb8 could not be found. May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:51.950000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe10c746-0140-4315-9291-877a14e89fd4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Image not found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe10c746-0140-4315-9291-877a14e89fd4 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8" status: 404 len: 62 microversion: 2.1 time: 0.039198 May 14 21:27:51.957161 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2061/4479] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:51 2022] DELETE /compute/v2.1/images/b031cdf6-be84-475f-a358-bdd8253aedb8 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:27:51.966969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:51.966969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:51.970407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.971436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.971839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:51.972317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:51.990272 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a HTTP/1.1 May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '3f740ee6-2164-45db-a16c-3fbe393cc90a'} May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:51.991926 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:51.997214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:27:52.000513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:52.000513 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0bf61fef-4042-472f-bedf-df8c7a2110dc tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 404 len: 111 microversion: 2.1 time: 0.043118 May 14 21:27:52.000513 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2419/4480] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:27:51 2022] DELETE /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:52.009511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:52.010032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] [instance: 3f740ee6-2164-45db-a16c-3fbe393cc90a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:52.023430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:52.023995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:52.024781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:52.025221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:52.041113 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] HTTP exception thrown: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Request method failure captured: May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a HTTP/1.1 May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB4RGKvLsm8bGgvdnTmfBZujHyVRKNS83qb6ALf5VSCzrSwD27ZADAhIJz9R5mubfAz7lCa5cHVUKoKgMwaOc3oPrd9D8UilpoJa0w2axXL_0rYVkN82bLutZl-LFA9azw0VsyTmTrrl-AWyRFlc03pCi_jZLGvrk6RVXvhWc-dI2kw May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c4fe0b96d43b41aaaa0e8e238888786a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c4fe0b96d43b41aaaa0e8e238888786a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesTestJSON-2016299277 May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c4fe0b96d43b41aaaa0e8e238888786a May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesTestJSON-2016299277 May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesTestJSON-2016299277-project May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ed0a76be93e44fa887cb813a8879e04d May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesTestJSON-2016299277-project May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3f740ee6-2164-45db-a16c-3fbe393cc90a'} May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:52.042781 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] Returning 404 to user: Instance 3f740ee6-2164-45db-a16c-3fbe393cc90a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:27:52.052921 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0785e1ed-194b-4b30-9fcb-f523ed091b56 tempest-ImagesTestJSON-2016299277 tempest-ImagesTestJSON-2016299277-project] 10.222.0.52 "GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a" status: 404 len: 111 microversion: 2.1 time: 0.039258 May 14 21:27:52.055662 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2062/4481] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:52 2022] GET /compute/v2.1/servers/3f740ee6-2164-45db-a16c-3fbe393cc90a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:27:52.353643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:52.354324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:52.365662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:52.367625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:52.368650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:52.371135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:52.508448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:52.521672 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-49e25f66-04a9-4981-8588-d8e2147efd9e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1213 microversion: 2.1 time: 0.171850 May 14 21:27:52.527068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2420/4482] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:52 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:52.897109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:52.897959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:52.905185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:52.905668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:52.906676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:52.907112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:53.223410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:53.232691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:53.234240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:53.235518 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-286a81a1-4edc-4460-b1a4-0d139b3c8580 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1802 microversion: 2.32 time: 0.342932 May 14 21:27:53.236086 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2063/4483] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:52 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1802 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:53.542352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:53.542960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:53.551637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:53.552099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:53.552989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:53.553337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:53.629756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:53.641300 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-268cfe45-fb17-4a6f-8d00-14c0855fb18e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1269 microversion: 2.1 time: 0.102868 May 14 21:27:53.642810 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2421/4484] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:53 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:54.256220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:54.257550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:54.265313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:54.270490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:54.270490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:54.270490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:54.661202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:54.661822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:54.669355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:54.670157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:54.671024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:54.671468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:54.682596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:54.699462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:54.706806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:54.712984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9f4bfe0-d9d4-4b65-a7f3-73e2e595bee8 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1790 microversion: 2.32 time: 0.461653 May 14 21:27:54.714482 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2064/4485] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:54 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1790 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:54.769999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:54.780481 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b0d62d6-7836-4eb5-ae1d-56e00ecdb537 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1267 microversion: 2.1 time: 0.124636 May 14 21:27:54.781081 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2422/4486] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:54 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1267 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:55.736087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:55.737926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:55.747154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:55.747942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:55.752244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:55.752244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:55.799080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:55.800518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:55.813503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:55.813967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:55.814858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:55.815266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:56.066030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:56.097131 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6877cdec-d4a8-4ac8-af57-ca4140744e1e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.301599 May 14 21:27:56.107392 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2423/4487] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:55 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:56.478146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:56.494659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:56.499804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:56.508412 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac83dfbf-51df-4dc1-9d44-37728f8fa080 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1837 microversion: 2.32 time: 0.771869 May 14 21:27:56.521805 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2065/4488] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:55 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1837 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:57.123541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:57.124180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:57.137503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:57.140074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:57.144503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:57.144759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:57.386443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:57.396735 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3eb56e72-9f1c-4650-8913-fb9ec605bbf2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.276776 May 14 21:27:57.397556 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2424/4489] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:57 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:57.465597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1858046030", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "23acb6aa-5f12-463d-b4bb-6884cb9f6bec"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:57.530127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:57.530937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:57.542760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:57.543440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:57.543851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] validate_networks() for [('23acb6aa-5f12-463d-b4bb-6884cb9f6bec', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:27:57.546802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:57.546802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:57.720329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:57.730675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:57.732361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:57.738953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-79f13953-af25-4867-8a5f-e17f2f77f4d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1837 microversion: 2.32 time: 0.208533 May 14 21:27:57.738953 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2425/4490] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:57 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1837 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:27:57.937208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d65c6378-c4f8-4bcc-94b9-0198d2268fac req-7df0de64-2aee-449c-b37d-ae203c8d59bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "a3973166-07b4-4aaf-95b2-bd95a9578877"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:57.951025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d65c6378-c4f8-4bcc-94b9-0198d2268fac req-7df0de64-2aee-449c-b37d-ae203c8d59bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:57.951765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d65c6378-c4f8-4bcc-94b9-0198d2268fac req-7df0de64-2aee-449c-b37d-ae203c8d59bf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:57.975203 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d65c6378-c4f8-4bcc-94b9-0198d2268fac req-7df0de64-2aee-449c-b37d-ae203c8d59bf service nova] Creating event network-changed:a3973166-07b4-4aaf-95b2-bd95a9578877 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:27:58.000737 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d65c6378-c4f8-4bcc-94b9-0198d2268fac req-7df0de64-2aee-449c-b37d-ae203c8d59bf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068709 May 14 21:27:58.007339 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2426/4491] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:27:58.165724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7963ed19-bd96-4b5c-85bc-1fef419bc54a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'create', calling method: .version_select at 0x7fb1a6f76820>, body: {"keypair": {"name": "tempest-keypair-1607661928", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9JNAHTGCwXBDcPqx4/ASC04mCS6G5Nx4Wc7yqfP9ECqtZ/jLdncGBXlnBVxIzQ2cSbP+cY1u38beBHcE0uJ3/y5yPdCQb451Uz/kIQlOKI6HbPqptn4umFlKnbhMzwkQ=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:27:58.206839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7963ed19-bd96-4b5c-85bc-1fef419bc54a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for project 6641b342c1d440aea451919f391bc5db. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:58.223255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7963ed19-bd96-4b5c-85bc-1fef419bc54a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for user 5586a3a946a0490498c42cb71f39ce1e and project 6641b342c1d440aea451919f391bc5db. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:58.384646 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7963ed19-bd96-4b5c-85bc-1fef419bc54a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.353920 May 14 21:27:58.393399 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2427/4492] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:27:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:27:58.417548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:58.418915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:58.430231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:58.430797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:58.432517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:58.433801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:58.680732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:58.693530 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f32b2898-6ae4-4a45-abef-b8f975595d60 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.282393 May 14 21:27:58.694211 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2428/4493] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:58 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:27:58.739608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:27:58.739608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:27:58.739608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:27:58.741994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:27:58.743364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:27:58.784158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:58.784845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:58.789818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:58.790305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:58.791133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:58.791607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:58.792864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:58.793725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:58.794889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:58.796552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:58.847614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:27:58.864533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for user 1d73e16649b845319b5184937056b233 and project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:27:58.900737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:27:58.903452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:27:59.050633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:59.063706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:59.066985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:59.068504 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c915ca08-f86e-4a7b-ba17-228385796bee tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1837 microversion: 2.32 time: 0.318688 May 14 21:27:59.070085 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2429/4494] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:27:58 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1837 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:27:59.087837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1782c2f9-a6a4-4f83-a523-b8db412c2f5c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.835043 May 14 21:27:59.088605 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2066/4495] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:27:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:27:59.102733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cdaaa60d-24de-4dff-b216-f60b191e1fdb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:59.103356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cdaaa60d-24de-4dff-b216-f60b191e1fdb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:59.259579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdaaa60d-24de-4dff-b216-f60b191e1fdb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:27:59.270312 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cdaaa60d-24de-4dff-b216-f60b191e1fdb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1225 microversion: 2.1 time: 0.172143 May 14 21:27:59.276593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2430/4496] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:59 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1225 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:27:59.712680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:27:59.713308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:27:59.729917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:59.730645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:27:59.731622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:27:59.732220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:00.066616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:00.077195 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-575e5294-1593-47a9-95a6-60f9ea62690a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.370061 May 14 21:28:00.078006 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2067/4497] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:27:59 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:00.089511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-45668dc7-f7e4-4d17-961a-ec65938c6bca req-aeb76a53-df9e-430d-9e67-be4acc47adb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d", "tag": "db40aee5-795f-4099-ad95-50687d306da4"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:00.103157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-45668dc7-f7e4-4d17-961a-ec65938c6bca req-aeb76a53-df9e-430d-9e67-be4acc47adb8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:00.103652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-45668dc7-f7e4-4d17-961a-ec65938c6bca req-aeb76a53-df9e-430d-9e67-be4acc47adb8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:00.103849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:00.104701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:00.112430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:00.112909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:00.115227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:00.115928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:00.144162 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-45668dc7-f7e4-4d17-961a-ec65938c6bca req-aeb76a53-df9e-430d-9e67-be4acc47adb8 service nova] Creating event network-changed:db40aee5-795f-4099-ad95-50687d306da4 for instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d on nch1-master-1 May 14 21:28:00.146183 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-45668dc7-f7e4-4d17-961a-ec65938c6bca req-aeb76a53-df9e-430d-9e67-be4acc47adb8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075098 May 14 21:28:00.160916 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2431/4498] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:00.295998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14c4dd4f-7e28-4f78-ac29-52817094a866 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:00.297352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-14c4dd4f-7e28-4f78-ac29-52817094a866 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:00.423551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14c4dd4f-7e28-4f78-ac29-52817094a866 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:00.433449 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14c4dd4f-7e28-4f78-ac29-52817094a866 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1225 microversion: 2.1 time: 0.141430 May 14 21:28:00.435866 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2432/4499] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:00 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:00.543190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:00.552632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:00.554281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:00.555466 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-25742afd-d1b4-4e54-9bdc-392994c26745 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1858 microversion: 2.32 time: 0.464388 May 14 21:28:00.556152 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2068/4500] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:00 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1858 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:01.094912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:01.097111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:01.111048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:01.112233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:01.113126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:01.113698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:01.341167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:01.350320 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ff7ebb82-b895-4767-a6d6-19ac8f27cdd6 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.259674 May 14 21:28:01.355629 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2433/4501] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:01 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:01.453986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:01.455901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:01.463149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:01.465431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:01.465431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:01.465431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:01.574616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:01.575513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:01.582785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:01.585148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:01.586704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:01.587320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:01.606203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:01.630968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc4605ac-1984-45b8-bfc7-ae177945c759 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1221 microversion: 2.1 time: 0.171855 May 14 21:28:01.630968 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2069/4502] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:01 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1221 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:01.800696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1623334884", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "482e0ed1-68c5-4c2d-8efe-8f79824053af"}], "security_groups": [{"name": "tempest-securitygroup--889174335"}], "key_name": "tempest-keypair-1607661928", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:01.807590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:01.818095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:01.820167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:01.820863 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f19d33ad-6cce-40a8-ae96-98c1a196dcef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1858 microversion: 2.32 time: 0.250376 May 14 21:28:01.825867 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2434/4503] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:01 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1858 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:01.990708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] validate_networks() for [('482e0ed1-68c5-4c2d-8efe-8f79824053af', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:28:02.180636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ff0629f4-de52-4215-a306-3f3b3854b6b5 req-43a7bada-3720-47ad-9761-a914b49e2120 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "ebe73789-12d4-4374-8e71-4e93c4257d27"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:02.192301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ff0629f4-de52-4215-a306-3f3b3854b6b5 req-43a7bada-3720-47ad-9761-a914b49e2120 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.193139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ff0629f4-de52-4215-a306-3f3b3854b6b5 req-43a7bada-3720-47ad-9761-a914b49e2120 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.214693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ff0629f4-de52-4215-a306-3f3b3854b6b5 req-43a7bada-3720-47ad-9761-a914b49e2120 service nova] Creating event network-changed:ebe73789-12d4-4374-8e71-4e93c4257d27 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:02.219386 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ff0629f4-de52-4215-a306-3f3b3854b6b5 req-43a7bada-3720-47ad-9761-a914b49e2120 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042373 May 14 21:28:02.221412 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2435/4504] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:02.368775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:02.370236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:02.381268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.381268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.381268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.381268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.546946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:02.556291 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29ec9c6b-5692-4318-a1bd-4e6b0877c21c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.192019 May 14 21:28:02.559606 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2436/4505] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:02 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:02.637678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:02.638638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:02.647736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.652244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.652244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.652244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.716548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:02.733729 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b496d73d-d765-47e1-b0b8-e72ba01cbb2b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1283 microversion: 2.1 time: 0.100100 May 14 21:28:02.735674 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2437/4506] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:02 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1283 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:02.840470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:02.841272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:02.847413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.847906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.848699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.849150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.980709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:28:02.981986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:28:02.982467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:28:02.982893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:28:02.983376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:28:02.993217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.993683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:02.994503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:02.995206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:03.013221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for project 6641b342c1d440aea451919f391bc5db. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:28:03.019284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for user 5586a3a946a0490498c42cb71f39ce1e and project 6641b342c1d440aea451919f391bc5db. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:28:03.031846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:28:03.034091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:28:03.048036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:03.057883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:03.062774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:03.062774 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f2b0dd9c-d44b-4f02-bc2d-230c1fcf5aff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.224193 May 14 21:28:03.062774 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2438/4507] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:02 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:03.275387 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f88c1f21-0b34-42a4-b2e5-4093c8f6b34b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.472691 May 14 21:28:03.281347 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2070/4508] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:28:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 1482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:28:03.286575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-267846c1-be0b-42f5-9262-98c684b65be2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:03.287216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-267846c1-be0b-42f5-9262-98c684b65be2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:03.359074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-267846c1-be0b-42f5-9262-98c684b65be2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:03.369266 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-267846c1-be0b-42f5-9262-98c684b65be2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1238 microversion: 2.1 time: 0.086572 May 14 21:28:03.372567 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2439/4509] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:03 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1238 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:03.577899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:03.578699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:03.591054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:03.591672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:03.597111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:03.597111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:03.753051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:03.753777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:03.760947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:03.761475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:03.762323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:03.762834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:03.829394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:03.860954 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d9bb81d-61a1-43e9-b806-7808841c9b05 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1283 microversion: 2.1 time: 0.094359 May 14 21:28:03.860954 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2440/4510] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:03 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:04.081512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:04.082302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:04.089823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:04.090415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:04.091541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:04.092077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:04.204901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:04.216474 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b8b576af-37fa-4033-ab90-ec96b66a15f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.645885 May 14 21:28:04.231839 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2071/4511] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:03 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:04.232135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-263b4324-9809-43e6-aec7-2a2b51bd0b54 req-e6e5e552-dfa1-4c48-b962-fc343b330df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d", "name": "network-vif-plugged", "status": "completed", "tag": "db40aee5-795f-4099-ad95-50687d306da4"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:04.242289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-263b4324-9809-43e6-aec7-2a2b51bd0b54 req-e6e5e552-dfa1-4c48-b962-fc343b330df9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:04.242622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-263b4324-9809-43e6-aec7-2a2b51bd0b54 req-e6e5e552-dfa1-4c48-b962-fc343b330df9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:04.284040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-263b4324-9809-43e6-aec7-2a2b51bd0b54 req-e6e5e552-dfa1-4c48-b962-fc343b330df9 service nova] Creating event network-vif-plugged:db40aee5-795f-4099-ad95-50687d306da4 for instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d on nch1-master-1 May 14 21:28:04.296381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-263b4324-9809-43e6-aec7-2a2b51bd0b54 req-e6e5e552-dfa1-4c48-b962-fc343b330df9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067848 May 14 21:28:04.296988 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2072/4512] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:04.303603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c9b38e39-6a22-42d0-8189-66e68aa2215b req-6c92072f-c4d7-4139-b21b-af3501249247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "63396429-e743-49a6-a83f-427d96ffbf18"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:04.315311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c9b38e39-6a22-42d0-8189-66e68aa2215b req-6c92072f-c4d7-4139-b21b-af3501249247 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:04.316202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c9b38e39-6a22-42d0-8189-66e68aa2215b req-6c92072f-c4d7-4139-b21b-af3501249247 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:04.329411 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c9b38e39-6a22-42d0-8189-66e68aa2215b req-6c92072f-c4d7-4139-b21b-af3501249247 service nova] Creating event network-changed:63396429-e743-49a6-a83f-427d96ffbf18 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:04.336768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c9b38e39-6a22-42d0-8189-66e68aa2215b req-6c92072f-c4d7-4139-b21b-af3501249247 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038142 May 14 21:28:04.339094 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2073/4513] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:04.386253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:04.390029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2490dad5-36e9-4aa1-b82b-e48d168733d9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:04.390756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2490dad5-36e9-4aa1-b82b-e48d168733d9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:04.398057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:04.399707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:04.401117 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b912eaf3-38a8-482f-8f0d-89298d46737b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.324829 May 14 21:28:04.412285 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2441/4514] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:04 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:04.519353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2490dad5-36e9-4aa1-b82b-e48d168733d9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:04.526266 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2490dad5-36e9-4aa1-b82b-e48d168733d9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1238 microversion: 2.1 time: 0.140772 May 14 21:28:04.527095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2074/4515] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:04 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1238 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:04.876582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:04.877274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:04.886968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:04.887424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:04.888275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:04.888812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:05.056679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:05.065123 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2de421e1-9583-4e58-a674-08d63e0aff04 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.192143 May 14 21:28:05.066075 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2442/4516] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:04 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:05.234364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:05.234959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:05.242706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:05.243161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:05.243969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:05.244409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:05.421859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:05.422737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:05.448256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:05.449961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:05.451557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:05.452208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:05.454961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:05.467244 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dc8837f5-c8a6-4854-8aa7-d128117d66ac tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1309 microversion: 2.1 time: 0.236639 May 14 21:28:05.478236 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2075/4517] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:05 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:05.544184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:05.544803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:05.554396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:05.554850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:05.555675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:05.556125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:05.699596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:05.709141 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff63d23f-df70-4b5b-8752-931daf1f22c6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1290 microversion: 2.1 time: 0.168777 May 14 21:28:05.710031 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2076/4518] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:05 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1290 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:05.716666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:05.728057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:05.730207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:05.731683 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98275265-8837-4d36-a79c-4266873cc1f3 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.313986 May 14 21:28:05.732508 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2443/4519] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:05 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:06.082641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:06.083777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:06.089968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.090427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.091217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.091766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.384363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-16265f28-dc28-4591-98c5-dfcfecdb03fe req-f0fac664-701e-48f4-bfad-4d5ee38b19cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "edfac6c5-c706-4629-944c-81d0943a6af1"}, {"name": "network-changed", "server_uuid": "642eb1fc-fd39-47fb-a85e-f6423a1c1a21", "tag": "28cb501e-e36e-4c9e-96d4-bd46e1d069db"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:06.393686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-16265f28-dc28-4591-98c5-dfcfecdb03fe req-f0fac664-701e-48f4-bfad-4d5ee38b19cd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.394153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-16265f28-dc28-4591-98c5-dfcfecdb03fe req-f0fac664-701e-48f4-bfad-4d5ee38b19cd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.409289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-16265f28-dc28-4591-98c5-dfcfecdb03fe req-f0fac664-701e-48f4-bfad-4d5ee38b19cd service nova] Creating event network-changed:edfac6c5-c706-4629-944c-81d0943a6af1 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:06.409822 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-16265f28-dc28-4591-98c5-dfcfecdb03fe req-f0fac664-701e-48f4-bfad-4d5ee38b19cd service nova] Creating event network-changed:28cb501e-e36e-4c9e-96d4-bd46e1d069db for instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 on nch2-master-1 May 14 21:28:06.418131 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-16265f28-dc28-4591-98c5-dfcfecdb03fe req-f0fac664-701e-48f4-bfad-4d5ee38b19cd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037838 May 14 21:28:06.418743 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2444/4520] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:06.485928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:06.487337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:06.493679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.494141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.494962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.495409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.515424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:06.528069 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-985282ad-7475-4765-a0a7-fbf9319d8a77 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.449274 May 14 21:28:06.528948 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2077/4521] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:06 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:06.643592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:06.651562 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29482af6-7f3b-45db-a4a9-00c0372838db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1489 microversion: 2.1 time: 0.170525 May 14 21:28:06.652485 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2445/4522] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:06 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1489 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:06.669190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:06.669834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:06.682731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.682731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.682731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.682731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.726791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:06.737213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:06.737213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.737213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.737213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.737213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.806361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:06.816496 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33d8816a-ebcd-4201-8da9-6a4f6ef09255 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1296 microversion: 2.1 time: 0.093570 May 14 21:28:06.817426 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2446/4523] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:06 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:06.822084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:06.822711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:06.836269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.836785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:06.838155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:06.838932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.057897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.067396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.068955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.070166 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8a3310d5-5a73-40de-9ec2-777fddf71493 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.251889 May 14 21:28:07.070745 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2447/4524] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:06 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:07.190481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.198171 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc0ca6a7-4801-44e5-9232-893a1007b330 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1490 microversion: 2.1 time: 0.533122 May 14 21:28:07.198766 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2078/4525] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:06 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1490 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:07.215155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:07.215804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:07.222540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.223116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.224850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.225297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.361189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.369722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b4fe0bf-ed16-479f-9a28-ecc88d639547 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1489 microversion: 2.1 time: 0.158644 May 14 21:28:07.370327 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2448/4526] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:07 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1489 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:07.387876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:07.388392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:07.397113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.397579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.398375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.398825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.426062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:28:07.546838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:07.547451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:07.555097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.558352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.558352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.558352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.701785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.711758 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc020b97-74a9-480b-8191-e0896536fe4f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.168775 May 14 21:28:07.712342 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2449/4527] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:07 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:07.722906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f163e64a-870e-4704-8629-7f74ab746dc4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 204 len: 0 microversion: 2.1 time: 0.338854 May 14 21:28:07.723654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2079/4528] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:28:07 2022] DELETE /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:28:07.731731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:07.738539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:07.739498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.740043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.740813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.741251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.840781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:07.841595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:07.848352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.849044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.850203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:07.850741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:07.887971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.899442 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0fe6cc7-c9c7-4bd9-813a-36fb5f76a1a8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1495 microversion: 2.1 time: 0.170496 May 14 21:28:07.900858 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2450/4529] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:07 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1495 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:07.964048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:07.973242 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a1ce7840-a52e-48db-91c8-011b2085a7ae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1296 microversion: 2.1 time: 0.137272 May 14 21:28:07.974024 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2080/4530] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:07 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1296 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:08.112653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:08.116538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:08.125716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.126023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.126882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.127310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.312253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:08.321714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:08.323365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:08.324451 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4dbc6d4c-cf54-4586-b174-0207cd433446 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.238039 May 14 21:28:08.325031 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2451/4531] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:08 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:08.452537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e2c13c9d-53cb-4240-a421-f2db1f817816 req-79b3ca04-f9cb-4314-9d6c-13152f26a328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "fa577191-77f9-4d03-a86c-1dae3aad889a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:08.463186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e2c13c9d-53cb-4240-a421-f2db1f817816 req-79b3ca04-f9cb-4314-9d6c-13152f26a328 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.463988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e2c13c9d-53cb-4240-a421-f2db1f817816 req-79b3ca04-f9cb-4314-9d6c-13152f26a328 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.477192 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e2c13c9d-53cb-4240-a421-f2db1f817816 req-79b3ca04-f9cb-4314-9d6c-13152f26a328 service nova] Creating event network-changed:fa577191-77f9-4d03-a86c-1dae3aad889a for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:08.482302 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e2c13c9d-53cb-4240-a421-f2db1f817816 req-79b3ca04-f9cb-4314-9d6c-13152f26a328 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 May 14 21:28:08.486351 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2081/4532] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:08.728810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:08.729437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:08.736342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.736803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.737687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.738129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.878504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:08.892093 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d8a7b52-eb79-404f-938b-f335893332cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.161406 May 14 21:28:08.892093 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2452/4533] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:08 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:08.917501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:08.920789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:08.925133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.925598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.926382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.926824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.989201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:08.990025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:08.996013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.996467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:08.997238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:08.997676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:09.141749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:09.154075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cdc9fd2d-434b-4db3-9c76-2649a7ae745f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.165351 May 14 21:28:09.154075 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2453/4534] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:08 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:09.343605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:09.344359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:09.351949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:09.352519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:09.353399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:09.354120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:09.456998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:09.465199 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1981c2a9-7569-443a-aae6-68911504d5a4 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1495 microversion: 2.1 time: 0.552150 May 14 21:28:09.465793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2082/4535] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:08 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1495 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:09.617870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:09.628849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:09.631661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:09.632917 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce5cdea0-cea3-424c-ad20-3d40ba0ad2f0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.293397 May 14 21:28:09.633762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2454/4536] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:09 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:09.850906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1d0c4a4c-44cd-45ae-8000-f012ada2b319 req-4dc68ebb-9683-478b-9b43-acc08ce4bb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d", "name": "network-vif-deleted", "tag": "db40aee5-795f-4099-ad95-50687d306da4"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:09.861349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1d0c4a4c-44cd-45ae-8000-f012ada2b319 req-4dc68ebb-9683-478b-9b43-acc08ce4bb58 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:09.862268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1d0c4a4c-44cd-45ae-8000-f012ada2b319 req-4dc68ebb-9683-478b-9b43-acc08ce4bb58 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:09.879309 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1d0c4a4c-44cd-45ae-8000-f012ada2b319 req-4dc68ebb-9683-478b-9b43-acc08ce4bb58 service nova] Creating event network-vif-deleted:db40aee5-795f-4099-ad95-50687d306da4 for instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d on nch1-master-1 May 14 21:28:09.884454 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1d0c4a4c-44cd-45ae-8000-f012ada2b319 req-4dc68ebb-9683-478b-9b43-acc08ce4bb58 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037939 May 14 21:28:09.886093 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2083/4537] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:09.904842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:09.905474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:09.915080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:09.915860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:09.916992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:09.917603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.116431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:10.124020 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-047d2428-dc26-4d8d-88b5-cd77ee756bcf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.223693 May 14 21:28:10.124601 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2455/4538] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:09 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:10.169061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:10.169771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:10.177190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:10.177729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.178576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:10.179105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.483549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:10.484963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:10.485684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:10.494050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:10.494502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.495353 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e61fd43b-9f94-4269-bf25-e8d48ed42146 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.330052 May 14 21:28:10.495651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:10.496095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.496855 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2084/4539] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:10 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:10.533656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:10.534109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.534757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lazy-loading 'fault' on Instance uuid 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:10.579055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:10.588888 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-60d46d5c-3f52-47f2-87c2-d230899ff0b1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 200 len: 1299 microversion: 2.1 time: 0.109291 May 14 21:28:10.590277 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2456/4540] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:10 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:10.652809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:10.653433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:10.660961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:10.661425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.662520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:10.663581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:10.999573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-067afa6d-f54d-42f7-b699-ae68c459ac70 req-4f45cba3-4092-4d76-b309-8db75c94c4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a91c0da-3308-4367-b3f4-ecc73bd8ee3f", "tag": "e90ff6bb-3ced-4a72-8633-418a004483a5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:11.018034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-067afa6d-f54d-42f7-b699-ae68c459ac70 req-4f45cba3-4092-4d76-b309-8db75c94c4ef service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.018034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-067afa6d-f54d-42f7-b699-ae68c459ac70 req-4f45cba3-4092-4d76-b309-8db75c94c4ef service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.025310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:11.049454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:11.051168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:11.052436 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-409f47aa-1bad-418d-8fcb-8d68f1c8d8a1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.403895 May 14 21:28:11.053048 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2085/4541] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:10 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:11.055524 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-067afa6d-f54d-42f7-b699-ae68c459ac70 req-4f45cba3-4092-4d76-b309-8db75c94c4ef service nova] Creating event network-changed:e90ff6bb-3ced-4a72-8633-418a004483a5 for instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f on nch1-master-1 May 14 21:28:11.060547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-067afa6d-f54d-42f7-b699-ae68c459ac70 req-4f45cba3-4092-4d76-b309-8db75c94c4ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065022 May 14 21:28:11.061152 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2457/4542] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:11.142231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:11.142960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:11.149603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.155468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.155468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.155468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.514254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:11.515100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:11.522712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.523186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.524023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.524471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.671262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:11.679871 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0672297-d063-4661-99bf-a4b5a061436f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.170688 May 14 21:28:11.684853 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2458/4543] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:11 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:11.685217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:11.685819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:11.694187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.694651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.695449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.695931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.710991 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d HTTP/1.1 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d'} May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:11.712850 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ccb55913-87ad-4641-871d-95c75951521c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 404 len: 111 microversion: 2.1 time: 0.032884 May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2459/4544] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:11 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:11.725521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:11.731072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.731780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.732674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:11.733252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:11.764840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:28:11.851159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:11.862547 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-12bd320e-b06c-4a79-bb83-6be62e02ca02 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.723580 May 14 21:28:11.863542 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2086/4545] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:11 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:12.072608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:12.073337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:12.081372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.082941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:12.083770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.084812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:12.118873 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b87d52b9-a33a-4c5d-9ac0-888aa7fe317c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 204 len: 0 microversion: 2.1 time: 0.398677 May 14 21:28:12.123340 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2460/4546] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:28:11 2022] DELETE /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:28:12.129643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:12.130364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:12.136385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.136842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:12.137621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.138065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:12.276276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:12.292223 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-287d95b7-0ebf-4930-a190-dac0072fdb9d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1496 microversion: 2.1 time: 0.167538 May 14 21:28:12.292920 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2461/4547] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:12 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1496 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:12.390570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:12.400441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:12.402091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:12.403439 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec34af81-cbe8-4f74-8da4-299406721acb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.335968 May 14 21:28:12.404030 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2087/4548] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:12 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:12.700666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:12.701373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:12.708198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.708681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:12.709469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.709915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:12.870299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:12.881435 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0733ed7-ecdf-434c-8494-932903306273 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.184566 May 14 21:28:12.881943 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2462/4549] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:12 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:12.882484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:12.883123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:12.890707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.891256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:12.893099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:12.893701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:13.035012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:13.042480 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad05f9ba-f8ce-40e5-84be-d287f14a0da0 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.165205 May 14 21:28:13.043091 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2088/4550] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:12 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:13.076881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0649650d-b42c-4e94-968e-bbf1a4cd07fe req-38e544ff-ebbf-4324-9610-b810dbec9947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "4663d148-3f78-4667-9e22-e6be0e34d3da"}, {"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "39024741-3b76-4bb3-aecf-4392e5246961"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:13.086381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0649650d-b42c-4e94-968e-bbf1a4cd07fe req-38e544ff-ebbf-4324-9610-b810dbec9947 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:13.086838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0649650d-b42c-4e94-968e-bbf1a4cd07fe req-38e544ff-ebbf-4324-9610-b810dbec9947 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:13.099001 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0649650d-b42c-4e94-968e-bbf1a4cd07fe req-38e544ff-ebbf-4324-9610-b810dbec9947 service nova] Creating event network-changed:4663d148-3f78-4667-9e22-e6be0e34d3da for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:13.099540 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0649650d-b42c-4e94-968e-bbf1a4cd07fe req-38e544ff-ebbf-4324-9610-b810dbec9947 service nova] Creating event network-changed:39024741-3b76-4bb3-aecf-4392e5246961 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:13.104763 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0649650d-b42c-4e94-968e-bbf1a4cd07fe req-38e544ff-ebbf-4324-9610-b810dbec9947 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031657 May 14 21:28:13.105556 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2463/4551] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:13.309987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:13.310729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:13.318065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:13.318698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:13.319499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:13.319940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:13.422927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:13.423612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:13.430579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:13.431033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:13.431841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:13.432284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:13.633034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:13.639901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:13.643986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:13.646147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:13.649340 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d84be94f-d1d5-4645-b93c-72962d9b1a39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1496 microversion: 2.1 time: 0.343462 May 14 21:28:13.649567 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e9baba33-66f8-45f7-8b78-ba8377a496ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.231055 May 14 21:28:13.652536 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2464/4553] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:13 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:13.652734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2089/4553] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:13 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1496 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:13.899676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:13.901133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:13.908031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:13.909801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:13.911076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:13.911727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.045094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-dfe4f637-ce3c-47c9-ade9-9a81ee384c5a req-4f829352-4425-4ee8-b406-66533d2e9d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642eb1fc-fd39-47fb-a85e-f6423a1c1a21", "name": "network-vif-plugged", "status": "completed", "tag": "28cb501e-e36e-4c9e-96d4-bd46e1d069db"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:14.054427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-dfe4f637-ce3c-47c9-ade9-9a81ee384c5a req-4f829352-4425-4ee8-b406-66533d2e9d0a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:14.054889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-dfe4f637-ce3c-47c9-ade9-9a81ee384c5a req-4f829352-4425-4ee8-b406-66533d2e9d0a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.067152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-dfe4f637-ce3c-47c9-ade9-9a81ee384c5a req-4f829352-4425-4ee8-b406-66533d2e9d0a service nova] Creating event network-vif-plugged:28cb501e-e36e-4c9e-96d4-bd46e1d069db for instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 on nch2-master-1 May 14 21:28:14.072229 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-dfe4f637-ce3c-47c9-ade9-9a81ee384c5a req-4f829352-4425-4ee8-b406-66533d2e9d0a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 May 14 21:28:14.072915 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2465/4554] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:14.079188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:14.080263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:14.088488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:14.088950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.089751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:14.090197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.145040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:14.154040 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23292558-5540-4c93-9888-19f22342d067 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.258368 May 14 21:28:14.155492 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2090/4555] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:13 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:14.242673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:14.250667 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-88ffb784-80a1-4fbf-ad65-f73f0c39133b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.176405 May 14 21:28:14.251330 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2466/4556] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:14 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:14.671844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:14.672505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:14.673304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:14.674535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:14.680511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:14.683321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:14.683321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.683555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.683688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:14.683791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:14.683890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.683988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:14.746532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:14.754988 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-308cbfee-34c7-485e-bb91-20d75ce29120 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1454 microversion: 2.1 time: 0.087219 May 14 21:28:14.764663 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2091/4557] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:14 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1454 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:14.876548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:14.885968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:14.887600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:14.892372 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6335d441-e767-45c6-885e-713e6965ac6d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.219355 May 14 21:28:14.892372 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2467/4558] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:14 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:15.127512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-85003270-763e-4c2b-be4a-540c7aa89758 req-c56f5cfe-fa25-4c7d-9818-11ac2346c59e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441f55e9-7d61-4fe1-824f-b109de8af293", "name": "network-vif-deleted", "tag": "639111d9-ddb5-416d-9307-f0c501e35589"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:15.137304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-85003270-763e-4c2b-be4a-540c7aa89758 req-c56f5cfe-fa25-4c7d-9818-11ac2346c59e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.138117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-85003270-763e-4c2b-be4a-540c7aa89758 req-c56f5cfe-fa25-4c7d-9818-11ac2346c59e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.151781 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-85003270-763e-4c2b-be4a-540c7aa89758 req-c56f5cfe-fa25-4c7d-9818-11ac2346c59e service nova] Creating event network-vif-deleted:639111d9-ddb5-416d-9307-f0c501e35589 for instance 441f55e9-7d61-4fe1-824f-b109de8af293 on nch1-master-1 May 14 21:28:15.157373 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-85003270-763e-4c2b-be4a-540c7aa89758 req-c56f5cfe-fa25-4c7d-9818-11ac2346c59e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034968 May 14 21:28:15.157992 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2092/4559] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:15.172952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:15.173572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:15.181125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.181586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.182421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.182796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.270367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:15.273715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:15.278505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.279041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.279983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.280490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.335615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:15.343712 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-322805de-3ec9-4ebd-be6b-e5b5ccf69a0d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.174757 May 14 21:28:15.344303 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2468/4560] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:15 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:15.497781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:15.506113 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7a341b0-ed70-4a6b-a457-fdc43603c169 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1325 microversion: 2.1 time: 0.240671 May 14 21:28:15.506759 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2093/4561] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:15 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1325 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:15.773848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:15.775437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:15.783385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.783884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.784914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.785696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.827468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.827993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.828459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lazy-loading 'fault' on Instance uuid 441f55e9-7d61-4fe1-824f-b109de8af293 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:15.877829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:15.887656 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5252caad-df7a-4a6b-9ad5-01f4c7914e79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 200 len: 1299 microversion: 2.1 time: 0.117913 May 14 21:28:15.888342 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2469/4562] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:15 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:15.906966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:15.907795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:15.916070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.916626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:15.917447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:15.917948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.203750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:16.213208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:16.214716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:16.215911 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64cfdd82-b054-48f8-a0a1-86afae72bcfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.313216 May 14 21:28:16.219225 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2094/4563] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:15 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:16.361218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:16.362311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:16.369116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.369576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.372788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.372788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.504153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:16.511972 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e703e45d-17a3-451a-9ee8-6042501924cc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.154716 May 14 21:28:16.512549 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2470/4564] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:16 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:16.524047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:16.524905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:16.530906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.531370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.532205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.532654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.722531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:16.731760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60560844-f239-44c7-a528-a308335d8000 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.211524 May 14 21:28:16.740971 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2095/4565] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:16 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:16.748767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:16.749386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:16.759582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.760084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.760948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.762747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.913273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:16.915962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:16.920376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:16.925535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.928309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.935335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:16.936099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:16.944042 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04f3ff55-7ce1-464e-ade1-d6c8a8a2bf55 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.192663 May 14 21:28:16.944042 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2471/4566] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:16 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:16.956821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c10da00-dfd1-4134-b17c-d5099e16ec2e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1255796988", "metadata": {"": ""}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c10da00-dfd1-4134-b17c-d5099e16ec2e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action HTTP/1.1 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 107 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1255796988", "metadata": {"": ""}}} May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '642eb1fc-fd39-47fb-a85e-f6423a1c1a21', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1255796988', 'metadata': {'': ''}}}} May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'': ''} May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:16.968062 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c10da00-dfd1-4134-b17c-d5099e16ec2e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c10da00-dfd1-4134-b17c-d5099e16ec2e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action" status: 400 len: 170 microversion: 2.1 time: 0.013511 May 14 21:28:16.972823 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2472/4567] 10.222.0.52 () {60 vars in 1278 bytes} [Sat May 14 21:28:16 2022] POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action => generated 170 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 HTTP/1.1 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '441f55e9-7d61-4fe1-824f-b109de8af293'} May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:28:16.974352 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:16.979309 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-935a55c8-a2bf-4ae2-af8e-e2a104f37ecd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 404 len: 111 microversion: 2.1 time: 0.065760 May 14 21:28:16.982017 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2096/4568] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:16 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:28:16.988813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:17.000152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:17.009574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.010423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.012180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.012180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.103229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-619661017", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8da851bf-8623-41cd-8e7e-e11152a2fef0"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:17.165917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:28:17.170263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:17.178676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1d0fc651-54a9-4a22-9d73-ea3a44d31e7a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.197675 May 14 21:28:17.179268 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2473/4569] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:16 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:17.196918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:17.198530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:17.205133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.205912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.207330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.207522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.349066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:17.357465 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9d71eebc-e7cd-4757-afc8-c42deb51d5cf tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.165059 May 14 21:28:17.358065 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2474/4570] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:17 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:17.363828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:17.364459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:17.372011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.372739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.373548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.374170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.577601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:17.587648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:17.589174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:17.590342 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1c64a7b7-1d9d-450d-8fb3-b324710966eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.231334 May 14 21:28:17.590912 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2475/4571] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:17 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa82f999-e63e-4961-b141-5595ff420200 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1834745200", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa82f999-e63e-4961-b141-5595ff420200 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action HTTP/1.1 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 619 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1834745200", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:28:17.600773 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '642eb1fc-fd39-47fb-a85e-f6423a1c1a21', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1834745200', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:17.606076 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa82f999-e63e-4961-b141-5595ff420200 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa82f999-e63e-4961-b141-5595ff420200 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action" status: 400 len: 938 microversion: 2.1 time: 0.008780 May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2476/4572] 10.222.0.52 () {60 vars in 1278 bytes} [Sat May 14 21:28:17 2022] POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:17.612139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:17.616557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.617022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.617808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.618255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.751638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:17.760284 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4fa5967b-a125-401a-bb80-b36ba5c34d5d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.158149 May 14 21:28:17.761137 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2477/4573] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:17 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:17.766602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:17.768054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:17.773970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.774436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.775218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.775690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.929938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:17.939870 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-851459f2-73a9-45b6-a3e4-98c0d916eb20 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.177500 May 14 21:28:17.941040 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2478/4574] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:17 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:17.958112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:17.958740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:17.965108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.965582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:17.966378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:17.966816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.135813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:28:18.136917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:28:18.137565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:28:18.138164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:28:18.138744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:28:18.147119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:18.149401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.154365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.154365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.154365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.159005 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1839f36d-e13a-4067-9021-15d4ca6af009 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.204823 May 14 21:28:18.160642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2479/4575] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:17 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:18.178898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15e274fa-3360-4b5b-aef8-6bec3bad3877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:18.179055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15e274fa-3360-4b5b-aef8-6bec3bad3877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action HTTP/1.1 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 285 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '642eb1fc-fd39-47fb-a85e-f6423a1c1a21', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:18.181312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:18.186324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15e274fa-3360-4b5b-aef8-6bec3bad3877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:18.189436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:28:18.189547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15e274fa-3360-4b5b-aef8-6bec3bad3877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action" status: 400 len: 619 microversion: 2.1 time: 0.012178 May 14 21:28:18.189547 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2480/4576] 10.222.0.52 () {60 vars in 1278 bytes} [Sat May 14 21:28:18 2022] POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:28:18.196503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:18.197122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:18.200070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:28:18.202273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:28:18.204445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.205580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.206878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.206878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.356120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:18.365180 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edb3eb68-6f7c-4957-b76b-bf28cb7f203c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.172569 May 14 21:28:18.377823 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2481/4577] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:18 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:18.378654 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd15f3a2-cf58-4b30-9874-29932ade84db tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.280632 May 14 21:28:18.379304 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2097/4578] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:28:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:28:18.383222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:18.384136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:18.410076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b01dfcfa-eeda-4803-84c8-aa4565ccde5b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:18.410076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b01dfcfa-eeda-4803-84c8-aa4565ccde5b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:18.410312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.410312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.410312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.410312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.487770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b01dfcfa-eeda-4803-84c8-aa4565ccde5b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:18.497799 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b01dfcfa-eeda-4803-84c8-aa4565ccde5b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1208 microversion: 2.1 time: 0.112485 May 14 21:28:18.498578 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2098/4579] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:18 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1208 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:18.557243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:18.566947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b5b0e428-196b-4063-acf5-536b7626ce18 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.187590 May 14 21:28:18.576991 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2482/4580] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:18 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:18.592981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d8cb050-9fc4-44fa-9eed-89890ac5295c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-374631797"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:18.592981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d8cb050-9fc4-44fa-9eed-89890ac5295c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:18.593790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d8cb050-9fc4-44fa-9eed-89890ac5295c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.593790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d8cb050-9fc4-44fa-9eed-89890ac5295c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.594315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d8cb050-9fc4-44fa-9eed-89890ac5295c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.594640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d8cb050-9fc4-44fa-9eed-89890ac5295c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.625998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:18.628247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:18.644529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.647184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.649718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.651336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.863193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:18.872309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:18.873799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:18.874959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-227b43de-d29c-4ad5-a795-7d7737cb2c41 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.261638 May 14 21:28:18.875539 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2483/4581] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:18 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:18.880279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:18.890132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:18.898675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.898675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:18.899680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:18.900318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.066948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:19.078222 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a55ed2ec-8bfe-4557-bd1e-b2859c78fad4 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.201610 May 14 21:28:19.080974 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2484/4582] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:18 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:19.130386 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d8cb050-9fc4-44fa-9eed-89890ac5295c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action" status: 202 len: 0 microversion: 2.1 time: 0.548488 May 14 21:28:19.131205 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2099/4583] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:28:18 2022] POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 14 21:28:19.141177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1324745268"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:19.142276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:19.148384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.148947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.149726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.150174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.184287 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Cannot 'createImage' instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 while it is in task_state image_snapshot_pending May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action HTTP/1.1 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 85 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1324745268"}} May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: exception: Cannot 'createImage' instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 while it is in task_state image_snapshot_pending May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '642eb1fc-fd39-47fb-a85e-f6423a1c1a21', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1324745268'}}} May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:28:19.185846 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 while it is in task_state image_snapshot_pending May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 while it is in task_state image_snapshot_pending May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 409 to user: Cannot 'createImage' instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 while it is in task_state image_snapshot_pending {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28dd9a03-2df7-42b3-a8c0-86deca276b8a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action" status: 409 len: 167 microversion: 2.1 time: 0.050425 May 14 21:28:19.193653 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2485/4584] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:28:19 2022] POST /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21/action => generated 167 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:28:19.197556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e0951cc-bae8-4f9f-a997-6df2252a9630 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '.version_select at 0x7fb1a6bcf310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:19.516201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:19.516814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:19.523988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.524521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.525292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.525732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.608639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:19.618620 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0a992963-95e6-4c3a-8799-2de3809dbd79 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1212 microversion: 2.1 time: 0.106590 May 14 21:28:19.619428 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2486/4585] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:19 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1212 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:19.630507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e0951cc-bae8-4f9f-a997-6df2252a9630 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/images/301fa1ac-88e4-4621-833a-66be3e40b561" status: 204 len: 0 microversion: 2.1 time: 0.437299 May 14 21:28:19.631239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2100/4586] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:19 2022] DELETE /compute/v2.1/images/301fa1ac-88e4-4621-833a-66be3e40b561 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:28:19.641995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:19.643307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:19.650200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.651529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.652517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.652965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.786773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:19.794370 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4a81001b-0222-4b9d-8c95-8ae388edc8d2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1534 microversion: 2.1 time: 0.158730 May 14 21:28:19.794954 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2487/4587] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:19 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1534 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:19.896278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:19.897531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:19.904676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.905235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:19.906168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:19.906618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.102562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:20.103621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:20.112021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:20.112021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.113002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:20.113521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.122712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:20.137778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:20.140114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:20.141648 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bb760723-8748-4a7a-b280-5256f6929611 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.250969 May 14 21:28:20.144715 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2101/4588] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:19 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:20.152928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-398ba10c-b0cb-4d73-96d6-69b6254bc8e7 req-e4d6c2a7-3de4-4ef3-8daa-d07c5aad9d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a91c0da-3308-4367-b3f4-ecc73bd8ee3f", "name": "network-vif-plugged", "status": "completed", "tag": "e90ff6bb-3ced-4a72-8633-418a004483a5"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:20.161516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-398ba10c-b0cb-4d73-96d6-69b6254bc8e7 req-e4d6c2a7-3de4-4ef3-8daa-d07c5aad9d0e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:20.161973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-398ba10c-b0cb-4d73-96d6-69b6254bc8e7 req-e4d6c2a7-3de4-4ef3-8daa-d07c5aad9d0e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.174425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-398ba10c-b0cb-4d73-96d6-69b6254bc8e7 req-e4d6c2a7-3de4-4ef3-8daa-d07c5aad9d0e service nova] Creating event network-vif-plugged:e90ff6bb-3ced-4a72-8633-418a004483a5 for instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f on nch1-master-1 May 14 21:28:20.180174 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-398ba10c-b0cb-4d73-96d6-69b6254bc8e7 req-e4d6c2a7-3de4-4ef3-8daa-d07c5aad9d0e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030304 May 14 21:28:20.180790 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2102/4589] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:20.285785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:20.293865 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a1bd41c-7121-4c1a-8bd2-38ffccc91d40 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.196151 May 14 21:28:20.294449 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2488/4590] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:20 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:20.637827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:20.638539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:20.646016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:20.646972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.647249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:20.647722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.734534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:20.742254 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7eef8b1c-d4c2-4af2-b21a-2d973976c3c3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1260 microversion: 2.1 time: 0.109262 May 14 21:28:20.743064 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2103/4591] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:20 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1260 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:20.812107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:20.812788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:20.821368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:20.821827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.822614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:20.823059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:20.973301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:20.980969 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6079c097-a0ff-49bc-9482-185ea382bc34 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1540 microversion: 2.1 time: 0.173073 May 14 21:28:20.981612 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2489/4592] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:20 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1540 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:21.164447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:21.165010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:21.172300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:21.172761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:21.173585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:21.174074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:21.312499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:21.313198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:21.320798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:21.321318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:21.322606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:21.323112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:21.391424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:21.401450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:21.402991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:21.404173 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11156203-2884-4f3a-8880-2f0d3400ffc6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.243924 May 14 21:28:21.404739 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2104/4593] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:21 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:21.457295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:21.464750 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a672d817-bc24-43b5-9bb9-d0dc2e703e15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1363 microversion: 2.1 time: 0.156577 May 14 21:28:21.465323 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2490/4594] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:21 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:21.761106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:21.761696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:21.768495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:21.768957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:21.769734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:21.770192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:21.837431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:21.844869 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-92ca0ab3-d86d-4338-b066-1a2ba746c551 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1278 microversion: 2.1 time: 0.087945 May 14 21:28:21.846349 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2105/4595] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:21 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:21.998843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:21.999471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:22.006642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.007127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.007938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.008375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.141731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:22.149973 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-30e186d6-c7af-4aed-b53d-17e99d6a1fb9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1540 microversion: 2.1 time: 0.155041 May 14 21:28:22.150575 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2491/4596] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:21 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1540 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:22.424550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:22.428375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:22.431691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.432239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.433089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.433763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.482512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:22.483457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:22.489832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.490296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.491135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.491611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.632652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:22.640734 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cc8b0acb-ae20-4f5f-a046-d0803c2f3434 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1548 microversion: 2.1 time: 0.162431 May 14 21:28:22.641315 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2492/4597] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:22 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:22.657458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-51568a5e-ef80-4cb5-908c-58be46c212f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:22.657938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-51568a5e-ef80-4cb5-908c-58be46c212f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:22.664194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51568a5e-ef80-4cb5-908c-58be46c212f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.664659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51568a5e-ef80-4cb5-908c-58be46c212f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.665435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51568a5e-ef80-4cb5-908c-58be46c212f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.665880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51568a5e-ef80-4cb5-908c-58be46c212f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.733415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:22.749189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:22.751301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:22.753625 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a2077da-4490-445c-9db8-bae33f34ddc7 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.333538 May 14 21:28:22.754269 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2106/4598] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:22 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:22.755286 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-51568a5e-ef80-4cb5-908c-58be46c212f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101930 May 14 21:28:22.755912 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2493/4599] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:28:22 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:28:22.867940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:22.868561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:22.878004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.878517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:22.879557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:22.879768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.070776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:23.078722 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-42934e9a-d14c-48ea-b1a1-053329428d41 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.219566 May 14 21:28:23.079322 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2107/4600] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:22 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:23.120415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ba85605-d01c-4881-ac90-542404d4ceec tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:23.120984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ba85605-d01c-4881-ac90-542404d4ceec tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.133082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ba85605-d01c-4881-ac90-542404d4ceec tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.133555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ba85605-d01c-4881-ac90-542404d4ceec tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.134357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ba85605-d01c-4881-ac90-542404d4ceec tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.134808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ba85605-d01c-4881-ac90-542404d4ceec tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.165835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7ba85605-d01c-4881-ac90-542404d4ceec tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9/ips" status: 200 len: 149 microversion: 2.1 time: 0.050421 May 14 21:28:23.172128 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2494/4601] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:28:23 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:23.172328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:23.172328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.176033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.176561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.177548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.177946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.181421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ba2acd5-df14-446f-a4d1-701795380c04"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:23.181421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.188908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.189502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.190554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.191013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.279032 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Invalid volume: volume 1ba2acd5-df14-446f-a4d1-701795380c04 is already attached to instances: 933ec720-1f55-478a-bac2-8f9e96aa692b May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9/os-volume_attachments HTTP/1.1 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 74 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: {"volumeAttachment": {"volumeId": "1ba2acd5-df14-446f-a4d1-701795380c04"}} May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid volume: volume 1ba2acd5-df14-446f-a4d1-701795380c04 is already attached to instances: 933ec720-1f55-478a-bac2-8f9e96aa692b May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': '512524da-bcba-4fde-ac6e-ba6748e659e9', 'body': {'volumeAttachment': {'volumeId': '1ba2acd5-df14-446f-a4d1-701795380c04'}}} May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ba2acd5-df14-446f-a4d1-701795380c04 is already attached to instances: 933ec720-1f55-478a-bac2-8f9e96aa692b May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:23.280756 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ba2acd5-df14-446f-a4d1-701795380c04 is already attached to instances: 933ec720-1f55-478a-bac2-8f9e96aa692b May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ba2acd5-df14-446f-a4d1-701795380c04 is already attached to instances: 933ec720-1f55-478a-bac2-8f9e96aa692b May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 400 to user: Invalid volume: volume 1ba2acd5-df14-446f-a4d1-701795380c04 is already attached to instances: 933ec720-1f55-478a-bac2-8f9e96aa692b {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8f4c5391-2e04-478c-8152-27072291ea4a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108993 May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2495/4602] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:28:23 2022] POST /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:23.293340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.299602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.299872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.300665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.301102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.328744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:28:23.442621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:23.452806 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d3b8f411-faef-41a6-8180-1e3edbdbeb0f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1522 microversion: 2.1 time: 0.289578 May 14 21:28:23.454062 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2108/4603] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:23 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:23.472912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:23.473615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.480977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.481707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.482535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.482980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.516026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:28:23.602934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2d4d397c-5f86-42fc-b698-352a7e901dd6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 204 len: 0 microversion: 2.1 time: 0.314866 May 14 21:28:23.603837 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2496/4604] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:28:23 2022] DELETE /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:28:23.613038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:23.614095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.621624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.622093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.622932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.623580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.815408 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f97df12-3b94-4d39-b8ee-435338c6fe81 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 204 len: 0 microversion: 2.1 time: 0.347593 May 14 21:28:23.816361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2109/4605] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:28:23 2022] DELETE /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:28:23.821813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7252b8a3-b2fa-4cf0-9c72-722dd6326a70 req-3b2c9bc7-6f66-4a18-9a57-c8712ec938eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69fb9083-0ea0-4eeb-92ff-1a2f6c876317", "tag": "842b646d-eb77-44e5-9fb8-12cb7dc078ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:23.830918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7252b8a3-b2fa-4cf0-9c72-722dd6326a70 req-3b2c9bc7-6f66-4a18-9a57-c8712ec938eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.831681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7252b8a3-b2fa-4cf0-9c72-722dd6326a70 req-3b2c9bc7-6f66-4a18-9a57-c8712ec938eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.843458 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7252b8a3-b2fa-4cf0-9c72-722dd6326a70 req-3b2c9bc7-6f66-4a18-9a57-c8712ec938eb service nova] Creating event network-changed:842b646d-eb77-44e5-9fb8-12cb7dc078ab for instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 on nch1-master-1 May 14 21:28:23.859956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:23.861545 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7252b8a3-b2fa-4cf0-9c72-722dd6326a70 req-3b2c9bc7-6f66-4a18-9a57-c8712ec938eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043457 May 14 21:28:23.862602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2110/4606] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:23.867957 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71042ed6-8b26-4851-84fc-e3d3f73807fc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1679 microversion: 2.1 time: 0.259932 May 14 21:28:23.868178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:23.868676 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2497/4607] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:23 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1679 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:23.869899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.877294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.877723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.878508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.878954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.884558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:23.885192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:23.891542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.892282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:23.893289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:23.893908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:24.099175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:24.113066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:24.114725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:24.115983 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ecdd54bd-6257-49aa-a6b6-c4958926e1cb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.252272 May 14 21:28:24.116825 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2111/4608] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:23 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:24.121157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:24.121775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:24.130475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:24.130936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:24.131808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:24.132477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:24.179313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:24.195666 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b5601fa-a1dc-4c79-a952-b2d476bbbb5b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1528 microversion: 2.1 time: 0.315472 May 14 21:28:24.197294 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2498/4609] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:23 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1528 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:24.357098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:24.367712 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-517377a8-8cc3-4bef-b4b4-836666751937 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.249974 May 14 21:28:24.369236 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2112/4610] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:24 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:24.457933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-f55fe8f7-5647-4dd7-b367-2c36761ba0bf req-fa735c6e-87c4-4c20-b07d-3b1a2e5022eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a91c0da-3308-4367-b3f4-ecc73bd8ee3f", "tag": "e90ff6bb-3ced-4a72-8633-418a004483a5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:24.467816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f55fe8f7-5647-4dd7-b367-2c36761ba0bf req-fa735c6e-87c4-4c20-b07d-3b1a2e5022eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:24.468349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-f55fe8f7-5647-4dd7-b367-2c36761ba0bf req-fa735c6e-87c4-4c20-b07d-3b1a2e5022eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:24.481341 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-f55fe8f7-5647-4dd7-b367-2c36761ba0bf req-fa735c6e-87c4-4c20-b07d-3b1a2e5022eb service nova] Creating event network-changed:e90ff6bb-3ced-4a72-8633-418a004483a5 for instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f on nch1-master-1 May 14 21:28:24.491056 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-f55fe8f7-5647-4dd7-b367-2c36761ba0bf req-fa735c6e-87c4-4c20-b07d-3b1a2e5022eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099461 May 14 21:28:24.492456 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2499/4611] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:24.886207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:24.886965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:24.897367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:24.898164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:24.899819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:24.900220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:25.140691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:25.142723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:25.149632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:25.150193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:25.151063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:25.151638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:25.378226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:25.389337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:25.391612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:25.392899 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ecc0f308-87a5-4046-b47e-9f678b50286e tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.259548 May 14 21:28:25.393814 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2500/4612] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:25 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:25.398467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:25.399086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:25.405646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:25.406095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:25.406871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:25.407309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:25.560393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:25.568287 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4d201cca-5ee5-42b3-9c3e-71e519582405 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1528 microversion: 2.1 time: 0.173375 May 14 21:28:25.568748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:25.578447 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2501/4613] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:25 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1528 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:25.578595 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-144355e6-3aba-408a-be27-a1385b827f77 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1679 microversion: 2.1 time: 0.695717 May 14 21:28:25.578595 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2113/4614] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:24 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1679 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:25.584358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:25.585243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:25.592989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:25.593793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:25.595848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:25.596569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:25.735668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:25.743140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e3f71e5-1666-4c60-86f6-67e8e2e29fa3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.163067 May 14 21:28:25.743979 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2502/4615] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:25 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:26.359293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-767903a7-b812-43de-9fc0-8fa6a07ee0db tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:26.360089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-767903a7-b812-43de-9fc0-8fa6a07ee0db tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:26.367691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767903a7-b812-43de-9fc0-8fa6a07ee0db tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.368152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767903a7-b812-43de-9fc0-8fa6a07ee0db tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.370264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767903a7-b812-43de-9fc0-8fa6a07ee0db tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.370715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767903a7-b812-43de-9fc0-8fa6a07ee0db tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.398966 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-767903a7-b812-43de-9fc0-8fa6a07ee0db tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/ips" status: 200 len: 151 microversion: 2.20 time: 0.043501 May 14 21:28:26.399815 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2114/4616] 10.222.0.52 () {60 vars in 1288 bytes} [Sat May 14 21:28:26 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:28:26.412626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:26.413199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:26.424435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.424435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.424435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.424435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.596196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:26.598051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:26.607563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.608375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.609747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.610395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.662516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:26.672594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:26.675507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:26.676872 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dfc577c6-95f6-43ba-a2ba-8ef73e0bce88 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.268938 May 14 21:28:26.688977 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2503/4617] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:26 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:26.695109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:26.695766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:26.702229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.702721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.703686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.704070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.854089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:26.862363 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5fd1b48b-fec1-46bd-9ad7-42628e93ad32 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1679 microversion: 2.1 time: 0.171135 May 14 21:28:26.863013 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2504/4618] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:26 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:26.867745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:26.868403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:26.874755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.875328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.876199 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:26.877497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:26.947020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:26.955533 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d3d30b3c-79c8-490f-88c2-2885ec19270d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1528 microversion: 2.1 time: 0.372614 May 14 21:28:26.958006 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2115/4619] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:26 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1528 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:27.099274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:27.110192 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e5366513-48eb-45f4-aa4f-cc5ae2f4c3d7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.245962 May 14 21:28:27.120378 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2505/4620] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:26 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:27.479600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fe06e0ce-f244-4d06-83a4-53c9054ffcc3 req-53760d3b-8aaf-45a2-85a5-7016b8f8d317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "642eb1fc-fd39-47fb-a85e-f6423a1c1a21", "name": "network-vif-deleted", "tag": "28cb501e-e36e-4c9e-96d4-bd46e1d069db"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:27.490641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fe06e0ce-f244-4d06-83a4-53c9054ffcc3 req-53760d3b-8aaf-45a2-85a5-7016b8f8d317 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:27.491106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fe06e0ce-f244-4d06-83a4-53c9054ffcc3 req-53760d3b-8aaf-45a2-85a5-7016b8f8d317 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:27.505803 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fe06e0ce-f244-4d06-83a4-53c9054ffcc3 req-53760d3b-8aaf-45a2-85a5-7016b8f8d317 service nova] Creating event network-vif-deleted:28cb501e-e36e-4c9e-96d4-bd46e1d069db for instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 on nch2-master-1 May 14 21:28:27.512240 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fe06e0ce-f244-4d06-83a4-53c9054ffcc3 req-53760d3b-8aaf-45a2-85a5-7016b8f8d317 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036538 May 14 21:28:27.513185 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2116/4621] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:27.698825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:27.700110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:27.707187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:27.707701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:27.708484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:27.709130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:27.883031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:27.885567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:27.893796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:27.894265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:27.895223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:27.895940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:27.976636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:27.988532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:27.990578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:27.992618 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82fb8be7-6cc5-4c31-a7c0-b82d440adcb2 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.298333 May 14 21:28:28.002634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2506/4622] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:27 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:28.015908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:28.017672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:28.020637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:28.026038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:28.026038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:28.026568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:28.027125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:28.030513 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab328e9a-4f29-4bb5-acea-1e17c8c6013e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1611 microversion: 2.1 time: 0.154056 May 14 21:28:28.031560 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2117/4623] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:27 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1611 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:28.064213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:28.064903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:28.065745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lazy-loading 'fault' on Instance uuid 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:28.128451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:28.129078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:28.139983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:28.140446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:28.141245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:28.141694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:28.153481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:28.163237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8f5eada-6d03-4da4-80c1-2827fb024e35 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 200 len: 1315 microversion: 2.1 time: 0.159178 May 14 21:28:28.164121 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2507/4624] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:28 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:28.335894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:28.344782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bf9556c-dd35-45e8-929a-2775adb2682d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.220615 May 14 21:28:28.347411 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2118/4625] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:28 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:29.014805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:29.016184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:29.028337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.028852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.029609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.030052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.050178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:29.050805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:29.057932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.062806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.062806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.062806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.093657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.094375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.095009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lazy-loading 'fault' on Instance uuid 512524da-bcba-4fde-ac6e-ba6748e659e9 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:29.146015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:29.158922 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c62e08bc-b4ba-469c-bec1-567ca0095755 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 200 len: 1329 microversion: 2.1 time: 0.113752 May 14 21:28:29.159934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2119/4626] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:29 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 1329 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:29.187779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:29.188693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:29.196268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.196984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.197773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.198215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.243621 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 HTTP/1.1 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '642eb1fc-fd39-47fb-a85e-f6423a1c1a21'} May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:29.245000 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d8550ab-1546-436f-a108-972ac20b6b0b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 404 len: 111 microversion: 2.1 time: 0.066638 May 14 21:28:29.258405 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2120/4627] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:29 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:28:29.263273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ca16d044-34bf-452d-a43e-6e55e3eb709a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'create', calling method: .version_select at 0x7fb1a6b9fdc0>, body: {"keypair": {"name": "tempest-keypair-1433246915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJO31pLUPv2LLOy0ZsQyGd73zK1iIBfIE492r+rw91FGP8DhZBZYyJFZmhFWB6FR2Sp+oXV34xhnDODswJG1BRMq6QeehKqpBT8zo3j2gfqhdzqPQo+YMooSPnmEl3WRsw=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:29.267908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:29.279440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:29.286383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:29.287639 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-61db0516-0012-4521-80bd-d5509901b810 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.278433 May 14 21:28:29.289315 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2508/4628] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:29 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:29.301468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ca16d044-34bf-452d-a43e-6e55e3eb709a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:28:29.308206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ca16d044-34bf-452d-a43e-6e55e3eb709a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for user 1d73e16649b845319b5184937056b233 and project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:28:29.364938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:29.365718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:29.372541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.373030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.375730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.375730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.427766 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ca16d044-34bf-452d-a43e-6e55e3eb709a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168461 May 14 21:28:29.428949 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2121/4629] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:28:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:29.526188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:29.534924 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a1a7d76-878d-4c66-9633-b24918afc7bf tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.174749 May 14 21:28:29.535613 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2509/4630] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:29 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:29.536323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fec5c92a-50b6-414b-bd5c-f6675fad93df req-74f471d8-952f-49c0-a56b-74650a6c6862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "512524da-bcba-4fde-ac6e-ba6748e659e9", "name": "network-vif-deleted", "tag": "a540ba33-d93a-4e5d-bf81-61d3d93287c8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:29.545853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fec5c92a-50b6-414b-bd5c-f6675fad93df req-74f471d8-952f-49c0-a56b-74650a6c6862 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.546293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fec5c92a-50b6-414b-bd5c-f6675fad93df req-74f471d8-952f-49c0-a56b-74650a6c6862 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.558412 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fec5c92a-50b6-414b-bd5c-f6675fad93df req-74f471d8-952f-49c0-a56b-74650a6c6862 service nova] Creating event network-vif-deleted:a540ba33-d93a-4e5d-bf81-61d3d93287c8 for instance 512524da-bcba-4fde-ac6e-ba6748e659e9 on nch2-master-1 May 14 21:28:29.564343 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fec5c92a-50b6-414b-bd5c-f6675fad93df req-74f471d8-952f-49c0-a56b-74650a6c6862 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 May 14 21:28:29.564977 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2122/4631] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:29.766326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:29.767610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:29.774127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.774618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.775411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:29.775896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:29.801946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lazy-loading 'flavor' on Instance uuid 4097156a-300a-4d17-87df-60620c836925 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:30.178467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:30.179564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:30.187554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.188437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.189637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.190298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.207740 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 HTTP/1.1 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '512524da-bcba-4fde-ac6e-ba6748e659e9'} May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:30.209757 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:30.221677 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd9b8136-9ef5-428c-9bb0-0b041ef67a1e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 404 len: 111 microversion: 2.1 time: 0.047556 May 14 21:28:30.227046 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2123/4632] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:30 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:28:30.232363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6b458fea-508a-4603-8818-bb247b0ba48b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '.version_select at 0x7fb1a6bfe0d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:30.307991 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6b458fea-508a-4603-8818-bb247b0ba48b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-42538759" status: 202 len: 0 microversion: 2.1 time: 0.079091 May 14 21:28:30.320821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2124/4633] 10.222.0.52 () {58 vars in 1214 bytes} [Sat May 14 21:28:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-42538759 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:28:30.334336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:30.334966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:30.342343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.342833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.344796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.346649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.515725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c74a1df-0a22-4542-a3c6-7450d8ba5348 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/action" status: 202 len: 0 microversion: 2.20 time: 0.754112 May 14 21:28:30.520191 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2510/4634] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:28:29 2022] POST /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/action => generated 0 bytes in 760 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 14 21:28:30.528175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:30.529163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:30.537021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.541120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.541120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.541120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.624922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:30.639106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:30.640940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:30.642788 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2964ca8b-05f0-401c-a4dd-23f0b980ccdb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.320299 May 14 21:28:30.643685 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2125/4635] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:30 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:30.648365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:30.648978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:30.659400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.659897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.660714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:30.661157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:30.715506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:30.724609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:30.726748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:30.727976 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4a76e535-c563-480b-92dc-9a5c7fd164c2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.205995 May 14 21:28:30.728548 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2511/4636] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:30 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:30.818017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:30.825769 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d16d374-8820-48ba-8dc8-6902d9fd9e0e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.180904 May 14 21:28:30.826341 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2126/4637] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:30 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:31.621633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:31.622369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:31.629541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.630101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:31.630957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.631395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:31.661475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:31.662091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:31.669266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.669696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:31.670650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.671096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:31.717682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lazy-loading 'services' on Instance uuid 933ec720-1f55-478a-bac2-8f9e96aa692b {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:31.873399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:31.883024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:31.884566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:31.885729 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-245dac22-4572-4967-8ed1-36862a8fd1ef tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.228642 May 14 21:28:31.886299 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2127/4638] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:31 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:31.891765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:31.891962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:31.897766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.898487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:31.899267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.899761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:31.967232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9bc20a05-9740-4fa4-b99c-e35f0e390973 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments/1ba2acd5-df14-446f-a4d1-701795380c04" status: 202 len: 0 microversion: 2.1 time: 0.341314 May 14 21:28:31.967232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2512/4639] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:28:31 2022] DELETE /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments/1ba2acd5-df14-446f-a4d1-701795380c04 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:28:31.972003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:31.973048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:31.980882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.981343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:31.982122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:31.982694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:32.070265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:32.078313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:32.080771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:32.081945 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-957bbea9-b173-4bc4-9afe-2b3bf066f1f3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.194646 May 14 21:28:32.082523 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2128/4640] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:31 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:32.088857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-af6be8a4-4776-46ed-a4c8-19e17510c0d0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:32.090350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-af6be8a4-4776-46ed-a4c8-19e17510c0d0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:32.096956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af6be8a4-4776-46ed-a4c8-19e17510c0d0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:32.097572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af6be8a4-4776-46ed-a4c8-19e17510c0d0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:32.099569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af6be8a4-4776-46ed-a4c8-19e17510c0d0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:32.099739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af6be8a4-4776-46ed-a4c8-19e17510c0d0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:32.139491 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-af6be8a4-4776-46ed-a4c8-19e17510c0d0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055610 May 14 21:28:32.140303 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2129/4641] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:28:32 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:32.173444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:32.181237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7d53adfd-7af9-4053-8f0a-632a834f9ece tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.216610 May 14 21:28:32.181814 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2513/4642] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:31 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:32.234547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-574776875", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:32.292160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] validate_networks() for [('23acb6aa-5f12-463d-b4bb-6884cb9f6bec', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:28:32.795719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:28:32.796303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:28:32.796620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:28:32.797038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:28:32.797460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:28:32.809416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:32.812855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:32.812855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:32.812855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:32.830986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:28:32.838326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for user 1d73e16649b845319b5184937056b233 and project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:28:32.862820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:28:32.865689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:28:32.905763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:32.906406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:32.916468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:32.917313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:32.918348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:32.919017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:33.072405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6840cfd1-9d24-4431-b2c2-0cf7a91076df tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.841959 May 14 21:28:33.073855 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2130/4643] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:28:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:28:33.085675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f0f51dc0-f038-4469-a83c-e14613b9b160 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:33.086823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0f51dc0-f038-4469-a83c-e14613b9b160 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:33.162525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.172406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.175677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.176852 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a420e08-2882-47d1-84ca-1f09df299968 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.275285 May 14 21:28:33.177424 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2514/4644] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:32 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:33.182187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:33.182369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f0f51dc0-f038-4469-a83c-e14613b9b160 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.182868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:33.189664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:33.190248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:33.191036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:33.191510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:33.196417 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f0f51dc0-f038-4469-a83c-e14613b9b160 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1224 microversion: 2.1 time: 0.116495 May 14 21:28:33.206780 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2131/4645] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:33 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:33.206780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c792f23-dfc5-494f-980b-fe2e84572047 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:33.206780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c792f23-dfc5-494f-980b-fe2e84572047 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:33.210438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c792f23-dfc5-494f-980b-fe2e84572047 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:33.210938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c792f23-dfc5-494f-980b-fe2e84572047 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:33.211704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c792f23-dfc5-494f-980b-fe2e84572047 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:33.212149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c792f23-dfc5-494f-980b-fe2e84572047 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:33.253080 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c792f23-dfc5-494f-980b-fe2e84572047 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054560 May 14 21:28:33.253976 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2132/4646] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:28:33 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:33.258838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:33.259528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:33.266622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:33.267858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:33.268824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:33.270114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:33.386655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.399130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.399130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.399394 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-45fe3f36-4db8-4ca1-a9b9-522b54ecd16a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.220543 May 14 21:28:33.399985 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2515/4647] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:33 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:33.493521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:33.501625 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffa9ceef-62b7-4eab-adcb-77daccb7502c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.246394 May 14 21:28:33.502602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2133/4648] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:33 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:34.196866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:34.197638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:34.205226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.206307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.208723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.208723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.215706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:34.216504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:34.225222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.225686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.226829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.227275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.412427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:34.422799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:34.425138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:34.426798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b485a69-7aa3-456a-b227-850719dc0d1d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.234295 May 14 21:28:34.427380 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2516/4649] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:34 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:34.432433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e6a1b76-8593-4c11-9ed2-a9777623a9a4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:34.433432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e6a1b76-8593-4c11-9ed2-a9777623a9a4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:34.441663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e6a1b76-8593-4c11-9ed2-a9777623a9a4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.442176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e6a1b76-8593-4c11-9ed2-a9777623a9a4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.443424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e6a1b76-8593-4c11-9ed2-a9777623a9a4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.443982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e6a1b76-8593-4c11-9ed2-a9777623a9a4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.478628 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e6a1b76-8593-4c11-9ed2-a9777623a9a4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050002 May 14 21:28:34.479249 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2517/4650] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:28:34 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:28:34.484346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:34.485252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:34.492612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.493356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.494815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.495280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.651381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:34.651762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:34.659668 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ab3f5d2-5e00-42d6-a52c-2b7d2983662d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1228 microversion: 2.1 time: 0.449451 May 14 21:28:34.661774 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2134/4651] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:34 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1228 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:34.662337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:34.664038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:34.665238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:34.665603 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-61513273-5fff-4857-9c68-cbc1fd5de5fb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.185034 May 14 21:28:34.665994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:34.666310 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2518/4652] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:34 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:34.672222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.672661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:34.673294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.674041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:34.675315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.675954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.681699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.684665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.684665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:34.684665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:34.712530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:28:35.134508 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81d58fcc-1a5a-42d9-a0db-2eaff91b5bff tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 204 len: 0 microversion: 2.1 time: 0.466588 May 14 21:28:35.135822 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2519/4653] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:28:34 2022] DELETE /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:28:35.145220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-63e5f8d7-9e39-442e-ab96-6f4a8f47dda6 req-67ac082e-8c3f-4292-ab20-0f3b01cd4c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-plugged", "status": "completed", "tag": "39024741-3b76-4bb3-aecf-4392e5246961"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:35.153949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-63e5f8d7-9e39-442e-ab96-6f4a8f47dda6 req-67ac082e-8c3f-4292-ab20-0f3b01cd4c7c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.154612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-63e5f8d7-9e39-442e-ab96-6f4a8f47dda6 req-67ac082e-8c3f-4292-ab20-0f3b01cd4c7c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.170738 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-63e5f8d7-9e39-442e-ab96-6f4a8f47dda6 req-67ac082e-8c3f-4292-ab20-0f3b01cd4c7c service nova] Creating event network-vif-plugged:39024741-3b76-4bb3-aecf-4392e5246961 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:35.177353 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-63e5f8d7-9e39-442e-ab96-6f4a8f47dda6 req-67ac082e-8c3f-4292-ab20-0f3b01cd4c7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039882 May 14 21:28:35.178578 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2520/4654] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:35.184814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:35.185904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:35.196202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.199423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.199423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.199423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.236388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:35.247000 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f673e8be-0693-4dd7-a97b-a3a857ebead0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.585591 May 14 21:28:35.248535 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2135/4655] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:34 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:35.354156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:35.365743 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ab1aa78-8760-45fd-9549-2df040ad400f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1682 microversion: 2.1 time: 0.185763 May 14 21:28:35.366430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2521/4656] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:35 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:35.446583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:35.447197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:35.453475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.453930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.454888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.455332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.679399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:35.679399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:35.688507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.689118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.690939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.691391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.757552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:35.765443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:35.767030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:35.768652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:35.769858 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe802893-f9ff-4fde-8ea3-d49153544e3b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.327238 May 14 21:28:35.770416 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2136/4657] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:35 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:35.775067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:35.775705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:35.781723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.782105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.783431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:35.784466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:35.785607 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-25da0e84-4b43-4c11-b52c-774b97d3dc68 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1284 microversion: 2.1 time: 0.112626 May 14 21:28:35.786868 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2522/4658] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:35 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:35.999954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:36.008738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:36.010788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:36.012819 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-85fa09e2-f7ae-43bb-8f06-37332f0f1ebb tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.240540 May 14 21:28:36.012819 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2137/4659] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:35 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:36.267437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:36.268394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:36.275567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.276101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.276883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.277329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.385662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:36.386923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:36.395895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.397303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.398260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.398976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.453107 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:36.458630 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cae898ae-76ea-489a-a54f-4531bed915e8 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.196201 May 14 21:28:36.459594 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2523/4660] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:36 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:36.668746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:36.681244 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-331fae97-ad3a-4e99-aaf9-45dabbcc00f2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1682 microversion: 2.1 time: 0.299353 May 14 21:28:36.681244 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2138/4661] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:36 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1682 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:36.791507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:36.792675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:36.803752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.804513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.806394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.807342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.819867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:36.824141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:36.842024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.842024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.842893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:36.844523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:36.952718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:36.962842 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44a33ca4-fa41-4640-a6ff-ccfab6a36b97 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1282 microversion: 2.1 time: 0.153897 May 14 21:28:36.975653 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2139/4662] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:36 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1282 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:37.033434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.038591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:37.039467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:37.044547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.046353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.047698 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-23dc187c-13ed-4c50-837a-4555dea387eb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.261986 May 14 21:28:37.047963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.048824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.048958 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2524/4663] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:36 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:37.049555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.050653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.197454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-plugged", "status": "completed", "tag": "a3973166-07b4-4aaf-95b2-bd95a9578877"}, {"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-plugged", "status": "completed", "tag": "63396429-e743-49a6-a83f-427d96ffbf18"}, {"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-plugged", "status": "completed", "tag": "edfac6c5-c706-4629-944c-81d0943a6af1"}, {"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-plugged", "status": "completed", "tag": "fa577191-77f9-4d03-a86c-1dae3aad889a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:37.206164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.206604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.218300 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] Creating event network-vif-plugged:a3973166-07b4-4aaf-95b2-bd95a9578877 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:37.218826 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] Creating event network-vif-plugged:63396429-e743-49a6-a83f-427d96ffbf18 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:37.219345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] Creating event network-vif-plugged:edfac6c5-c706-4629-944c-81d0943a6af1 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:37.219890 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] Creating event network-vif-plugged:fa577191-77f9-4d03-a86c-1dae3aad889a for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:37.226349 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1bb61e8a-6a7b-4ce1-bc8a-2bec1f4cae8a req-e444595e-fc1e-43d3-bd06-a264fbfeecb6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.033036 May 14 21:28:37.226971 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2525/4664] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:37.390843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.399933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.401455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.411011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19468272-eebf-4588-a8b3-437e4842baa7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.376339 May 14 21:28:37.411011 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2140/4665] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:37 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:37.477385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:37.478326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:37.484675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.485144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.486068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.486465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.624963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.632812 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b4a701c-d05d-4f80-8b38-27a987e04e3e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.160354 May 14 21:28:37.633514 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2526/4666] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:37 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:37.697119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:37.702780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:37.709817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.710285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.711217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.711698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.886379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:37.886379 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c710b579-a49f-434b-835f-c2da4fa00747 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1614 microversion: 2.1 time: 0.143881 May 14 21:28:37.886379 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2141/4667] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:37 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1614 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:37.981354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:37.986236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:37.989455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.989912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:37.990689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:37.991131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.070831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:38.071534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:38.080795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.081272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.082090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.082544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.203908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.213582 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a5f0578-d9d5-4ec5-9a05-3451d5e17d63 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.236169 May 14 21:28:38.222197 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2527/4668] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:37 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:38.421335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:38.422064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:38.429205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.433481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.433481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.433481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.599084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.611415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.611415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.611415 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f740ffa8-f8a0-4e55-b4a5-fd93e20ab392 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.193591 May 14 21:28:38.612458 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2528/4669] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:38 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:38.631869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2dcc96d3-0af5-48c4-a6d9-c196c8692ca0 req-f25e703b-bf41-4d20-a27b-6eec081f5e1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933ec720-1f55-478a-bac2-8f9e96aa692b", "name": "network-vif-deleted", "tag": "b88ac6b1-d929-407f-bf99-94e2f2e3f04b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:38.644634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2dcc96d3-0af5-48c4-a6d9-c196c8692ca0 req-f25e703b-bf41-4d20-a27b-6eec081f5e1e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.645235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2dcc96d3-0af5-48c4-a6d9-c196c8692ca0 req-f25e703b-bf41-4d20-a27b-6eec081f5e1e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.659612 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2dcc96d3-0af5-48c4-a6d9-c196c8692ca0 req-f25e703b-bf41-4d20-a27b-6eec081f5e1e service nova] Creating event network-vif-deleted:b88ac6b1-d929-407f-bf99-94e2f2e3f04b for instance 933ec720-1f55-478a-bac2-8f9e96aa692b on nch2-master-1 May 14 21:28:38.664994 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2dcc96d3-0af5-48c4-a6d9-c196c8692ca0 req-f25e703b-bf41-4d20-a27b-6eec081f5e1e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040415 May 14 21:28:38.673298 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2529/4670] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:38.673298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:38.673298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:38.681090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.681814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.682800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.683592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.699143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.724264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.726544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.730553 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f12b4e4b-d15c-4c56-a5bd-c6f97a0a5274 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.667823 May 14 21:28:38.731810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2142/4671] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:38 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:38.857102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:38.857903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:38.870672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.873910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.879291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:38.884209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:38.884868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:38.892595 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f400c016-94a7-4601-89ac-0721d0eeb711 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.225452 May 14 21:28:38.904152 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2530/4672] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:38 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:39.008994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:39.019763 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c906528a-ee99-4c77-b8a3-269e611c9b2c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 200 len: 1326 microversion: 2.1 time: 0.168643 May 14 21:28:39.022230 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2143/4673] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:38 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 1326 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:39.233366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:39.234330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:39.242748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7e4bdcc4-2eaf-48c2-af8a-c1484745d0f8 req-eff7470f-b618-42b4-ac97-71e643a4f754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-plugged", "status": "completed", "tag": "ebe73789-12d4-4374-8e71-4e93c4257d27"}, {"server_uuid": "69fb9083-0ea0-4eeb-92ff-1a2f6c876317", "name": "network-vif-plugged", "status": "completed", "tag": "842b646d-eb77-44e5-9fb8-12cb7dc078ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:39.255471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:39.256291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:39.256848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:39.257308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:39.258478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7e4bdcc4-2eaf-48c2-af8a-c1484745d0f8 req-eff7470f-b618-42b4-ac97-71e643a4f754 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:39.258766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7e4bdcc4-2eaf-48c2-af8a-c1484745d0f8 req-eff7470f-b618-42b4-ac97-71e643a4f754 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:39.279332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7e4bdcc4-2eaf-48c2-af8a-c1484745d0f8 req-eff7470f-b618-42b4-ac97-71e643a4f754 service nova] Creating event network-vif-plugged:ebe73789-12d4-4374-8e71-4e93c4257d27 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:39.282032 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7e4bdcc4-2eaf-48c2-af8a-c1484745d0f8 req-eff7470f-b618-42b4-ac97-71e643a4f754 service nova] Creating event network-vif-plugged:842b646d-eb77-44e5-9fb8-12cb7dc078ab for instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 on nch1-master-1 May 14 21:28:39.292936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7e4bdcc4-2eaf-48c2-af8a-c1484745d0f8 req-eff7470f-b618-42b4-ac97-71e643a4f754 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053910 May 14 21:28:39.293872 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2144/4674] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:28:39.407177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:39.416430 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7bca624c-c653-4af5-8e6b-35e1287811a8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.187091 May 14 21:28:39.416614 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2531/4675] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:39 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:39.637572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:39.639663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:39.653181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:39.654240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:39.655287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:39.656011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:39.748888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:39.749523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:39.757057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:39.759259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:39.759259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:39.759259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:39.968089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:39.981214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:39.981214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:39.982172 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-667c11a5-795a-4304-9833-f6d48392ccd6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.236965 May 14 21:28:39.982172 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2532/4676] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:39 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:39.993516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:39.998827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:39.999763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:40.005675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:40.006363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:40.007959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:40.008108 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa2bcc24-2d38-410b-8c32-6129151f8b09 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.376394 May 14 21:28:40.008784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:40.009887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:40.010540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:40.017943 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2145/4677] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:39 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:40.038528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:40.039348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:40.047069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:40.047680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:40.052241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:40.057393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:40.072774 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b HTTP/1.1 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '933ec720-1f55-478a-bac2-8f9e96aa692b'} May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:40.075138 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0aa1a8ba-d18b-48d4-a6c0-73387d9c6f9d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 404 len: 111 microversion: 2.1 time: 0.043967 May 14 21:28:40.085427 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2146/4678] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:40 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:28:40.093426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8d8c277-ef12-4d89-b5e7-5b33ab16c710 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '.version_select at 0x7fb1a6c033a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:40.162304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:40.170318 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9091a5ba-894b-4c45-85c5-eb18cb280ab0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1308 microversion: 2.1 time: 0.175328 May 14 21:28:40.171114 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2533/4679] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:39 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:40.215503 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8d8c277-ef12-4d89-b5e7-5b33ab16c710 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082053266" status: 202 len: 0 microversion: 2.1 time: 0.127960 May 14 21:28:40.216100 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2147/4680] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082053266 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:28:40.436353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:40.436353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:40.444707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:40.445481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:40.447168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:40.447168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:40.682060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9a7f9546-69ba-4aaf-ae7d-45bce51f9e61 req-fb68ba9b-01ce-4dd6-b1d4-cf895cf5f267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ef508d-db13-4092-a0a8-0c0cfdde7687", "tag": "695d61db-6e17-4068-af47-59d37b70b7ca"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:40.691281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:40.691764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9a7f9546-69ba-4aaf-ae7d-45bce51f9e61 req-fb68ba9b-01ce-4dd6-b1d4-cf895cf5f267 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:40.692240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9a7f9546-69ba-4aaf-ae7d-45bce51f9e61 req-fb68ba9b-01ce-4dd6-b1d4-cf895cf5f267 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:40.698619 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bce9b7e7-36c3-4734-ab7b-0f85452291a1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.269298 May 14 21:28:40.699224 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2534/4681] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:40 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:40.703295 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9a7f9546-69ba-4aaf-ae7d-45bce51f9e61 req-fb68ba9b-01ce-4dd6-b1d4-cf895cf5f267 service nova] Creating event network-changed:695d61db-6e17-4068-af47-59d37b70b7ca for instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 on nch2-master-1 May 14 21:28:40.711692 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9a7f9546-69ba-4aaf-ae7d-45bce51f9e61 req-fb68ba9b-01ce-4dd6-b1d4-cf895cf5f267 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034601 May 14 21:28:40.712602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2148/4682] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:28:41.001010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:41.002797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:41.009877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.010393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.011183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.011662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.027496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:41.028365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:41.036047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.039241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.039241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.039241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.214985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.224681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.234276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.234276 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1e21fb92-0aba-410a-add7-f327c0af9579 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.230652 May 14 21:28:41.234276 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2535/4683] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:40 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:41.234620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea4dd0ec-a84b-4f95-a67c-6b6ee0eb0f7a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: .version_select at 0x7fb1a77eae50>, body: {"keypair": {"name": "tempest-keypair-2061595565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0J78vFZpu5yWQu51yQrmTUGLFKuNCyfH+PDkG6uhKoykopnocd9zbqUakuaYDRH+JbA/+xGgkvSQzj5qNCZynX7BA6JbeWREVKeoI47QAF4OtZdZynWM9DcIHdU62qvA=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:41.249435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ea4dd0ec-a84b-4f95-a67c-6b6ee0eb0f7a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:28:41.255615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ea4dd0ec-a84b-4f95-a67c-6b6ee0eb0f7a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:28:41.277823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.290829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.292859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.294063 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db6edafc-938a-4f1c-a481-04822b0bb1de tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.271186 May 14 21:28:41.294977 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2149/4684] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:41 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:41.299897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:41.300546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:41.310244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.315160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.315160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.315160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.359349 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea4dd0ec-a84b-4f95-a67c-6b6ee0eb0f7a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130103 May 14 21:28:41.360015 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2536/4685] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:28:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:41.365395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d386a6ac-d209-43cf-afce-594522c860f3 req-cf0145a6-77d5-44c7-afcf-2905334a83ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-plugged", "status": "completed", "tag": "4663d148-3f78-4667-9e22-e6be0e34d3da"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:41.374149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d386a6ac-d209-43cf-afce-594522c860f3 req-cf0145a6-77d5-44c7-afcf-2905334a83ad service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.375008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d386a6ac-d209-43cf-afce-594522c860f3 req-cf0145a6-77d5-44c7-afcf-2905334a83ad service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.389603 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d386a6ac-d209-43cf-afce-594522c860f3 req-cf0145a6-77d5-44c7-afcf-2905334a83ad service nova] Creating event network-vif-plugged:4663d148-3f78-4667-9e22-e6be0e34d3da for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:41.395801 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d386a6ac-d209-43cf-afce-594522c860f3 req-cf0145a6-77d5-44c7-afcf-2905334a83ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034537 May 14 21:28:41.396422 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2537/4686] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:41.577482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.586024 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac70d2ab-dd50-4f27-8cff-4227bc8ab063 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1488 microversion: 2.1 time: 0.290038 May 14 21:28:41.586599 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2150/4687] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:41 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1488 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:41.605023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac62b541-3849-41b9-bf16-214cb48b272a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:41.606987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac62b541-3849-41b9-bf16-214cb48b272a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:41.614633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac62b541-3849-41b9-bf16-214cb48b272a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.615460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac62b541-3849-41b9-bf16-214cb48b272a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.616515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac62b541-3849-41b9-bf16-214cb48b272a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.617290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac62b541-3849-41b9-bf16-214cb48b272a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.716517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:41.717132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:41.732721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.733176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.733951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.734390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.750715 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac62b541-3849-41b9-bf16-214cb48b272a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "PUT /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1083 microversion: 2.1 time: 0.150409 May 14 21:28:41.751855 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2538/4688] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:28:41 2022] PUT /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1083 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:41.768974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:41.769618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:41.778164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.778966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.779588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.780040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.888779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.900629 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a62221b9-6d52-4689-9947-b8a161f2db1f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.185361 May 14 21:28:41.900629 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2151/4689] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:41 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:41.960010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:41.967904 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2ad5de47-97b1-46d9-b5e2-7698e135974c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1509 microversion: 2.1 time: 0.205509 May 14 21:28:41.968488 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2539/4690] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:41 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1509 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:41.984095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:41.984710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:41.991278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.991814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:41.992660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:41.993220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.146180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.153850 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad9e8a29-5d38-4220-b7aa-b174dab8ac7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1509 microversion: 2.1 time: 0.173535 May 14 21:28:42.154423 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2152/4691] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:41 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:42.170262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:42.170782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:42.177943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.178518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.179290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.179785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.206012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:28:42.250347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:42.250347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:42.254658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.255190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.256190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.256710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.462120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.472369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.473915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.475058 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58173947-399a-43b8-a662-c75db2aed16a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.232360 May 14 21:28:42.475644 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2153/4692] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:42 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:42.480475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:42.480701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:42.487123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.490493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.490493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.490493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.511252 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-813bbcc6-53ee-4252-9fd0-a82b02f41919 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 204 len: 0 microversion: 2.1 time: 0.344690 May 14 21:28:42.512129 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2540/4693] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:28:42 2022] DELETE /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:28:42.520750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:42.521462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:42.527532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.527999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.528833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.529282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.676585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.685636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.687571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.688874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ecc8a77-427f-4e69-a0fb-13a7ff4cd2a5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.212296 May 14 21:28:42.699753 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2154/4694] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:42 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:42.915668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:42.916297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:42.925863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.929691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.930825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:42.931537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:42.987428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:42.995919 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-21137b42-c04b-4c40-adca-d02849412c06 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1515 microversion: 2.1 time: 0.479240 May 14 21:28:42.996508 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2541/4695] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:42 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1515 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:43.083823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:43.091319 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c412e252-9670-4d1a-b146-ebddb232134b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.179837 May 14 21:28:43.099102 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2155/4696] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:42 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:43.493965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:43.494628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:43.501138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:43.501625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:43.502929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:43.503387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:43.696510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:43.707279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:43.708954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:43.709429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:43.709640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:43.710083 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-75243d03-8185-4983-9c8b-7dd907555ab0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1879 microversion: 2.32 time: 0.220276 May 14 21:28:43.710863 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2542/4697] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:43 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1879 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:43.715699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:43.716159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:43.716930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:43.717367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:43.870299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:43.883240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:43.885518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:43.886996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cba23ad4-ef1c-432d-8a4d-10eaf1f7efcf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.183200 May 14 21:28:43.887771 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2156/4698] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:43 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:43.893277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1642088308", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd341be-651f-4dc3-82bf-83f603d58628"}], "security_groups": [{"name": "tempest-securitygroup--2067453777"}], "key_name": "tempest-keypair-2061595565", "user_data": "}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:44.008405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] validate_networks() for [('afd341be-651f-4dc3-82bf-83f603d58628', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:28:44.014841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:44.015465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:44.030434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.032237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.032954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.033452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.265032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:44.273823 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ce579cac-0f9f-4e97-8324-ff1c8b4763e1 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1515 microversion: 2.1 time: 0.264031 May 14 21:28:44.274749 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2157/4699] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:44 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:44.282604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:44.283681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:44.292260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.292993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.293979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.297231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.435910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:28:44.436825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:28:44.437592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:28:44.438191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:28:44.438857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:28:44.452674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.453709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.454748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.455967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.494601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:28:44.504193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:28:44.519024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:44.522344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:28:44.524844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:28:44.526647 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f574b66-5855-4f6f-8f45-d4b69a833f8b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.250669 May 14 21:28:44.536290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2158/4700] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:44 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:44.691553 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97a3ab44-e777-482d-b60b-ab23cb6aaae4 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.804055 May 14 21:28:44.692228 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2543/4701] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:28:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:28:44.702175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4beb75c9-4e3a-4406-b87f-f9984c38b85f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:44.708402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4beb75c9-4e3a-4406-b87f-f9984c38b85f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:44.731499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:44.731499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:44.738046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.748243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.760727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.761459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.795777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4beb75c9-4e3a-4406-b87f-f9984c38b85f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:44.804662 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4beb75c9-4e3a-4406-b87f-f9984c38b85f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1242 microversion: 2.1 time: 0.106264 May 14 21:28:44.807669 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2159/4702] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:44 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1242 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:44.877668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-54b9ef1d-9a56-4b80-acc9-52235c2c339b req-f086c701-1e6f-4b15-a0cd-70c9685b7d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69fb9083-0ea0-4eeb-92ff-1a2f6c876317", "name": "network-vif-deleted", "tag": "842b646d-eb77-44e5-9fb8-12cb7dc078ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:44.885342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-54b9ef1d-9a56-4b80-acc9-52235c2c339b req-f086c701-1e6f-4b15-a0cd-70c9685b7d13 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.885880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-54b9ef1d-9a56-4b80-acc9-52235c2c339b req-f086c701-1e6f-4b15-a0cd-70c9685b7d13 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.909280 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-54b9ef1d-9a56-4b80-acc9-52235c2c339b req-f086c701-1e6f-4b15-a0cd-70c9685b7d13 service nova] Creating event network-vif-deleted:842b646d-eb77-44e5-9fb8-12cb7dc078ab for instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 on nch1-master-1 May 14 21:28:44.919342 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-54b9ef1d-9a56-4b80-acc9-52235c2c339b req-f086c701-1e6f-4b15-a0cd-70c9685b7d13 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041364 May 14 21:28:44.919342 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2160/4703] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:28:44.932505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:44.932505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:44.935736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.936199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:44.936998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:44.937570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.018785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.028427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.031725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.031999 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1582e2b0-219b-4e47-afde-c208568ab7cd tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2833 microversion: 2.32 time: 0.307272 May 14 21:28:45.032558 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2544/4704] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:44 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2833 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:45.053707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68ac6ca2-afa6-45c5-9d02-4215bd02ab5d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:45.054397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-68ac6ca2-afa6-45c5-9d02-4215bd02ab5d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:45.061073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68ac6ca2-afa6-45c5-9d02-4215bd02ab5d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:45.061963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68ac6ca2-afa6-45c5-9d02-4215bd02ab5d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.062754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68ac6ca2-afa6-45c5-9d02-4215bd02ab5d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:45.063458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68ac6ca2-afa6-45c5-9d02-4215bd02ab5d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.098514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.107627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.109169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.110435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c8eb871-fea3-4e49-952c-cb8473d4b23a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.193572 May 14 21:28:45.111125 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2161/4705] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:44 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:45.197588 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68ac6ca2-afa6-45c5-9d02-4215bd02ab5d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.150220 May 14 21:28:45.198192 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2545/4706] 10.222.0.52 () {60 vars in 1315 bytes} [Sat May 14 21:28:45 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e/os-interface => generated 1832 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:45.292602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:45.296606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:45.299862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:45.300326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.301316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:45.301756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.336670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:45.337130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.337604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lazy-loading 'fault' on Instance uuid 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:45.380153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.388624 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3305bee7-8660-407e-85a2-633e84e11011 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 200 len: 1319 microversion: 2.1 time: 0.100118 May 14 21:28:45.389970 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2162/4707] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:45 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 1319 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:45.544813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:45.546024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:45.553048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:45.553505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.554278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:45.554717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:45.795363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.804774 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d933e3e8-83a2-4a04-aa09-4e720c9f553c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.264940 May 14 21:28:45.805377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2546/4708] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:45 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:45.822739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb289ac8-f07d-4478-bf15-85c0dad83d0c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:45.823315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cb289ac8-f07d-4478-bf15-85c0dad83d0c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:45.889908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb289ac8-f07d-4478-bf15-85c0dad83d0c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:45.898253 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb289ac8-f07d-4478-bf15-85c0dad83d0c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1242 microversion: 2.1 time: 0.079751 May 14 21:28:45.898956 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2163/4709] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:45 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:46.100321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-269e59ee-063d-4c46-b3ab-94d3f5908748 req-e9a51705-c9e4-4d6b-8cf7-ed36d44ddadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ef508d-db13-4092-a0a8-0c0cfdde7687", "name": "network-vif-plugged", "status": "completed", "tag": "695d61db-6e17-4068-af47-59d37b70b7ca"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:46.109071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-269e59ee-063d-4c46-b3ab-94d3f5908748 req-e9a51705-c9e4-4d6b-8cf7-ed36d44ddadd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.109556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-269e59ee-063d-4c46-b3ab-94d3f5908748 req-e9a51705-c9e4-4d6b-8cf7-ed36d44ddadd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:46.122642 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-269e59ee-063d-4c46-b3ab-94d3f5908748 req-e9a51705-c9e4-4d6b-8cf7-ed36d44ddadd service nova] Creating event network-vif-plugged:695d61db-6e17-4068-af47-59d37b70b7ca for instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 on nch2-master-1 May 14 21:28:46.131316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-269e59ee-063d-4c46-b3ab-94d3f5908748 req-e9a51705-c9e4-4d6b-8cf7-ed36d44ddadd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035970 May 14 21:28:46.131594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:46.132413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:46.132588 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2547/4710] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:46.142191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.144341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:46.146114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.146741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:46.323536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:46.333099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:46.335190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:46.336955 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34aad2c3-fc37-4267-9252-15c36f35113a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.211814 May 14 21:28:46.338179 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2164/4711] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:46 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:46.416768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:46.417758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:46.424866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.425335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:46.426233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.426678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:46.440245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ae7fc29d-6ba4-4a05-864c-42d47d333eb6 req-0aa323e5-a34e-43b6-88ca-fb4be8d7150b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "tag": "a3973166-07b4-4aaf-95b2-bd95a9578877"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:46.443635 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 HTTP/1.1 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '69fb9083-0ea0-4eeb-92ff-1a2f6c876317'} May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:46.445823 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:46.452649 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:46.452649 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:46.452649 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:46.452649 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:46.452649 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:28:46.452649 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:46.455767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ae7fc29d-6ba4-4a05-864c-42d47d333eb6 req-0aa323e5-a34e-43b6-88ca-fb4be8d7150b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.455767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ae7fc29d-6ba4-4a05-864c-42d47d333eb6 req-0aa323e5-a34e-43b6-88ca-fb4be8d7150b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:46.456171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:46.456171 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70a96a33-b852-4a0e-b1db-f69a239f4f8c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 404 len: 111 microversion: 2.1 time: 0.043485 May 14 21:28:46.456781 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2548/4712] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:46 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:28:46.483217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ae7fc29d-6ba4-4a05-864c-42d47d333eb6 req-0aa323e5-a34e-43b6-88ca-fb4be8d7150b service nova] Creating event network-changed:a3973166-07b4-4aaf-95b2-bd95a9578877 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:28:46.489445 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ae7fc29d-6ba4-4a05-864c-42d47d333eb6 req-0aa323e5-a34e-43b6-88ca-fb4be8d7150b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058978 May 14 21:28:46.492608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2165/4713] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:28:46.514835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-159463139", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8da851bf-8623-41cd-8e7e-e11152a2fef0"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:46.595240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] validate_networks() for [('8da851bf-8623-41cd-8e7e-e11152a2fef0', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:28:46.822893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:46.823775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:46.831987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.832690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:46.833679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:46.834317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:47.063689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:47.072353 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87ca155b-9d7a-4d26-b7d1-0189a7e67969 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1324 microversion: 2.1 time: 0.254076 May 14 21:28:47.074202 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2166/4714] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:46 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1324 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:47.081309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:28:47.081789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:28:47.082340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:28:47.082701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:28:47.083126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:28:47.088678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:47.094494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:47.100068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:47.103004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:47.103004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:47.103004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:47.111579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:47.112086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:47.113107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:47.113593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:47.136125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:28:47.142496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Getting quotas for user b398969c37454956a73bf459e0d37e61 and project 91fceeecfb744810a52fd04cc03c72cf. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:28:47.159020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:28:47.161772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:28:47.234724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:47.242865 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b1ed9ae4-1d4c-4100-ae19-fc3439326369 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1294 microversion: 2.1 time: 0.167805 May 14 21:28:47.243746 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2167/4715] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:47 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1294 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:47.290674 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-158c2d2b-2df4-4432-b4cf-8128194432a2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780125 May 14 21:28:47.291406 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2549/4716] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:28:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:28:47.301570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dfc2e367-781d-4a05-826f-635360007a4a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:47.302444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dfc2e367-781d-4a05-826f-635360007a4a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:47.358059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:47.358668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:47.367730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:47.368471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:47.369259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:47.370064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:47.391858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dfc2e367-781d-4a05-826f-635360007a4a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:47.404011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dfc2e367-781d-4a05-826f-635360007a4a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1208 microversion: 2.1 time: 0.106126 May 14 21:28:47.424874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2168/4717] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:47 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:47.529094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:47.544971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:47.547125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:47.549366 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c3def01-2b25-47c0-8ef8-9cd0b4527ee3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1743 microversion: 2.20 time: 0.195851 May 14 21:28:47.550632 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2550/4718] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:47 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1743 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:48.090592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:48.091358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:48.098058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.098454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.099258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.099730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.266724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:48.267390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:48.278992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.279822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.280894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.281389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.333475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:48.355860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:48.363046 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d73289e0-acb4-47f8-8f7c-a44dbcbb12c2 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1521 microversion: 2.1 time: 0.271502 May 14 21:28:48.365105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2169/4719] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:48 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:48.372905 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6db5444-941b-4ec9-b05a-75598cdd61e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1300 microversion: 2.1 time: 0.111788 May 14 21:28:48.374878 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2551/4720] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:48 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:48.391432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:48.392229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:48.399083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.399577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.400606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.401057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.422328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:48.422963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:48.430428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.430895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.431883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.432344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.494898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:48.503411 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fdbb4d96-ae25-44e7-9062-fbc0e6f3f2a0 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1212 microversion: 2.1 time: 0.085072 May 14 21:28:48.504376 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2552/4721] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:48 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1212 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:48.573493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:48.574515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:48.581493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.582261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.583055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.583793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.601992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:48.609875 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4c9f9cd-07ff-4bf8-8536-ced52fc2593b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1521 microversion: 2.1 time: 0.223940 May 14 21:28:48.610460 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2170/4722] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:48 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:48.626054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a892caf-716a-4b4c-9019-9bdf8c76b903 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1015292458"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:48.628196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3a892caf-716a-4b4c-9019-9bdf8c76b903 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:48.634458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a892caf-716a-4b4c-9019-9bdf8c76b903 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.634928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a892caf-716a-4b4c-9019-9bdf8c76b903 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.641726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a892caf-716a-4b4c-9019-9bdf8c76b903 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:48.641726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a892caf-716a-4b4c-9019-9bdf8c76b903 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:48.809029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:48.818512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:48.827463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:48.828787 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fb8db00e-6dd0-4328-a7ba-9d56fb50aea6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1743 microversion: 2.20 time: 0.259652 May 14 21:28:48.829402 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2553/4723] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:48 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1743 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:49.255617 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a892caf-716a-4b4c-9019-9bdf8c76b903 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687/action" status: 202 len: 0 microversion: 2.1 time: 0.633254 May 14 21:28:49.256599 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2171/4724] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:28:48 2022] POST /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 14 21:28:49.267085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f88d3e12-1190-41cd-a5fb-4552761b6060 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '.version_select at 0x7fb1a78a4e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:49.395035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:49.395818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:49.406751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:49.407330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:49.409569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:49.417022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:49.594959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f88d3e12-1190-41cd-a5fb-4552761b6060 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a" status: 204 len: 0 microversion: 2.1 time: 0.332773 May 14 21:28:49.596232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2554/4725] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:49 2022] DELETE /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:28:49.602758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:49.603384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:49.614994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:49.615460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:49.622077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:49.622077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:49.689126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:49.711341 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd3391cb-138f-4af7-b8b2-c816eb4dea70 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1268 microversion: 2.1 time: 0.113134 May 14 21:28:49.712479 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2555/4726] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:49 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1268 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:49.717918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5ee83f7d-2050-4412-a9ff-2b5f6d25bd9d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '.version_select at 0x7fb1a781cee0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:49.746499 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5ee83f7d-2050-4412-a9ff-2b5f6d25bd9d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Image not found. May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5ee83f7d-2050-4412-a9ff-2b5f6d25bd9d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a HTTP/1.1 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1010acb3-884d-4eac-8507-a964ea165c0a'} May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1010acb3-884d-4eac-8507-a964ea165c0a May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 14 21:28:49.749833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1010acb3-884d-4eac-8507-a964ea165c0a could not be found. May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5ee83f7d-2050-4412-a9ff-2b5f6d25bd9d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5ee83f7d-2050-4412-a9ff-2b5f6d25bd9d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a" status: 404 len: 62 microversion: 2.1 time: 0.037979 May 14 21:28:49.756565 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2556/4727] 10.222.0.52 () {58 vars in 1232 bytes} [Sat May 14 21:28:49 2022] GET /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:28:49.766427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:49.767138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:49.775513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:49.775987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:49.776850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:49.777309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:50.013892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:50.035111 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-85b7a05a-73c9-4d56-9f76-393d41dab4bd tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1533 microversion: 2.1 time: 0.275747 May 14 21:28:50.037129 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2557/4728] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:49 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1533 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:50.045156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:50.051141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:50.057668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:50.066178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:50.067647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:50.068162 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6ce289f-b865-43c7-ac78-1ea9f1a0049a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.679029 May 14 21:28:50.070049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:50.072796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:50.074243 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2172/4729] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:49 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:50.277552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b4000d6d-e2a8-4741-a8dd-dd1c6d469a13 req-19793227-2789-4f71-8b1d-36aee5637e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4097156a-300a-4d17-87df-60620c836925", "name": "network-vif-plugged", "status": "completed", "tag": "5c660063-0f23-4b2d-b5ca-12d4f3ea2036"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:50.296010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4000d6d-e2a8-4741-a8dd-dd1c6d469a13 req-19793227-2789-4f71-8b1d-36aee5637e6b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:50.299738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4000d6d-e2a8-4741-a8dd-dd1c6d469a13 req-19793227-2789-4f71-8b1d-36aee5637e6b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:50.322817 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b4000d6d-e2a8-4741-a8dd-dd1c6d469a13 req-19793227-2789-4f71-8b1d-36aee5637e6b service nova] Creating event network-vif-plugged:5c660063-0f23-4b2d-b5ca-12d4f3ea2036 for instance 4097156a-300a-4d17-87df-60620c836925 on nch2-master-1 May 14 21:28:50.334377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:50.336000 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b4000d6d-e2a8-4741-a8dd-dd1c6d469a13 req-19793227-2789-4f71-8b1d-36aee5637e6b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061334 May 14 21:28:50.336871 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2173/4730] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:28:50.348810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:50.354633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:50.354633 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a42578ca-2742-47d5-b996-a828a0f2c189 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.314023 May 14 21:28:50.354633 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2558/4731] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:50 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:50.712501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cc53abb9-1e5e-4957-a22f-6e157b1e9e06 req-f8090808-86fe-4aca-bec6-339731e21438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb444169-fb87-45fa-a967-7df84f979a00", "tag": "1b49f503-95db-4b59-ab25-ac9c8795cafa"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:50.722134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cc53abb9-1e5e-4957-a22f-6e157b1e9e06 req-f8090808-86fe-4aca-bec6-339731e21438 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:50.725210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cc53abb9-1e5e-4957-a22f-6e157b1e9e06 req-f8090808-86fe-4aca-bec6-339731e21438 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:50.729874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:50.730429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:50.741495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:50.742368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:50.744285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:50.744424 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cc53abb9-1e5e-4957-a22f-6e157b1e9e06 req-f8090808-86fe-4aca-bec6-339731e21438 service nova] Creating event network-changed:1b49f503-95db-4b59-ab25-ac9c8795cafa for instance cb444169-fb87-45fa-a967-7df84f979a00 on nch2-master-1 May 14 21:28:50.755446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:50.756794 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cc53abb9-1e5e-4957-a22f-6e157b1e9e06 req-f8090808-86fe-4aca-bec6-339731e21438 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048396 May 14 21:28:50.759837 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2174/4732] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:50.835339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:50.843614 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-741d6c8f-36d0-4205-9411-d20611f365f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1266 microversion: 2.1 time: 0.117797 May 14 21:28:50.847204 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2559/4733] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:50 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:51.067076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:51.070328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:51.084324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.085860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:51.086766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.087296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:51.088232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:51.089117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:51.102029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.102029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:51.102029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.103153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:51.360095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:51.392050 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a7464c2a-7684-40ba-bdf8-3f5814b187bd tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.309359 May 14 21:28:51.398410 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2560/4734] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:51 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:51.405864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:51.407146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:51.408929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:51.422606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.423544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:51.425119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.425807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:51.430216 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-987dac60-4971-4277-a021-d684b7042a32 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1539 microversion: 2.1 time: 0.379594 May 14 21:28:51.431352 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2175/4735] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:51 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1539 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:51.654951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:51.669829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:51.672487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:51.676541 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa84d4a4-6f96-4f48-b21d-5aedf9517e35 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.273631 May 14 21:28:51.687523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2561/4736] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:51 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:51.868539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:51.869189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:51.877479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.878387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:51.879503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:51.880459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:52.251863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:52.267087 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-302a8842-240d-441b-9af6-c8509452ab52 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.402709 May 14 21:28:52.268405 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2176/4737] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:51 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:52.415725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:52.416393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:52.423944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:52.424414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:52.425197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:52.425636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:52.456934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:52.457573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:52.466192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:52.468721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:52.471037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:52.472498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:52.600253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:52.610170 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e2adb1aa-ddad-44d1-80fb-a406ea6e323c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.198944 May 14 21:28:52.610781 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2562/4738] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:52 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:52.696602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:52.697083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:52.709060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:52.709527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:52.710992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:52.711667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:52.712126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:52.724524 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a060d786-d996-44b6-8a03-5cb680a464fe tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1539 microversion: 2.1 time: 0.271429 May 14 21:28:52.726714 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2177/4739] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:52 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1539 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:52.992921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:53.002639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:53.005027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:53.008582 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0178b920-67aa-4e3b-a104-f6641e5bc894 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.318041 May 14 21:28:53.010585 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2563/4740] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:52 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:28:53.237929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f34ae408-4690-44ae-a406-39e9298eef3e req-808e0b29-4ef7-4162-b317-2b89becc1b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a53b5c2-e7e2-47ca-9535-d84670971640", "tag": "b9f9fedb-f9dd-40c1-884c-8431a6e41116"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:53.246659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f34ae408-4690-44ae-a406-39e9298eef3e req-808e0b29-4ef7-4162-b317-2b89becc1b9d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:53.247108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f34ae408-4690-44ae-a406-39e9298eef3e req-808e0b29-4ef7-4162-b317-2b89becc1b9d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:53.258863 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f34ae408-4690-44ae-a406-39e9298eef3e req-808e0b29-4ef7-4162-b317-2b89becc1b9d service nova] Creating event network-changed:b9f9fedb-f9dd-40c1-884c-8431a6e41116 for instance 4a53b5c2-e7e2-47ca-9535-d84670971640 on nch1-master-1 May 14 21:28:53.265600 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f34ae408-4690-44ae-a406-39e9298eef3e req-808e0b29-4ef7-4162-b317-2b89becc1b9d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031833 May 14 21:28:53.267056 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2178/4741] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:53.287307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:53.289327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:53.304124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:53.304536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:53.308856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:53.310073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:53.528048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:53.541500 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3885ca1a-27e8-4e8b-b383-d950de44c101 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.260875 May 14 21:28:53.542768 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2564/4742] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:53 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:53.631222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:53.633638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:53.646024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:53.647015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:53.649201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:53.649846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:53.742779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:53.743807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:53.750309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:53.755188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:53.755188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:53.755188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:53.992109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:54.003103 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f55c3619-a150-42b1-9535-267bc0425877 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1534 microversion: 2.1 time: 0.264076 May 14 21:28:54.004035 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2565/4743] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:53 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1534 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:54.031425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:54.032354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:54.040775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:54.041566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:54.042603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:54.043367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:54.070132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:54.078746 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-32bbe4dc-d387-469d-9290-53fca63ace85 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.454888 May 14 21:28:54.086583 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2179/4744] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:53 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:54.217378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:54.226601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:54.228336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:54.229658 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2f72797-4f8e-425f-986b-b84bd50c240d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.203879 May 14 21:28:54.236430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2566/4745] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:54 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:54.558872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:54.559455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:54.571729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:54.572163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:54.572947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:54.573423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:54.737860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:54.747990 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c877d60-e349-4312-9de1-a7b852d8f6f9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.193167 May 14 21:28:54.756885 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2180/4746] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:54 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:55.020668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:55.021428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:55.030529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.031364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.032393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.033120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.101029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:55.102041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:55.112935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.113619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.116756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.117378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.266892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:55.277216 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-455000d7-117a-416f-a25d-ce03bb10d870 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1521 microversion: 2.1 time: 0.260498 May 14 21:28:55.279732 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2567/4747] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:55 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:55.295864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:55.295864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:55.303639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.315152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.315152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.315152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.331870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:55.342139 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28306f26-608f-4187-bfb8-936b4bce96e1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.244957 May 14 21:28:55.355471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2181/4748] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:55 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:55.359810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:55.360394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:55.367194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.367728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.368886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.369148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.398886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:28:55.460995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:55.473260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:55.475941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:55.485412 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7fb6a46f-15fe-4636-a128-e88fa7114537 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.204472 May 14 21:28:55.486859 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2568/4749] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:55 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:55.777984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:55.778820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:55.786894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.787704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.788673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:55.789131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:55.980364 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b30d59a4-bbdc-4dc9-89fd-c1a9c586196e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 204 len: 0 microversion: 2.1 time: 0.626364 May 14 21:28:55.982447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2182/4750] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:28:55 2022] DELETE /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:28:55.997729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:55.998526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:56.014600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:56.015358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:56.016435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:56.017953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:56.046135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:56.062486 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4f446e1a-5fcf-49ac-86a6-584005018ad3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.288911 May 14 21:28:56.065262 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2569/4751] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:55 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:56.256654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:56.281586 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-579a46e7-3357-4a14-ae93-58b6f491041c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1527 microversion: 2.1 time: 0.295719 May 14 21:28:56.283216 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2183/4752] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:55 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1527 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:28:56.360525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:56.361959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:56.374091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:56.374925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:56.376285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:56.377743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:56.394922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-bba162fc-f107-4889-aebd-709ded017ddc req-5c867442-54d2-49e8-8a75-4e9ae614c275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ef508d-db13-4092-a0a8-0c0cfdde7687", "name": "network-vif-plugged", "status": "completed", "tag": "695d61db-6e17-4068-af47-59d37b70b7ca"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:56.413207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-bba162fc-f107-4889-aebd-709ded017ddc req-5c867442-54d2-49e8-8a75-4e9ae614c275 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:56.414309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-bba162fc-f107-4889-aebd-709ded017ddc req-5c867442-54d2-49e8-8a75-4e9ae614c275 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:56.446478 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-bba162fc-f107-4889-aebd-709ded017ddc req-5c867442-54d2-49e8-8a75-4e9ae614c275 service nova] Creating event network-vif-plugged:695d61db-6e17-4068-af47-59d37b70b7ca for instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 on nch2-master-1 May 14 21:28:56.460173 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-bba162fc-f107-4889-aebd-709ded017ddc req-5c867442-54d2-49e8-8a75-4e9ae614c275 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070206 May 14 21:28:56.474291 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2184/4753] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:56.513927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:56.522939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:56.542912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:56.543790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:56.546116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:56.551673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:56.597975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:56.624132 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2bba95a-a5ee-4370-b6da-d7303eb15c3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.265664 May 14 21:28:56.627430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2570/4754] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:56 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:56.788548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:56.800448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:56.802594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:56.805369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-13e14dd7-7f8e-491d-bfe6-fefed8dea499 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.302497 May 14 21:28:56.806901 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2185/4755] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:56 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:57.083868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:57.084492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:57.095896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.096664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:57.097825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.098451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:57.275912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:57.285192 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b4c4d074-df0e-4c27-b249-cb0b72837ce7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.204978 May 14 21:28:57.286052 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2571/4756] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:57 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:57.302041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:57.302915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:57.310857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.315956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:57.315956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.315956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:57.485356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:57.499020 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-040f3829-0f88-49fe-a03d-5624464b3af3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1527 microversion: 2.1 time: 0.202053 May 14 21:28:57.499648 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2186/4757] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:57 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1527 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:57.642526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:57.643626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:57.652291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.653002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:57.654169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.654759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:57.802126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:57.810300 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-55a7704a-89d6-4c67-91b9-b6346b7289a7 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.172739 May 14 21:28:57.811000 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2572/4758] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:57 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:57.826509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:57.827151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:57.835276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.835831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:57.836631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:57.837081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.200032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-845cbec4-1d82-40c7-a348-2a411e8af4d6 req-627b9bcc-6737-44dc-a3d1-edfcc8f77886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ef508d-db13-4092-a0a8-0c0cfdde7687", "name": "network-vif-deleted", "tag": "695d61db-6e17-4068-af47-59d37b70b7ca"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:58.215418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:58.223437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-845cbec4-1d82-40c7-a348-2a411e8af4d6 req-627b9bcc-6737-44dc-a3d1-edfcc8f77886 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.223967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-845cbec4-1d82-40c7-a348-2a411e8af4d6 req-627b9bcc-6737-44dc-a3d1-edfcc8f77886 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.232239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:58.233936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:58.235179 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3f2c34ea-c989-4fa9-aac1-47381c1b4cb2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.413559 May 14 21:28:58.239327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2187/4759] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:57 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:58.250680 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-845cbec4-1d82-40c7-a348-2a411e8af4d6 req-627b9bcc-6737-44dc-a3d1-edfcc8f77886 service nova] Creating event network-vif-deleted:695d61db-6e17-4068-af47-59d37b70b7ca for instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 on nch2-master-1 May 14 21:28:58.258407 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-845cbec4-1d82-40c7-a348-2a411e8af4d6 req-627b9bcc-6737-44dc-a3d1-edfcc8f77886 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069976 May 14 21:28:58.259942 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2573/4760] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:28:58.303084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:58.304478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:58.311811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.312422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.313468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.314723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.512441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-08ad5b45-6ef3-4ea3-bc19-d1001d1d0848 req-6ad8b735-4a73-4a23-a587-afc3a03c4250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb444169-fb87-45fa-a967-7df84f979a00", "name": "network-vif-plugged", "status": "completed", "tag": "1b49f503-95db-4b59-ab25-ac9c8795cafa"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:28:58.522106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:58.524848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-08ad5b45-6ef3-4ea3-bc19-d1001d1d0848 req-6ad8b735-4a73-4a23-a587-afc3a03c4250 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.531838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-08ad5b45-6ef3-4ea3-bc19-d1001d1d0848 req-6ad8b735-4a73-4a23-a587-afc3a03c4250 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.532140 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-95e79740-8af5-4cee-9057-56d934f0e208 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.232220 May 14 21:28:58.538952 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-08ad5b45-6ef3-4ea3-bc19-d1001d1d0848 req-6ad8b735-4a73-4a23-a587-afc3a03c4250 service nova] Creating event network-vif-plugged:1b49f503-95db-4b59-ab25-ac9c8795cafa for instance cb444169-fb87-45fa-a967-7df84f979a00 on nch2-master-1 May 14 21:28:58.542293 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2188/4761] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:58 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:58.544757 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-08ad5b45-6ef3-4ea3-bc19-d1001d1d0848 req-6ad8b735-4a73-4a23-a587-afc3a03c4250 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 May 14 21:28:58.546055 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2574/4762] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:28:58.548204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:58.549088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:58.563005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.563005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.563005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.563005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.634460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:58.643952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-834775b7-509d-4149-89bf-934ebbf99b86 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1309 microversion: 2.1 time: 0.099686 May 14 21:28:58.645672 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2189/4763] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:58 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:58.833719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:58.834358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:58.844119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.844902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:58.846501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:58.847262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.008836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:59.018755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a055897e-b240-45e3-a3af-de91f26edf08 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.190902 May 14 21:28:59.019718 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2575/4764] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:58 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:59.253880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:59.255008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:59.266896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:59.268501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.270845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:59.271304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.438154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:59.452772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:59.454387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:59.456461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0df15d9d-326e-4c64-81c9-aac7798bd63c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.207238 May 14 21:28:59.467513 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2190/4765] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:28:59 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:28:59.549845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:59.550614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:59.573938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:59.573938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.573938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:59.573938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.665382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:28:59.666282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:28:59.681552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:59.682698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.683564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:59.684175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.739597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:28:59.740344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:28:59.744075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lazy-loading 'fault' on Instance uuid 81ef508d-db13-4092-a0a8-0c0cfdde7687 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:28:59.814364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:59.821952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:28:59.849063 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ecd53b73-6295-45b0-900d-5670a184a468 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.299967 May 14 21:28:59.850172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-220f8896-a241-4b87-b3f3-947ee26547a3 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 200 len: 1314 microversion: 2.1 time: 0.192210 May 14 21:28:59.861579 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2576/4766] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:59 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:28:59.864654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2191/4767] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:28:59 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:00.036868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:00.037497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:00.046797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.047260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.048141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.049183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.212546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:00.221312 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4281f81c-f470-4771-b5ec-6dcaa5f8295f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1368 microversion: 2.1 time: 0.189058 May 14 21:29:00.231297 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2577/4768] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:00 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:00.475820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:00.476375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:00.490350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.491082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.494336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.495646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.656810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:00.669719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:00.671649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:00.673070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-77d4aa24-0fa6-431c-b5cd-bca624c0c54e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.201759 May 14 21:29:00.674404 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2192/4769] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:00 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:00.713401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-419c62d9-17af-480e-ae4f-12a9d3411380 req-222fb3f2-cb91-4ff1-a1aa-b3884a8db901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a53b5c2-e7e2-47ca-9535-d84670971640", "name": "network-vif-plugged", "status": "completed", "tag": "b9f9fedb-f9dd-40c1-884c-8431a6e41116"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:00.723991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-419c62d9-17af-480e-ae4f-12a9d3411380 req-222fb3f2-cb91-4ff1-a1aa-b3884a8db901 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.724729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-419c62d9-17af-480e-ae4f-12a9d3411380 req-222fb3f2-cb91-4ff1-a1aa-b3884a8db901 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.744442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbf07af2-8d6b-4366-affd-c3b0eec54831 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:00.744877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fbf07af2-8d6b-4366-affd-c3b0eec54831 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:00.748329 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-419c62d9-17af-480e-ae4f-12a9d3411380 req-222fb3f2-cb91-4ff1-a1aa-b3884a8db901 service nova] Creating event network-vif-plugged:b9f9fedb-f9dd-40c1-884c-8431a6e41116 for instance 4a53b5c2-e7e2-47ca-9535-d84670971640 on nch1-master-1 May 14 21:29:00.755087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-419c62d9-17af-480e-ae4f-12a9d3411380 req-222fb3f2-cb91-4ff1-a1aa-b3884a8db901 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047876 May 14 21:29:00.755975 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2578/4770] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:29:00.762486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf07af2-8d6b-4366-affd-c3b0eec54831 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.763041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf07af2-8d6b-4366-affd-c3b0eec54831 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.764254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf07af2-8d6b-4366-affd-c3b0eec54831 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.765542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf07af2-8d6b-4366-affd-c3b0eec54831 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.791844 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbf07af2-8d6b-4366-affd-c3b0eec54831 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/ips" status: 200 len: 143 microversion: 2.1 time: 0.051596 May 14 21:29:00.792734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2193/4771] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:29:00 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/ips => generated 143 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:00.879561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:00.880295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:00.880438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:00.881439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:00.895814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.896930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.897949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.903209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.904697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.907270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.910857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:00.911574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:00.952862 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 HTTP/1.1 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '81ef508d-db13-4092-a0a8-0c0cfdde7687'} May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:00.961741 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:00.967256 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:00.971203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:00.972570 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-671cedd5-5b50-446b-b8fa-1621db52a838 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 404 len: 111 microversion: 2.1 time: 0.103683 May 14 21:29:00.976187 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2579/4772] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:00 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:01.161554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:01.168030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-75938418", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:01.171121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-878a1c61-afed-4ee2-b73e-1ec14e4b8e28 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.297763 May 14 21:29:01.171837 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2194/4773] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:00 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:01.227253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] validate_networks() for [('23acb6aa-5f12-463d-b4bb-6884cb9f6bec', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:29:01.239010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:01.239670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:01.245911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.246296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.247064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.247611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.385974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:01.394709 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b1a95a0-8ab1-4fb6-93cb-28dbb252da61 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1558 microversion: 2.1 time: 0.160217 May 14 21:29:01.395315 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2195/4774] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:01 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:01.412228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-74ca6d0f-1868-49e7-a68d-db70a7535125 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:01.412766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-74ca6d0f-1868-49e7-a68d-db70a7535125 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:01.419256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74ca6d0f-1868-49e7-a68d-db70a7535125 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.420222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74ca6d0f-1868-49e7-a68d-db70a7535125 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.421021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74ca6d0f-1868-49e7-a68d-db70a7535125 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.421471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74ca6d0f-1868-49e7-a68d-db70a7535125 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.500424 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-74ca6d0f-1868-49e7-a68d-db70a7535125 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092520 May 14 21:29:01.502097 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2196/4775] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:29:01 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:01.693281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:01.694187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:01.700529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.701269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.702063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.702509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.737418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:29:01.737875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:29:01.738381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:29:01.738812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:29:01.739229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:29:01.756423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.756423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.756423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:01.756423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:01.788805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:29:01.797088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Getting quotas for user 1d73e16649b845319b5184937056b233 and project bbb13e5ea4a949d18e6c5c4bf679fde2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:29:01.812200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:29:01.815379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:29:01.984089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:01.995410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:01.997304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:01.998282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-257be5fa-f72d-444d-9d81-8cf95d03bc54 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.309805 May 14 21:29:01.998865 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2197/4776] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:01 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:02.028113 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ebb98006-018f-4cba-8f01-350eb75a52ea tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.864445 May 14 21:29:02.029370 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2580/4777] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:29:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:29:02.040125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-13296666-6336-4cfb-82ff-49c53578efc5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:02.042953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-13296666-6336-4cfb-82ff-49c53578efc5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:02.185586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-13296666-6336-4cfb-82ff-49c53578efc5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:02.195587 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-13296666-6336-4cfb-82ff-49c53578efc5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1223 microversion: 2.1 time: 0.159429 May 14 21:29:02.199165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:02.200461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:02.213309 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2198/4778] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:02 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1223 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:02.235906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:02.238245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:02.243609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:02.245664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:02.478086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:02.486561 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c10849e1-62bb-4fd1-9f92-0d2060450e4d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1308 microversion: 2.1 time: 0.294256 May 14 21:29:02.491838 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2581/4779] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:02 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:03.033100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:03.043675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:03.051779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.052245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.053057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.053508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.214269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-12081f45-6d81-49ee-b9ae-ff9191ec70a5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:03.214987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-12081f45-6d81-49ee-b9ae-ff9191ec70a5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:03.251183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:03.260655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:03.262522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:03.275280 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-608eb891-cd28-4524-9365-3183f6073513 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1738 microversion: 2.20 time: 0.249470 May 14 21:29:03.275280 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2199/4780] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:03 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:03.300582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-12081f45-6d81-49ee-b9ae-ff9191ec70a5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:03.303588 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-12081f45-6d81-49ee-b9ae-ff9191ec70a5 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1223 microversion: 2.1 time: 0.093366 May 14 21:29:03.304383 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2582/4781] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:03 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:03.423972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c867494d-080f-42ab-b822-3e183be5a409 req-8cdc626d-f7d1-4fe9-8a12-70c7ed8c9263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb444169-fb87-45fa-a967-7df84f979a00", "tag": "1b49f503-95db-4b59-ab25-ac9c8795cafa"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:03.438153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c867494d-080f-42ab-b822-3e183be5a409 req-8cdc626d-f7d1-4fe9-8a12-70c7ed8c9263 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.438724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c867494d-080f-42ab-b822-3e183be5a409 req-8cdc626d-f7d1-4fe9-8a12-70c7ed8c9263 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.452158 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c867494d-080f-42ab-b822-3e183be5a409 req-8cdc626d-f7d1-4fe9-8a12-70c7ed8c9263 service nova] Creating event network-changed:1b49f503-95db-4b59-ab25-ac9c8795cafa for instance cb444169-fb87-45fa-a967-7df84f979a00 on nch2-master-1 May 14 21:29:03.457295 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c867494d-080f-42ab-b822-3e183be5a409 req-8cdc626d-f7d1-4fe9-8a12-70c7ed8c9263 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038626 May 14 21:29:03.457912 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2200/4782] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:03.503947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:03.504860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:03.511650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.512117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.512907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.513378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.716242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:03.725823 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-90db9919-b3c9-4fec-953f-2ff33a72bb71 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1488 microversion: 2.1 time: 0.225664 May 14 21:29:03.727077 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2583/4783] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:03 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1488 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:03.750401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9ada06e-09dc-4e48-aa8f-9a5d34cb59ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-119141610"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:03.752572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9ada06e-09dc-4e48-aa8f-9a5d34cb59ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:03.761401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9ada06e-09dc-4e48-aa8f-9a5d34cb59ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.768624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9ada06e-09dc-4e48-aa8f-9a5d34cb59ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.768624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9ada06e-09dc-4e48-aa8f-9a5d34cb59ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.768624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9ada06e-09dc-4e48-aa8f-9a5d34cb59ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.949720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9ada06e-09dc-4e48-aa8f-9a5d34cb59ed tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "PUT /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1073 microversion: 2.1 time: 0.204332 May 14 21:29:03.960216 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2201/4784] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:29:03 2022] PUT /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1073 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:03.966438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:03.967091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:03.974740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.977675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:03.980106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:03.980581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.158371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:04.168397 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b79d52d-e72d-4ce7-9a14-962995979731 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1499 microversion: 2.1 time: 0.205890 May 14 21:29:04.181979 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2584/4785] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:03 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1499 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:04.199027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:04.199735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:04.209534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.210720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.211956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.212769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.282328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:04.284473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:04.291806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.292636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.293534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.294074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.408324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:04.417690 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9dc1a5b3-9426-4005-b7a4-64525b87cec3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1499 microversion: 2.1 time: 0.224175 May 14 21:29:04.420516 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2202/4786] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:04 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1499 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:04.431764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:04.432511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:04.439313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.439914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.441010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.441456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.458361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:04.471552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:04.473403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:04.476828 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ef0fc28-2762-4334-8c43-b381b8e53be2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1720 microversion: 2.20 time: 0.197002 May 14 21:29:04.478234 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2585/4787] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:04 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1720 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:04.484012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e6075315-b1b2-4037-b0a6-5d2b3b25d845 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:04.493472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6075315-b1b2-4037-b0a6-5d2b3b25d845 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.502587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e6075315-b1b2-4037-b0a6-5d2b3b25d845 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.540176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e6075315-b1b2-4037-b0a6-5d2b3b25d845 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Going to try to stop instance {{(pid=130638) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:29:04.591436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:04.603461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-77fa54ea-29f7-4516-9e28-06768cec9edb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1275 microversion: 2.1 time: 0.183453 May 14 21:29:04.604080 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2203/4788] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:04 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:04.782739 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e6075315-b1b2-4037-b0a6-5d2b3b25d845 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "POST /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640/action" status: 202 len: 0 microversion: 2.1 time: 0.302879 May 14 21:29:04.784885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2586/4789] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:29:04 2022] POST /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:29:04.800686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:04.803940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:04.822724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.823617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:04.826348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:04.827796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:05.192535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:05.200487 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8588dba0-5b9c-4820-a192-07b554ced04f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.406455 May 14 21:29:05.205743 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2204/4790] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:04 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:05.282212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f0b1e0b4-c472-4192-9f11-22f5d472e774 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe4b9b45-3bd4-47a6-bd85-901d2fa90799"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:05.284299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f0b1e0b4-c472-4192-9f11-22f5d472e774 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:05.291114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0b1e0b4-c472-4192-9f11-22f5d472e774 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:05.291621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0b1e0b4-c472-4192-9f11-22f5d472e774 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:05.292397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0b1e0b4-c472-4192-9f11-22f5d472e774 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:05.292833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0b1e0b4-c472-4192-9f11-22f5d472e774 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:05.496146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:05.496683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:05.503914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:05.508815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:05.508815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:05.508815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:05.728029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:05.737943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:05.739608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:05.740859 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0c8ccab-e719-4653-b130-3eb1599a10e4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1720 microversion: 2.20 time: 0.248791 May 14 21:29:05.741489 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2205/4791] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:05 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1720 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:05.758112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:05.759077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:05.766130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:05.766614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:05.768015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:05.768471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:05.832856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:05.840612 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4fdf05e3-9a73-4111-b8b4-498eb3a0b27d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1281 microversion: 2.1 time: 0.086598 May 14 21:29:05.841190 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2206/4792] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:05 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:06.057236 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f0b1e0b4-c472-4192-9f11-22f5d472e774 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779417 May 14 21:29:06.057827 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2587/4793] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:29:05 2022] POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:06.218245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:06.218873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:06.225757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:06.226224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:06.227011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:06.227459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:06.364502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:06.373121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-33587e2b-74aa-46a2-b8ce-db4b3e1dc383 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.158699 May 14 21:29:06.373708 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2207/4794] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:06 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:06.765166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:06.767737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:06.780117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:06.781065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:06.782896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:06.784248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:06.858061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:06.858620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:06.872944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:06.873458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:06.874258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:06.874712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:07.023749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:07.041180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:07.042737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:07.043978 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9af8392d-c168-4ed2-9201-465637f9b454 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1720 microversion: 2.20 time: 0.287767 May 14 21:29:07.046282 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2588/4795] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:06 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1720 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:07.211200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:07.222437 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ddfe8fd-1cb0-4dd9-9597-b70aeca3b577 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.368717 May 14 21:29:07.224606 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2208/4796] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:06 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:07.390429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:07.391148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:07.401337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:07.401826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:07.402646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:07.403309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:07.530066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fa258207-6736-4667-a2f6-1b6c96370cc3 req-b2fbdc4b-d631-47f4-9136-f565989c5ddd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e9a665a-c55d-44d7-9bd1-b182eec3a594", "tag": "494c8c7a-1ac3-474f-b92a-ac3b0c597848"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:07.542635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fa258207-6736-4667-a2f6-1b6c96370cc3 req-b2fbdc4b-d631-47f4-9136-f565989c5ddd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:07.543176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fa258207-6736-4667-a2f6-1b6c96370cc3 req-b2fbdc4b-d631-47f4-9136-f565989c5ddd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:07.559129 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fa258207-6736-4667-a2f6-1b6c96370cc3 req-b2fbdc4b-d631-47f4-9136-f565989c5ddd service nova] Creating event network-changed:494c8c7a-1ac3-474f-b92a-ac3b0c597848 for instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 on nch2-master-1 May 14 21:29:07.560343 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fa258207-6736-4667-a2f6-1b6c96370cc3 req-b2fbdc4b-d631-47f4-9136-f565989c5ddd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045956 May 14 21:29:07.560962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2209/4797] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:29:07.572444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:07.585604 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9526e6e3-62af-4974-b34f-e51d80003225 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.196786 May 14 21:29:07.585604 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2589/4798] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:07 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:08.067039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:08.068141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:08.075307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.076106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.077417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.078183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.218228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-25482881-e83c-4b6d-b22c-502fbbd4c10b req-f8743373-341c-4a88-81d5-1b9702f462a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4097156a-300a-4d17-87df-60620c836925", "name": "network-vif-unplugged", "status": "completed", "tag": "5c660063-0f23-4b2d-b5ca-12d4f3ea2036"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:08.231842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-25482881-e83c-4b6d-b22c-502fbbd4c10b req-f8743373-341c-4a88-81d5-1b9702f462a3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.232872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-25482881-e83c-4b6d-b22c-502fbbd4c10b req-f8743373-341c-4a88-81d5-1b9702f462a3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.247705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.server_external_events [req-25482881-e83c-4b6d-b22c-502fbbd4c10b req-f8743373-341c-4a88-81d5-1b9702f462a3 service nova] Unable to find a host for instance 4097156a-300a-4d17-87df-60620c836925. Dropping event network-vif-unplugged {{(pid=130638) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 14 21:29:08.249073 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-25482881-e83c-4b6d-b22c-502fbbd4c10b req-f8743373-341c-4a88-81d5-1b9702f462a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039251 May 14 21:29:08.249939 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2590/4799] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 14 21:29:08.256688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:08.257309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:08.264337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.265175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.266355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.267046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.376000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:08.387379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:08.390129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:08.392196 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1541c6be-5b74-421d-a9df-000431016694 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1663 microversion: 2.20 time: 0.332582 May 14 21:29:08.405752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2210/4800] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:08 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1663 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:08.411500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f47167e4-a5da-48da-b622-2c4b73785c05 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d520492e-c3a1-42a9-a065-6b741defc4c0"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:08.413194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f47167e4-a5da-48da-b622-2c4b73785c05 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:08.424322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f47167e4-a5da-48da-b622-2c4b73785c05 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.424322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f47167e4-a5da-48da-b622-2c4b73785c05 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.424322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f47167e4-a5da-48da-b622-2c4b73785c05 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.424322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f47167e4-a5da-48da-b622-2c4b73785c05 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.484390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:08.492518 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3bf1af5b-e022-4187-9fe6-72a0bd040b3d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.240409 May 14 21:29:08.496558 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2591/4801] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:08 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:08.600656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:08.601277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:08.607622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.608126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.608908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:08.609348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:08.760131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:08.773292 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53376a0a-ed3f-4c7e-b732-459ef1924e14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.176619 May 14 21:29:08.773895 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2592/4802] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:08 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:09.464703 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f47167e4-a5da-48da-b622-2c4b73785c05 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.057350 May 14 21:29:09.470600 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2211/4803] 10.222.0.52 () {62 vars in 1363 bytes} [Sat May 14 21:29:08 2022] POST /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments => generated 188 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:29:09.513937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:09.514858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:09.522324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:09.522887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:09.523799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:09.524317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:09.647696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46814633-9529-4ad1-9d1a-fe6dcedd2040 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:09.656818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46814633-9529-4ad1-9d1a-fe6dcedd2040 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:09.658203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46814633-9529-4ad1-9d1a-fe6dcedd2040 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:09.686879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:09.699098 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-390bdc0e-6a6d-4aa5-8df7-63fda50a1884 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.189278 May 14 21:29:09.700569 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2593/4804] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:09 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:09.702747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-46814633-9529-4ad1-9d1a-fe6dcedd2040 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Going to try to stop instance {{(pid=130637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:29:09.708573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b5c326b8-6d43-4a76-bc80-8413d46498c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:09.709442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b5c326b8-6d43-4a76-bc80-8413d46498c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:09.724549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c326b8-6d43-4a76-bc80-8413d46498c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:09.725463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c326b8-6d43-4a76-bc80-8413d46498c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:09.726617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c326b8-6d43-4a76-bc80-8413d46498c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:09.727134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b5c326b8-6d43-4a76-bc80-8413d46498c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:09.901978 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46814633-9529-4ad1-9d1a-fe6dcedd2040 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action" status: 202 len: 0 microversion: 2.1 time: 0.257999 May 14 21:29:09.902902 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2212/4805] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:29:09 2022] POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:29:09.909120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:09.909846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:09.916415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:09.916880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:09.921350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:09.921350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:10.016312 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b5c326b8-6d43-4a76-bc80-8413d46498c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/action" status: 202 len: 0 microversion: 2.20 time: 0.314305 May 14 21:29:10.017518 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2594/4806] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:29:09 2022] POST /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:29:10.022906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:10.023794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:10.029959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:10.030637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:10.031445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:10.031916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:10.075551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:10.085660 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-378c5ff8-82e8-4414-9282-e0f3f2622c04 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.181181 May 14 21:29:10.087918 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2213/4807] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:09 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:10.095982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:10.097004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:10.104155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:10.104891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:10.106133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:10.106679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:10.185280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:10.195234 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-49f29f86-53c5-4315-abd1-8128bc406e1a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.176409 May 14 21:29:10.196080 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2595/4808] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:10 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:10.254419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:10.263111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:10.264959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:10.266149 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc01ba8f-6363-4dfb-b676-f1dfbfbb21b7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1749 microversion: 2.20 time: 0.176972 May 14 21:29:10.267407 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2214/4809] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:10 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1749 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:10.726804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:10.726804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:10.731090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:10.731585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:10.732390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:10.732828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:10.877753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:10.886488 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-251dc8ce-6f17-44dd-a791-92277bf836ed tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.167900 May 14 21:29:10.887083 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2596/4810] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:10 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:11.105828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:11.106542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:11.114204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.114669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:11.115468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.116033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:11.215052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:11.216201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:11.232542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.233004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:11.234284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.234741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:11.383765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:11.395041 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6dfdb5e9-cf91-4b54-aba7-4a1b49441baf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.184577 May 14 21:29:11.395796 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2597/4811] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:11 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:11.408798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:11.409710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:11.416376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.417923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:11.417923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.418204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:11.562727 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:11.572353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:11.573966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:11.575175 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b93de593-89a7-4988-bf8f-39299e6cd841 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1749 microversion: 2.20 time: 0.171175 May 14 21:29:11.575980 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2598/4812] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:11 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1749 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:11.582415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:11.591819 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffae27f9-34aa-4cec-9f57-f944221bea91 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.489895 May 14 21:29:11.594211 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2215/4813] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:11 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:11.904003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:11.904630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:11.912277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.912741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:11.913523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:11.913975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:12.047593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:12.056084 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43ce6c35-b4b1-493f-abfb-307adae21873 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.156072 May 14 21:29:12.057350 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2599/4814] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:11 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:12.414023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:12.415248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:12.423128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:12.423839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:12.428117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:12.428117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:12.563595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:12.571949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f9ffa93-4e2b-4f1f-8ab9-1d9870161b90 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.162485 May 14 21:29:12.572536 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2216/4815] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:12 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:12.594151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:12.595325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:12.606691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:12.606691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:12.606691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:12.606691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:12.611160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:12.612389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:12.618426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:12.618885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:12.620211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:12.620211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:12.772692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:12.781195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:12.781775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:12.784645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:12.790024 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-57dbf817-e47f-4c92-8069-4438c215f63e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1751 microversion: 2.20 time: 0.195859 May 14 21:29:12.790024 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2600/4816] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:12 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:12.791907 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f207b04-a896-4536-8074-dbd60fcad75e tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.185637 May 14 21:29:12.792800 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2217/4817] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:12 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:13.072918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:13.073543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:13.081133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.081586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.082384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.082825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.223894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:13.231588 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4780c060-6333-42d0-a618-0a30a5550f8e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.162519 May 14 21:29:13.232178 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2601/4818] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:13 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:13.589021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:13.589679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:13.597280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.597746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.598535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.599044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.729001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:13.737177 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-edc60f2a-86ea-46c6-abe9-1aa9e08a7eea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.152146 May 14 21:29:13.737755 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2218/4819] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:13 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:13.804010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:13.804630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:13.808761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:13.809387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:13.810938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.811397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.812265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.812704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.815676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.816140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.816978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:13.817408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:13.968851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:13.978884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:13.980601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:13.983066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3148b637-136f-4a36-835d-3e621dab29e9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.183235 May 14 21:29:13.984059 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2602/4820] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:13 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:14.027953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:14.035515 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff8f9f3d-3804-4261-ab86-11e2b6d1a4e7 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.230644 May 14 21:29:14.036177 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2219/4821] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:13 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:14.248721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:14.249372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:14.256797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:14.265355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:14.265355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:14.265355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:14.398541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:14.408228 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-651e0b61-9b35-40ca-83ee-135a972d0755 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.163349 May 14 21:29:14.410809 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2603/4822] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:14 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:14.491219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-79a01b0d-5129-4696-803b-b8866644afe4 req-a67bd000-290e-43a2-8313-04e438a054a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9a665a-c55d-44d7-9bd1-b182eec3a594", "name": "network-vif-plugged", "status": "completed", "tag": "494c8c7a-1ac3-474f-b92a-ac3b0c597848"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:14.500167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-79a01b0d-5129-4696-803b-b8866644afe4 req-a67bd000-290e-43a2-8313-04e438a054a3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:14.500626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-79a01b0d-5129-4696-803b-b8866644afe4 req-a67bd000-290e-43a2-8313-04e438a054a3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:14.512306 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-79a01b0d-5129-4696-803b-b8866644afe4 req-a67bd000-290e-43a2-8313-04e438a054a3 service nova] Creating event network-vif-plugged:494c8c7a-1ac3-474f-b92a-ac3b0c597848 for instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 on nch2-master-1 May 14 21:29:14.519074 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-79a01b0d-5129-4696-803b-b8866644afe4 req-a67bd000-290e-43a2-8313-04e438a054a3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031396 May 14 21:29:14.519826 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2220/4823] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:14.756365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:14.757124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:14.763660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:14.764218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:14.765430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:14.765943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:14.900585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:14.910117 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d33a1d2-9ea9-48a3-9d5b-be0c7ce009ac tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.157722 May 14 21:29:14.914920 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2604/4824] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:14 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:15.002773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:15.003609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:15.009816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.010269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:15.011040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.011496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:15.053585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:15.054276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:15.060297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.060753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:15.061528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.061972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:15.194019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:15.203600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:15.206506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:15.208263 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb9b698d-a167-430d-ad8a-d4ac0fd4c186 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.210631 May 14 21:29:15.226292 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2221/4825] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:14 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:15.242124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:15.251673 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3d687eb-b372-4260-98c0-de22de7e418d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.201795 May 14 21:29:15.262637 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2605/4826] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:15 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:15.425729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:15.427104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:15.437327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.438061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:15.439151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.447562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:15.625353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:15.637140 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aed0d2e1-bd3b-4fb9-adec-fc3bf57dd88e tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.212394 May 14 21:29:15.637140 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2222/4827] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:15 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:15.929130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:15.929769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:15.938129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.939389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:15.940357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:15.940966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:16.087813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:16.097953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba07442b-e730-4510-8a4e-601beea4e984 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.172746 May 14 21:29:16.098739 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2606/4828] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:15 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:16.234924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:16.235600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:16.243009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:16.243747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:16.244994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:16.245464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:16.271117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:16.272777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:16.284811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:16.285741 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:16.286835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:16.287697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:16.431766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:16.451767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:16.459142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:16.471541 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-233440e7-930b-4c86-8c7a-776ed37d5a21 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.230389 May 14 21:29:16.471541 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2223/4829] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:16 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:16.471965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:16.471965 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f790937d-8cc4-43b4-a602-dc9eb806fd80 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.204736 May 14 21:29:16.479563 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2607/4830] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:16 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:16.652198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:16.652743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:16.664318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:16.665059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:16.666037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:16.666658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:16.935215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:16.944921 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6252f996-8858-413e-9177-fdec3f136532 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.296950 May 14 21:29:16.946278 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2224/4831] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:16 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:17.115407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:17.116210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:17.125092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.125745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:17.127187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.127878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:17.283352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:17.292453 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19943c67-3480-417c-be1c-161d9c7b6f92 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.181846 May 14 21:29:17.293040 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2608/4832] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:17 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:17.479062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:17.479734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:17.487135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.487945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:17.489006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.489462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:17.489744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:17.490499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:17.497508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.497967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:17.498758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.499295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:17.628686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:17.637729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:17.638437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:17.639288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:17.640789 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb2a5dd6-2ebf-4004-b1a2-cec1dbcb822f tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.165826 May 14 21:29:17.641352 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2225/4833] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:17 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:17.648757 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-59112ebc-6c45-40cb-a3a4-5ee9a58d423a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.164413 May 14 21:29:17.649329 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2609/4834] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:17 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:17.965795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:17.967008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:17.975577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.976517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:17.977951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:17.978873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:18.154301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:18.164051 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d5044765-1b75-458b-9916-b963b28e7fb8 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.205155 May 14 21:29:18.165241 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2226/4835] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:17 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:18.310311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:18.311334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:18.317966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:18.318424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:18.319198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:18.319687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:18.460286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:18.473796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-96210a19-2f32-4cc5-943a-d861bc5537dd tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.167397 May 14 21:29:18.483915 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2610/4836] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:18 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:18.659804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:18.660554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:18.666097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:18.666737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:18.668195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:18.668690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:18.669583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:18.670066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:18.672795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:18.673277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:18.674042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:18.674487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:18.809065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:18.809280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:18.817495 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f7cb978-4483-4855-8f5c-0d1111dade39 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.155677 May 14 21:29:18.818229 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2611/4837] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:18 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:18.818850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:18.820548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:18.821767 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28c29a1b-6f8d-4f98-8317-4cd0b3c6de48 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.166606 May 14 21:29:18.822767 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2227/4838] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:18 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:19.182475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:19.190270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:19.190957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.191876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:19.192662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.193102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:19.351370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:19.362851 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a5e4660f-d9fa-41f4-9fbe-b1c71996fb70 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.184304 May 14 21:29:19.363669 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2612/4839] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:19 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:19.502344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:19.502344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:19.502344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.502344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:19.502344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.502344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:19.670090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:19.679986 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9354aecd-e2a8-48e5-ad14-e2bdf259e9a2 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1721 microversion: 2.1 time: 0.191516 May 14 21:29:19.683669 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2228/4840] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:19 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:19.835405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:19.836196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:19.844151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.845763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:19.846910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.847786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:19.850531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:19.851154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:19.858051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.859051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:19.860240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:19.860878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:20.056479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:20.065803 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9aa3eada-067b-4eff-8f86-70cb880e3127 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.234573 May 14 21:29:20.075835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:20.076777 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2613/4841] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:19 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:20.081793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:20.085103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:20.085103 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f2515f9d-0b4b-41a0-83e6-5d3b0b730345 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.238873 May 14 21:29:20.087902 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2229/4842] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:19 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:20.381097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:20.381755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:20.388876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:20.389337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:20.390509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:20.390953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:20.531097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:20.539823 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca5f1a81-e176-4ae6-9de8-fd57f84bd61b tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.162883 May 14 21:29:20.540432 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2614/4843] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:20 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:20.697537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:20.698198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:20.706602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:20.707127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:20.707951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:20.708573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:20.865561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:20.884304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d483612b-6c79-4b73-b0e6-c31466ae9268 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1698 microversion: 2.1 time: 0.190563 May 14 21:29:20.899682 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2230/4844] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:20 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1698 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:20.905662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-180a2a99-3bf9-48d5-ac8a-e23e941f206f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:20.915728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-180a2a99-3bf9-48d5-ac8a-e23e941f206f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:20.916829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-180a2a99-3bf9-48d5-ac8a-e23e941f206f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:20.966515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-180a2a99-3bf9-48d5-ac8a-e23e941f206f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Going to try to start instance {{(pid=130638) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 21:29:21.084193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:21.084817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:21.092309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.096385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.096385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.096385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.189991 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-180a2a99-3bf9-48d5-ac8a-e23e941f206f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action" status: 202 len: 0 microversion: 2.1 time: 0.286829 May 14 21:29:21.192036 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2615/4845] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:29:20 2022] POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:29:21.202320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:21.203671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:21.218554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.219382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.220906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.221739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.360760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:21.360760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-adad60fb-6af0-4563-a9f9-670d6362e797 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.269606 May 14 21:29:21.360760 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2231/4846] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:21 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:21.360760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:21.360760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:21.376034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.377182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.378266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.378709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.427645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:21.439792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:21.442175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:21.443698 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bb432043-7a3f-41ac-b098-777f47657304 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.249943 May 14 21:29:21.456762 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2616/4847] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:21 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:21.557661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:21.558287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:21.565507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.565964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.566745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:21.567187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:21.668834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:21.668834 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4ab4243-ba6e-44f1-ac28-b3cc42900a76 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1707 microversion: 2.1 time: 0.297693 May 14 21:29:21.668834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2232/4848] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:21 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1707 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:21.719805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:21.728547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e502a042-68e0-4ee7-97b2-11e5b3cb187a tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.174701 May 14 21:29:21.737540 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2617/4849] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:21 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:22.376312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:22.377035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:22.383792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.384253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.385023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.385466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.463438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:22.464642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:22.479606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.479606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.480422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.480947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.549587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:22.558547 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-160f533c-b42b-49f9-b9d5-7deb07fcdec5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.186840 May 14 21:29:22.569916 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2233/4850] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:22 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:22.633183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:22.642476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:22.644045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:22.645227 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37541dda-44cc-4523-b169-9d5e66d68583 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.185838 May 14 21:29:22.645805 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2618/4851] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:22 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:22.667607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:22.668237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:22.675015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.675584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.676307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.676752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.753394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:22.754051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:22.761324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.761324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.761567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:22.761827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:22.810422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:22.831933 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ed880fe-67c2-43d2-a189-9377430b4510 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1707 microversion: 2.1 time: 0.163660 May 14 21:29:22.833401 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2234/4852] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:22 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1707 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:22.931075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:22.943307 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b9980c42-8300-4222-babd-3affea1a7867 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.194748 May 14 21:29:22.945442 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2619/4853] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:22 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:23.578020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:23.580396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:23.589096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.592498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:23.592498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.592498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:23.666274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:23.667075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:23.673916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.678754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:23.678754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.678754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:23.751265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:23.760456 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a33463b6-1eb2-4a07-8e9a-944fae3abf2f tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.187047 May 14 21:29:23.761429 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2235/4854] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:23 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:23.841187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:23.850144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:23.851933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:23.853036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:23.854580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:23.855851 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d18de574-7b65-4887-8a90-4df18c8e67d7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.194223 May 14 21:29:23.856622 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2620/4855] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:23 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:23.861120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.861743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:23.862587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.863552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:23.962241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:23.962870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:23.969307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.970345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:23.971217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:23.971702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:24.045987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:24.064925 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e986d3d-2cf5-4d58-bcf2-e1e395b0053f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1711 microversion: 2.1 time: 0.219042 May 14 21:29:24.076524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2236/4856] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:23 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1711 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:24.458969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:24.475845 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-140e040e-3e59-4fcd-bb04-e5c8c28f2927 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.510334 May 14 21:29:24.481151 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2621/4857] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:23 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:24.803312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:24.804065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:24.812843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:24.813447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:24.814232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:24.814670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:24.875669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:24.877802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:24.888599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:24.888599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:24.889218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:24.890566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:24.988286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:24.998153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-48858020-6ec5-4fd5-987a-8ce674906486 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.198712 May 14 21:29:24.998739 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2237/4858] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:24 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:25.062671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:25.072164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:25.073698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:25.074922 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-156059ec-86bf-4c00-a5c6-401508fc4074 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.203380 May 14 21:29:25.075515 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2622/4859] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:24 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:25.494169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:25.494974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:25.505631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:25.508036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:25.508036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:25.508282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:25.679288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:25.688310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1171dfab-db19-427e-b45b-0d1e9e6a70ce tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1323 microversion: 2.1 time: 0.198222 May 14 21:29:25.688907 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2238/4860] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:25 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:26.016158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:26.016824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:26.024219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.026502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.026502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.026502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.094146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:26.095522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:26.102483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.102878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.103703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.104149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.162930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:26.170602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c9de2d1a-fa1b-440e-9bf5-83c9502904c5 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.158730 May 14 21:29:26.171190 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2623/4861] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:26 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:26.237263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:26.246016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:26.250020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:26.250020 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24be1cc9-f0ce-4814-9da7-fc5cc8baac69 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.158717 May 14 21:29:26.250020 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2239/4862] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:26 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:26.706329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:26.706948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:26.713171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.713633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.714402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.714843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.847423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:26.855061 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-67ae9772-1ccb-4cab-891b-9fe014df1add tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1521 microversion: 2.1 time: 0.153333 May 14 21:29:26.855826 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2624/4863] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:26 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:26.881775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:26.882312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:26.888387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.888841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.889604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:26.890365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:26.917863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:29:27.188440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:27.189160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:27.195820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:27.196276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:27.197208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:27.197483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:27.259208 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6027a40e-48b9-4bc6-a3fc-bf2f5b4d7692 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 204 len: 0 microversion: 2.1 time: 0.381071 May 14 21:29:27.259890 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2240/4864] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:26 2022] DELETE /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:29:27.268542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:27.269263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:27.275326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:27.276394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:27.276675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:27.277220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:27.341257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:27.348029 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3b59131-be49-4c56-9130-9e0449b73d7d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.163364 May 14 21:29:27.355675 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2625/4865] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:27 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:27.355675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:27.355675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:27.359795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:27.360516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:27.361308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:27.361761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:27.429725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:27.442854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:27.442854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:27.442854 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c48c4b5e-cd25-4a40-96ee-21fc2588261c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.178942 May 14 21:29:27.443297 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2241/4866] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:27 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:27.505563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:27.513085 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9946837-5ce7-4d66-9524-9b3ba1a79b24 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1527 microversion: 2.1 time: 0.163566 May 14 21:29:27.513666 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2626/4867] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:27 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:28.370440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:28.371279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:28.378555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:28.379021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:28.380327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:28.380777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:28.461047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:28.461669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:28.468688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:28.469153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:28.470573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:28.471030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:28.517252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:28.524942 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a93b627a-80e1-4549-91e8-189b8356162c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.158683 May 14 21:29:28.525834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2242/4868] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:28 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:28.530283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:28.531190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:28.537278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:28.541497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:28.541497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:28.541497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:28.605477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:28.615218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:28.616836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:28.618020 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cd4cb17-688b-4f00-b974-06834f291e8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.161141 May 14 21:29:28.618591 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2627/4869] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:28 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:28.668866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:28.677084 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27b77226-e365-4b79-a82e-7026ead9b953 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1527 microversion: 2.1 time: 0.150280 May 14 21:29:28.677658 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2243/4870] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:28 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1527 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:29.542575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:29.544016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:29.552369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:29.552977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:29.553993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:29.554446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:29.636988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:29.638562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:29.647209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:29.647781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:29.649072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:29.649788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:29.732865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:29.745805 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c3c0484e-cd85-44ff-8209-5a5fbc2537f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1509 microversion: 2.1 time: 0.207679 May 14 21:29:29.746785 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2628/4871] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:29 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:29.753138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:29.754019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:29.762594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:29.763463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:29.768058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:29.768058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:29.910590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:29.920360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:29.922200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:29.925028 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54cc66af-e149-4377-8f31-5cf7f1c80fda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.291022 May 14 21:29:29.926100 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2244/4872] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:29 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:29.941868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:29.950885 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3dce349c-7b15-48bf-948f-4f0780a91bbc tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1527 microversion: 2.1 time: 0.202627 May 14 21:29:29.951839 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2629/4873] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:29 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1527 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:30.316714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9b8d8179-c840-45a3-8c72-e6ff0225fa70 req-a9626401-f655-4179-b2b5-a9630934445d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e9a665a-c55d-44d7-9bd1-b182eec3a594", "name": "network-vif-deleted", "tag": "494c8c7a-1ac3-474f-b92a-ac3b0c597848"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:30.325674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9b8d8179-c840-45a3-8c72-e6ff0225fa70 req-a9626401-f655-4179-b2b5-a9630934445d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:30.326576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9b8d8179-c840-45a3-8c72-e6ff0225fa70 req-a9626401-f655-4179-b2b5-a9630934445d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:30.340537 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9b8d8179-c840-45a3-8c72-e6ff0225fa70 req-a9626401-f655-4179-b2b5-a9630934445d service nova] Creating event network-vif-deleted:494c8c7a-1ac3-474f-b92a-ac3b0c597848 for instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 on nch2-master-1 May 14 21:29:30.347691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9b8d8179-c840-45a3-8c72-e6ff0225fa70 req-a9626401-f655-4179-b2b5-a9630934445d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035302 May 14 21:29:30.348494 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2245/4874] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:30.767125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:30.767792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:30.774971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:30.775506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:30.779882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:30.779882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:30.926362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:30.934254 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8373733f-f43a-41bd-9866-b2b82089e676 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1486 microversion: 2.1 time: 0.172250 May 14 21:29:30.934840 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2630/4875] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:30 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1486 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:30.946721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:30.947434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:30.954331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ab1826cb-dbcb-4773-b879-bcff2dc7525b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-649589129"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:30.955013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:30.955506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:30.955666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ab1826cb-dbcb-4773-b879-bcff2dc7525b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:30.956277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:30.956718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:30.964411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab1826cb-dbcb-4773-b879-bcff2dc7525b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:30.964411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab1826cb-dbcb-4773-b879-bcff2dc7525b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:30.964411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab1826cb-dbcb-4773-b879-bcff2dc7525b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:30.964411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ab1826cb-dbcb-4773-b879-bcff2dc7525b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.102245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:31.112029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:31.113684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:31.114874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9cd7ec22-0bdd-4443-9f3b-f16fd3ed12c7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.173767 May 14 21:29:31.115452 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2246/4876] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:30 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:31.120099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:31.120747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:31.127569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.128041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.128835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.129289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.154814 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ab1826cb-dbcb-4773-b879-bcff2dc7525b tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "PUT /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1059 microversion: 2.1 time: 0.204592 May 14 21:29:31.155751 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2631/4877] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:29:30 2022] PUT /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1059 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:31.163811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.164278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.164922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lazy-loading 'fault' on Instance uuid 1e9a665a-c55d-44d7-9bd1-b182eec3a594 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:29:31.169843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:31.170469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:31.176996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.177447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.178220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.178662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.206992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d73e16649b845319b5184937056b233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb13e5ea4a949d18e6c5c4bf679fde2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:31.218875 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c2b0de02-ed0d-4ba9-8881-df45029a4cd1 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 200 len: 1313 microversion: 2.1 time: 0.102136 May 14 21:29:31.219807 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2247/4878] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:31 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 1313 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:31.314656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:31.322266 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-133539fc-7398-4eec-adfc-ead1a1cd60b9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1486 microversion: 2.1 time: 0.156249 May 14 21:29:31.322918 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2632/4879] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:31 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1486 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:31.338508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:31.341179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:31.345216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.345671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.346436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.346875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.481595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:31.489312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1e91955-dca0-491c-9c9a-8170022b02bd tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1486 microversion: 2.1 time: 0.154558 May 14 21:29:31.490693 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2248/4880] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:31 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1486 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:31.508526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:31.509060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:31.520428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.520428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.520428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.520428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.550092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:29:31.939658 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-93f91b8c-6dd4-4028-9a17-8fafcc57e5bb tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 204 len: 0 microversion: 2.1 time: 0.437574 May 14 21:29:31.940854 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2633/4881] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:31 2022] DELETE /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:29:31.948398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:31.949021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:31.955871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.956330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:31.957117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:31.957552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.094479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:32.102291 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cecbf489-0a59-494a-9537-3adeaf9bc825 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1492 microversion: 2.1 time: 0.157774 May 14 21:29:32.103668 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2249/4882] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:31 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1492 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:32.133696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:32.134445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:32.140918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.142040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.142822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.143271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.236239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:32.236955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 1e9a665a-c55d-44d7-9bd1-b182eec3a594] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:32.247302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.247302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.247302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.247302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.260822 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 could not be found. May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 HTTP/1.1 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 could not be found. May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1e9a665a-c55d-44d7-9bd1-b182eec3a594'} May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 could not be found. May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 could not be found. May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.262622 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 could not be found. May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Instance 1e9a665a-c55d-44d7-9bd1-b182eec3a594 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4ca0e17-5b5e-48b3-a0e7-1e03e7c48e9c tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594" status: 404 len: 111 microversion: 2.1 time: 0.033083 May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2250/4883] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:32 2022] GET /compute/v2.1/servers/1e9a665a-c55d-44d7-9bd1-b182eec3a594 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:29:32.280518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-310fd903-e95b-4d24-b97b-a2f57ae3f789 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '.version_select at 0x7fb1a7658310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:32.282295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:32.292403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:32.293968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:32.295160 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-153c3491-2196-43a4-8cb7-7977ca13f39b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.165922 May 14 21:29:32.295990 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2634/4884] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:32 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:32.299462 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-310fd903-e95b-4d24-b97b-a2f57ae3f789 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Image not found. May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-310fd903-e95b-4d24-b97b-a2f57ae3f789 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a HTTP/1.1 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: method: May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: exception: Image not found. May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1010acb3-884d-4eac-8507-a964ea165c0a'} May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1010acb3-884d-4eac-8507-a964ea165c0a to delete May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1010acb3-884d-4eac-8507-a964ea165c0a could not be found. May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.301591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-310fd903-e95b-4d24-b97b-a2f57ae3f789 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Image not found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-310fd903-e95b-4d24-b97b-a2f57ae3f789 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a" status: 404 len: 62 microversion: 2.1 time: 0.030818 May 14 21:29:32.311312 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2251/4885] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:32 2022] DELETE /compute/v2.1/images/1010acb3-884d-4eac-8507-a964ea165c0a => generated 62 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 14 21:29:32.314855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:32.315271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:32.321471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.322117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.322736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.323183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.337471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 HTTP/1.1 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '81ef508d-db13-4092-a0a8-0c0cfdde7687'} May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:32.339386 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6e4b8f1e-a4eb-4181-b5a9-76269bed2afa tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 404 len: 111 microversion: 2.1 time: 0.032158 May 14 21:29:32.344586 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2635/4886] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:32 2022] DELETE /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:32.349179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:32.349812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 81ef508d-db13-4092-a0a8-0c0cfdde7687] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:32.356951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.357415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.358199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:32.358644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:32.372422 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 HTTP/1.1 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '81ef508d-db13-4092-a0a8-0c0cfdde7687'} May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.373969 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Instance 81ef508d-db13-4092-a0a8-0c0cfdde7687 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7122a424-3bc0-4a68-9b4d-ea71575935d9 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687" status: 404 len: 111 microversion: 2.1 time: 0.030086 May 14 21:29:32.380149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2252/4887] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:32 2022] GET /compute/v2.1/servers/81ef508d-db13-4092-a0a8-0c0cfdde7687 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:32.385034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-665190f8-9e18-4fd6-adc4-ad57f80bf66f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '.version_select at 0x7fb1a78d75e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:32.454170 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-665190f8-9e18-4fd6-adc4-ad57f80bf66f tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433246915" status: 202 len: 0 microversion: 2.1 time: 0.072755 May 14 21:29:32.454864 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2636/4888] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:29:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433246915 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:29:33.120019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:33.120575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:33.129422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.129887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.130758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.131206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.276318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-af3db890-f236-43a0-8cd2-926f5d472742 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '.version_select at 0x7fb1a719cd30>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:33.276838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:33.286098 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-16977c47-0c73-4030-b145-e7e0b70c3dc9 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1492 microversion: 2.1 time: 0.170163 May 14 21:29:33.286831 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2253/4889] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:33 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1492 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:33.303119 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-af3db890-f236-43a0-8cd2-926f5d472742 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Image not found. May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-af3db890-f236-43a0-8cd2-926f5d472742 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/images/301fa1ac-88e4-4621-833a-66be3e40b561 HTTP/1.1 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: exception: Image not found. May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '301fa1ac-88e4-4621-833a-66be3e40b561'} May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 301fa1ac-88e4-4621-833a-66be3e40b561 to delete May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 301fa1ac-88e4-4621-833a-66be3e40b561 could not be found. May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:33.305066 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-af3db890-f236-43a0-8cd2-926f5d472742 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Image not found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-af3db890-f236-43a0-8cd2-926f5d472742 tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/images/301fa1ac-88e4-4621-833a-66be3e40b561" status: 404 len: 62 microversion: 2.1 time: 0.035315 May 14 21:29:33.316705 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2637/4890] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:33 2022] DELETE /compute/v2.1/images/301fa1ac-88e4-4621-833a-66be3e40b561 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 14 21:29:33.318715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:33.318715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:33.323913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.324126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:33.324383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.324844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:33.325173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.325677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.332463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.332926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.333708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.334146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.349332 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 HTTP/1.1 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '642eb1fc-fd39-47fb-a85e-f6423a1c1a21'} May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:33.351187 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.356369 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.357997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:33.358905 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7eb2839a-8018-4223-8937-ff41d7e98dbb tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "DELETE /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 404 len: 111 microversion: 2.1 time: 0.039671 May 14 21:29:33.359471 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2638/4891] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:33 2022] DELETE /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:33.367315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:33.368083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] [instance: 642eb1fc-fd39-47fb-a85e-f6423a1c1a21] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:33.378958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.378958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.378958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.378958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.392737 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] HTTP exception thrown: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Request method failure captured: May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 HTTP/1.1 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dXjX8wNt_1bDlaC4MyVyzQ3LUyb6WgYVbAaPWwTTzmD2O2c0Rk8iHQjma4OTo0mt9E4I7Sh66_XZmfWqdezwyYqZtP9rNMm0J0CEKPbt4-Lcsuec6eiQT0szN6KjbCM8dT7gc495iN9L_5FAusxVWRQaCYb0QVi9tF2xBQoPJG3o May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/bbb13e5ea4a949d18e6c5c4bf679fde2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_bbb13e5ea4a949d18e6c5c4bf679fde2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: bbb13e5ea4a949d18e6c5c4bf679fde2 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1d73e16649b845319b5184937056b233 May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1283471479-project May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '642eb1fc-fd39-47fb-a85e-f6423a1c1a21'} May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.394894 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] Returning 404 to user: Instance 642eb1fc-fd39-47fb-a85e-f6423a1c1a21 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50308ea6-f5c5-473d-9e34-37967254e17d tempest-ImagesOneServerNegativeTestJSON-1283471479 tempest-ImagesOneServerNegativeTestJSON-1283471479-project] 10.222.0.52 "GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21" status: 404 len: 111 microversion: 2.1 time: 0.032741 May 14 21:29:33.399652 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2639/4892] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:33 2022] GET /compute/v2.1/servers/642eb1fc-fd39-47fb-a85e-f6423a1c1a21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:29:33.603911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:33.612741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:33.614267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:33.615457 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-acfc09a6-33e6-4fb3-b890-df8716a84aff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.303650 May 14 21:29:33.616055 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2254/4893] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:33 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:33.963830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-28e956f6-0f48-4500-a70c-11f27b9396af req-96ebcb1f-0117-464a-bef4-2b37f4a4aec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a53b5c2-e7e2-47ca-9535-d84670971640", "name": "network-vif-deleted", "tag": "b9f9fedb-f9dd-40c1-884c-8431a6e41116"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:33.973025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-28e956f6-0f48-4500-a70c-11f27b9396af req-96ebcb1f-0117-464a-bef4-2b37f4a4aec0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:33.973963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-28e956f6-0f48-4500-a70c-11f27b9396af req-96ebcb1f-0117-464a-bef4-2b37f4a4aec0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:33.990314 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-28e956f6-0f48-4500-a70c-11f27b9396af req-96ebcb1f-0117-464a-bef4-2b37f4a4aec0 service nova] Creating event network-vif-deleted:b9f9fedb-f9dd-40c1-884c-8431a6e41116 for instance 4a53b5c2-e7e2-47ca-9535-d84670971640 on nch1-master-1 May 14 21:29:33.997558 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-28e956f6-0f48-4500-a70c-11f27b9396af req-96ebcb1f-0117-464a-bef4-2b37f4a4aec0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039869 May 14 21:29:33.997558 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2640/4894] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:34.308852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:34.313471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:34.316864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:34.317332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:34.318824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:34.318956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:34.355720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:34.356186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:34.356647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lazy-loading 'fault' on Instance uuid 4a53b5c2-e7e2-47ca-9535-d84670971640 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:29:34.401516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:34.411250 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f270bd58-d9ce-4fee-bc15-eff26830bf08 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 200 len: 1309 microversion: 2.1 time: 0.105677 May 14 21:29:34.421725 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2255/4895] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:34 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:34.425931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-48645dd7-645f-4f4b-8d2d-5383f481862b req-899702b4-fd62-4e3d-8b68-4429b80a181a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4097156a-300a-4d17-87df-60620c836925", "name": "network-vif-plugged", "status": "completed", "tag": "5c660063-0f23-4b2d-b5ca-12d4f3ea2036"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:34.437001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-48645dd7-645f-4f4b-8d2d-5383f481862b req-899702b4-fd62-4e3d-8b68-4429b80a181a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:34.437001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-48645dd7-645f-4f4b-8d2d-5383f481862b req-899702b4-fd62-4e3d-8b68-4429b80a181a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:34.447815 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-48645dd7-645f-4f4b-8d2d-5383f481862b req-899702b4-fd62-4e3d-8b68-4429b80a181a service nova] Creating event network-vif-plugged:5c660063-0f23-4b2d-b5ca-12d4f3ea2036 for instance 4097156a-300a-4d17-87df-60620c836925 on nch2-master-1 May 14 21:29:34.452710 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-48645dd7-645f-4f4b-8d2d-5383f481862b req-899702b4-fd62-4e3d-8b68-4429b80a181a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039879 May 14 21:29:34.456885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2641/4896] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:34.634334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:34.639018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:34.642928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:34.643386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:34.644207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:34.644664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:34.839524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:34.853219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:34.854822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:34.866066 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f139e8f-63cc-4feb-84e8-330723ab28c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.235623 May 14 21:29:34.868756 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2256/4897] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:34 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:35.429944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.430674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.439577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.443681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.443681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.443681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.455045 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 HTTP/1.1 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '4a53b5c2-e7e2-47ca-9535-d84670971640'} May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.456726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd196c10-b209-4d31-b809-a8471311097a tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 404 len: 111 microversion: 2.1 time: 0.033359 May 14 21:29:35.462584 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2642/4898] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.473736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.474271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.480827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.481291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.482073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.482519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.499097 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 HTTP/1.1 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '4a53b5c2-e7e2-47ca-9535-d84670971640'} May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.501418 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-123cebd3-52ae-49aa-b84c-68c63ae3bf07 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 404 len: 111 microversion: 2.1 time: 0.033385 May 14 21:29:35.507393 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2257/4899] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:35 2022] DELETE /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.511619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.512242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4a53b5c2-e7e2-47ca-9535-d84670971640] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.521242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.522226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.523701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.523900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.540032 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 HTTP/1.1 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '4a53b5c2-e7e2-47ca-9535-d84670971640'} May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.541999 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 4a53b5c2-e7e2-47ca-9535-d84670971640 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0f5a5bab-312e-422f-b7ad-e8b20c542b59 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640" status: 404 len: 111 microversion: 2.1 time: 0.035938 May 14 21:29:35.552500 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2643/4900] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/4a53b5c2-e7e2-47ca-9535-d84670971640 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.554037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.554586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.560716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.561178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.561962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.562408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.579059 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 HTTP/1.1 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '69fb9083-0ea0-4eeb-92ff-1a2f6c876317'} May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.580816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae627a7e-9ddc-4d02-abcd-24c394c2f0e3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 404 len: 111 microversion: 2.1 time: 0.034464 May 14 21:29:35.586669 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2258/4901] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:35 2022] DELETE /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.592184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.592836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 69fb9083-0ea0-4eeb-92ff-1a2f6c876317] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.599082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.600559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.600559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.600795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.616745 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 HTTP/1.1 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '69fb9083-0ea0-4eeb-92ff-1a2f6c876317'} May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.619039 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 69fb9083-0ea0-4eeb-92ff-1a2f6c876317 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f2bb9a96-7f7b-4839-a4d7-16996f2e2945 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317" status: 404 len: 111 microversion: 2.1 time: 0.032699 May 14 21:29:35.630087 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2644/4902] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/69fb9083-0ea0-4eeb-92ff-1a2f6c876317 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.630901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.630901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.637144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.637603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.638379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.638912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.653698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d HTTP/1.1 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d'} May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.655255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-42a9fe82-c664-44b4-9a49-03246d31ba72 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 404 len: 111 microversion: 2.1 time: 0.031106 May 14 21:29:35.661161 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2259/4903] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:35 2022] DELETE /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.666922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.667559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.674776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.675233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.676135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.676692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.692325 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d HTTP/1.1 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d'} May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.693997 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b48e11ef-7d58-4514-9f4f-831ec06ad3f2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d" status: 404 len: 111 microversion: 2.1 time: 0.033018 May 14 21:29:35.704007 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2645/4904] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/310ba3dc-8a6a-4d6a-9d96-6ced86f4ec4d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.707865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.711033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.715099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.715697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.716396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.716917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.732589 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 HTTP/1.1 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '441f55e9-7d61-4fe1-824f-b109de8af293'} May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.734149 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fcd8395e-6cfa-4955-9166-a77d28844599 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 404 len: 111 microversion: 2.1 time: 0.033211 May 14 21:29:35.740145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2260/4905] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:35 2022] DELETE /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.746215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.746831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 441f55e9-7d61-4fe1-824f-b109de8af293] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.757588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.758046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.758848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.759290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.774447 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 HTTP/1.1 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '441f55e9-7d61-4fe1-824f-b109de8af293'} May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.776239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 441f55e9-7d61-4fe1-824f-b109de8af293 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-155e7e49-1226-45c7-be4e-383afda8c992 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293" status: 404 len: 111 microversion: 2.1 time: 0.037053 May 14 21:29:35.787009 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2646/4906] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/441f55e9-7d61-4fe1-824f-b109de8af293 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.788604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.788604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.796066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.796066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.796574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.797089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.813332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 HTTP/1.1 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1a0cb80c-e155-4079-9b66-51a732c612d8'} May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.815177 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.820235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.821360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-413ce5fd-9244-4fc8-ae67-d8b0c4b4f654 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 404 len: 111 microversion: 2.1 time: 0.037268 May 14 21:29:35.825492 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2261/4907] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:35 2022] DELETE /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.834311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.834941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 1a0cb80c-e155-4079-9b66-51a732c612d8] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.840890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.841343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.842118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.842583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.856240 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 HTTP/1.1 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1a0cb80c-e155-4079-9b66-51a732c612d8'} May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.857747 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 1a0cb80c-e155-4079-9b66-51a732c612d8 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-efe80b4e-dc11-45f5-9338-9a45c0728f14 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8" status: 404 len: 111 microversion: 2.1 time: 0.028853 May 14 21:29:35.863597 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2647/4908] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/1a0cb80c-e155-4079-9b66-51a732c612d8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.868252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.868759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.874967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.876302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.877242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.877687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.886052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.886667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.892890 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.893763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.894222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f HTTP/1.1 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '4caf8900-4253-4d9b-b3bc-c45824e00b7f'} May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.894545 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.899426 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.900182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.900275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.900377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.900487 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52b0d721-5a11-47d3-a25a-7f0dd70b3027 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 404 len: 111 microversion: 2.1 time: 0.031622 May 14 21:29:35.900487 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2262/4909] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:35 2022] DELETE /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.908351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.909142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 4caf8900-4253-4d9b-b3bc-c45824e00b7f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.916041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.916565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.920498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:35.920498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:35.933134 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f HTTP/1.1 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '4caf8900-4253-4d9b-b3bc-c45824e00b7f'} May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.934683 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 4caf8900-4253-4d9b-b3bc-c45824e00b7f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f7c8e00-cc06-4a3e-a4a6-225ea32097ce tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f" status: 404 len: 111 microversion: 2.1 time: 0.032037 May 14 21:29:35.941132 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2263/4910] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/4caf8900-4253-4d9b-b3bc-c45824e00b7f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.952735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2de45246-f1cb-453e-a8bd-21edbe296e76 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.954220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2de45246-f1cb-453e-a8bd-21edbe296e76 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: ab45b1e6-4517-4aea-a4f5-7f29b059ff65] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:35.961259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2de45246-f1cb-453e-a8bd-21edbe296e76 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2de45246-f1cb-453e-a8bd-21edbe296e76 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65 HTTP/1.1 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ab45b1e6-4517-4aea-a4f5-7f29b059ff65'} May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:35.962981 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.968728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:35.968728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:35.968728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:35.968728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:35.968728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:35.968728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:35.968728 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:35.980498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2de45246-f1cb-453e-a8bd-21edbe296e76 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:35.981405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2de45246-f1cb-453e-a8bd-21edbe296e76 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65" status: 404 len: 111 microversion: 2.1 time: 0.033062 May 14 21:29:35.983562 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2264/4911] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:35 2022] DELETE /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:35.992758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d9ed35ad-0bc1-46eb-b76f-1d11f0b18646 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:35.993453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d9ed35ad-0bc1-46eb-b76f-1d11f0b18646 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: ab45b1e6-4517-4aea-a4f5-7f29b059ff65] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:36.005311 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d9ed35ad-0bc1-46eb-b76f-1d11f0b18646 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d9ed35ad-0bc1-46eb-b76f-1d11f0b18646 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65 HTTP/1.1 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ab45b1e6-4517-4aea-a4f5-7f29b059ff65'} May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:36.006978 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:36.012293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:36.012293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:36.012293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. May 14 21:29:36.012293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:36.012293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d9ed35ad-0bc1-46eb-b76f-1d11f0b18646 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance ab45b1e6-4517-4aea-a4f5-7f29b059ff65 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:36.012293 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d9ed35ad-0bc1-46eb-b76f-1d11f0b18646 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65" status: 404 len: 111 microversion: 2.1 time: 0.022577 May 14 21:29:36.012293 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2265/4912] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/ab45b1e6-4517-4aea-a4f5-7f29b059ff65 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:29:36.021750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:36.022613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:36.036187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.036649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.037769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.038383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.072052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:29:36.085516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:36.094963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:36.103524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:36.108865 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7ab17974-a6ea-4b16-82b5-7e3a65ab866e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.221963 May 14 21:29:36.117384 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2648/4913] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:35 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:36.268916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-222785705", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": "none"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:36.320895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:29:36.324708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:29:36.324708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:29:36.324708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:29:36.324708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:29:36.332609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.333077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.333893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.334344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.353184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Getting quotas for project f43cf27f7a634cb4adb7865a7e8b7838. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:29:36.358549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Getting quotas for user b75ffa8886d946e3ae228f737b193198 and project f43cf27f7a634cb4adb7865a7e8b7838. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:29:36.371372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:29:36.386452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:29:36.386612 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffc424fd-1f9e-4a30-939e-f6c9256e68f3 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "DELETE /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 204 len: 0 microversion: 2.1 time: 0.367183 May 14 21:29:36.386612 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2266/4914] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:36 2022] DELETE /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:29:36.393961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:36.395069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:36.401590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.402057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.402847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.403291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.472050 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3f89c099-c04b-4d59-b3f4-6a9dff7b960a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.324013 May 14 21:29:36.472876 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2649/4915] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 326 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 14 21:29:36.482893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd40c8cc-ca24-43d5-8c8d-d0c2960162ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:36.483690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd40c8cc-ca24-43d5-8c8d-d0c2960162ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:36.542785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd40c8cc-ca24-43d5-8c8d-d0c2960162ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:36.548452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:36.551515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd40c8cc-ca24-43d5-8c8d-d0c2960162ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:36.551845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd40c8cc-ca24-43d5-8c8d-d0c2960162ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:36.553262 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd40c8cc-ca24-43d5-8c8d-d0c2960162ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31" status: 200 len: 1277 microversion: 2.47 time: 0.074414 May 14 21:29:36.553836 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2650/4916] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:36 2022] GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31 => generated 1277 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:36.556532 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9041fec5-3e80-4506-9a13-1655ea850285 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1478 microversion: 2.1 time: 0.167828 May 14 21:29:36.557303 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2267/4917] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:36 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1478 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:36.621740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-988074423", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": "none"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:36.674240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:29:36.674678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:29:36.675170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:29:36.675632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:29:36.676059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:29:36.685217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.688681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.688681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:36.688681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:36.704948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Getting quotas for project f43cf27f7a634cb4adb7865a7e8b7838. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:29:36.710105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Getting quotas for user b75ffa8886d946e3ae228f737b193198 and project f43cf27f7a634cb4adb7865a7e8b7838. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:29:36.722380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:29:36.724698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:29:36.859206 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a29b4c9b-9140-4c5d-8663-430b08b8b84c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.241398 May 14 21:29:36.861721 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2651/4918] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 244 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 14 21:29:36.870739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e44085c-34ec-4c5b-82df-4c55f240f64f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:36.871933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e44085c-34ec-4c5b-82df-4c55f240f64f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:36.918782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e44085c-34ec-4c5b-82df-4c55f240f64f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "PUT /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 991 microversion: 2.47 time: 0.052016 May 14 21:29:36.920266 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2268/4919] 10.222.0.52 () {62 vars in 1296 bytes} [Sat May 14 21:29:36 2022] PUT /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:29:36.935518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e9c65493-1b27-4a19-8a03-98d4940918eb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:36.936259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e9c65493-1b27-4a19-8a03-98d4940918eb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:36.992456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9c65493-1b27-4a19-8a03-98d4940918eb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:37.006421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9c65493-1b27-4a19-8a03-98d4940918eb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:37.006421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9c65493-1b27-4a19-8a03-98d4940918eb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:37.006421 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e9c65493-1b27-4a19-8a03-98d4940918eb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1277 microversion: 2.47 time: 0.074582 May 14 21:29:37.006421 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2652/4920] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:36 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1277 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:37.125419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:37.126313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:37.134444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:37.134914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:37.135735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:37.136580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:37.275791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:37.285049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:37.286627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:37.287827 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a13a0213-15e7-4595-877b-955dcd833a2b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.166769 May 14 21:29:37.288399 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2269/4921] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:37 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:37.574299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:37.575301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:37.596280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:37.597240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:37.598587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:37.599210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:37.756219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:37.763875 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-359eeba5-bd1d-40a5-9053-3268ba9cc1bc tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1478 microversion: 2.1 time: 0.193455 May 14 21:29:37.764692 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2653/4922] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:37 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1478 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:38.026520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:38.031267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:38.034167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:38.034630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:38.035455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:38.035929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:38.125822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:38.137908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:38.140951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:38.147277 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2ed46fa7-5eb5-45e5-852d-f5332e2cac5e tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1281 microversion: 2.47 time: 0.120615 May 14 21:29:38.147277 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2270/4923] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:38 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:38.306103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:38.306731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:38.313939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:38.320541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:38.320541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:38.320541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:38.500332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:38.503393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fb1bffa1-7c40-4446-b85e-0c30bff0d2e7 req-a4e1de40-aa3e-4355-b519-168b9dae8735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "936e1550-0631-4554-ac76-155d45752fd2", "name": "network-vif-deleted", "tag": "d7b1cab6-624b-468c-b548-316667b4aa2b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:38.509377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:38.511315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:38.512945 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e003f53d-25cb-433f-b467-7e91f3e695a3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1807 microversion: 2.20 time: 0.210669 May 14 21:29:38.513898 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2654/4924] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:38 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:38.517824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fb1bffa1-7c40-4446-b85e-0c30bff0d2e7 req-a4e1de40-aa3e-4355-b519-168b9dae8735 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:38.519363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fb1bffa1-7c40-4446-b85e-0c30bff0d2e7 req-a4e1de40-aa3e-4355-b519-168b9dae8735 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:38.532531 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fb1bffa1-7c40-4446-b85e-0c30bff0d2e7 req-a4e1de40-aa3e-4355-b519-168b9dae8735 service nova] Creating event network-vif-deleted:d7b1cab6-624b-468c-b548-316667b4aa2b for instance 936e1550-0631-4554-ac76-155d45752fd2 on nch2-master-1 May 14 21:29:38.537458 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fb1bffa1-7c40-4446-b85e-0c30bff0d2e7 req-a4e1de40-aa3e-4355-b519-168b9dae8735 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038574 May 14 21:29:38.538073 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2271/4925] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:29:38.782748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:38.783371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:38.790635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:38.791094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:38.791916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:38.792634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:38.857870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:38.865989 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-18ea7d7e-3a6d-46a4-8e11-1927b8f34ce2 tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1277 microversion: 2.1 time: 0.087566 May 14 21:29:38.866584 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2655/4926] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:38 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:39.165561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:39.166277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:39.177105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.177572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.178481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.178969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.248796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:39.259607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:39.261793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:39.264628 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6214168c-c62d-4445-a338-e8d1cc4212d4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1329 microversion: 2.47 time: 0.103300 May 14 21:29:39.264628 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2272/4927] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:39 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1329 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:39.533305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:39.533936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:39.541584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.542424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.543888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.544725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.697214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:39.705914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:39.707504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:39.708688 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-775ac99f-1438-4e91-8870-850c7ac29551 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1794 microversion: 2.20 time: 0.180047 May 14 21:29:39.709452 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2656/4928] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:39 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1794 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:39.886876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:39.887673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:39.895946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.896529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.897604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.898145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.938299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.938828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aeb0b087-146d-4cd1-b703-8661f752940a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:39.939305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.939417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aeb0b087-146d-4cd1-b703-8661f752940a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:39.939542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lazy-loading 'fault' on Instance uuid 936e1550-0631-4554-ac76-155d45752fd2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:29:39.945820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeb0b087-146d-4cd1-b703-8661f752940a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.946274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeb0b087-146d-4cd1-b703-8661f752940a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.947053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeb0b087-146d-4cd1-b703-8661f752940a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:39.947583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aeb0b087-146d-4cd1-b703-8661f752940a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:39.972934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aeb0b087-146d-4cd1-b703-8661f752940a tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/ips" status: 200 len: 149 microversion: 2.1 time: 0.038938 May 14 21:29:39.973540 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2657/4929] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:29:39 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:39.982527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b398969c37454956a73bf459e0d37e61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91fceeecfb744810a52fd04cc03c72cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:39.990335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f7c56e60-a3b1-4467-a60a-7adc8279a67d tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 200 len: 1282 microversion: 2.1 time: 0.110438 May 14 21:29:39.991425 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2273/4930] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:39 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 1282 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:40.284208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:40.285484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:40.293068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:40.293608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:40.294492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:40.295011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:40.362052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:40.370112 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:40.371683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:40.372834 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d064db6e-38a6-46dd-9fff-430e55652c22 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1335 microversion: 2.47 time: 0.092888 May 14 21:29:40.373400 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2658/4931] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:40 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1335 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:41.007649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:41.008179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] [instance: 936e1550-0631-4554-ac76-155d45752fd2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:41.015504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:41.016597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:41.017385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:41.017834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:41.031170 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] HTTP exception thrown: Instance 936e1550-0631-4554-ac76-155d45752fd2 could not be found. May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Request method failure captured: May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 HTTP/1.1 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5qHCNmSVTxKZNe81V1vRoTvVZsJRqNtEZSakPP6lHqFMUoUEZXs6Qk6GZIHtz9uVwh9yIEqcVSajIYj_eIZbOBmRLBj7Ftfngj0qzOg7kGNcKe_ltNwcqqtk4bTQBRNjnaDIU7Oim8FzilfZFzGDE9OdNAPEqon4pKkVkPjffMifk May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersTestJSON-628961225 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91fceeecfb744810a52fd04cc03c72cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91fceeecfb744810a52fd04cc03c72cf", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersTestJSON-628961225 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 91fceeecfb744810a52fd04cc03c72cf May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersTestJSON-628961225 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersTestJSON-628961225-project May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b398969c37454956a73bf459e0d37e61 May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersTestJSON-628961225-project May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 936e1550-0631-4554-ac76-155d45752fd2 could not be found. May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '936e1550-0631-4554-ac76-155d45752fd2'} May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 936e1550-0631-4554-ac76-155d45752fd2 could not be found. May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 936e1550-0631-4554-ac76-155d45752fd2 could not be found. May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:41.033014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 936e1550-0631-4554-ac76-155d45752fd2 could not be found. May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] Returning 404 to user: Instance 936e1550-0631-4554-ac76-155d45752fd2 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb944ab9-d11c-4d47-a6cc-47ace340da7c tempest-ServersTestJSON-628961225 tempest-ServersTestJSON-628961225-project] 10.222.0.52 "GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2" status: 404 len: 111 microversion: 2.1 time: 0.030955 May 14 21:29:41.038810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2274/4932] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:41 2022] GET /compute/v2.1/servers/936e1550-0631-4554-ac76-155d45752fd2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:41.396651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:41.397439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:41.403604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:41.404064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:41.404838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:41.405283 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:41.509160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:41.518553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:41.520273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:41.521428 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02363bc5-35dc-473a-8528-9852244ad60b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1335 microversion: 2.47 time: 0.133881 May 14 21:29:41.521992 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2659/4933] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:41 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1335 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:42.540483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:42.541059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:42.548023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:42.548482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:42.549253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:42.549694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:42.615467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f20b2976-ec20-4397-bd0c-0360aa137492 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3d7bef2-cd53-4508-9fd9-b7613815d546"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:42.616991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f20b2976-ec20-4397-bd0c-0360aa137492 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:42.620153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:42.627245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20b2976-ec20-4397-bd0c-0360aa137492 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:42.627245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20b2976-ec20-4397-bd0c-0360aa137492 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:42.627245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20b2976-ec20-4397-bd0c-0360aa137492 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:42.627245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20b2976-ec20-4397-bd0c-0360aa137492 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:42.629475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:42.630999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:42.632217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d28c2325-aa8f-4cfb-a45e-bbf516e73896 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1335 microversion: 2.47 time: 0.095783 May 14 21:29:42.632800 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2275/4934] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:42 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:43.588122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9007b782-a073-4db9-aebd-ab6f58c977c7 tempest-ExtensionsTest-1959394093 tempest-ExtensionsTest-1959394093-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:43.589956 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9007b782-a073-4db9-aebd-ab6f58c977c7 tempest-ExtensionsTest-1959394093 tempest-ExtensionsTest-1959394093-project] 10.222.0.52 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.121619 May 14 21:29:43.590565 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2276/4935] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:29:43 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:29:43.599131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f37a6ad-83f7-47a7-b1d8-61a328e9df68 tempest-ExtensionsTest-1959394093 tempest-ExtensionsTest-1959394093-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:43.601254 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3f37a6ad-83f7-47a7-b1d8-61a328e9df68 tempest-ExtensionsTest-1959394093 tempest-ExtensionsTest-1959394093-project] 10.222.0.52 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005643 May 14 21:29:43.601752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2277/4936] 10.222.0.52 () {58 vars in 1133 bytes} [Sat May 14 21:29:43 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 21:29:43.652918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:43.653670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:43.660747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:43.661210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:43.661996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:43.662664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:43.744153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:43.753693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:43.755215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:43.756492 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2aed76bc-6b01-4d3f-aa20-683493e94045 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1356 microversion: 2.47 time: 0.108532 May 14 21:29:43.757066 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2278/4937] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:43 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1356 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:43.775183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:43.776788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:43.783000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:43.783465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:43.784285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:43.784725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:43.869368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:29:43.869809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:29:43.870321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:29:43.870864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:29:43.871286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:29:43.974359 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f20b2976-ec20-4397-bd0c-0360aa137492 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.362721 May 14 21:29:43.975291 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2660/4938] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:29:42 2022] POST /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments => generated 194 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:29:44.124088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:44.134300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:44.134848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:44.135906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:44.136495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:44.174437 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60e2b431-c59b-4946-8617-324b3dd240ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "POST /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda/action" status: 202 len: 1078 microversion: 2.47 time: 0.403223 May 14 21:29:44.175164 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2279/4939] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:29:43 2022] POST /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda/action => generated 1078 bytes in 405 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) May 14 21:29:44.191709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:44.192709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:44.199304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:44.200086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:44.201293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:44.201528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:44.310329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:44.328762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:44.330322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:44.331522 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b9244ec-cc30-4f24-a648-2cb9de524e81 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.145489 May 14 21:29:44.332304 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2661/4940] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:44 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:45.350263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:45.351661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:45.357802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:45.358310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:45.359971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:45.360738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:45.434422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:45.443088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:45.444755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:45.445956 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-17547dd2-90b6-4af3-9a60-75789e8e4f70 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.099764 May 14 21:29:45.446595 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2280/4941] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:45 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:46.465263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:46.465883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:46.474077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:46.474536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:46.475470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:46.476173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:46.542247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:46.550961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:46.552576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:46.553796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0852ecb8-d83c-4072-ab12-04d7cf4e94b3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.092599 May 14 21:29:46.554381 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2662/4942] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:46 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:47.573989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:47.573989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:47.581620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:47.584025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:47.585341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:47.585793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:47.660028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:47.668131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:47.669658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:47.670845 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64a662a7-9cbe-4be8-80c9-66f4cf4f16e5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.101706 May 14 21:29:47.671421 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2281/4943] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:47 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:48.310511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3d7bef2-cd53-4508-9fd9-b7613815d546"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:48.311731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:48.319201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.319738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.320529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.320977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.402433 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Invalid volume: volume e3d7bef2-cd53-4508-9fd9-b7613815d546 is already attached to instances: cb444169-fb87-45fa-a967-7df84f979a00 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments HTTP/1.1 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 74 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: {"volumeAttachment": {"volumeId": "e3d7bef2-cd53-4508-9fd9-b7613815d546"}} May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid volume: volume e3d7bef2-cd53-4508-9fd9-b7613815d546 is already attached to instances: cb444169-fb87-45fa-a967-7df84f979a00 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': 'cb444169-fb87-45fa-a967-7df84f979a00', 'body': {'volumeAttachment': {'volumeId': 'e3d7bef2-cd53-4508-9fd9-b7613815d546'}}} May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e3d7bef2-cd53-4508-9fd9-b7613815d546 is already attached to instances: cb444169-fb87-45fa-a967-7df84f979a00 May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:29:48.404253 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e3d7bef2-cd53-4508-9fd9-b7613815d546 is already attached to instances: cb444169-fb87-45fa-a967-7df84f979a00 May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e3d7bef2-cd53-4508-9fd9-b7613815d546 is already attached to instances: cb444169-fb87-45fa-a967-7df84f979a00 May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 400 to user: Invalid volume: volume e3d7bef2-cd53-4508-9fd9-b7613815d546 is already attached to instances: cb444169-fb87-45fa-a967-7df84f979a00 {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1ac6b242-31de-4b8d-8ff6-f7a0a933b8ce tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099312 May 14 21:29:48.410784 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2663/4944] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:29:48 2022] POST /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:29:48.468657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:48.469854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:48.476232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.476702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.477968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.478413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.577668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lazy-loading 'services' on Instance uuid cb444169-fb87-45fa-a967-7df84f979a00 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:29:48.690071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:48.690691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:48.697178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.697633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.698409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.698853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.769607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:48.781335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:48.782853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:48.784146 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f5ee59bd-83b1-4718-a1d5-e24e22a3123c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.098024 May 14 21:29:48.784730 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2664/4945] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:48 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:29:48.830541 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-145ab0a0-454f-4745-b798-b71ab9a9e951 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments/e3d7bef2-cd53-4508-9fd9-b7613815d546" status: 202 len: 0 microversion: 2.1 time: 0.365602 May 14 21:29:48.836112 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2282/4946] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:29:48 2022] DELETE /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments/e3d7bef2-cd53-4508-9fd9-b7613815d546 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:29:48.846783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eaa007fe-5472-461f-9368-cd7f452496c3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:48.848507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-eaa007fe-5472-461f-9368-cd7f452496c3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:48.857846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaa007fe-5472-461f-9368-cd7f452496c3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.858617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaa007fe-5472-461f-9368-cd7f452496c3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.860627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaa007fe-5472-461f-9368-cd7f452496c3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:48.861501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-eaa007fe-5472-461f-9368-cd7f452496c3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:48.907693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eaa007fe-5472-461f-9368-cd7f452496c3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067947 May 14 21:29:48.908300 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2665/4947] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:29:48 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:49.804185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:49.805130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:49.812983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:49.813448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:49.814389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:49.814838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:49.882833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:49.896382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:49.898273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:49.901304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cf34bcd-0e54-4e07-b4b7-b2d09cee036d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.099969 May 14 21:29:49.901304 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2283/4948] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:49 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:49.922117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9598c176-ec3d-414e-a29a-e0083e70a466 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:49.923070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9598c176-ec3d-414e-a29a-e0083e70a466 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:49.932548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9598c176-ec3d-414e-a29a-e0083e70a466 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:49.932548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9598c176-ec3d-414e-a29a-e0083e70a466 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:49.932548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9598c176-ec3d-414e-a29a-e0083e70a466 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:49.932548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9598c176-ec3d-414e-a29a-e0083e70a466 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:49.969813 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9598c176-ec3d-414e-a29a-e0083e70a466 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053700 May 14 21:29:49.970443 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2666/4949] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:29:49 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:50.929425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:50.930645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:50.937560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:50.938014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:50.938787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:50.939228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:50.981344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3095e778-42e0-4498-8cbf-3de48b596723 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:50.982500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3095e778-42e0-4498-8cbf-3de48b596723 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:50.990035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3095e778-42e0-4498-8cbf-3de48b596723 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:50.990490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3095e778-42e0-4498-8cbf-3de48b596723 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:50.991268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3095e778-42e0-4498-8cbf-3de48b596723 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:50.991739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3095e778-42e0-4498-8cbf-3de48b596723 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:51.003914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:51.012516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:51.014169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:51.015689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-36ce9b21-1ce4-462c-a16b-5f5e87919410 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.090379 May 14 21:29:51.017399 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2284/4950] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:50 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:51.023442 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3095e778-42e0-4498-8cbf-3de48b596723 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046162 May 14 21:29:51.024042 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2667/4951] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:29:50 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:29:51.082943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:51.083466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:51.089749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:51.090253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:51.091049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:51.091523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:51.118913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:29:51.425234 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1563dc5b-eb32-4f35-84d6-7f41ec6a0107 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 204 len: 0 microversion: 2.1 time: 0.345697 May 14 21:29:51.425792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2285/4952] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:29:51 2022] DELETE /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:29:51.434334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:51.435171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:51.441548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:51.442089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:51.442949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:51.443470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:51.584226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:51.592748 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7121848-05a8-4e39-87ef-a6281aaa54ef tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1682 microversion: 2.1 time: 0.162369 May 14 21:29:51.593329 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2668/4953] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:51 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:52.034626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:52.035357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:52.042119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:52.042582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:52.043349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:52.043888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:52.114503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:52.125596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:52.126053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:52.127308 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d706a0a6-c1a9-47c8-9e0e-a58a6dd6cd32 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.096965 May 14 21:29:52.127917 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2286/4954] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:52 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:52.614485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:52.615156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:52.622330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:52.622793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:52.623662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:52.624160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:52.762336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:52.776841 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-acd32048-3241-4882-8a33-73b867899ecc tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1682 microversion: 2.1 time: 0.165390 May 14 21:29:52.776841 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2669/4955] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:52 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:53.146298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:53.148876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:53.154822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:53.155287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:53.156662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:53.157112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:53.249677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:53.259108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:53.260677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:53.261898 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b8ba78a3-5bb7-4278-8968-3fe8c5a0f0c7 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.119794 May 14 21:29:53.271267 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2287/4956] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:53 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:53.796706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:53.799537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:53.807660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:53.808155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:53.808945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:53.809391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:53.895211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:53.909290 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f974944a-84b7-4711-80c6-2790ad31758e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1614 microversion: 2.1 time: 0.115638 May 14 21:29:53.913853 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2670/4957] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:53 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1614 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:29:54.188562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6a7086ce-0213-44d2-b5cb-3aaa9c07be16 req-4ad3de02-61ec-4cf1-9211-52c31ef0631e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb444169-fb87-45fa-a967-7df84f979a00", "name": "network-vif-deleted", "tag": "1b49f503-95db-4b59-ab25-ac9c8795cafa"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:54.197975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6a7086ce-0213-44d2-b5cb-3aaa9c07be16 req-4ad3de02-61ec-4cf1-9211-52c31ef0631e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:54.198425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6a7086ce-0213-44d2-b5cb-3aaa9c07be16 req-4ad3de02-61ec-4cf1-9211-52c31ef0631e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:54.210654 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6a7086ce-0213-44d2-b5cb-3aaa9c07be16 req-4ad3de02-61ec-4cf1-9211-52c31ef0631e service nova] Creating event network-vif-deleted:1b49f503-95db-4b59-ab25-ac9c8795cafa for instance cb444169-fb87-45fa-a967-7df84f979a00 on nch2-master-1 May 14 21:29:54.215698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6a7086ce-0213-44d2-b5cb-3aaa9c07be16 req-4ad3de02-61ec-4cf1-9211-52c31ef0631e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032585 May 14 21:29:54.231913 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2288/4958] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:29:54.282620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:54.283288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:54.290559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:54.292669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:54.292669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:54.292917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:54.378036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:54.401215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:54.402769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:54.417039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-80f6cfb7-b76e-45ab-90eb-5e100c54c05a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.139698 May 14 21:29:54.419662 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2671/4959] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:54 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:54.935790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:54.935790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:54.941584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:54.942149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:54.943165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:54.943677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:54.977024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:54.977400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:54.977862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lazy-loading 'fault' on Instance uuid cb444169-fb87-45fa-a967-7df84f979a00 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:29:55.024755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:55.033060 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e596efb9-c23b-4216-8386-f03a78a83ef0 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 200 len: 1332 microversion: 2.1 time: 0.105583 May 14 21:29:55.033642 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2289/4960] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:54 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 1332 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:55.439788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:55.440435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:55.450452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:55.451069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:55.452076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:55.452647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:55.527033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:55.536309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:55.537846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:55.539041 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b4548916-b281-461c-bb31-540f337acfec tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.105303 May 14 21:29:55.539637 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2672/4961] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:55 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:56.058744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:56.058744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:56.065524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:56.065988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:56.066769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:56.067220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:56.080704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 HTTP/1.1 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'cb444169-fb87-45fa-a967-7df84f979a00'} May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:29:56.082368 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-91b2b73e-7bea-4c34-b693-87a4d981c9b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 404 len: 111 microversion: 2.1 time: 0.029883 May 14 21:29:56.088085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2290/4962] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:56 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:29:56.093052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6a5359de-ae5d-4b1b-9035-ebc024b92923 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '.version_select at 0x7fb1a6fc7ee0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:56.185251 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6a5359de-ae5d-4b1b-9035-ebc024b92923 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061595565" status: 202 len: 0 microversion: 2.1 time: 0.095978 May 14 21:29:56.185976 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2673/4963] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2061595565 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:29:56.558316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:56.558939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:56.567456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:56.567845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:56.568627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:56.569068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:56.571172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:56.572433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:56.584732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:56.588097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:56.588969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:56.589526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:56.659709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:56.669850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:56.672013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:56.674061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e15f4de-105d-4242-9ee6-fc7fec1bd438 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.118983 May 14 21:29:56.674695 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2291/4964] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:56 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:56.705220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lazy-loading 'services' on Instance uuid 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:29:57.017942 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b2069536-118b-43fb-9aa7-096505b19edf tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-volume_attachments/fe4b9b45-3bd4-47a6-bd85-901d2fa90799" status: 202 len: 0 microversion: 2.1 time: 0.452144 May 14 21:29:57.018551 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2674/4965] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:29:56 2022] DELETE /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-volume_attachments/fe4b9b45-3bd4-47a6-bd85-901d2fa90799 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:29:57.028618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-465343f8-210d-42ea-84be-aad1df89706e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: .version_select at 0x7fb1a7dfa430>, body: {"keypair": {"name": "tempest-keypair-1105276351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD55MbVvG8+u/qOhyPURsiFCnrp/tNhiMTsBcPHbwOsyYdu+vVYi+BHesyscpvSnLbU/QJlc/pYAgY33R9ux8RgpeKd9NZkMSTWKvdpIFn9Pth1sdCT1eM7F6lEn/PuJKw=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:57.049976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-465343f8-210d-42ea-84be-aad1df89706e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:29:57.052096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-465343f8-210d-42ea-84be-aad1df89706e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:29:57.238425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-465343f8-210d-42ea-84be-aad1df89706e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.219675 May 14 21:29:57.240890 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2292/4966] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:29:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:29:57.695381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:57.696129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:57.703631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:57.704223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:57.705035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:57.705483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:57.778265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:57.787953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:57.790074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:57.791279 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4ddba5c6-d2b8-4587-a7d1-0a4bba4a6939 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.101141 May 14 21:29:57.795617 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2675/4967] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:57 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:58.132529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc0300c0-e0e7-433e-bcfb-559d9f4f4a28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:58.141546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc0300c0-e0e7-433e-bcfb-559d9f4f4a28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:58.141546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc0300c0-e0e7-433e-bcfb-559d9f4f4a28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:58.169126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc0300c0-e0e7-433e-bcfb-559d9f4f4a28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Going to try to stop instance {{(pid=130637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:29:58.473197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc0300c0-e0e7-433e-bcfb-559d9f4f4a28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action" status: 202 len: 0 microversion: 2.1 time: 0.346066 May 14 21:29:58.474783 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2293/4968] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:29:58 2022] POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:29:58.483307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:58.484953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:58.492084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:58.494397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:58.494397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:58.494397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:58.637057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:58.646257 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c7b0bd0f-8131-4e97-a3da-a2da84635a21 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.166880 May 14 21:29:58.648561 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2676/4969] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:58 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:58.810937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:58.811898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:58.819230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:58.819791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:58.820795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:58.821297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:58.938779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:58.961595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:58.963650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:58.965210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f023f505-866b-4cfd-b41d-6d5ff216a2a3 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.158727 May 14 21:29:58.965792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2294/4970] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:58 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:29:59.663822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:59.664451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:59.672185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:59.673955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:59.673955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:29:59.674603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:29:59.841532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:29:59.851873 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0aa271f8-6336-4665-aa27-063e996e59fe tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.191914 May 14 21:29:59.853332 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2677/4971] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:29:59 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:29:59.954891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1930162042", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afd341be-651f-4dc3-82bf-83f603d58628"}], "security_groups": [{"name": "tempest-securitygroup--822475590"}], "key_name": "tempest-keypair-1105276351", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:29:59.986850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:29:59.988033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:29:59.999108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:00.002158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:00.004001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:00.016236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:00.092434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] validate_networks() for [('afd341be-651f-4dc3-82bf-83f603d58628', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:30:00.103060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:00.115240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:00.117164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:00.119090 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf09c021-6047-4144-9b75-c973a5a3a143 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.137257 May 14 21:30:00.121278 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2678/4972] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:29:59 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:00.497995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:30:00.498634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:30:00.499185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:30:00.500299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:30:00.501001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:30:00.510634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:00.511163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:00.512381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:00.512784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:00.531929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:30:00.538560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Getting quotas for user 1e3390c9579a4f598c46f9417b4dd046 and project 8bd6f25048cd4798985e725f734f1845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:30:00.551905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:30:00.554576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:30:00.736154 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-81726724-3363-468d-a2ea-f6ff55bcd999 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.791476 May 14 21:30:00.737059 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2295/4973] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:29:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:30:00.746765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0dd9c3d-c4ef-4324-9d5e-c9f4042b7e68 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:00.748153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a0dd9c3d-c4ef-4324-9d5e-c9f4042b7e68 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:00.804337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a0dd9c3d-c4ef-4324-9d5e-c9f4042b7e68 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:00.811428 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a0dd9c3d-c4ef-4324-9d5e-c9f4042b7e68 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1242 microversion: 2.1 time: 0.068503 May 14 21:30:00.813096 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2679/4974] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:00 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:00.870428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:00.871042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:00.878817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:00.879272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:00.880500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:00.881046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:01.044659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:01.061562 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9b75676e-bf86-4c77-b459-056c71893ecc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.188028 May 14 21:30:01.062747 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2296/4975] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:00 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:01.140484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:01.141485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:01.148806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:01.149571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:01.150560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:01.151579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:01.239504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:01.248621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:01.250236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:01.252315 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e8fe6c25-640d-46ab-a954-595e2d88eb1d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.116521 May 14 21:30:01.252944 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2680/4976] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:01 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:01.830611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:01.831297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:01.837761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:01.838225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:01.839015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:01.839516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:01.905463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:01.913474 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-33d3adcf-5e9c-4e46-8abd-b0747b14a2e3 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1246 microversion: 2.1 time: 0.087893 May 14 21:30:01.914788 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2297/4977] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:01 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:02.084561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:02.086774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:02.095451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:02.096094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:02.096916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:02.097363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:02.271471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:02.272916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:02.280262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:02.287207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:02.293592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:02.294605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:02.295241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:02.295868 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-539611da-5a27-4c3b-bcd6-11a163d56f73 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.218382 May 14 21:30:02.301868 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2681/4978] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:02 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:02.382923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:02.393324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:02.395191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:02.397610 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-36571165-5366-4f01-a335-66fbd7f90563 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.130200 May 14 21:30:02.400227 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2298/4979] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:02 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:02.931314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:02.931994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:02.940323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:02.941021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:02.942013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:02.942704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:03.010374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:03.018663 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-57e8cd6a-990f-4b0e-9704-6b84b4d40d2b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1294 microversion: 2.1 time: 0.091838 May 14 21:30:03.019581 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2682/4980] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:02 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:03.315717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:03.316312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:03.324853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:03.325313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:03.326274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:03.326718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:03.421046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:03.422332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:03.429491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:03.430093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:03.431058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:03.431521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:03.482171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:03.494035 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-337a5e12-bc62-4be8-b7ff-3446da033e65 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.183749 May 14 21:30:03.494949 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2299/4981] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:03 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:03.517320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:03.525585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:03.527114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:03.528317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43106100-ed89-4133-ac9b-abe36186ad7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.111811 May 14 21:30:03.528964 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2683/4982] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:03 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:04.042186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:04.043114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:04.053275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:04.054084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:04.055466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:04.056331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:04.275606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:04.283784 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-858dace7-887a-4a87-9608-093c8b71ad09 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1367 microversion: 2.1 time: 0.245750 May 14 21:30:04.284425 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2300/4983] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:04 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:04.512186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:04.513231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:04.520887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:04.521357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:04.522150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:04.522631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:04.548330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:04.548962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:04.555643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:04.556104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:04.556879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:04.557324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:04.624147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:04.632920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:04.645504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:04.646745 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4072a754-6c3b-4228-9f8f-af572499a90b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.103471 May 14 21:30:04.647681 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2301/4984] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:04 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:04.670607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:04.683871 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f4f0d57b-2c55-45ad-9d03-dc8eed71960a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.175313 May 14 21:30:04.686568 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2684/4985] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:04 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:04.994753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-90166cdd-92f7-439b-aa84-ad3198fdae60 req-1870de62-4efb-4cda-b072-0fc90e1ef825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b21a9c-db83-4565-bb10-82a25f2c2f73", "tag": "e5d49f69-5adf-446a-833b-443aa05619fb"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:05.014694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90166cdd-92f7-439b-aa84-ad3198fdae60 req-1870de62-4efb-4cda-b072-0fc90e1ef825 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:05.016236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90166cdd-92f7-439b-aa84-ad3198fdae60 req-1870de62-4efb-4cda-b072-0fc90e1ef825 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:05.029172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-90166cdd-92f7-439b-aa84-ad3198fdae60 req-1870de62-4efb-4cda-b072-0fc90e1ef825 service nova] Creating event network-changed:e5d49f69-5adf-446a-833b-443aa05619fb for instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 on nch1-master-1 May 14 21:30:05.034873 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-90166cdd-92f7-439b-aa84-ad3198fdae60 req-1870de62-4efb-4cda-b072-0fc90e1ef825 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043633 May 14 21:30:05.035520 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2302/4986] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:05.303866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:05.304572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:05.311229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:05.311982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:05.313908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:05.314755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:05.466281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:05.474451 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-48f880a9-afea-496b-9ccc-d3681168a5a8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1367 microversion: 2.1 time: 0.177950 May 14 21:30:05.483727 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2685/4987] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:05 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:05.667912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:05.668690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:05.676204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:05.676667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:05.678208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:05.678960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:05.703251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:05.705385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:05.721590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:05.722606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:05.723631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:05.724146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:05.789474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:05.803199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:05.804728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:05.806144 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09a2a86e-3998-47a6-a004-2a070875906b tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.143692 May 14 21:30:05.807201 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2303/4988] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:05 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:05.889623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:05.898828 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04ffdd67-bc07-494f-a5c5-8dd8389b06ce tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.201181 May 14 21:30:05.899348 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2686/4989] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:05 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:06.491496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:06.496215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:06.499525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:06.500318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:06.500839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:06.501288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:06.643928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:06.651546 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4761d73-1529-425b-8ebe-aa89835b6c56 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1367 microversion: 2.1 time: 0.164014 May 14 21:30:06.652125 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2304/4990] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:06 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:06.825602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:06.826257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:06.834053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:06.834514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:06.835290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:06.835762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:06.902545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:06.910697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:06.912273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:06.913575 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82fbb316-fe48-43eb-9d0a-f49aa19d9f4d tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.092011 May 14 21:30:06.914189 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2687/4991] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:06 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:06.918350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:06.920884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:06.930034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:06.934028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:06.934943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:06.935408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:07.074817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:07.082676 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d0ba1bdb-2674-435b-8290-22cc975943e7 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.169600 May 14 21:30:07.083263 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2305/4992] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:06 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:07.668946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:07.669609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:07.676082 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:07.684388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:07.684388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:07.684388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:07.810323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:07.823424 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-63238044-d07d-44a4-a2cd-8c553fea1a58 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1367 microversion: 2.1 time: 0.158454 May 14 21:30:07.824305 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2688/4993] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:07 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:07.934523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:07.935140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:07.942645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:07.943100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:07.944135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:07.944582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:08.011460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:08.020583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:08.022099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:08.023267 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ac32c80-ee98-4912-b189-c46efa790847 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.092674 May 14 21:30:08.023854 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2306/4994] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:07 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:08.099573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:08.100211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:08.107133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:08.107642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:08.108432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:08.108883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:08.259808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:08.268232 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-482ec4ed-edef-4bd8-8ccd-0ef3aa217c81 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1675 microversion: 2.1 time: 0.172647 May 14 21:30:08.268960 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2689/4995] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:08 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:08.842624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:08.843400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:08.850906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:08.851468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:08.855960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:08.855960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:09.022834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:09.030438 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2552dbf8-c338-402d-b896-c4c695420cfa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1367 microversion: 2.1 time: 0.192166 May 14 21:30:09.031070 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2307/4996] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:08 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:09.042649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:09.043309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:09.050345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:09.050800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:09.051597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:09.052037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:09.132956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:09.137920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:09.139763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:09.141778 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e932d00b-9191-4450-8966-08b647875d7a tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.103241 May 14 21:30:09.142381 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2690/4997] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:09 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:09.286352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:09.287131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:09.293374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:09.293840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:09.294662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:09.295138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:09.426441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:09.434135 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c5f5053-c2db-4638-917a-c9012506a053 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1652 microversion: 2.1 time: 0.152742 May 14 21:30:09.434726 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2308/4998] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:09 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1652 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:09.451189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-195fd57b-b4ea-4dd0-934b-a44197660857 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:09.458409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-195fd57b-b4ea-4dd0-934b-a44197660857 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:09.461775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-195fd57b-b4ea-4dd0-934b-a44197660857 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:09.483446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-195fd57b-b4ea-4dd0-934b-a44197660857 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Going to try to start instance {{(pid=130638) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 21:30:09.666245 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-195fd57b-b4ea-4dd0-934b-a44197660857 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action" status: 202 len: 0 microversion: 2.1 time: 0.219042 May 14 21:30:09.669089 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2691/4999] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:30:09 2022] POST /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:30:09.677164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:09.678053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:09.687456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:09.689500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:09.690790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:09.691397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:10.049397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:10.050391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:10.057730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:10.058384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:10.059177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:10.059967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:10.196497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:10.208308 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-56aff32d-d313-4331-9f96-3d051a91b45d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1661 microversion: 2.1 time: 0.535410 May 14 21:30:10.209226 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2309/5000] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:09 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1661 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:10.215739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:10.217774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:10.225980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:10.226223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:10.227010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:10.227864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:10.241940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:10.259631 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6acecfa-0049-455e-837c-eeb3384e9f59 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1367 microversion: 2.1 time: 0.215517 May 14 21:30:10.261115 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2692/5001] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:10 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:10.350228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:10.354603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:10.356164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:10.357438 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-74de5055-994e-4f2a-be3a-91cbe69e844c tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.146384 May 14 21:30:10.357993 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2310/5002] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:10 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:10.903658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8b0a596e-888e-47b2-bef2-055661163cc8 req-dfdec0f2-467c-42ba-893a-6ee5378d0897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b21a9c-db83-4565-bb10-82a25f2c2f73", "name": "network-vif-plugged", "status": "completed", "tag": "e5d49f69-5adf-446a-833b-443aa05619fb"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:10.912797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8b0a596e-888e-47b2-bef2-055661163cc8 req-dfdec0f2-467c-42ba-893a-6ee5378d0897 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:10.913251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8b0a596e-888e-47b2-bef2-055661163cc8 req-dfdec0f2-467c-42ba-893a-6ee5378d0897 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:10.926482 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8b0a596e-888e-47b2-bef2-055661163cc8 req-dfdec0f2-467c-42ba-893a-6ee5378d0897 service nova] Creating event network-vif-plugged:e5d49f69-5adf-446a-833b-443aa05619fb for instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 on nch1-master-1 May 14 21:30:10.931515 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8b0a596e-888e-47b2-bef2-055661163cc8 req-dfdec0f2-467c-42ba-893a-6ee5378d0897 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031764 May 14 21:30:10.932529 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2693/5003] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:11.226009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:11.226635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:11.233567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:11.234058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:11.235388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:11.235866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:11.278670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:11.279352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:11.286457 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:11.286661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:11.287383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:11.287870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:11.383006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:11.391439 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b7917a9-9dd8-4357-98bc-75b257ac3946 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1661 microversion: 2.1 time: 0.169300 May 14 21:30:11.392105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2311/5004] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:11 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1661 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:11.397057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:11.397886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:11.404175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:11.408227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:11.410017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:11.410759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:11.456016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:11.479265 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28acc4c4-349b-4b97-bc63-2931b61573fa tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1367 microversion: 2.1 time: 0.205720 May 14 21:30:11.479927 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2694/5005] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:11 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:11.485668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:11.496815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:11.498344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:11.499571 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-81fd1836-15b1-4cb9-bb2e-4020490300b4 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.106464 May 14 21:30:11.500918 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2312/5006] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:11 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:12.409292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:12.412944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:12.419634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.420142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.420974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.421425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.498323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:12.498959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:12.506498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.506987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.507921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.508376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.572582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:12.581110 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ad1a41cc-def7-40da-82b9-928af785a713 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1665 microversion: 2.1 time: 0.176836 May 14 21:30:12.581877 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2695/5007] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:12 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:12.586843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:12.587750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:12.596102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.596602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.597401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.597845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.664192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:12.673050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:12.674588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:12.676166 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8fb5889f-c4c5-4d03-bb83-4538599d9f3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.093347 May 14 21:30:12.676817 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2696/5008] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:12 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:12.698297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:12.706706 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c556d2f6-7554-4943-b817-8a8ea9773404 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1557 microversion: 2.1 time: 0.212261 May 14 21:30:12.708612 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2313/5009] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:12 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1557 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:12.713919 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4aa8e7cf-785c-4fbe-8ea3-624fa10904af tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:12.715078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4aa8e7cf-785c-4fbe-8ea3-624fa10904af tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:12.723021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4aa8e7cf-785c-4fbe-8ea3-624fa10904af tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.724896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de3f8df2-c4c6-42b3-8d50-35eed87ff575 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:12.725632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de3f8df2-c4c6-42b3-8d50-35eed87ff575 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:12.726266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4aa8e7cf-785c-4fbe-8ea3-624fa10904af tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.727202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4aa8e7cf-785c-4fbe-8ea3-624fa10904af tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.727747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4aa8e7cf-785c-4fbe-8ea3-624fa10904af tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.733267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de3f8df2-c4c6-42b3-8d50-35eed87ff575 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.733748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de3f8df2-c4c6-42b3-8d50-35eed87ff575 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.735299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de3f8df2-c4c6-42b3-8d50-35eed87ff575 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.736059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de3f8df2-c4c6-42b3-8d50-35eed87ff575 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.762434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4aa8e7cf-785c-4fbe-8ea3-624fa10904af tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments/d520492e-c3a1-42a9-a065-6b741defc4c0" status: 200 len: 194 microversion: 2.20 time: 0.052500 May 14 21:30:12.763043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2697/5010] 10.222.0.52 () {60 vars in 1453 bytes} [Sat May 14 21:30:12 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments/d520492e-c3a1-42a9-a065-6b741defc4c0 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:30:12.822900 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de3f8df2-c4c6-42b3-8d50-35eed87ff575 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100817 May 14 21:30:12.822900 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2314/5011] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:30:12 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:30:12.829178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:12.829680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:12.836131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.836589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.837370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:12.837817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:12.955279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lazy-loading 'services' on Instance uuid 4097156a-300a-4d17-87df-60620c836925 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:30:13.153458 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d605fde2-b157-440c-b17b-8fb14edd1a97 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments/d520492e-c3a1-42a9-a065-6b741defc4c0" status: 202 len: 0 microversion: 2.20 time: 0.328722 May 14 21:30:13.157415 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2698/5012] 10.222.0.52 () {60 vars in 1456 bytes} [Sat May 14 21:30:12 2022] DELETE /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments/d520492e-c3a1-42a9-a065-6b741defc4c0 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:30:13.162625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6825219-e3b3-4bc9-acad-3cc52c6ed2f8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:13.163778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c6825219-e3b3-4bc9-acad-3cc52c6ed2f8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:13.170945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6825219-e3b3-4bc9-acad-3cc52c6ed2f8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:13.171904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6825219-e3b3-4bc9-acad-3cc52c6ed2f8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:13.172775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6825219-e3b3-4bc9-acad-3cc52c6ed2f8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:13.173320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6825219-e3b3-4bc9-acad-3cc52c6ed2f8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:13.210110 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c6825219-e3b3-4bc9-acad-3cc52c6ed2f8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051287 May 14 21:30:13.217329 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2315/5013] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:30:13 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:30:13.696820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:13.697654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:13.706455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:13.706923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:13.707880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:13.708336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:14.120673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:14.131760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:14.133476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:14.134693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b3d12735-304f-4cdc-9337-3903cb77f346 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.443666 May 14 21:30:14.135606 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2699/5014] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:13 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:14.233791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd41395b-537f-4803-84d7-50b8284ca639 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:14.235903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd41395b-537f-4803-84d7-50b8284ca639 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:14.244923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd41395b-537f-4803-84d7-50b8284ca639 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:14.245714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd41395b-537f-4803-84d7-50b8284ca639 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:14.246704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd41395b-537f-4803-84d7-50b8284ca639 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:14.247317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd41395b-537f-4803-84d7-50b8284ca639 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:14.288534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd41395b-537f-4803-84d7-50b8284ca639 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060867 May 14 21:30:14.289339 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2316/5015] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:30:14 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:30:14.336906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fb59fbfe-22c8-4d1b-8074-808c07ad507f req-a6f6823a-1482-4a30-b872-fe5da05765eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b21a9c-db83-4565-bb10-82a25f2c2f73", "tag": "e5d49f69-5adf-446a-833b-443aa05619fb"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:14.345901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fb59fbfe-22c8-4d1b-8074-808c07ad507f req-a6f6823a-1482-4a30-b872-fe5da05765eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:14.346352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fb59fbfe-22c8-4d1b-8074-808c07ad507f req-a6f6823a-1482-4a30-b872-fe5da05765eb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:14.357620 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fb59fbfe-22c8-4d1b-8074-808c07ad507f req-a6f6823a-1482-4a30-b872-fe5da05765eb service nova] Creating event network-changed:e5d49f69-5adf-446a-833b-443aa05619fb for instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 on nch1-master-1 May 14 21:30:14.363281 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fb59fbfe-22c8-4d1b-8074-808c07ad507f req-a6f6823a-1482-4a30-b872-fe5da05765eb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030230 May 14 21:30:14.363944 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2700/5016] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:15.154881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:15.155516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:15.168767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.168767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:15.168767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.168767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:15.241132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:15.250480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:15.252284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:15.253518 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-48f41a24-ddb2-4fa0-92aa-8f41834523fb tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.102672 May 14 21:30:15.254079 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2317/5017] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:15 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:15.301881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ac0b3eb-2c96-42d8-9aa2-12583cbc0a51 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:15.312901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ac0b3eb-2c96-42d8-9aa2-12583cbc0a51 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:15.312901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ac0b3eb-2c96-42d8-9aa2-12583cbc0a51 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.312901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ac0b3eb-2c96-42d8-9aa2-12583cbc0a51 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:15.312901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ac0b3eb-2c96-42d8-9aa2-12583cbc0a51 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.312901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7ac0b3eb-2c96-42d8-9aa2-12583cbc0a51 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:15.346188 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7ac0b3eb-2c96-42d8-9aa2-12583cbc0a51 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049512 May 14 21:30:15.347036 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2701/5018] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:30:15 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:15.415575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:15.416147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:15.422606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.423405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:15.424227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.424695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:15.453140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:30:15.914110 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-043a50e1-fe77-469b-a375-e5767eda20d8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 204 len: 0 microversion: 2.20 time: 0.502172 May 14 21:30:15.914764 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2318/5019] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:30:15 2022] DELETE /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:30:15.924268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:15.925138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:15.931791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.932534 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:15.933196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:15.933641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:16.080746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:16.088797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:16.090386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:16.091590 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-547f7cf4-a20c-42be-95c7-ea17c7b8f850 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.172388 May 14 21:30:16.092175 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2702/5020] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:15 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:16.276187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:16.277022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:16.284342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:16.285977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:16.285977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:16.286214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:16.363177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:16.371361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:16.372911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:16.374091 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4bf512e3-5237-4816-b18b-1ffc17c3722f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1365 microversion: 2.47 time: 0.103966 May 14 21:30:16.374666 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2319/5021] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:16 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:17.111944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:17.112893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:17.120374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:17.125450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:17.125450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:17.125450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:17.263966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:17.273063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:17.274939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:17.276155 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7da315b1-7ae0-421f-a590-1007f8de809a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.169941 May 14 21:30:17.276733 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2703/5022] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:17 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:17.393553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:17.394459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:17.401561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:17.402018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:17.403014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:17.403665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:17.534207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:17.549735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:17.551694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:17.553208 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2737a4a8-a2c7-4ca8-b189-e4c5b2933b91 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1383 microversion: 2.47 time: 0.164184 May 14 21:30:17.554108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2320/5023] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:17 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1383 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:18.301598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:18.302873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:18.309591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:18.310247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:18.311224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:18.311935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:18.464465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:18.471511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:18.473475 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:18.475025 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fda6adb2-f0b2-4447-817a-ef834426251a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1722 microversion: 2.20 time: 0.184496 May 14 21:30:18.475848 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2704/5024] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:18 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:18.573125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:18.582500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:18.582500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:18.587693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:18.588538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:18.594270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:18.696500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:18.707057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:18.709187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:18.710589 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-49037e02-2d27-4452-a717-f12d9ccf1eb5 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1371 microversion: 2.47 time: 0.141391 May 14 21:30:18.711717 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2321/5025] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:18 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:18.953313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-16a1fdc7-bd56-42ae-a97b-a2c7d269fdbe req-6eb47866-03ca-4c1a-9a1c-60cfa9b8197b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4097156a-300a-4d17-87df-60620c836925", "name": "network-vif-deleted", "tag": "5c660063-0f23-4b2d-b5ca-12d4f3ea2036"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:18.968970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-16a1fdc7-bd56-42ae-a97b-a2c7d269fdbe req-6eb47866-03ca-4c1a-9a1c-60cfa9b8197b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:18.969622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-16a1fdc7-bd56-42ae-a97b-a2c7d269fdbe req-6eb47866-03ca-4c1a-9a1c-60cfa9b8197b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:18.983333 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-16a1fdc7-bd56-42ae-a97b-a2c7d269fdbe req-6eb47866-03ca-4c1a-9a1c-60cfa9b8197b service nova] Creating event network-vif-deleted:5c660063-0f23-4b2d-b5ca-12d4f3ea2036 for instance 4097156a-300a-4d17-87df-60620c836925 on nch2-master-1 May 14 21:30:18.989305 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-16a1fdc7-bd56-42ae-a97b-a2c7d269fdbe req-6eb47866-03ca-4c1a-9a1c-60cfa9b8197b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040623 May 14 21:30:18.990477 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2705/5026] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:30:19.494072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:19.494978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:19.506161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:19.506522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:19.507763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:19.508378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:19.549426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:19.549891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:19.550427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lazy-loading 'fault' on Instance uuid 4097156a-300a-4d17-87df-60620c836925 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:30:19.611341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:19.630697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:19.632349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:19.633567 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ecf5d11a-78dc-4376-9eab-463981287917 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 200 len: 1371 microversion: 2.20 time: 0.143505 May 14 21:30:19.649574 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2322/5027] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:19 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:19.732009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:19.732704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:19.749815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:19.750287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:19.751355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:19.752068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:19.869006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:19.879527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:19.881098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:19.884135 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71fa8621-9c17-496d-b8c7-4291cf509521 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1371 microversion: 2.47 time: 0.157500 May 14 21:30:19.884725 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2706/5028] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:19 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:20.659353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:20.660772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:20.669259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:20.669740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:20.670551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:20.671011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:20.689619 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] HTTP exception thrown: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Request method failure captured: May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 HTTP/1.1 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB604rebpQeLnyYI852JXnERPYC8krWfoXtVWkh4nDcimyiojWSh2eGdPTLybHYevbyIK-Pa-gSj3ZDPEuMi3deCkuSSS48R-w6YMG5zWSLw9zar0yUOCC0XTqv5Y3AlVsXuKwKTyVDwQcSLFd7xRiCasmFSoIa1Ds_2eKFjDywncr4 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.20 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4989c480608c4b86bd1cd7615fba4d20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 04e48304473d40ebb8c0c5386c4c3592 May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '4097156a-300a-4d17-87df-60620c836925'} May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:20.691346 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Returning 404 to user: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-096d927e-d748-4c64-9716-fd647bf631c8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 404 len: 111 microversion: 2.20 time: 0.039971 May 14 21:30:20.697167 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2323/5029] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:20 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:30:20.703660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6f8af94-5739-4a36-986e-def2305d3b59 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '.version_select at 0x7fb1a7018ee0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:20.778449 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6f8af94-5739-4a36-986e-def2305d3b59 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973558508" status: 204 len: 0 microversion: 2.20 time: 0.079627 May 14 21:30:20.779114 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2707/5030] 10.222.0.52 () {60 vars in 1258 bytes} [Sat May 14 21:30:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973558508 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:30:20.903880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:20.904509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:20.911559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:20.912015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:20.913232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:20.914174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:20.985328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:20.994980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:20.996730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:20.998237 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6414c341-3760-47e0-8a80-8a9f868e40ff tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1356 microversion: 2.47 time: 0.098439 May 14 21:30:20.998878 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2324/5031] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:20 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:21.018010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:21.021481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:21.022382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Searching by: {'deleted': False, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:30:21.029173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.029838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.030664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.031533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.159787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:30:21.255002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:21.262228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.262687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.274369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:21.275920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:21.317679 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0efe1585-189f-4220-b309-e9f1e286d745 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.303948 May 14 21:30:21.318290 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2708/5032] 10.222.0.52 () {60 vars in 1186 bytes} [Sat May 14 21:30:21 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:21.344366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:21.344874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:21.350721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.351211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.352006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.352735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.378211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:30:21.547694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-20b1bd7e-468f-4908-9111-67b4b63aef7a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:21.548847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-20b1bd7e-468f-4908-9111-67b4b63aef7a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:21.555900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20b1bd7e-468f-4908-9111-67b4b63aef7a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.556360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20b1bd7e-468f-4908-9111-67b4b63aef7a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.557142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20b1bd7e-468f-4908-9111-67b4b63aef7a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.557587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20b1bd7e-468f-4908-9111-67b4b63aef7a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.618262 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-20b1bd7e-468f-4908-9111-67b4b63aef7a tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "POST /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90/action" status: 200 len: 32492 microversion: 2.42 time: 0.076431 May 14 21:30:21.619427 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2709/5033] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:30:21 2022] POST /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90/action => generated 32492 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 14 21:30:21.634152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:21.634970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:21.644481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.644788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.645600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.646229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.677480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:30:21.735150 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a79c855a-31c9-45c3-b38c-2fd066e4c6a2 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "DELETE /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 204 len: 0 microversion: 2.47 time: 0.393847 May 14 21:30:21.735940 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2325/5034] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:30:21 2022] DELETE /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:30:21.750875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:21.751934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:21.758578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.759032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.760377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:21.760830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:21.866040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:21.879625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:21.881859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:21.883757 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a81aa592-3c2c-420f-920e-2037e08f79e6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1362 microversion: 2.47 time: 0.137977 May 14 21:30:21.884622 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2326/5035] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:21 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:21.894923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb525f0a-ea88-46f6-aa7c-a316a1a92886 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'create', calling method: .version_select at 0x7fb1a7d9ad30>, body: {"keypair": {"name": "tempest-keypair-994967664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHB75nN4oD8o1c9j95SLOluxhTVnzkAVv5Y4j/4/sKSncOKyce3pVdKD0GsMX8cLQqCi0d9WI6asHmlnEuaCvTyT4LGF2mQB724fjrmhYgeAM3ucPPvw+0AIdcCKGN33eQ=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:21.912930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-eb525f0a-ea88-46f6-aa7c-a316a1a92886 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:30:21.934901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-eb525f0a-ea88-46f6-aa7c-a316a1a92886 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for user 04e48304473d40ebb8c0c5386c4c3592 and project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:30:22.001088 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84c0e141-78b7-49b9-a9e9-1dfcbbbd41ce tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "DELETE /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 204 len: 0 microversion: 2.42 time: 0.373767 May 14 21:30:22.001803 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2710/5036] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:30:21 2022] DELETE /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:30:22.010586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:22.011317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:22.017647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:22.018743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:22.019767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:22.020230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:22.033219 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb525f0a-ea88-46f6-aa7c-a316a1a92886 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.145830 May 14 21:30:22.033858 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2327/5037] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:30:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 148 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 21:30:22.237081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:22.246298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:22.247888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:22.249163 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b751e3c-440d-4a2b-a2ca-bfcc70b2c1ea tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2963 microversion: 2.42 time: 0.242864 May 14 21:30:22.250743 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2711/5038] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:22 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2963 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:22.907949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:22.909368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:22.917552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:22.918013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:22.918825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:22.919296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:22.989896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:22.998688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:23.000926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:23.002326 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-721d97af-32c2-4541-a290-a0a889ebb529 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1362 microversion: 2.47 time: 0.098770 May 14 21:30:23.003107 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2328/5039] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:22 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1362 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:23.272922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:23.273671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:23.281642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:23.281930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:23.282906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:23.283589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:23.626578 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:23.637243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:23.639413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:23.642684 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0abd4858-bf24-4bcb-b0d2-e073f689690f tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2963 microversion: 2.42 time: 0.373773 May 14 21:30:23.643523 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2712/5040] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:23 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2963 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:24.025821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:24.027106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:24.042941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:24.043656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:24.049515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:24.049515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:24.091797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:24.092254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:24.092719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lazy-loading 'fault' on Instance uuid 81dab7b9-07c5-42e6-b9e1-6c71402bbbda {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:30:24.165787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:24.175523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:24.179831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:24.179831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b9a9d6f-c111-4eef-b2c2-260b7cd79a42 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 200 len: 1367 microversion: 2.47 time: 0.156855 May 14 21:30:24.179831 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2329/5041] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:24 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:24.663763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:24.664987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:24.681393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:24.682176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:24.683750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:24.684788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:24.902100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-615780330", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cc7003c-2823-48d0-8842-9a2e7e084a2e"}], "security_groups": [{"name": "tempest-securitygroup--229165867"}], "key_name": "tempest-keypair-994967664", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:24.912007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:24.921714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:24.923244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:24.925467 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-457a089d-08f0-40cf-94d4-d7927c876671 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2942 microversion: 2.42 time: 0.265684 May 14 21:30:24.926243 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2713/5042] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:24 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2942 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:25.022530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] validate_networks() for [('4cc7003c-2823-48d0-8842-9a2e7e084a2e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:30:25.199903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:25.200621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 81dab7b9-07c5-42e6-b9e1-6c71402bbbda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:25.208419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.208875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:25.209918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.210759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:25.241221 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] HTTP exception thrown: Instance 81dab7b9-07c5-42e6-b9e1-6c71402bbbda could not be found. May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Request method failure captured: May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda HTTP/1.1 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB9Avzxk3Wc2tWeNTNzYVNbO0D9C9qZclYSACSap1nQO7_yQa_cIHcQ7sLzWTjYAhbeyOLq_ngNKpgP6UaycnDBmVxyVzmK5OMFE3Srs9UdhLrnRlr7iJmjvZBScBY2jZnt9qjECsM3PuJKrOlywS43kRoH-JmTEk7FCmQUmg2F9jRs May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.47 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f43cf27f7a634cb4adb7865a7e8b7838 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerShowV247Test-2078379159 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f43cf27f7a634cb4adb7865a7e8b7838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f43cf27f7a634cb4adb7865a7e8b7838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f43cf27f7a634cb4adb7865a7e8b7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f43cf27f7a634cb4adb7865a7e8b7838", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerShowV247Test-2078379159 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f43cf27f7a634cb4adb7865a7e8b7838 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerShowV247Test-2078379159 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerShowV247Test-2078379159-project May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b75ffa8886d946e3ae228f737b193198 May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerShowV247Test-2078379159-project May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 81dab7b9-07c5-42e6-b9e1-6c71402bbbda could not be found. May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '81dab7b9-07c5-42e6-b9e1-6c71402bbbda'} May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81dab7b9-07c5-42e6-b9e1-6c71402bbbda could not be found. May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81dab7b9-07c5-42e6-b9e1-6c71402bbbda could not be found. May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:25.245341 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81dab7b9-07c5-42e6-b9e1-6c71402bbbda could not be found. May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Returning 404 to user: Instance 81dab7b9-07c5-42e6-b9e1-6c71402bbbda could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a826f134-5e72-4b2a-8900-ca2df0dad11f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda" status: 404 len: 111 microversion: 2.47 time: 0.053166 May 14 21:30:25.258353 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2714/5043] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:25 2022] GET /compute/v2.1/servers/81dab7b9-07c5-42e6-b9e1-6c71402bbbda => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 14 21:30:25.267016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:25.267629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:25.277265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.277735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:25.278533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.279050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:25.315093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:30:25.626250 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0fea7f4f-d060-4cc1-be4d-f9f969b7abca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31" status: 204 len: 0 microversion: 2.47 time: 0.368159 May 14 21:30:25.627251 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2715/5044] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:30:25 2022] DELETE /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:30:25.635958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:25.636669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:25.649167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.649627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:25.651077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.651552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:25.734470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:25.745023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:25.747117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:25.748736 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6a3af13e-ff33-43f8-914b-19ef1c3d1c3f tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31" status: 200 len: 1362 microversion: 2.47 time: 0.117360 May 14 21:30:25.749524 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2716/5045] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:25 2022] GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31 => generated 1362 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:25.947144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:25.947928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:25.955529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.956079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:25.957158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:25.957861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:26.150410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.159861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.161672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.163138 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4b93c150-1ef6-4fc6-ac12-b696e88d0fca tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2921 microversion: 2.42 time: 0.220503 May 14 21:30:26.163742 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2717/5046] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:25 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2921 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:26.213464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:30:26.215985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:30:26.216603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:30:26.217128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:30:26.217661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:30:26.228689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:26.229274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:26.230185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:26.230719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:26.250868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:30:26.256921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Getting quotas for user 04e48304473d40ebb8c0c5386c4c3592 and project 4989c480608c4b86bd1cd7615fba4d20. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:30:26.273116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:30:26.275923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:30:26.758167 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be888a0d-a850-4788-ab4c-11dd9c8e560a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.861235 May 14 21:30:26.758832 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2330/5047] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:30:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 14 21:30:26.773663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:26.774681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:26.776643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0be55428-41fe-4246-9cd6-87c839d676a1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:26.779450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0be55428-41fe-4246-9cd6-87c839d676a1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:26.786849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:26.787315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:26.788188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:26.788838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:26.878898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0be55428-41fe-4246-9cd6-87c839d676a1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.886400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0be55428-41fe-4246-9cd6-87c839d676a1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.891244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0be55428-41fe-4246-9cd6-87c839d676a1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.895773 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0be55428-41fe-4246-9cd6-87c839d676a1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1280 microversion: 2.20 time: 0.129014 May 14 21:30:26.896983 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2718/5048] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:26 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1280 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:26.920672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.936273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.940717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:26.948381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-582cecf2-c849-47f5-8f5f-a2276ef2c5ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31" status: 200 len: 1362 microversion: 2.47 time: 0.174664 May 14 21:30:26.948381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2331/5049] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:26 2022] GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:27.001545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e7ae80d4-e32f-4719-b987-40ca914cd2ec req-dc7ba4b9-c667-4550-83bc-71a8b3e2f461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-deleted", "tag": "5fe9ffa2-546d-42d9-a88d-11e41c94e5f9"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:27.010759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e7ae80d4-e32f-4719-b987-40ca914cd2ec req-dc7ba4b9-c667-4550-83bc-71a8b3e2f461 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:27.011228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e7ae80d4-e32f-4719-b987-40ca914cd2ec req-dc7ba4b9-c667-4550-83bc-71a8b3e2f461 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:27.038956 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e7ae80d4-e32f-4719-b987-40ca914cd2ec req-dc7ba4b9-c667-4550-83bc-71a8b3e2f461 service nova] Creating event network-vif-deleted:5fe9ffa2-546d-42d9-a88d-11e41c94e5f9 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:27.052738 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e7ae80d4-e32f-4719-b987-40ca914cd2ec req-dc7ba4b9-c667-4550-83bc-71a8b3e2f461 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052265 May 14 21:30:27.053487 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2719/5050] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:30:27.057716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2a4d4aeb-5183-4b5b-ac5a-cf1fecc3f5b8 req-85a4c655-9799-427c-9cc8-3fff9024ad3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-unplugged", "status": "completed", "tag": "54b871a9-1a1e-4062-9a50-5ddf26961b8e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:27.070902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2a4d4aeb-5183-4b5b-ac5a-cf1fecc3f5b8 req-85a4c655-9799-427c-9cc8-3fff9024ad3b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:27.071369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2a4d4aeb-5183-4b5b-ac5a-cf1fecc3f5b8 req-85a4c655-9799-427c-9cc8-3fff9024ad3b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:27.089213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2a4d4aeb-5183-4b5b-ac5a-cf1fecc3f5b8 req-85a4c655-9799-427c-9cc8-3fff9024ad3b service nova] Creating event network-vif-unplugged:54b871a9-1a1e-4062-9a50-5ddf26961b8e for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:27.095538 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2a4d4aeb-5183-4b5b-ac5a-cf1fecc3f5b8 req-85a4c655-9799-427c-9cc8-3fff9024ad3b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044444 May 14 21:30:27.100022 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2332/5051] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:30:27.186329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:27.188220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:27.194654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:27.195896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:27.196811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:27.197300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:27.626327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:27.626327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:27.626327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:27.626327 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-10038a31-58c4-4bc7-b4c7-35529b109006 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2874 microversion: 2.42 time: 0.260268 May 14 21:30:27.626327 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2720/5052] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:27 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2874 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:27.918262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8d08030-4f45-4037-b0cc-0c53e1547050 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:27.927104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8d08030-4f45-4037-b0cc-0c53e1547050 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:27.961689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:27.962325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:27.972126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:27.972598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:27.981943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:27.987387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:28.037371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8d08030-4f45-4037-b0cc-0c53e1547050 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.048421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:28.048823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8d08030-4f45-4037-b0cc-0c53e1547050 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.051024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8d08030-4f45-4037-b0cc-0c53e1547050 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.052204 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8d08030-4f45-4037-b0cc-0c53e1547050 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1280 microversion: 2.20 time: 0.139664 May 14 21:30:28.053548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:28.055253 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2333/5053] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:27 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:28.055916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lazy-loading 'fault' on Instance uuid 4684e4d5-0592-4c2b-af3b-8489e3d07e31 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:30:28.125069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.133614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.135241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b75ffa8886d946e3ae228f737b193198', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f43cf27f7a634cb4adb7865a7e8b7838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.147753 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-deb94ba6-156d-4c90-ac2a-5e50339d73ca tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31" status: 200 len: 1367 microversion: 2.47 time: 0.183466 May 14 21:30:28.147753 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2721/5054] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:27 2022] GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:28.464942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:28.465981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:28.479897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:28.480646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:28.481961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:28.482571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:28.801574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.814924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.816580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:28.817887 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d001588-fd80-48d5-a12d-9d287ede2dd5 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2713 microversion: 2.42 time: 0.358294 May 14 21:30:28.827104 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2334/5055] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:28 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2713 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:29.297016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-7b53069f-80fb-465e-a7d6-8d07f5ab0369 req-14fa8a88-662e-4bd3-bef6-bf515af06ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-deleted", "tag": "54b871a9-1a1e-4062-9a50-5ddf26961b8e"}, {"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-deleted", "tag": "d09b3141-d774-4a45-8f42-7303f69488da"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:29.301553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:29.301553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:29.303714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7b53069f-80fb-465e-a7d6-8d07f5ab0369 req-14fa8a88-662e-4bd3-bef6-bf515af06ef6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.303714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7b53069f-80fb-465e-a7d6-8d07f5ab0369 req-14fa8a88-662e-4bd3-bef6-bf515af06ef6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:29.303714 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-7b53069f-80fb-465e-a7d6-8d07f5ab0369 req-14fa8a88-662e-4bd3-bef6-bf515af06ef6 service nova] Creating event network-vif-deleted:54b871a9-1a1e-4062-9a50-5ddf26961b8e for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:29.304440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.304440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:29.305454 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-7b53069f-80fb-465e-a7d6-8d07f5ab0369 req-14fa8a88-662e-4bd3-bef6-bf515af06ef6 service nova] Creating event network-vif-deleted:d09b3141-d774-4a45-8f42-7303f69488da for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:29.305725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.305725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-7b53069f-80fb-465e-a7d6-8d07f5ab0369 req-14fa8a88-662e-4bd3-bef6-bf515af06ef6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043075 May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2722/5056] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e6e666d8-c52c-4341-acf2-322dc124eace req-b6f35c13-6c1e-4c94-b36c-9cd95018af5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-unplugged", "status": "completed", "tag": "150fe679-5889-44eb-bcc1-bbb9d924b590"}, {"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-unplugged", "status": "completed", "tag": "d09b3141-d774-4a45-8f42-7303f69488da"}, {"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-unplugged", "status": "completed", "tag": "ed4b2309-b8f5-4d14-9e50-2b5701924849"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e6e666d8-c52c-4341-acf2-322dc124eace req-b6f35c13-6c1e-4c94-b36c-9cd95018af5c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e6e666d8-c52c-4341-acf2-322dc124eace req-b6f35c13-6c1e-4c94-b36c-9cd95018af5c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e6e666d8-c52c-4341-acf2-322dc124eace req-b6f35c13-6c1e-4c94-b36c-9cd95018af5c service nova] Creating event network-vif-unplugged:150fe679-5889-44eb-bcc1-bbb9d924b590 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e6e666d8-c52c-4341-acf2-322dc124eace req-b6f35c13-6c1e-4c94-b36c-9cd95018af5c service nova] Creating event network-vif-unplugged:d09b3141-d774-4a45-8f42-7303f69488da for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e6e666d8-c52c-4341-acf2-322dc124eace req-b6f35c13-6c1e-4c94-b36c-9cd95018af5c service nova] Creating event network-vif-unplugged:ed4b2309-b8f5-4d14-9e50-2b5701924849 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e6e666d8-c52c-4341-acf2-322dc124eace req-b6f35c13-6c1e-4c94-b36c-9cd95018af5c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.046622 May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2723/5057] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] [instance: 4684e4d5-0592-4c2b-af3b-8489e3d07e31] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.306316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] HTTP exception thrown: Instance 4684e4d5-0592-4c2b-af3b-8489e3d07e31 could not be found. May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Request method failure captured: May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31 HTTP/1.1 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB9Avzxk3Wc2tWeNTNzYVNbO0D9C9qZclYSACSap1nQO7_yQa_cIHcQ7sLzWTjYAhbeyOLq_ngNKpgP6UaycnDBmVxyVzmK5OMFE3Srs9UdhLrnRlr7iJmjvZBScBY2jZnt9qjECsM3PuJKrOlywS43kRoH-JmTEk7FCmQUmg2F9jRs May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.47 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: f43cf27f7a634cb4adb7865a7e8b7838 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerShowV247Test-2078379159 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f43cf27f7a634cb4adb7865a7e8b7838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f43cf27f7a634cb4adb7865a7e8b7838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f43cf27f7a634cb4adb7865a7e8b7838"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f43cf27f7a634cb4adb7865a7e8b7838", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerShowV247Test-2078379159 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: f43cf27f7a634cb4adb7865a7e8b7838 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerShowV247Test-2078379159 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerShowV247Test-2078379159-project May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: b75ffa8886d946e3ae228f737b193198 May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerShowV247Test-2078379159-project May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 4684e4d5-0592-4c2b-af3b-8489e3d07e31 could not be found. May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '4684e4d5-0592-4c2b-af3b-8489e3d07e31'} May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4684e4d5-0592-4c2b-af3b-8489e3d07e31 could not be found. May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:29.307587 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4684e4d5-0592-4c2b-af3b-8489e3d07e31 could not be found. May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4684e4d5-0592-4c2b-af3b-8489e3d07e31 could not be found. May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] Returning 404 to user: Instance 4684e4d5-0592-4c2b-af3b-8489e3d07e31 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b4023aa1-c885-472d-a26c-7c7859818aa6 tempest-ServerShowV247Test-2078379159 tempest-ServerShowV247Test-2078379159-project] 10.222.0.52 "GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31" status: 404 len: 111 microversion: 2.47 time: 0.036776 May 14 21:30:29.313441 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2724/5058] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:29 2022] GET /compute/v2.1/servers/4684e4d5-0592-4c2b-af3b-8489e3d07e31 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:30:29.315781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:29.315781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:29.315781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:29.315781 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9466f2a-554a-4c27-a0bd-edaf292f6ffa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1276 microversion: 2.20 time: 0.182551 May 14 21:30:29.315781 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2335/5059] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:29 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:29.839293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:29.840248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:29.855967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.857334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:29.862729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:29.862729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:30.109392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:30.119402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:30.121990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:30.123397 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-98bb487b-5d31-4c15-a359-81ed9acab455 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2347 microversion: 2.42 time: 0.288600 May 14 21:30:30.125185 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2725/5060] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:29 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2347 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:30.272829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:30.273877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:30.281451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:30.281917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:30.282708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:30.283153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:30.396074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:30.404291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:30.406561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:30.408250 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6bc976c2-1247-4470-b40a-8692561c4229 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1340 microversion: 2.20 time: 0.139443 May 14 21:30:30.409079 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2336/5061] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:30 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:31.152411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:31.153221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:31.160352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-73ff9c70-bb9e-4b9c-baf0-09b4d84422f8 req-1ba7ada3-acbf-4e80-a1ff-ceecca8f0199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-deleted", "tag": "150fe679-5889-44eb-bcc1-bbb9d924b590"}, {"server_uuid": "982e9a4e-db57-4fc9-adb1-78cf5bcecb90", "name": "network-vif-deleted", "tag": "ed4b2309-b8f5-4d14-9e50-2b5701924849"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:31.163746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:31.164329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:31.165310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:31.166080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:31.189085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-73ff9c70-bb9e-4b9c-baf0-09b4d84422f8 req-1ba7ada3-acbf-4e80-a1ff-ceecca8f0199 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:31.189546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-73ff9c70-bb9e-4b9c-baf0-09b4d84422f8 req-1ba7ada3-acbf-4e80-a1ff-ceecca8f0199 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:31.219989 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-73ff9c70-bb9e-4b9c-baf0-09b4d84422f8 req-1ba7ada3-acbf-4e80-a1ff-ceecca8f0199 service nova] Creating event network-vif-deleted:150fe679-5889-44eb-bcc1-bbb9d924b590 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:31.220703 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-73ff9c70-bb9e-4b9c-baf0-09b4d84422f8 req-1ba7ada3-acbf-4e80-a1ff-ceecca8f0199 service nova] Creating event network-vif-deleted:ed4b2309-b8f5-4d14-9e50-2b5701924849 for instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 on nch1-master-1 May 14 21:30:31.231636 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-73ff9c70-bb9e-4b9c-baf0-09b4d84422f8 req-1ba7ada3-acbf-4e80-a1ff-ceecca8f0199 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075549 May 14 21:30:31.232859 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2337/5062] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:31.284684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:31.299158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:31.301861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:31.304033 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ff95e16-f6e7-4d0f-889a-e275bb827924 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 2279 microversion: 2.42 time: 0.157272 May 14 21:30:31.305488 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2726/5063] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:31 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 2279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:31.429316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:31.430629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:31.445360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:31.446201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:31.447193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:31.447819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:31.869384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:31.886657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:31.904895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:31.906726 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8dcd5e6f-62e1-4c7a-97f9-ca79a8045e28 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.484027 May 14 21:30:31.912115 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2338/5064] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:31 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:32.330942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:32.331724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:32.339739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:32.340419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:32.341417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:32.341866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:32.405195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:32.407197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:32.407914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lazy-loading 'fault' on Instance uuid 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:30:32.493060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:32.510135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:32.512760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:32.514353 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fac83339-77d7-4ce1-b6cc-bd8561f32350 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1878 microversion: 2.42 time: 0.188747 May 14 21:30:32.516462 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2727/5065] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:32 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1878 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:32.676520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-250944129", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": "none"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:32.753918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:30:32.754600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:30:32.755307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:30:32.755890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:30:32.756319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:30:32.792183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:32.792183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:32.792917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:32.794253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:32.818787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Getting quotas for project ae5e9ab5390a49d0ad1896e52248340d. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:30:32.828363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Getting quotas for user 7133ca2c209048149a095b778ac1424e and project ae5e9ab5390a49d0ad1896e52248340d. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:30:32.886871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:30:32.894391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:30:32.943465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:32.944311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:32.951989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:32.952686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:32.955214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:32.956097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:33.245179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.257976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.259615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.272407 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b910738-6197-4f8c-a6e5-b83daba8e0a8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.335262 May 14 21:30:33.274466 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2728/5066] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:32 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:33.536610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:33.537251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:33.544568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:33.545025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:33.545805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:33.547134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:33.581333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:33.581781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:33.582236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lazy-loading 'fault' on Instance uuid 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:30:33.623788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.633474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.634982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2d0ac47523ba4f288bcd89f8228ef910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8d3f937d0cc40e6b1cd90e72b6fb07e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.636287 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1c2bff2-d7b1-4e7b-8c55-247a34bb7834 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 200 len: 1878 microversion: 2.42 time: 0.103740 May 14 21:30:33.637073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2729/5067] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:33 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 1878 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:33.763114 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8affe477-0923-4d31-9fce-a8863ca52173 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.216651 May 14 21:30:33.763114 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2339/5068] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:30:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:30:33.773850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97440272-7881-48c5-83b8-27f47497de14 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:33.774545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97440272-7881-48c5-83b8-27f47497de14 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:33.853424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97440272-7881-48c5-83b8-27f47497de14 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.865542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97440272-7881-48c5-83b8-27f47497de14 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.867382 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97440272-7881-48c5-83b8-27f47497de14 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:33.869076 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97440272-7881-48c5-83b8-27f47497de14 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1277 microversion: 2.54 time: 0.099643 May 14 21:30:33.870527 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2730/5069] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:33 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:33.906071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-920acbdb-9d18-438a-8b5e-73d747749465 req-20ba5ef6-0f06-441a-a601-4a74d8065a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:33.920161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-920acbdb-9d18-438a-8b5e-73d747749465 req-20ba5ef6-0f06-441a-a601-4a74d8065a89 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:33.922032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-920acbdb-9d18-438a-8b5e-73d747749465 req-20ba5ef6-0f06-441a-a601-4a74d8065a89 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:33.947781 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-920acbdb-9d18-438a-8b5e-73d747749465 req-20ba5ef6-0f06-441a-a601-4a74d8065a89 service nova] Creating event network-changed:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch2-master-1 May 14 21:30:33.957851 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-920acbdb-9d18-438a-8b5e-73d747749465 req-20ba5ef6-0f06-441a-a601-4a74d8065a89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055790 May 14 21:30:33.957851 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2340/5070] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:34.293961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:34.294814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:34.302097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:34.302837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:34.303862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:34.304463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:34.512708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:34.552930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:34.554617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:34.562498 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-45ddb2ce-00ec-4ba7-8531-4ef246d86d82 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.274149 May 14 21:30:34.579697 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2731/5071] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:34 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:34.664249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:34.666939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] [instance: 982e9a4e-db57-4fc9-adb1-78cf5bcecb90] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:34.673155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:34.673618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:34.674596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:34.675253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] HTTP exception thrown: Instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 could not be found. May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Request method failure captured: May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 HTTP/1.1 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB1j6WYN8G-5LtaKyP_PPx35vOPIOqNL7KL59zMFdcFAAEuQEmfBJZ_1ytthFTOAbUZrw6AmMEYNwN7f3dKFnwB-Aoh8sXbOHObLyvKrJBVlAPH4Nch33fMuEexM67qgop3VPGdweYAboeKLnIHqRrv-UX6mqld8034HMz8dniTl_N4 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.42 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: c8d3f937d0cc40e6b1cd90e72b6fb07e May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-387890351 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8d3f937d0cc40e6b1cd90e72b6fb07e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/c8d3f937d0cc40e6b1cd90e72b6fb07e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/c8d3f937d0cc40e6b1cd90e72b6fb07e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_c8d3f937d0cc40e6b1cd90e72b6fb07e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TaggedBootDevicesTest_v242-387890351 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: c8d3f937d0cc40e6b1cd90e72b6fb07e May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-387890351 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TaggedBootDevicesTest_v242-387890351-project May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2d0ac47523ba4f288bcd89f8228ef910 May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TaggedBootDevicesTest_v242-387890351-project May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 could not be found. May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '982e9a4e-db57-4fc9-adb1-78cf5bcecb90'} May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 could not be found. May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:30:34.696397 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 could not be found. May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 could not be found. May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Returning 404 to user: Instance 982e9a4e-db57-4fc9-adb1-78cf5bcecb90 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5f1d9d3f-2753-40f9-9cb4-c7a21c8141ff tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90" status: 404 len: 111 microversion: 2.42 time: 0.038283 May 14 21:30:34.699324 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2341/5072] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:34 2022] GET /compute/v2.1/servers/982e9a4e-db57-4fc9-adb1-78cf5bcecb90 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:30:34.754523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-87483cc9-b022-47f1-923e-3dfa5ef9d5f2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] Calling method '.version_select at 0x7fb1a7018ee0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:34.892567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d3a739ba-94e4-43d8-9727-d532cc0d15f6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:34.895022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d3a739ba-94e4-43d8-9727-d532cc0d15f6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:34.906261 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-87483cc9-b022-47f1-923e-3dfa5ef9d5f2 tempest-TaggedBootDevicesTest_v242-387890351 tempest-TaggedBootDevicesTest_v242-387890351-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931352794" status: 204 len: 0 microversion: 2.42 time: 0.156831 May 14 21:30:34.913008 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2732/5073] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:30:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1931352794 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:30:35.370991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3a739ba-94e4-43d8-9727-d532cc0d15f6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:35.388002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3a739ba-94e4-43d8-9727-d532cc0d15f6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:35.391808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3a739ba-94e4-43d8-9727-d532cc0d15f6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:35.393941 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d3a739ba-94e4-43d8-9727-d532cc0d15f6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1277 microversion: 2.54 time: 0.507066 May 14 21:30:35.395067 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2342/5074] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:34 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1277 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:35.589954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:35.590640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:35.599859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:35.601337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:35.601337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:35.601598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:35.864445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:35.876503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:35.878165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:35.879344 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a81ca2a7-7ee1-47d3-93e3-f1206df82d20 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.294307 May 14 21:30:35.882110 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2733/5075] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:35 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:36.413693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:36.415077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:36.428288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:36.428288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:36.428288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:36.428288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:36.548781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:36.570937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:36.574160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:36.581554 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64e3c6be-4cff-4da5-9e1a-3200ae7ad69b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1329 microversion: 2.54 time: 0.167528 May 14 21:30:36.581554 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2343/5076] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:36 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1329 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:36.900499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:36.901198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:36.913178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:36.913820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:36.916242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:36.916897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:37.102167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:37.118551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:37.124371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:37.124371 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d6be74c-ca87-4cb7-b155-e458e129dd9a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.225867 May 14 21:30:37.124371 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2734/5077] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:36 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:37.615365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:37.616574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:37.631694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:37.632484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:37.633603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:37.634667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:37.788610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:37.796511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:37.799060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:37.802885 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e36772e5-7491-45ee-849f-113128ddaf94 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1337 microversion: 2.54 time: 0.202629 May 14 21:30:37.812040 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2344/5078] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:37 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1337 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:38.141909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:38.142530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:38.151929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:38.152655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:38.153740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:38.154377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:38.479335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:38.490962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:38.492524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:38.494312 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a391c64c-24ea-4959-a5b4-461012580c22 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.357597 May 14 21:30:38.494899 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2735/5079] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:38 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:38.827351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:38.832800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:38.840606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:38.843638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:38.844605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:38.845065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:39.049449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:39.072002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:39.075390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:39.076796 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3aed967a-9ec8-4003-9bd1-b2a1f51bd635 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1335 microversion: 2.54 time: 0.255660 May 14 21:30:39.084428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2345/5080] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:38 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1335 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:39.524312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:39.525010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:39.539313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:39.540336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:39.542037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:39.543297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:39.840682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:39.871189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:39.876403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:39.877915 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5a294ba1-182d-4d90-a614-a4fd69248ec1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.367683 May 14 21:30:39.896727 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2736/5081] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:39 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:40.110371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:40.111582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:40.119511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:40.120175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:40.121405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:40.123090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:40.286496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:40.304810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:40.318732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:40.322075 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e722e232-adbe-4d61-83ad-d92025e8ccac tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1335 microversion: 2.54 time: 0.220667 May 14 21:30:40.325959 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2346/5082] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:40 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1335 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:40.900927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:40.903138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:40.910937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:40.911677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:40.912931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:40.913506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:40.943106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-56bf7a20-bb12-4d82-a4af-e1097583b3e9 req-ef583d96-480b-4c2d-a14f-014e7a02dc22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "name": "network-vif-plugged", "status": "completed", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:40.959684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-56bf7a20-bb12-4d82-a4af-e1097583b3e9 req-ef583d96-480b-4c2d-a14f-014e7a02dc22 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:40.960147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-56bf7a20-bb12-4d82-a4af-e1097583b3e9 req-ef583d96-480b-4c2d-a14f-014e7a02dc22 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:40.979361 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-56bf7a20-bb12-4d82-a4af-e1097583b3e9 req-ef583d96-480b-4c2d-a14f-014e7a02dc22 service nova] Creating event network-vif-plugged:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch2-master-1 May 14 21:30:40.986305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-56bf7a20-bb12-4d82-a4af-e1097583b3e9 req-ef583d96-480b-4c2d-a14f-014e7a02dc22 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047395 May 14 21:30:40.987300 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2347/5083] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:41.111330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:41.127428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:41.129223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:41.130440 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-76b39817-87bc-4c34-b7c0-e77462652787 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.234406 May 14 21:30:41.131438 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2737/5084] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:40 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:41.344505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:41.345217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:41.352844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:41.353331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:41.354204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:41.354662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:41.456555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:41.465659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:41.468238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:41.469516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f773067-ba75-4871-b158-72560b32c3ab tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1356 microversion: 2.54 time: 0.131638 May 14 21:30:41.471152 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2348/5085] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:41 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1356 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:41.492605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e5cae9e6-18eb-4c11-a74e-9f6a10a58223 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Action: 'create', calling method: .version_select at 0x7fb1a6fa63a0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1540418644", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2arsIYgD6muTY3T41eQnB/xpoWa8JWPYzhiHBljnjSNK5tG7nc3tUnWvvgCiImy2EyeEZpyUTdtwc2rRYSULvdmawKMCSt7udFUSAYG9s6jWpyADFHTFEOIbAdCtCFsw=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:41.506914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e5cae9e6-18eb-4c11-a74e-9f6a10a58223 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Getting quotas for project ae5e9ab5390a49d0ad1896e52248340d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:30:41.514047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e5cae9e6-18eb-4c11-a74e-9f6a10a58223 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Getting quotas for user 7133ca2c209048149a095b778ac1424e and project ae5e9ab5390a49d0ad1896e52248340d. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:30:41.665686 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e5cae9e6-18eb-4c11-a74e-9f6a10a58223 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.177920 May 14 21:30:41.666328 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2738/5086] 10.222.0.52 () {62 vars in 1199 bytes} [Sat May 14 21:30:41 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 179 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 14 21:30:41.677258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1540418644", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:41.680028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:41.686927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:41.687388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:41.688223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:41.688671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:41.782698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:30:41.783135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:30:41.783746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:30:41.784062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:30:41.784469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:30:42.150857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:42.152396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:42.166020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:42.166642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:42.167775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:42.168215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:42.299227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:42.310626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:42.312076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:42.313311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:42.314602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:42.359850 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3717e4d7-5388-4bd8-918a-95e80caa5013 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "POST /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35/action" status: 202 len: 1139 microversion: 2.54 time: 0.686860 May 14 21:30:42.360655 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2349/5087] 10.222.0.52 () {62 vars in 1319 bytes} [Sat May 14 21:30:41 2022] POST /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35/action => generated 1139 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 14 21:30:42.377331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:42.378178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:42.385988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:42.386521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:42.387509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:42.388176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:42.394139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:42.406468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:42.409398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:42.416271 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f18ba6bf-b71b-4462-97cb-7b8cdcf09bba tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1405 microversion: 2.20 time: 0.266013 May 14 21:30:42.416271 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2739/5088] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:42 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:42.481436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:42.508325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:42.508325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:42.508325 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6b2184e4-9a8c-4c92-b84d-3ccad7c348df tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.125302 May 14 21:30:42.508325 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2350/5089] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:42 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:43.430827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:43.433012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:43.441706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:43.443595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:43.444402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:43.444847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:43.553363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:43.553363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:43.553363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:43.553363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:43.553363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:43.553363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:43.605583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:43.609496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:43.614667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:43.616305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:43.617486 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c8a9087-ed6e-4a4d-b072-ea27d7839bb2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.105304 May 14 21:30:43.617617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:43.618060 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2351/5090] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:43 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:43.619279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:43.621012 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-61ea640f-5402-4c85-84fc-819d7b31179c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1598 microversion: 2.20 time: 0.195500 May 14 21:30:43.621728 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2740/5091] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:43 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:43.645980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d92fb594-1b8a-4995-8cb7-0011982c4ad5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:43.646621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d92fb594-1b8a-4995-8cb7-0011982c4ad5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:43.653259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d92fb594-1b8a-4995-8cb7-0011982c4ad5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:43.654020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d92fb594-1b8a-4995-8cb7-0011982c4ad5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:43.654874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d92fb594-1b8a-4995-8cb7-0011982c4ad5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:43.660366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d92fb594-1b8a-4995-8cb7-0011982c4ad5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:43.779526 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d92fb594-1b8a-4995-8cb7-0011982c4ad5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.141951 May 14 21:30:43.780774 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2352/5092] 10.222.0.52 () {60 vars in 1315 bytes} [Sat May 14 21:30:43 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:30:44.643443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:44.644192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:44.653096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:44.653747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:44.654607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:44.655764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:44.781989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:44.790797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:44.792802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:44.793996 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1db08970-319c-41a6-936e-a33e030ba630 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.160137 May 14 21:30:44.794571 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2741/5093] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:44 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:45.641202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e53c5b3-bda4-4d99-93de-0d26ffec903c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:45.643631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e53c5b3-bda4-4d99-93de-0d26ffec903c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:45.650745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e53c5b3-bda4-4d99-93de-0d26ffec903c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:45.651207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e53c5b3-bda4-4d99-93de-0d26ffec903c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:45.655264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e53c5b3-bda4-4d99-93de-0d26ffec903c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:45.655264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e53c5b3-bda4-4d99-93de-0d26ffec903c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:45.689575 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e53c5b3-bda4-4d99-93de-0d26ffec903c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055090 May 14 21:30:45.690357 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2353/5094] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:30:45 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:30:45.754571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:45.755760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:45.762997 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:45.763763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:45.769874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:45.769874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:45.795215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:30:45.812833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:45.813463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:45.820485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:45.821021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:45.821731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:45.822182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:45.898074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:45.908516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:45.910596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:45.912203 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3a31fb8-e63c-4f14-b7de-66aabce2c940 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.103799 May 14 21:30:45.915545 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2354/5095] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:45 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:46.021191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1181085d-233f-4349-8138-566feb9a32fa req-951dc176-1806-4797-9410-538118f80309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:46.068159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1181085d-233f-4349-8138-566feb9a32fa req-951dc176-1806-4797-9410-538118f80309 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:46.068619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1181085d-233f-4349-8138-566feb9a32fa req-951dc176-1806-4797-9410-538118f80309 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:46.098029 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1181085d-233f-4349-8138-566feb9a32fa req-951dc176-1806-4797-9410-538118f80309 service nova] Creating event network-changed:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch2-master-1 May 14 21:30:46.105200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1181085d-233f-4349-8138-566feb9a32fa req-951dc176-1806-4797-9410-538118f80309 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087600 May 14 21:30:46.106209 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2355/5096] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:46.275968 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-51a8d3b8-a806-4fb7-90e1-e6c8965509ad tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 204 len: 0 microversion: 2.1 time: 0.524988 May 14 21:30:46.276686 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2742/5097] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:30:45 2022] DELETE /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:30:46.286675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:46.287391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:46.309463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:46.309955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:46.310787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:46.311406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:46.933885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:46.935827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:46.953170 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:46.953638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:46.958215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:46.965970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:46.984326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:46.998242 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3b22548-5b29-483c-b5da-6a5bf87b03a6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1671 microversion: 2.1 time: 0.714522 May 14 21:30:46.999792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2356/5098] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:46 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1671 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:47.069939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:47.086291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:47.088272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:47.089700 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c6d46a6-4a30-4845-bd72-dcb7011843b6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.160570 May 14 21:30:47.093930 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2743/5099] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:46 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:48.017644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:48.018566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:48.025773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:48.026398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:48.027255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:48.027822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:48.123164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:48.125215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:48.133618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:48.134823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:48.134921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:48.135298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:48.239965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:48.272719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:48.274261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:48.275859 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae0ac0d9-73e4-47dc-9c94-9176a87bd9a4 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.158175 May 14 21:30:48.277168 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2744/5100] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:48 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:48.344910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:48.352310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-75026da2-7609-4f0a-b605-ccff4fa51482 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1671 microversion: 2.1 time: 0.339792 May 14 21:30:48.352897 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2357/5101] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:48 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1671 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:49.294452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:49.295125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:49.302797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:49.303331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:49.304213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:49.304883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:49.370060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:49.370447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:49.377312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:49.378287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:49.378752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:49.382685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:49.382685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:49.385611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:49.387266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:49.388651 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58d270cd-fc3b-407b-ab9f-1cc17f8b8a71 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.098305 May 14 21:30:49.390046 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2745/5102] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:49 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:49.499048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:49.507033 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf5c4aa4-5b1b-4e6e-89eb-c6f526c5198b tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1604 microversion: 2.1 time: 0.141350 May 14 21:30:49.507658 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2358/5103] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:49 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1604 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:49.646032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c37d2166-1f3e-48cd-9e2a-3f935bda726a req-86f4c132-1403-4f94-851f-0c89334dc1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a91c0da-3308-4367-b3f4-ecc73bd8ee3f", "name": "network-vif-deleted", "tag": "e90ff6bb-3ced-4a72-8633-418a004483a5"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:49.655778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c37d2166-1f3e-48cd-9e2a-3f935bda726a req-86f4c132-1403-4f94-851f-0c89334dc1d5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:49.656615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c37d2166-1f3e-48cd-9e2a-3f935bda726a req-86f4c132-1403-4f94-851f-0c89334dc1d5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:49.671982 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c37d2166-1f3e-48cd-9e2a-3f935bda726a req-86f4c132-1403-4f94-851f-0c89334dc1d5 service nova] Creating event network-vif-deleted:e90ff6bb-3ced-4a72-8633-418a004483a5 for instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f on nch1-master-1 May 14 21:30:49.678102 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c37d2166-1f3e-48cd-9e2a-3f935bda726a req-86f4c132-1403-4f94-851f-0c89334dc1d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035529 May 14 21:30:49.678855 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2746/5104] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:50.334103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-46de0b36-58d9-4ff4-b6cc-d9b57c45267c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:50.334637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-46de0b36-58d9-4ff4-b6cc-d9b57c45267c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:50.340681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46de0b36-58d9-4ff4-b6cc-d9b57c45267c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:50.341142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46de0b36-58d9-4ff4-b6cc-d9b57c45267c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:50.342052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46de0b36-58d9-4ff4-b6cc-d9b57c45267c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:50.343031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-46de0b36-58d9-4ff4-b6cc-d9b57c45267c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:50.369385 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-46de0b36-58d9-4ff4-b6cc-d9b57c45267c tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/ips" status: 200 len: 150 microversion: 2.1 time: 0.039360 May 14 21:30:50.372602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2359/5105] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:30:50 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:30:50.410239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:50.410937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:50.429204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:50.429676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:50.430647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:50.431235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:50.523206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:50.526075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:50.527518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:50.535655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:50.537183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:50.538372 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1d7a392-04f3-4606-8c65-398b91c3e4be tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.132377 May 14 21:30:50.538863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:50.538988 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2747/5106] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:50 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:50.551838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:50.555908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:50.555908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:50.592079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:50.593104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:50.593801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lazy-loading 'fault' on Instance uuid 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:30:50.700858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:50.712338 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83c64aee-d2b0-4397-af12-31b5829a1d15 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 200 len: 1328 microversion: 2.1 time: 0.190901 May 14 21:30:50.727053 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2360/5107] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:50 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 1328 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:30:51.556788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:51.557414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:51.565957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:51.566432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:51.567277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:51.567795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:51.643434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:51.651802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:51.653340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:51.654516 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b185e5e1-1d84-4808-8424-a82bb39b168b tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.101863 May 14 21:30:51.655154 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2748/5108] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:51 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:51.738957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:51.739787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:51.750430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:51.750430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:51.750430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:51.750430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:51.764100 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] HTTP exception thrown: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Request method failure captured: May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f HTTP/1.1 May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB7dR5Br-85r_xroEIubjtcujEO9DjMhMRQAo-sNEQSWq_kbkbjio1ibNIrita8v-LjHR84K6mX87wrKF6VBTpqyb7bqQC-nGsg3aVVDGcNwoxaZjMQjTlZihE1SMH0rqWbyt_lyLml2ycUbSCUtr_nQCKw00gutDx4iulYuLKoKmlo May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 6641b342c1d440aea451919f391bc5db May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6641b342c1d440aea451919f391bc5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6641b342c1d440aea451919f391bc5db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeTestJSON-1845080071 May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 6641b342c1d440aea451919f391bc5db May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 5586a3a946a0490498c42cb71f39ce1e May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '6a91c0da-3308-4367-b3f4-ecc73bd8ee3f'} May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:30:51.765987 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Returning 404 to user: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1686aa21-7321-4503-be7c-fa0f1a1fa186 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 404 len: 111 microversion: 2.1 time: 0.032664 May 14 21:30:51.769459 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2361/5109] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:51 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:30:51.776608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6ec6866-61bd-48f9-8b2f-9b165990737a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '.version_select at 0x7fb1a6fb1ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:51.899616 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6ec6866-61bd-48f9-8b2f-9b165990737a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607661928" status: 202 len: 0 microversion: 2.1 time: 0.126775 May 14 21:30:51.900221 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2749/5110] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607661928 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:30:52.674138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:52.674752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:52.681320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:52.681781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:52.684655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:52.684655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:52.751364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e95d3051-2b16-4dec-a7f0-0a07120cc4ed tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'create', calling method: .version_select at 0x7fb1b96c6ee0>, body: {"keypair": {"name": "tempest-keypair-743069403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNycVWwLhFXBWEDgKjnEjo2q45cZvrDl/gs2sbsq2wTIPEvirtD8WqSyy03FBIxtszqzWJFqI8D0w6Td7ZxC/95FuBQ4SU4sbV4gyhSCyB5fotkF2Hkx78G6RLixL1PrjQ=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:52.767375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e95d3051-2b16-4dec-a7f0-0a07120cc4ed tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for project 6641b342c1d440aea451919f391bc5db. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:30:52.772805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e95d3051-2b16-4dec-a7f0-0a07120cc4ed tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for user 5586a3a946a0490498c42cb71f39ce1e and project 6641b342c1d440aea451919f391bc5db. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:30:52.781180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:52.795348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:52.797435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:52.798664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e2d3280-2128-466a-80ca-b5aacf38e54f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.128922 May 14 21:30:52.799706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2362/5111] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:52 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:52.894294 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e95d3051-2b16-4dec-a7f0-0a07120cc4ed tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148460 May 14 21:30:52.895088 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2750/5112] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:30:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:30:53.310097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b79a726c-80d5-42bd-8f23-9d79e54ac0a1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b941c16b-80e2-4f26-bb91-adb28379cf31"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:53.312364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b79a726c-80d5-42bd-8f23-9d79e54ac0a1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:53.318542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b79a726c-80d5-42bd-8f23-9d79e54ac0a1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:53.319008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b79a726c-80d5-42bd-8f23-9d79e54ac0a1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:53.319822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b79a726c-80d5-42bd-8f23-9d79e54ac0a1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:53.320272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b79a726c-80d5-42bd-8f23-9d79e54ac0a1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:53.826414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:53.827601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:53.833294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:53.835319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:53.836349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:53.836949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:53.921035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:53.934445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:53.936582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:53.937972 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8f08777-953c-4898-9c8e-da7a2b1e9d0f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.116435 May 14 21:30:53.939992 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2751/5113] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:53 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:30:54.163374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b79a726c-80d5-42bd-8f23-9d79e54ac0a1 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "POST /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.857195 May 14 21:30:54.181472 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2363/5114] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:30:53 2022] POST /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:30:54.957312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:54.958724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:54.966168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:54.966892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:54.968869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:54.969518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:55.051933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:55.062349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:55.064436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:55.075747 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-35e21b4c-b368-4442-aeba-868b79437500 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.112640 May 14 21:30:55.077550 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2752/5115] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:54 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:56.086665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:56.087531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:56.096552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:56.097143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:56.098058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:56.098594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:56.187716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1415006032", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "482e0ed1-68c5-4c2d-8efe-8f79824053af"}], "security_groups": [{"name": "tempest-securitygroup--77388826"}], "key_name": "tempest-keypair-743069403", "user_data": "}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:30:56.193732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:56.202025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:56.203743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:56.204966 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c25e5917-5a4d-4801-990c-09252b357183 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.122746 May 14 21:30:56.205932 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2364/5116] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:56 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:56.298937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] validate_networks() for [('482e0ed1-68c5-4c2d-8efe-8f79824053af', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:30:56.696359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:30:56.696815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:30:56.697296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:30:56.697714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:30:56.698150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:30:56.707849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:56.708300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:56.709098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:56.709539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:56.727658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for project 6641b342c1d440aea451919f391bc5db. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:30:56.733902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Getting quotas for user 5586a3a946a0490498c42cb71f39ce1e and project 6641b342c1d440aea451919f391bc5db. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:30:56.749092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:30:56.752280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:30:56.946429 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1d56539-2464-4006-a79d-7bf76e2368ea tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.763684 May 14 21:30:56.952531 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2753/5117] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:30:56 2022] POST /compute/v2.1/servers => generated 400 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:30:56.959343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c6b6039-e466-40cb-a32f-5977d92a827d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:56.960108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c6b6039-e466-40cb-a32f-5977d92a827d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:57.021402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c6b6039-e466-40cb-a32f-5977d92a827d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:57.028043 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c6b6039-e466-40cb-a32f-5977d92a827d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1237 microversion: 2.1 time: 0.073182 May 14 21:30:57.028810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2365/5118] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:56 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:57.224398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:57.225039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:57.232360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:57.233522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:57.234448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:57.235365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:57.303097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:57.311174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:57.312879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:57.314065 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d35e0421-48f0-436f-81f2-25008a4c04ba tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.094826 May 14 21:30:57.314640 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2754/5119] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:57 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:58.046268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:58.047683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:58.056838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:58.056838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:58.057199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:58.057640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:58.138741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:58.146779 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2815f68-9b84-4fce-87c0-41f8b2684796 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1241 microversion: 2.1 time: 0.105069 May 14 21:30:58.147604 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2366/5120] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:58 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:58.333774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:58.334405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:58.341454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:58.342520 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:58.343301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:58.343898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:58.410891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:58.419014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:58.420647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:58.421826 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-217378ee-3714-4bf4-a2c0-4e3ac6f644d3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.092510 May 14 21:30:58.422416 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2755/5121] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:58 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:30:59.164349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:59.164914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:59.172438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:59.172894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:59.173672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:59.174121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:59.273761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:59.281120 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-13074614-2932-4751-a3de-aad69b4e1bb9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1289 microversion: 2.1 time: 0.120809 May 14 21:30:59.281705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2367/5122] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:30:59 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:30:59.443912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:30:59.444675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:30:59.455713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:59.457456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:59.457456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:30:59.457636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:30:59.532189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:59.553527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:59.557772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:30:59.563039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6f9e9be-6325-4a2e-9284-e19644957ec6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.125930 May 14 21:30:59.574466 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2756/5123] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:30:59 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:00.299330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:00.301639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:00.318562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:00.318562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:00.318562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:00.318562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:00.407471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:00.414984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eedb58cd-3ddb-4c05-8a78-1705326d7e7c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1307 microversion: 2.1 time: 0.120778 May 14 21:31:00.415592 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2368/5124] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:00 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1307 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:00.585529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:00.587395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:00.603266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:00.604136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:00.605207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:00.605847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:00.705735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:00.715233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:00.717154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:00.718822 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-39998554-4fbe-464a-8524-49322adb1d6e tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.140065 May 14 21:31:00.720009 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2757/5125] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:00 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:00.988983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:00.989542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:00.995682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:00.996422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:00.997289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:00.997816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:01.120430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lazy-loading 'services' on Instance uuid 75b21a9c-db83-4565-bb10-82a25f2c2f73 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:31:01.383181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3187cd81-fcbf-4a76-84f7-05dcf108d97f tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments/b941c16b-80e2-4f26-bb91-adb28379cf31" status: 202 len: 0 microversion: 2.1 time: 0.397857 May 14 21:31:01.384279 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2369/5126] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:31:00 2022] DELETE /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments/b941c16b-80e2-4f26-bb91-adb28379cf31 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:31:01.393393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9f3ab701-b865-46a9-b512-f1b6bc339488 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:01.394456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9f3ab701-b865-46a9-b512-f1b6bc339488 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:01.401243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9f3ab701-b865-46a9-b512-f1b6bc339488 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:01.401953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9f3ab701-b865-46a9-b512-f1b6bc339488 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:01.402806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9f3ab701-b865-46a9-b512-f1b6bc339488 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:01.403329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9f3ab701-b865-46a9-b512-f1b6bc339488 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:01.434048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:01.434767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:01.443530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:01.444578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:01.445620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:01.446739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:01.466443 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9f3ab701-b865-46a9-b512-f1b6bc339488 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077911 May 14 21:31:01.472216 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2758/5127] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:31:01 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:01.696969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:01.707181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-80abfc98-a9c7-4546-8b89-1adb91d6e3eb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.277570 May 14 21:31:01.708020 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2370/5128] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:01 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:01.736620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:01.737419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:01.744155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:01.744611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:01.745395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:01.745837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:01.817402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:01.825645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:01.829063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:01.831552 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a151ccab-fcd7-4fb8-9610-d9be2803f8c1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.098608 May 14 21:31:01.832407 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2759/5129] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:01 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:01.966495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-07195b3a-66bc-4744-8b6c-7673e2a04db8 req-8b2c9370-94df-4980-85ff-8533fdb1974b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3052d147-1dbb-4370-97c7-1d8170765e60", "tag": "eeffe894-ffc8-46c9-9c14-d40a84ece6ac"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:01.981337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-07195b3a-66bc-4744-8b6c-7673e2a04db8 req-8b2c9370-94df-4980-85ff-8533fdb1974b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:01.981793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-07195b3a-66bc-4744-8b6c-7673e2a04db8 req-8b2c9370-94df-4980-85ff-8533fdb1974b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:02.009742 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-07195b3a-66bc-4744-8b6c-7673e2a04db8 req-8b2c9370-94df-4980-85ff-8533fdb1974b service nova] Creating event network-changed:eeffe894-ffc8-46c9-9c14-d40a84ece6ac for instance 3052d147-1dbb-4370-97c7-1d8170765e60 on nch1-master-1 May 14 21:31:02.016535 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-07195b3a-66bc-4744-8b6c-7673e2a04db8 req-8b2c9370-94df-4980-85ff-8533fdb1974b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053319 May 14 21:31:02.017591 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2371/5130] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:02.479000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edd9938c-0101-46ed-8232-5e8475cbd46e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:02.480023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edd9938c-0101-46ed-8232-5e8475cbd46e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:02.487142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd9938c-0101-46ed-8232-5e8475cbd46e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:02.487641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd9938c-0101-46ed-8232-5e8475cbd46e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:02.489168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd9938c-0101-46ed-8232-5e8475cbd46e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:02.489616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edd9938c-0101-46ed-8232-5e8475cbd46e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:02.531470 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edd9938c-0101-46ed-8232-5e8475cbd46e tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056587 May 14 21:31:02.532712 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2760/5131] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:31:02 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:31:02.603255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:02.603255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:02.604905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:02.606880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:02.606880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:02.606880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:02.646399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:31:02.725554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:02.726631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:02.734913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:02.735380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:02.736268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:02.736719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:03.069666 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4bfcbde5-fb83-45c2-b2dc-9c2723b46a69 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 204 len: 0 microversion: 2.1 time: 0.474916 May 14 21:31:03.070523 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2372/5132] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:31:02 2022] DELETE /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:31:03.076630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:03.077797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:03.084469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:03.084922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:03.085709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:03.086335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:03.164256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:03.174389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:03.176029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:03.177237 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-66a5b5fa-a8df-441a-9b75-4d77c67b1ade tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.105279 May 14 21:31:03.177821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2373/5133] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:03 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:03.182409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:03.198481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:03.198481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:03.198481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:03.198481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:03.198481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:03.297276 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:03.305120 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72d6c9e5-1060-46a2-89ec-e930d97b325d tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.584360 May 14 21:31:03.305706 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2761/5134] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:02 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:31:03.348439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:03.356369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1253d048-91ad-42b8-9a5d-68986de71bf2 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1682 microversion: 2.1 time: 0.177572 May 14 21:31:03.356966 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2374/5135] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:03 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:04.196987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:04.197666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:04.205489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:04.205951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:04.206737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:04.207185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:04.322514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:04.324194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:04.332282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:04.332747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:04.333660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:04.334343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:04.337679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:04.347656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:04.349185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:04.350401 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a952184f-2dc2-44c4-a226-d0806a8b96e2 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.157423 May 14 21:31:04.351181 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2762/5136] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:04 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:04.374673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:04.375405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:04.381603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:04.382166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:04.383025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:04.383576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:04.488779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:04.494494 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d5684e48-fd44-4a0c-8b59-a3a16c28fb71 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.175730 May 14 21:31:04.495101 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2375/5137] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:04 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:04.539650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:04.548149 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6f28ab93-735f-40c8-97b4-9e97b221564d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1682 microversion: 2.1 time: 0.177740 May 14 21:31:04.548734 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2763/5138] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:04 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:31:05.369288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:05.370060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:05.381809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:05.381809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:05.381809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:05.381809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:05.511903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:05.512538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:05.516070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:05.521034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:05.521566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:05.522537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:05.522986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:05.524479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:05.526171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:05.527446 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7cc93f4c-f5d9-4eac-8943-9c9c518a002f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.162068 May 14 21:31:05.528057 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2376/5139] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:05 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:05.565706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:05.566820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:05.573803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:05.574275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:05.575071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:05.575551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:05.668658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:05.676425 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f496c3d-008d-47ce-ad96-ff2379e01960 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.168748 May 14 21:31:05.677010 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2764/5140] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:05 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:31:05.949776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:05.958321 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a4f29da-1d99-4752-9a6b-336e4bd08a84 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1682 microversion: 2.1 time: 0.396744 May 14 21:31:05.959028 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2377/5141] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:05 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1682 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:31:06.547622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:06.548303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:06.555065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:06.565193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:06.565193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:06.565193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:06.633641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:06.636592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ce102e81-f521-400e-af02-053e660f8bac req-e9f2271e-a591-43cb-a588-423cfa35cfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b21a9c-db83-4565-bb10-82a25f2c2f73", "name": "network-vif-deleted", "tag": "e5d49f69-5adf-446a-833b-443aa05619fb"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:06.642393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:06.643938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:06.645138 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53b7a936-c6fa-4fb3-b682-210540ffc966 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.102700 May 14 21:31:06.646785 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2765/5142] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:06 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:06.650512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ce102e81-f521-400e-af02-053e660f8bac req-e9f2271e-a591-43cb-a588-423cfa35cfea service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:06.651044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ce102e81-f521-400e-af02-053e660f8bac req-e9f2271e-a591-43cb-a588-423cfa35cfea service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:06.663907 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ce102e81-f521-400e-af02-053e660f8bac req-e9f2271e-a591-43cb-a588-423cfa35cfea service nova] Creating event network-vif-deleted:e5d49f69-5adf-446a-833b-443aa05619fb for instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 on nch1-master-1 May 14 21:31:06.670550 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ce102e81-f521-400e-af02-053e660f8bac req-e9f2271e-a591-43cb-a588-423cfa35cfea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038388 May 14 21:31:06.671678 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2378/5143] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:31:06.693846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:06.694815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:06.702798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:06.706409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:06.706409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:06.706409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:06.900453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:06.910807 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-46980df8-7be1-420b-9d7e-13acbfaeda04 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.220903 May 14 21:31:06.921740 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2766/5144] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:06 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:06.978564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:06.979584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:06.991849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:06.993146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:06.997086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:06.997704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:07.040898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:07.041363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:07.041833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lazy-loading 'fault' on Instance uuid 75b21a9c-db83-4565-bb10-82a25f2c2f73 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:31:07.111040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e3390c9579a4f598c46f9417b4dd046', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd6f25048cd4798985e725f734f1845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:07.121304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9bf2ea6-bc01-402c-b509-f110cd06cc66 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 200 len: 1332 microversion: 2.1 time: 0.147574 May 14 21:31:07.122149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2379/5145] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:06 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:07.665837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:07.666467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:07.673750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:07.674225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:07.675042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:07.675509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:07.754545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:07.767717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:07.769249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:07.770676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-767d96d2-8a14-41d9-b5e3-6529fd5d23d1 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.109131 May 14 21:31:07.771254 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2767/5146] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:07 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:07.928334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:07.929104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:07.936149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:07.936611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:07.937426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:07.937877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:08.095359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:08.112521 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-364adfb4-b57e-46f5-bb8f-736c952ac70c tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.188144 May 14 21:31:08.113396 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2380/5147] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:07 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:31:08.139401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:08.140086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:08.146279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:08.146738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:08.147530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:08.147978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:08.161218 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 HTTP/1.1 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '75b21a9c-db83-4565-bb10-82a25f2c2f73'} May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:08.162871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4b06e3f-de3e-45ab-9dde-159770082535 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 404 len: 111 microversion: 2.1 time: 0.028895 May 14 21:31:08.166707 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2768/5148] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:08 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:08.174020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f8874057-d61c-4b51-a06f-a53d9d476d3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '.version_select at 0x7fb1a702c3a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:08.304971 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f8874057-d61c-4b51-a06f-a53d9d476d3d tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105276351" status: 202 len: 0 microversion: 2.1 time: 0.135264 May 14 21:31:08.305571 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2381/5149] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1105276351 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:31:08.790084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:08.792915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:08.799390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:08.799976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:08.800861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:08.801408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:08.876878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:08.885678 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:08.887464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:08.888840 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b05e7362-d3ad-40ee-8d04-950a88903bb3 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1408 microversion: 2.54 time: 0.102678 May 14 21:31:08.900159 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2769/5150] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:08 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:09.132466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:09.135064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:09.146385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:09.147156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:09.148160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:09.148814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:09.162166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-cde02e67-4b39-46a3-8f4b-a1b9012ebff7 req-bc6a9120-1920-40b4-aefa-1180aff60a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3052d147-1dbb-4370-97c7-1d8170765e60", "name": "network-vif-plugged", "status": "completed", "tag": "eeffe894-ffc8-46c9-9c14-d40a84ece6ac"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:09.179536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cde02e67-4b39-46a3-8f4b-a1b9012ebff7 req-bc6a9120-1920-40b4-aefa-1180aff60a9a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:09.179536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cde02e67-4b39-46a3-8f4b-a1b9012ebff7 req-bc6a9120-1920-40b4-aefa-1180aff60a9a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:09.197399 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-cde02e67-4b39-46a3-8f4b-a1b9012ebff7 req-bc6a9120-1920-40b4-aefa-1180aff60a9a service nova] Creating event network-vif-plugged:eeffe894-ffc8-46c9-9c14-d40a84ece6ac for instance 3052d147-1dbb-4370-97c7-1d8170765e60 on nch1-master-1 May 14 21:31:09.203343 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-cde02e67-4b39-46a3-8f4b-a1b9012ebff7 req-bc6a9120-1920-40b4-aefa-1180aff60a9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045851 May 14 21:31:09.204339 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2770/5151] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:31:09.369446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:09.377452 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd22d904-ab4b-4bd3-892d-a9854e65480a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.251283 May 14 21:31:09.386948 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2382/5152] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:09 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:09.909996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:09.910830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:09.918291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:09.919049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:09.921805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:09.922500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:09.997841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:10.006028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:10.007726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:10.008981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0250abb0-0566-42fb-9ecc-d6693ada14fe tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1426 microversion: 2.54 time: 0.104825 May 14 21:31:10.009558 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2771/5153] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:09 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1426 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:10.395431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:10.396145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:10.404708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:10.405339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:10.406148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:10.406596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:10.569994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:10.578642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d7c0c33f-11dc-46b0-8d1b-d1b09dcaeddb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1361 microversion: 2.1 time: 0.187640 May 14 21:31:10.580639 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2383/5154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:10 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:31:11.028071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:11.028701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:11.036742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:11.037205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:11.038146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:11.038590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:11.108627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:11.116010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:11.117525 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:11.119970 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ffccd9df-7b46-4dfc-9ee5-2435b0f89baf tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1414 microversion: 2.54 time: 0.095854 May 14 21:31:11.120538 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2772/5155] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:11 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1414 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:11.595863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:11.596497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:11.608284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:11.609180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:11.610236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:11.610714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:11.751185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:11.761825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f8a045c-918e-4f8c-bd64-b5157fdf0dae tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1546 microversion: 2.1 time: 0.170532 May 14 21:31:11.763295 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2384/5156] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:11 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1546 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:31:11.781245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c316836f-8229-4216-be09-cc9a40034e88 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:11.781245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c316836f-8229-4216-be09-cc9a40034e88 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:11.787690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c316836f-8229-4216-be09-cc9a40034e88 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:11.788071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c316836f-8229-4216-be09-cc9a40034e88 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:11.788901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c316836f-8229-4216-be09-cc9a40034e88 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:11.789388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c316836f-8229-4216-be09-cc9a40034e88 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:11.869736 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c316836f-8229-4216-be09-cc9a40034e88 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093598 May 14 21:31:11.870428 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2773/5157] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:31:11 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:12.140906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:12.142366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:12.148512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:12.149116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:12.149904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:12.150460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:12.238022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:12.247699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:12.248484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:12.249874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2954f330-c9b9-473d-86f3-6525ee748ddc tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1414 microversion: 2.54 time: 0.115602 May 14 21:31:12.250593 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2385/5158] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:12 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1414 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:13.128733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-41b2efef-a9f8-4039-87c4-c88ad3ff4791 req-d953d84e-1a38-4b42-ba26-18bb21666bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3052d147-1dbb-4370-97c7-1d8170765e60", "tag": "eeffe894-ffc8-46c9-9c14-d40a84ece6ac"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:13.128733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-41b2efef-a9f8-4039-87c4-c88ad3ff4791 req-d953d84e-1a38-4b42-ba26-18bb21666bd1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:13.129616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-41b2efef-a9f8-4039-87c4-c88ad3ff4791 req-d953d84e-1a38-4b42-ba26-18bb21666bd1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:13.143961 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-41b2efef-a9f8-4039-87c4-c88ad3ff4791 req-d953d84e-1a38-4b42-ba26-18bb21666bd1 service nova] Creating event network-changed:eeffe894-ffc8-46c9-9c14-d40a84ece6ac for instance 3052d147-1dbb-4370-97c7-1d8170765e60 on nch1-master-1 May 14 21:31:13.148816 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-41b2efef-a9f8-4039-87c4-c88ad3ff4791 req-d953d84e-1a38-4b42-ba26-18bb21666bd1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033222 May 14 21:31:13.149420 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2774/5159] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:13.269656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:13.270538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:13.277701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:13.278421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:13.279938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:13.280731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:13.375949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:13.384665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:13.386314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:13.387662 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5f56b68-3f58-4a99-9741-baaffe2e2b0a tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1399 microversion: 2.54 time: 0.122297 May 14 21:31:13.389207 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2386/5160] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:13 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1399 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:31:13.409341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f5e33566-7b59-4e15-a4e6-d99a93a894c6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '.version_select at 0x7fb1b96c6550>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:13.574234 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f5e33566-7b59-4e15-a4e6-d99a93a894c6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1540418644" status: 204 len: 0 microversion: 2.54 time: 0.169425 May 14 21:31:13.576362 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2775/5161] 10.222.0.52 () {60 vars in 1318 bytes} [Sat May 14 21:31:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1540418644 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:31:13.593183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:13.594078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:13.604483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:13.605628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:13.606521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:13.608446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:13.644692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:31:14.103377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f7629073-238d-45a6-ae6b-d6eb6c05a4a6 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 204 len: 0 microversion: 2.54 time: 0.515790 May 14 21:31:14.107960 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2387/5162] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:31:13 2022] DELETE /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:31:14.112431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:14.113198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:14.122942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:14.124560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:14.124954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:14.125572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:14.220765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:14.242599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:14.244329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:14.245750 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6a9bf5f-af6e-4c4b-a68b-4c4ed1d55000 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1405 microversion: 2.54 time: 0.137183 May 14 21:31:14.246240 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2776/5163] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:14 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:31:15.265896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:15.266594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:15.273324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:15.277946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:15.277946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:15.277946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:15.364946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:15.378138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:15.381515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:15.381515 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-251abd94-0ead-4632-b633-89892eaf3a13 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1405 microversion: 2.54 time: 0.120417 May 14 21:31:15.381515 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2388/5164] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:15 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:16.401018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:16.401608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:16.409400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:16.409851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:16.410624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:16.411061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:16.443554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:16.444008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:16.444458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lazy-loading 'fault' on Instance uuid b790ef9f-e749-4444-a8a0-cd0538a43c35 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:31:16.485564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:16.493456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:16.495017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7133ca2c209048149a095b778ac1424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5e9ab5390a49d0ad1896e52248340d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:16.496298 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b19121cc-741f-4b77-8d3e-9366d7deeaf7 tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 200 len: 1410 microversion: 2.54 time: 0.099368 May 14 21:31:16.496869 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2777/5165] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:16 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 1410 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:17.514531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:17.516069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] [instance: b790ef9f-e749-4444-a8a0-cd0538a43c35] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:17.523912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:17.524376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:17.525168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:17.525608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:17.541191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] HTTP exception thrown: Instance b790ef9f-e749-4444-a8a0-cd0538a43c35 could not be found. May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Request method failure captured: May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 HTTP/1.1 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB94PhtaDgH4979AKe_0GDC39NkGE3hoJyae3pibcC-9D8HwNC75Q9V9541tBjXAwzuDeyOyExzfeB8RC-pfTih7eQ5FRYdsbAQquxy80dhx667oJ4isW-hIxHl-bU248oe6L661cW--bye76HDcGYdx9Kp1OqZN5H5M-8DLrRS8FgA May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.54 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: ae5e9ab5390a49d0ad1896e52248340d May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerShowV254Test-831601773 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e9ab5390a49d0ad1896e52248340d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ae5e9ab5390a49d0ad1896e52248340d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ae5e9ab5390a49d0ad1896e52248340d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ae5e9ab5390a49d0ad1896e52248340d", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerShowV254Test-831601773 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: ae5e9ab5390a49d0ad1896e52248340d May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerShowV254Test-831601773 May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerShowV254Test-831601773-project May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 7133ca2c209048149a095b778ac1424e May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerShowV254Test-831601773-project May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance b790ef9f-e749-4444-a8a0-cd0538a43c35 could not be found. May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'b790ef9f-e749-4444-a8a0-cd0538a43c35'} May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b790ef9f-e749-4444-a8a0-cd0538a43c35 could not be found. May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b790ef9f-e749-4444-a8a0-cd0538a43c35 could not be found. May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:17.542885 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b790ef9f-e749-4444-a8a0-cd0538a43c35 could not be found. May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] Returning 404 to user: Instance b790ef9f-e749-4444-a8a0-cd0538a43c35 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3f633f69-305f-4ad0-971f-668876663e4f tempest-ServerShowV254Test-831601773 tempest-ServerShowV254Test-831601773-project] 10.222.0.52 "GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35" status: 404 len: 111 microversion: 2.54 time: 0.034922 May 14 21:31:17.548088 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2389/5166] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:17 2022] GET /compute/v2.1/servers/b790ef9f-e749-4444-a8a0-cd0538a43c35 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:31:20.011119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-08743024-7b53-4e18-a533-f15584ef1498 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:20.011760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-08743024-7b53-4e18-a533-f15584ef1498 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:20.021511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08743024-7b53-4e18-a533-f15584ef1498 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:20.022287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08743024-7b53-4e18-a533-f15584ef1498 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:20.023532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08743024-7b53-4e18-a533-f15584ef1498 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:20.024990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-08743024-7b53-4e18-a533-f15584ef1498 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:20.050573 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-08743024-7b53-4e18-a533-f15584ef1498 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/ips" status: 200 len: 152 microversion: 2.20 time: 0.043701 May 14 21:31:20.051170 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2778/5167] 10.222.0.52 () {60 vars in 1288 bytes} [Sat May 14 21:31:20 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:31:24.372248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:24.372830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:24.382160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:24.382636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:24.385055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:24.388229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:24.405017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:24.405611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:24.413877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:24.414342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:24.415441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:24.416076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:24.427074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lazy-loading 'flavor' on Instance uuid db0cc056-41d6-4656-ab5e-714ac048819b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:31:24.437126 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 HTTP/1.1 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '75b21a9c-db83-4565-bb10-82a25f2c2f73'} May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:24.438847 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-682dfe7b-a036-4197-a33b-e48a244ba654 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 404 len: 111 microversion: 2.1 time: 0.039973 May 14 21:31:24.442540 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2779/5168] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:31:24 2022] DELETE /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:31:24.452432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:24.453089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 75b21a9c-db83-4565-bb10-82a25f2c2f73] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:24.462507 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:24.462971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:24.463908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:24.464424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:24.483342 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 HTTP/1.1 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '75b21a9c-db83-4565-bb10-82a25f2c2f73'} May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:24.484963 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 75b21a9c-db83-4565-bb10-82a25f2c2f73 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edfc7912-0ddd-4168-9133-69a9a9ae77b6 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73" status: 404 len: 111 microversion: 2.1 time: 0.041465 May 14 21:31:24.488717 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2780/5169] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:24 2022] GET /compute/v2.1/servers/75b21a9c-db83-4565-bb10-82a25f2c2f73 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:25.098402 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-263cee4b-a7aa-41e6-a58e-7de84afaca9e tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/action" status: 202 len: 0 microversion: 2.20 time: 0.730238 May 14 21:31:25.099986 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2390/5170] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:31:24 2022] POST /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:31:25.111574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:25.111574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:25.117817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:25.118348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:25.119163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:25.119652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:25.598952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:25.609528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:25.611511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:25.612900 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-efc1256e-3b47-4c4e-9f29-01e1da94395c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.509091 May 14 21:31:25.613556 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2781/5171] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:25 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:26.633710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:26.635369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:26.643656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:26.644142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:26.644934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:26.645377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:26.822477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:26.834216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:26.835888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:26.837207 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d3683edb-d82a-4aec-8591-eabfcb3d72c1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.208890 May 14 21:31:26.838032 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2391/5172] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:26 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:27.858780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:27.859693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:27.867118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:27.867810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:27.868593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:27.869533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:28.097456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:28.105866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:28.108123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:28.109317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15e590e0-f2c0-43de-b539-2c00ed5ed4dd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.256977 May 14 21:31:28.109899 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2782/5173] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:27 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:29.128713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:29.129348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:29.136164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:29.136631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:29.138924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:29.138924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:29.277628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:29.285885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:29.287422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:29.288674 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28d8f7f8-804b-48f2-b421-623b3c882fe6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.163885 May 14 21:31:29.289257 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2392/5174] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:29 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:30.308399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:30.309033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:30.316613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:30.316777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:30.317560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:30.318019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:30.459032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:30.468233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:30.469868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:30.471057 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70e98114-8e9d-4c9c-918c-b1aa4eea4192 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.166898 May 14 21:31:30.484255 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2783/5175] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:30 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:31.490579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:31.491216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:31.499090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:31.499936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:31.505401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:31.505401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:31.692613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:31.703685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:31.705313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:31.707062 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0e3d67c-cea3-4705-a306-ee6d38020dca tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.220868 May 14 21:31:31.707675 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2393/5176] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:31 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:32.726684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:32.727400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:32.734205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:32.734660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:32.735437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:32.736892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:33.084560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:33.097388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:33.099730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:33.109310 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f733bab9-a4f3-4ce7-948c-8c4def9777ea tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.380035 May 14 21:31:33.109310 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2784/5177] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:32 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:31:34.133381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:34.133381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:34.138087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:34.138672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:34.139604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:34.140129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:34.440269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:34.450146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:34.454227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:34.455688 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b6dbb7b4-cfe4-4705-81b6-7279d31a51c6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.334666 May 14 21:31:34.456913 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2394/5178] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:34 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:35.474329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:35.474955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:35.483185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:35.483675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:35.484451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:35.484889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:35.674088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:35.688724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:35.691247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:35.692759 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c7597ad-5ea2-4ce9-b698-0bcc7129ffb7 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.222497 May 14 21:31:35.693517 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2785/5179] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:35 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:36.711211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:36.711924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:36.719724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:36.720402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:36.721570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:36.723327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:36.939602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:36.948544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:36.950449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:36.951870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d1a192b-4560-49bf-af5f-e48e9d7c60b3 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1743 microversion: 2.20 time: 0.244640 May 14 21:31:36.952563 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2395/5180] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:36 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1743 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:37.972693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:37.973663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:37.992066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:37.993254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:37.994940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:37.995770 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:39.049344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:39.058474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:39.062596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:39.064913 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a183b26-e975-46f9-b6b0-1b74151ab773 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 1.096857 May 14 21:31:39.065638 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2786/5181] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:37 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:39.143553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2516e137-e28f-4ea8-b804-4449df599e08 req-4ff93d62-590b-4b0f-be45-6639dd13ac50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "name": "network-vif-plugged", "status": "completed", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:39.154125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2516e137-e28f-4ea8-b804-4449df599e08 req-4ff93d62-590b-4b0f-be45-6639dd13ac50 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:39.154845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2516e137-e28f-4ea8-b804-4449df599e08 req-4ff93d62-590b-4b0f-be45-6639dd13ac50 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:39.169252 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2516e137-e28f-4ea8-b804-4449df599e08 req-4ff93d62-590b-4b0f-be45-6639dd13ac50 service nova] Creating event network-vif-plugged:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch2-master-1 May 14 21:31:39.175555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2516e137-e28f-4ea8-b804-4449df599e08 req-4ff93d62-590b-4b0f-be45-6639dd13ac50 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035727 May 14 21:31:39.176857 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2396/5182] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:40.084581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:40.085265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:40.098538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:40.098975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:40.099840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:40.100380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:40.363947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:40.376118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:40.377989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:40.379434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a1d132c9-cf6c-41a6-96b5-5d62370ebe0b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.299196 May 14 21:31:40.392695 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2787/5183] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:40 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:41.404858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:41.404858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:41.412240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:41.412717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:41.413505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:41.413953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:41.846427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:41.848239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:41.862555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:41.863890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:41.865422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:41.866924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:41.896640 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 HTTP/1.1 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'cb444169-fb87-45fa-a967-7df84f979a00'} May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:41.907412 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:41.911848 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:41.912697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:41.913451 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-da30c3f6-d8d3-46a6-b1c0-195bfa305998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 404 len: 111 microversion: 2.1 time: 0.072763 May 14 21:31:41.939867 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2788/5184] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:31:41 2022] DELETE /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:41.956499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:41.966668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: cb444169-fb87-45fa-a967-7df84f979a00] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:41.975987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:41.976409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:41.977206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:41.977733 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:42.016739 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 HTTP/1.1 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'cb444169-fb87-45fa-a967-7df84f979a00'} May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:42.019522 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.023737 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.023737 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:42.023737 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:42.023737 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:42.023737 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:42.023737 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. May 14 21:31:42.023737 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.025147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance cb444169-fb87-45fa-a967-7df84f979a00 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:42.026613 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37a5edb5-543a-4814-b488-1a4b1e809da8 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00" status: 404 len: 111 microversion: 2.1 time: 0.082517 May 14 21:31:42.027516 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2789/5185] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:41 2022] GET /compute/v2.1/servers/cb444169-fb87-45fa-a967-7df84f979a00 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:42.037331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:42.038332 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:42.048969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:42.049680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:42.050647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:42.051249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:42.088951 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 HTTP/1.1 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '512524da-bcba-4fde-ac6e-ba6748e659e9'} May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:42.095783 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.100755 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.110776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:42.110776 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9434e6f-1392-4341-979c-0b870040ed75 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 404 len: 111 microversion: 2.1 time: 0.071964 May 14 21:31:42.110776 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2790/5186] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:31:42 2022] DELETE /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:42.118559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:42.119348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 512524da-bcba-4fde-ac6e-ba6748e659e9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:42.128628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:42.129249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:42.130049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:42.130989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:42.154479 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 HTTP/1.1 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '512524da-bcba-4fde-ac6e-ba6748e659e9'} May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:42.159879 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 512524da-bcba-4fde-ac6e-ba6748e659e9 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf966ee7-ad42-4747-a5ad-6ae745f6b998 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9" status: 404 len: 111 microversion: 2.1 time: 0.052794 May 14 21:31:42.163900 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2791/5187] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:42 2022] GET /compute/v2.1/servers/512524da-bcba-4fde-ac6e-ba6748e659e9 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:42.533953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:42.543402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:42.553360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:42.554760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-35fa378c-6b6f-4190-b763-688f32b9bbd6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 1.160039 May 14 21:31:42.555347 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2397/5188] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:41 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:43.577794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:43.578461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:43.601149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:43.603470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:43.608377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:43.612269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:43.989484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:44.006154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:44.009688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:44.011470 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6ee3aead-f707-4379-beba-b444bb1ba5f1 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.438561 May 14 21:31:44.012593 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2792/5189] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:43 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:45.030695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:45.032095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:45.046034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:45.050250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:45.054369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:45.061459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:45.345460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:45.354729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:45.357896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:45.362067 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2edcd4f1-0d8c-421a-8e3d-f49a89447612 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.334675 May 14 21:31:45.362067 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2398/5190] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:45 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:46.393636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:46.395424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:46.417056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:46.417438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:46.418239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:46.419452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:46.860407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:46.956658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:46.956658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:46.959042 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cdc59e13-490a-46b1-bd53-4b0bcae950b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.580428 May 14 21:31:46.973703 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2793/5191] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:46 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:47.574624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8c77a93-3a03-4d3e-97c6-bcd317cd2ce1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:47.582237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8c77a93-3a03-4d3e-97c6-bcd317cd2ce1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:47.589067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8c77a93-3a03-4d3e-97c6-bcd317cd2ce1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:47.589527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8c77a93-3a03-4d3e-97c6-bcd317cd2ce1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:47.590341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8c77a93-3a03-4d3e-97c6-bcd317cd2ce1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:47.591190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8c77a93-3a03-4d3e-97c6-bcd317cd2ce1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:47.619830 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8c77a93-3a03-4d3e-97c6-bcd317cd2ce1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/ips" status: 200 len: 145 microversion: 2.1 time: 0.050399 May 14 21:31:47.626587 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2399/5192] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:31:47 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/ips => generated 145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:47.981539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:47.982163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:47.989316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:47.991212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:47.991212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:47.991212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:48.273453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:48.286130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:48.287697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:48.288879 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-575af799-3bec-4aab-93bd-2a3f75e027fc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.311940 May 14 21:31:48.304966 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2794/5193] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:47 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:49.310286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:49.311923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:49.320971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:49.324106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:49.324106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:49.324106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:49.553961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:49.566083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:49.581491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:49.582778 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3360c9df-6741-4128-8644-51a1c3c300ff tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.279015 May 14 21:31:49.583981 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2400/5194] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:49 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:50.614895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:50.616313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:50.648778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:50.653379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:50.653913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:50.655531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:50.741364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9679505f-6c9b-4840-a65b-11aacd39c6f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01597bbf-2f11-4ddd-bf70-6785c56639f3"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:50.744650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9679505f-6c9b-4840-a65b-11aacd39c6f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:50.757662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9679505f-6c9b-4840-a65b-11aacd39c6f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:50.757662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9679505f-6c9b-4840-a65b-11aacd39c6f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:50.757662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9679505f-6c9b-4840-a65b-11aacd39c6f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:50.757662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9679505f-6c9b-4840-a65b-11aacd39c6f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:51.033975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:51.040581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:51.047035 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:51.056506 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf6e6321-625f-41b5-b460-ef2bc8f2f244 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.456138 May 14 21:31:51.062172 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2795/5195] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:50 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:52.085527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:52.086219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:52.104944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:52.108065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:52.109124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:52.109601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:52.265257 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9679505f-6c9b-4840-a65b-11aacd39c6f6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.527685 May 14 21:31:52.266747 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2401/5196] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:31:50 2022] POST /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments => generated 194 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:31:52.358730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:52.379410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:52.387439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:52.392750 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-377c9014-d1e6-49ce-8928-d451860fd475 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.310809 May 14 21:31:52.409664 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2796/5197] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:52 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:31:53.427769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:53.429444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:53.449664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:53.452010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:53.468732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:53.471428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:53.771429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:53.785251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:53.786954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:53.788310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6df1854c-da33-4979-af2a-fe6c62e2294d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1738 microversion: 2.20 time: 0.370347 May 14 21:31:53.789745 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2402/5198] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:53 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1738 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:54.377453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1225758196", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "b0cab043-53b8-4ad0-a05a-af91f4f3c378"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:54.460024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] validate_networks() for [('b0cab043-53b8-4ad0-a05a-af91f4f3c378', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:31:54.821222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:54.821958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:54.830949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:54.831548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:54.832645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:54.833290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:55.077923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:55.092658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:55.094217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:55.101708 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11d0dd72-c21b-451a-867f-d3ab99d6aaf8 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1720 microversion: 2.20 time: 0.286623 May 14 21:31:55.102395 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2403/5199] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:54 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:55.213568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:31:55.215057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:31:55.215971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:31:55.216645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:31:55.217191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:31:55.235155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:55.235918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:55.236913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:55.237552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:55.259854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Getting quotas for project 5241cdff4cf3483c9b0dbdf7bf4e0ceb. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:31:55.268845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Getting quotas for user 4ad81cc85a4146199c0d1a8c17f8aa21 and project 5241cdff4cf3483c9b0dbdf7bf4e0ceb. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:31:55.296691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:31:55.300879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:31:55.518774 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f92e556f-08b6-40e0-ac73-ec4c52cec8db tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.565853 May 14 21:31:55.520869 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2797/5200] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:31:55.532441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8884c3a-2fdd-453d-96c8-bcf6179f1ec0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:55.533380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d8884c3a-2fdd-453d-96c8-bcf6179f1ec0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:55.598991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d8884c3a-2fdd-453d-96c8-bcf6179f1ec0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:55.611307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d8884c3a-2fdd-453d-96c8-bcf6179f1ec0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:55.616824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d8884c3a-2fdd-453d-96c8-bcf6179f1ec0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:55.620430 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8884c3a-2fdd-453d-96c8-bcf6179f1ec0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1259 microversion: 2.21 time: 0.091149 May 14 21:31:55.621069 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2404/5201] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:55 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1259 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:55.789826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:55.790352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:55.800718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:55.801175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:55.802132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:55.802901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b HTTP/1.1 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '933ec720-1f55-478a-bac2-8f9e96aa692b'} May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:55.826425 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:31:55.830911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:55.833040 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a07df6a7-3f14-4d27-8b05-5fe2c703c4f9 tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "DELETE /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 404 len: 111 microversion: 2.1 time: 0.041129 May 14 21:31:55.834306 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2798/5202] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:31:55 2022] DELETE /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:55.850858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:55.858868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] [instance: 933ec720-1f55-478a-bac2-8f9e96aa692b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:55.889824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:55.889824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:55.889824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:55.892817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:55.939753 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] HTTP exception thrown: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Request method failure captured: May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b HTTP/1.1 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB5m8AAT4Z_k-vIXl0iO7PmEwA3tlWaV0Z6Ddf-T4glkZbOUDda0DrcRdqabVduehXjVMOVzmql_2Hkp-93MNcr6knCIqlhefy9JMrsy2eqBN01EhAkRUMdc8NC_s8nMNGxks788RPp1liKz8SRoskMamJ3IOWSn2SCKchbNu463vUQ May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bd6f25048cd4798985e725f734f1845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bd6f25048cd4798985e725f734f1845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 8bd6f25048cd4798985e725f734f1845 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286916119 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1e3390c9579a4f598c46f9417b4dd046 May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeNegativeTest-1286916119-project May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '933ec720-1f55-478a-bac2-8f9e96aa692b'} May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:31:55.944176 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:55.948306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:31:55.948306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:31:55.948306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:31:55.948306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:31:55.948306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:31:55.948306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. May 14 21:31:55.948306 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:31:55.949246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] Returning 404 to user: Instance 933ec720-1f55-478a-bac2-8f9e96aa692b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:31:55.950706 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-77c4311a-c9b2-4da1-b46f-bc5110aa333b tempest-AttachVolumeNegativeTest-1286916119 tempest-AttachVolumeNegativeTest-1286916119-project] 10.222.0.52 "GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b" status: 404 len: 111 microversion: 2.1 time: 0.112145 May 14 21:31:55.955420 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2405/5203] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:31:55 2022] GET /compute/v2.1/servers/933ec720-1f55-478a-bac2-8f9e96aa692b => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:31:56.127519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:56.128379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:56.146341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:56.146341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:56.146341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:56.146341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:56.344763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:56.357440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:56.359308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:56.360924 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e11cbef-8a9c-45f5-8889-552356318abc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1720 microversion: 2.20 time: 0.239518 May 14 21:31:56.362356 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2799/5204] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:56 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:56.639664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8809d210-28a7-4106-84f8-3269ee5fd39a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:56.641333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8809d210-28a7-4106-84f8-3269ee5fd39a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:56.774604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8809d210-28a7-4106-84f8-3269ee5fd39a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:56.784014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8809d210-28a7-4106-84f8-3269ee5fd39a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:56.786827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8809d210-28a7-4106-84f8-3269ee5fd39a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:56.788290 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8809d210-28a7-4106-84f8-3269ee5fd39a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1259 microversion: 2.21 time: 0.152862 May 14 21:31:56.799952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2406/5205] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:56 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:56.979638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-865df02a-1951-4510-90b6-5ff47fb07a8e tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:56.980945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-865df02a-1951-4510-90b6-5ff47fb07a8e tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:56.987880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-865df02a-1951-4510-90b6-5ff47fb07a8e tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:56.989867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-865df02a-1951-4510-90b6-5ff47fb07a8e tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:56.990990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-865df02a-1951-4510-90b6-5ff47fb07a8e tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:56.991816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-865df02a-1951-4510-90b6-5ff47fb07a8e tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.051408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c5d5e9ef-fbc4-48dd-bcaa-4127fab61b3e req-8b5317b6-3d22-4692-bef8-0b5b5c1d13d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "name": "network-vif-unplugged", "status": "completed", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:57.054664 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-865df02a-1951-4510-90b6-5ff47fb07a8e tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080410 May 14 21:31:57.055501 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2800/5206] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:31:56 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:57.065547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c5d5e9ef-fbc4-48dd-bcaa-4127fab61b3e req-8b5317b6-3d22-4692-bef8-0b5b5c1d13d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.068137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c5d5e9ef-fbc4-48dd-bcaa-4127fab61b3e req-8b5317b6-3d22-4692-bef8-0b5b5c1d13d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.068264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e55d7aaa-aa98-4e5d-a2b0-e8d063147547 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:57.068264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e55d7aaa-aa98-4e5d-a2b0-e8d063147547 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:57.075192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e55d7aaa-aa98-4e5d-a2b0-e8d063147547 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.075774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e55d7aaa-aa98-4e5d-a2b0-e8d063147547 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.076572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e55d7aaa-aa98-4e5d-a2b0-e8d063147547 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.077011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e55d7aaa-aa98-4e5d-a2b0-e8d063147547 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.081708 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c5d5e9ef-fbc4-48dd-bcaa-4127fab61b3e req-8b5317b6-3d22-4692-bef8-0b5b5c1d13d1 service nova] Creating event network-vif-unplugged:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch2-master-1 May 14 21:31:57.088202 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c5d5e9ef-fbc4-48dd-bcaa-4127fab61b3e req-8b5317b6-3d22-4692-bef8-0b5b5c1d13d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041063 May 14 21:31:57.088980 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2407/5207] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:31:57.114554 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e55d7aaa-aa98-4e5d-a2b0-e8d063147547 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/01597bbf-2f11-4ddd-bf70-6785c56639f3" status: 200 len: 194 microversion: 2.1 time: 0.052157 May 14 21:31:57.115307 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2801/5208] 10.222.0.52 () {58 vars in 1412 bytes} [Sat May 14 21:31:57 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/01597bbf-2f11-4ddd-bf70-6785c56639f3 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:31:57.387524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:57.388358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:57.397780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.398251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.399396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.408238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.775454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:57.799437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:57.801296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:57.803225 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8144df20-3bfb-4d8f-9602-619bbfe04e67 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1723 microversion: 2.20 time: 0.421180 May 14 21:31:57.804412 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2408/5209] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:57 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:57.818380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:57.819009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:57.829614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.834917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.835783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.836246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.838113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cbd78046-40e1-4642-b56c-ae8a203375cd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11d02ad8-e260-47a5-8195-f9c8f8b8ea85"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:31:57.839875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cbd78046-40e1-4642-b56c-ae8a203375cd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:57.856644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbd78046-40e1-4642-b56c-ae8a203375cd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.857112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbd78046-40e1-4642-b56c-ae8a203375cd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:57.857935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbd78046-40e1-4642-b56c-ae8a203375cd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:57.858416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbd78046-40e1-4642-b56c-ae8a203375cd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:58.045028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:58.060579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:58.062924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:58.064324 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50ac3c79-c53e-4472-9b0e-90d98fd8ac3d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1255 microversion: 2.21 time: 0.261845 May 14 21:31:58.069841 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2802/5210] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:57 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1255 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:59.098631 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:59.101744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:59.111106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:59.111887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:59.113031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:59.113722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:59.307699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:59.321249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:59.326500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:31:59.332125 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-def969fc-6a39-45d3-bff3-e3f717f6965e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1329 microversion: 2.21 time: 0.246737 May 14 21:31:59.346760 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2803/5211] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:31:59 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1329 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:31:59.502346 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cbd78046-40e1-4642-b56c-ae8a203375cd tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.680898 May 14 21:31:59.504538 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2409/5212] 10.222.0.52 () {62 vars in 1363 bytes} [Sat May 14 21:31:57 2022] POST /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-volume_attachments => generated 188 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:31:59.676027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-88d24d17-99e2-4724-bf09-602bcf131253 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:31:59.676803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-88d24d17-99e2-4724-bf09-602bcf131253 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:31:59.707147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d24d17-99e2-4724-bf09-602bcf131253 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:59.711599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d24d17-99e2-4724-bf09-602bcf131253 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:31:59.712579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d24d17-99e2-4724-bf09-602bcf131253 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:31:59.713049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-88d24d17-99e2-4724-bf09-602bcf131253 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:00.353120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:00.353869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:00.365798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:00.366361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:00.367430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:00.368369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:00.717117 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-88d24d17-99e2-4724-bf09-602bcf131253 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-volume_attachments/11d02ad8-e260-47a5-8195-f9c8f8b8ea85" status: 202 len: 0 microversion: 2.20 time: 1.043254 May 14 21:32:00.721166 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2804/5213] 10.222.0.52 () {60 vars in 1456 bytes} [Sat May 14 21:31:59 2022] DELETE /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-volume_attachments/11d02ad8-e260-47a5-8195-f9c8f8b8ea85 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:32:00.728538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:00.746690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:00.762244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:00.767599 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f897ab70-2bb6-42f6-917a-60a48fc76aa5 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 0.418735 May 14 21:32:00.780116 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2410/5214] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:00 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:00.807764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b8d61a4c-c667-4077-a0e1-52b4a9e3d6c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:00.808351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b8d61a4c-c667-4077-a0e1-52b4a9e3d6c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:00.815466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8d61a4c-c667-4077-a0e1-52b4a9e3d6c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:00.817203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8d61a4c-c667-4077-a0e1-52b4a9e3d6c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:00.821147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8d61a4c-c667-4077-a0e1-52b4a9e3d6c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:00.821765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8d61a4c-c667-4077-a0e1-52b4a9e3d6c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:01.174778 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b8d61a4c-c667-4077-a0e1-52b4a9e3d6c4 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "POST /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/action" status: 202 len: 0 microversion: 2.20 time: 0.371972 May 14 21:32:01.175430 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2805/5215] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:32:00 2022] POST /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 14 21:32:01.190715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:01.191154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:01.228341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:01.228863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:01.229694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:01.230139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:01.303922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2f05bdbd-ad45-4d9c-b983-436376046ada tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db8974a4-ada7-45fe-acdd-6123c7b72686"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:01.305132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2f05bdbd-ad45-4d9c-b983-436376046ada tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:01.323793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f05bdbd-ad45-4d9c-b983-436376046ada tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:01.325073 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f05bdbd-ad45-4d9c-b983-436376046ada tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:01.327115 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f05bdbd-ad45-4d9c-b983-436376046ada tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:01.327781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2f05bdbd-ad45-4d9c-b983-436376046ada tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:01.814394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:01.843529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:01.853884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:01.856055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d70956e-083b-48b2-8862-80c48a3752c5 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1671 microversion: 2.20 time: 0.674691 May 14 21:32:01.872950 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2411/5216] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:01 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1671 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:01.879864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:01.885237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:01.901111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:01.901763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:01.903684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:01.903684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:02.577793 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2f05bdbd-ad45-4d9c-b983-436376046ada tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "POST /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.277832 May 14 21:32:02.580811 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2806/5217] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:32:01 2022] POST /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments => generated 194 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:02.892668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:02.894324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:02.908510 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:02.909124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:02.910560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:02.911192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:03.085448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:03.094483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:03.107516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:03.108748 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c00c036-f7f6-47c0-b7fc-9852eefd1d86 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 1.234090 May 14 21:32:03.109339 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2412/5218] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:01 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:03.214212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:03.236762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:03.241906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:03.244830 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-958d252a-01bd-4a6d-910c-25c16cf11e86 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1671 microversion: 2.20 time: 0.366783 May 14 21:32:03.249486 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2807/5219] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:02 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1671 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:04.127587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:04.128793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:04.141663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:04.142727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:04.146909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:04.148197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:04.269865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:04.270574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:04.287587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:04.288062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:04.289029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:04.289927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:04.788230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:04.797041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:04.798812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:04.800237 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fbf8bd61-87ff-414b-a006-863147a42e94 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.537408 May 14 21:32:04.814144 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2808/5220] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:04 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:05.024543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:05.040250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:05.046643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:05.051820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-851c358e-d686-445f-a1a0-0cf3f507132e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 0.927704 May 14 21:32:05.063669 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2413/5221] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:04 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:05.078024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-937a1f85-7055-4f7a-898c-a5f7e7c945f6 req-1798f96f-5ebc-47eb-ba60-61f64711d435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5097366c-3a6d-4520-b622-a2b5efbf3e67", "tag": "f4fab8ca-b5ab-4fbe-826f-38baba8500e2"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:05.090480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-937a1f85-7055-4f7a-898c-a5f7e7c945f6 req-1798f96f-5ebc-47eb-ba60-61f64711d435 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:05.091024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-937a1f85-7055-4f7a-898c-a5f7e7c945f6 req-1798f96f-5ebc-47eb-ba60-61f64711d435 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:05.102633 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-937a1f85-7055-4f7a-898c-a5f7e7c945f6 req-1798f96f-5ebc-47eb-ba60-61f64711d435 service nova] Creating event network-changed:f4fab8ca-b5ab-4fbe-826f-38baba8500e2 for instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 on nch2-master-1 May 14 21:32:05.109951 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-937a1f85-7055-4f7a-898c-a5f7e7c945f6 req-1798f96f-5ebc-47eb-ba60-61f64711d435 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294017 May 14 21:32:05.110949 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2809/5222] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:05.820932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:05.821481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:05.830726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:05.831558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:05.852075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:05.852075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:06.076383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:06.077241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:06.087422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:06.088247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:06.090367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:06.091103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:06.117344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:06.133127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:06.135017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:06.136582 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72fc2ba1-e252-4778-890a-42d8312307ae tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.320159 May 14 21:32:06.137603 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2414/5223] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:05 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:06.349256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:06.358663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:06.360213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:06.361329 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edb67dc7-7dd7-4f95-8d24-1f67018e24ab tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 0.294240 May 14 21:32:06.361900 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2810/5224] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:06 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:07.160469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-42686823-a32a-47f9-8d67-cf044169983e req-9a5eac60-1013-44a3-a019-d678d3f94d97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:07.163193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:07.164053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:07.180363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:07.181261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:07.182322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-42686823-a32a-47f9-8d67-cf044169983e req-9a5eac60-1013-44a3-a019-d678d3f94d97 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:07.183103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-42686823-a32a-47f9-8d67-cf044169983e req-9a5eac60-1013-44a3-a019-d678d3f94d97 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:07.190855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:07.191266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:07.220599 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-42686823-a32a-47f9-8d67-cf044169983e req-9a5eac60-1013-44a3-a019-d678d3f94d97 service nova] Creating event network-changed:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch1-master-1 May 14 21:32:07.231254 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-42686823-a32a-47f9-8d67-cf044169983e req-9a5eac60-1013-44a3-a019-d678d3f94d97 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074858 May 14 21:32:07.234306 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2415/5225] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:07.383379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:07.383878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:07.395357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:07.398200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:07.399228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:07.399664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:07.493360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:07.505658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:07.507429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:07.509704 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bdb46e79-3787-4e38-84c8-855b403310c0 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.352160 May 14 21:32:07.510832 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2811/5226] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:07 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:08.358967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-803196bf-e9c0-406f-b5b9-16ea5162557d tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Action: 'create', calling method: .version_select at 0x7fb1a6c4d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1986164432"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:08.365497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:08.381523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:08.381523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:08.381523 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4536b2e2-72ab-4fff-9d7e-314182376ca0 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 1.000825 May 14 21:32:08.381523 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2416/5227] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:07 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:08.387833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ca60c7e7-ae2e-40bf-8cf0-628bbf7df791 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:08.389935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ca60c7e7-ae2e-40bf-8cf0-628bbf7df791 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:08.397752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca60c7e7-ae2e-40bf-8cf0-628bbf7df791 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.398625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca60c7e7-ae2e-40bf-8cf0-628bbf7df791 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.399616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca60c7e7-ae2e-40bf-8cf0-628bbf7df791 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.403453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca60c7e7-ae2e-40bf-8cf0-628bbf7df791 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.439430 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ca60c7e7-ae2e-40bf-8cf0-628bbf7df791 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057755 May 14 21:32:08.445285 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2417/5228] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:32:08 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:08.532476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:08.533245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:08.539671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.540482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.541489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.542148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.731506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:08.741353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:08.743224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:08.744617 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-92bd4dc9-2750-4a82-86f8-818579b25926 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.219718 May 14 21:32:08.745339 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2418/5229] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:08 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:08.754493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cf9cd62d-ac81-4da8-98d6-14d7c25ccbef tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:08.755162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cf9cd62d-ac81-4da8-98d6-14d7c25ccbef tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:08.761666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf9cd62d-ac81-4da8-98d6-14d7c25ccbef tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.768027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf9cd62d-ac81-4da8-98d6-14d7c25ccbef tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.768027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf9cd62d-ac81-4da8-98d6-14d7c25ccbef tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.768027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf9cd62d-ac81-4da8-98d6-14d7c25ccbef tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.796685 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cf9cd62d-ac81-4da8-98d6-14d7c25ccbef tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/01597bbf-2f11-4ddd-bf70-6785c56639f3" status: 200 len: 194 microversion: 2.1 time: 0.047653 May 14 21:32:08.797352 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2419/5230] 10.222.0.52 () {58 vars in 1412 bytes} [Sat May 14 21:32:08 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/01597bbf-2f11-4ddd-bf70-6785c56639f3 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:08.807109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:08.807652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:08.814642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.820891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.820891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:08.820891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:08.903167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lazy-loading 'services' on Instance uuid 3052d147-1dbb-4370-97c7-1d8170765e60 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:32:09.209984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52dbf432-897f-4870-9f23-ec0e61a61b67 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/01597bbf-2f11-4ddd-bf70-6785c56639f3" status: 202 len: 0 microversion: 2.1 time: 0.406513 May 14 21:32:09.211058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2420/5231] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:32:08 2022] DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/01597bbf-2f11-4ddd-bf70-6785c56639f3 => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:32:09.403083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:09.404648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:09.421404 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-803196bf-e9c0-406f-b5b9-16ea5162557d tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 1.214361 May 14 21:32:09.422065 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2812/5232] 10.222.0.52 () {60 vars in 1154 bytes} [Sat May 14 21:32:08 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 1216 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 14 21:32:09.437381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:09.437381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:09.437381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:09.437381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:09.437765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ab07d4f-5be5-4084-82ec-ff0e5d3351c3 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6cf95e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:09.521691 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6ab07d4f-5be5-4084-82ec-ff0e5d3351c3 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.092144 May 14 21:32:09.522531 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2813/5233] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:09 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:09.774123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:09.774752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:09.803728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:09.811133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:09.815392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:09.818818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:09.890080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:09.910994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:09.915163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:09.923528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8018a01c-e0b3-4e11-b847-425e81cf1f3e tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 0.525383 May 14 21:32:09.942670 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2421/5234] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:09 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:10.138557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:10.161960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:10.167074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:10.178024 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3feb17fc-f2bc-41a0-83d0-0d33b2b07d8c tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.410252 May 14 21:32:10.180138 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2814/5235] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:09 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:10.534688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5b69f44-fcbf-4aac-8371-5c6b3c569732 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a70734c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:10.597354 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5b69f44-fcbf-4aac-8371-5c6b3c569732 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.066687 May 14 21:32:10.598024 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2422/5236] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:10 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:10.873333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1458895001", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "f6b7d9d1-0c8a-4575-b44c-15c1cddb85d8"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:10.952957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:10.960402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:10.981038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:10.981038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:10.981038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:10.981038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:10.994614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] validate_networks() for [('f6b7d9d1-0c8a-4575-b44c-15c1cddb85d8', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:32:11.193833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:11.206286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:11.208447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:11.210167 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae4edaa6-aa89-45b1-b6d8-a1970cd33e84 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 0.263395 May 14 21:32:11.210984 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2423/5237] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:10 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:11.217602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:11.218798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:11.227377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.228210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.229277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.229953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.549888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:11.586593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:11.589477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:11.591530 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82d05243-6016-470b-ac04-06f1af23e874 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.379069 May 14 21:32:11.592152 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2424/5238] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:11 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:11.596991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8401dc11-d1dc-404e-892f-343d0f27b583 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:11.597862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8401dc11-d1dc-404e-892f-343d0f27b583 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:11.606370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8401dc11-d1dc-404e-892f-343d0f27b583 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.606843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8401dc11-d1dc-404e-892f-343d0f27b583 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.607833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8401dc11-d1dc-404e-892f-343d0f27b583 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.608448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8401dc11-d1dc-404e-892f-343d0f27b583 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.665723 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8401dc11-d1dc-404e-892f-343d0f27b583 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/db8974a4-ada7-45fe-acdd-6123c7b72686" status: 200 len: 194 microversion: 2.1 time: 0.072285 May 14 21:32:11.666301 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2425/5239] 10.222.0.52 () {58 vars in 1412 bytes} [Sat May 14 21:32:11 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/db8974a4-ada7-45fe-acdd-6123c7b72686 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:11.683995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2c231a9f-c2f6-4e6e-ad95-43f3cd70b412 req-71576c25-32fa-4084-ac36-3560ab982f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5097366c-3a6d-4520-b622-a2b5efbf3e67", "name": "network-vif-plugged", "status": "completed", "tag": "f4fab8ca-b5ab-4fbe-826f-38baba8500e2"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:11.708188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2c231a9f-c2f6-4e6e-ad95-43f3cd70b412 req-71576c25-32fa-4084-ac36-3560ab982f70 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.708643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2c231a9f-c2f6-4e6e-ad95-43f3cd70b412 req-71576c25-32fa-4084-ac36-3560ab982f70 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.715396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:32:11.715788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:32:11.716476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:32:11.717091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:32:11.717674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:32:11.739181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.739918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.741258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.741902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.746877 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2c231a9f-c2f6-4e6e-ad95-43f3cd70b412 req-71576c25-32fa-4084-ac36-3560ab982f70 service nova] Creating event network-vif-plugged:f4fab8ca-b5ab-4fbe-826f-38baba8500e2 for instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 on nch2-master-1 May 14 21:32:11.753844 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2c231a9f-c2f6-4e6e-ad95-43f3cd70b412 req-71576c25-32fa-4084-ac36-3560ab982f70 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085847 May 14 21:32:11.755844 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2426/5240] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:11.766742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0c1f557-0026-48ff-b87e-daca86fd87f1 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a78efd30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:11.794251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Getting quotas for project 162610ac2697486d8a05f41713cc5ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:32:11.803171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Getting quotas for user a8e967d05266477dbc5748ed77b8c69e and project 162610ac2697486d8a05f41713cc5ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:32:11.819128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:32:11.822677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:32:11.875735 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0c1f557-0026-48ff-b87e-daca86fd87f1 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 339 microversion: 2.1 time: 0.117311 May 14 21:32:11.876536 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2427/5241] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:11 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:11.882848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:11.883721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:11.893057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.893741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:11.894724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:11.895328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:12.040465 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f2ffd093-9c4e-48e3-859e-f2b4254650d2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.177870 May 14 21:32:12.048997 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2815/5242] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:32:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:32:12.053883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lazy-loading 'services' on Instance uuid 3052d147-1dbb-4370-97c7-1d8170765e60 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:32:12.056755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1a504f3-e7e9-4a90-b0e0-b2dda9972646 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Action: 'create', calling method: .version_select at 0x7fb1a6c3fe50>, body: {"snapshot": {"volume_id": "6ab899de-8a3b-4d6c-85de-5c4440b09dfb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1242261641"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:12.364426 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d5ef0ed3-27f2-4678-bd03-1ba98d4a066a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/db8974a4-ada7-45fe-acdd-6123c7b72686" status: 202 len: 0 microversion: 2.1 time: 0.485644 May 14 21:32:12.370476 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2428/5243] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:32:11 2022] DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments/db8974a4-ada7-45fe-acdd-6123c7b72686 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:32:12.377784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-df6bd864-f01c-45f2-90e8-79ddca657860 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:12.380430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-df6bd864-f01c-45f2-90e8-79ddca657860 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:12.523319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-df6bd864-f01c-45f2-90e8-79ddca657860 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:12.536586 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-df6bd864-f01c-45f2-90e8-79ddca657860 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1219 microversion: 2.1 time: 0.164983 May 14 21:32:12.552107 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2429/5244] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:12 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1219 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:12.560929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:12.560929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:12.567269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:12.567799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:12.568893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:12.569369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:12.817997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:12.831096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:12.839832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:12.841640 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c56384d8-85b6-46a4-bc1f-2df6feb19caa tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1359 microversion: 2.21 time: 0.287677 May 14 21:32:12.853595 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2430/5245] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:12 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1359 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:12.861231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:12.862099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:12.870194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:12.871668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:12.872644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:12.873447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:12.969043 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1a504f3-e7e9-4a90-b0e0-b2dda9972646 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.917886 May 14 21:32:12.970256 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2816/5246] 10.222.0.52 () {60 vars in 1161 bytes} [Sat May 14 21:32:12 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:12.981234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fdede30f-5938-43fb-9a10-c74770fa23e3 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6c3ff70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:13.046798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fdede30f-5938-43fb-9a10-c74770fa23e3 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.070446 May 14 21:32:13.048281 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2817/5247] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:12 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:13.059669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ff4136f6-1996-47e2-a0ae-5348dc627034 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6cb81f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:13.149613 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ff4136f6-1996-47e2-a0ae-5348dc627034 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.089362 May 14 21:32:13.153200 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2818/5248] 10.222.0.52 () {58 vars in 1139 bytes} [Sat May 14 21:32:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:13.159606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:13.166830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d14bfe90-3266-46a4-976a-4621c9033f6a tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6cda700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:13.170369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:13.172205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:13.176338 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f056eace-fc28-4b26-98ab-f3deb7832f58 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.320672 May 14 21:32:13.187515 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2431/5249] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:12 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:13.226747 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d14bfe90-3266-46a4-976a-4621c9033f6a tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.068746 May 14 21:32:13.233887 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2819/5250] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:13 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:32:13.556391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-327dc4e9-d7cd-49ae-9889-d080fda18a74 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:13.559198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-327dc4e9-d7cd-49ae-9889-d080fda18a74 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:13.696776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-327dc4e9-d7cd-49ae-9889-d080fda18a74 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:13.705720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-327dc4e9-d7cd-49ae-9889-d080fda18a74 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1219 microversion: 2.1 time: 0.153334 May 14 21:32:13.720169 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2432/5251] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:13 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:13.865907 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:13.866717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:13.877197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:13.877669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:13.878470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:13.878917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.208521 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:14.209719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:14.215201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:14.229843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.231196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.235279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:14.243425 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:14.247259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.247993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.253401 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d7939ec7-c13d-457c-989f-43f8faaaf123 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1552 microversion: 2.21 time: 0.391608 May 14 21:32:14.264137 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2820/5252] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:13 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1552 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:14.270478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-81100f13-29ff-47d9-9edc-33e0950d9c59 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6cb8310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:14.326422 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-81100f13-29ff-47d9-9edc-33e0950d9c59 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.060812 May 14 21:32:14.327043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2821/5253] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:14 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:14.335242 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:14.335784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:14.343222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.344201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.345381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.346119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.381031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:32:14.494293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:14.507944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:14.516798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:14.518445 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6b605fb9-5622-46ce-bdb9-7bed7bdbc1dc tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.322852 May 14 21:32:14.523765 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2433/5254] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:14 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:14.737859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:14.738531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:14.748600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.749660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.752737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.753598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.910574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:14.928760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87115a87-2888-42c7-b403-f32229dc7ea2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1271 microversion: 2.1 time: 0.195584 May 14 21:32:14.929372 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2434/5255] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:14 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:32:14.947751 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4e8fa516-b875-411e-a42a-7a2abbd3518a tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 204 len: 0 microversion: 2.21 time: 0.614347 May 14 21:32:14.947751 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2822/5256] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:32:14 2022] DELETE /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:32:14.956433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:14.957870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-69c0931d-742d-4244-aea1-442a5198bc28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:14.958205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:14.960909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-69c0931d-742d-4244-aea1-442a5198bc28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:14.967085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.967714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.968895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.969384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.976102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69c0931d-742d-4244-aea1-442a5198bc28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.978606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69c0931d-742d-4244-aea1-442a5198bc28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:14.979801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69c0931d-742d-4244-aea1-442a5198bc28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:14.980783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69c0931d-742d-4244-aea1-442a5198bc28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.036200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-69c0931d-742d-4244-aea1-442a5198bc28 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094996 May 14 21:32:15.037096 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2435/5257] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:32:14 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:32:15.186866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:15.205021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-459d573a-3caf-46ba-abd8-783c484480c8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:15.206027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-459d573a-3caf-46ba-abd8-783c484480c8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:15.207179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:15.210539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:15.210539 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4daf7835-29f9-4548-9519-e5c6d8cc69c9 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1558 microversion: 2.21 time: 0.258968 May 14 21:32:15.211221 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2823/5258] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:14 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1558 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:15.215094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-459d573a-3caf-46ba-abd8-783c484480c8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.215857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-459d573a-3caf-46ba-abd8-783c484480c8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.216822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-459d573a-3caf-46ba-abd8-783c484480c8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.217483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-459d573a-3caf-46ba-abd8-783c484480c8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.257106 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-459d573a-3caf-46ba-abd8-783c484480c8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057745 May 14 21:32:15.259625 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2436/5259] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:32:15 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:32:15.327034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:15.327653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:15.335601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.336235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.337343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.337848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.338099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b68a41b-1f1d-41fe-aca6-b7b45b972b43 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a7607940>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:15.380979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b68a41b-1f1d-41fe-aca6-b7b45b972b43 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.046620 May 14 21:32:15.385256 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2437/5260] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:15 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:15.397851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:32:15.532578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] Calling method '.version_select at 0x7fb1a76075e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:15.533524 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:32:15.533524 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:32:15.537772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.537772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.581280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.581750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.601409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.601958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.622136 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0417d4d-3e21-47ae-8984-5228c9852a5a tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1921879272-project-admin] 10.222.0.52 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.238781 May 14 21:32:15.622755 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2438/5261] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:32:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:15.633969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:15.634889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:15.655668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.656184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.657069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.657572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.857592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-086c19ae-a4ef-4dd7-8443-6b336767f285 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 204 len: 0 microversion: 2.1 time: 0.534455 May 14 21:32:15.858478 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2824/5262] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:32:15 2022] DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:32:15.868313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:15.869124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:15.881536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.882000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:15.884009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:15.884009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:16.087908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.122859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.128878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.129137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.131553 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e2202e8-6a4a-4949-a954-ff786f3cec6d tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.507796 May 14 21:32:16.135682 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2439/5263] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:15 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:16.215858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:16.215858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:16.216323 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-542a7455-17b6-42ca-910e-6a57b38b6e64 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1671 microversion: 2.1 time: 0.279535 May 14 21:32:16.216323 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2825/5264] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:15 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1671 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:32:16.216825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:16.216825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:16.216825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:16.216825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:16.229699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:16.232366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:16.245711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:16.251189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:16.251189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:16.251189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:16.310398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.322682 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fcbbea74-bc7b-44eb-8a93-d20641c90df1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1279 microversion: 2.1 time: 0.184230 May 14 21:32:16.324939 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2440/5265] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:16 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:16.394512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbc0fbef-3a0e-41c4-9d9b-0aeaab150c6b tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a702bb80>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:16.424205 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbc0fbef-3a0e-41c4-9d9b-0aeaab150c6b tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.034553 May 14 21:32:16.425139 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2441/5266] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:16 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:16.491287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.500680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.502268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:16.504157 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ff95d9cc-06a4-47f5-a052-bc28b2fce18f tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1558 microversion: 2.21 time: 0.279222 May 14 21:32:16.504966 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2826/5267] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:16 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1558 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:17.224362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:17.225037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:17.258927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.271717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.272560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.274513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.547506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:17.548215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:17.560160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.560930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.562150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.562780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.596105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:17.607842 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ef834711-2550-4532-ac1d-6a96339990f8 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1671 microversion: 2.1 time: 0.389351 May 14 21:32:17.608980 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2442/5268] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:17 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1671 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:17.615331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-22e9bf25-f6ba-4219-9f27-c9d5aa9b28c1 req-6fe58dfa-3b8a-4280-b2f5-5060bf324003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5097366c-3a6d-4520-b622-a2b5efbf3e67", "name": "network-vif-deleted", "tag": "f4fab8ca-b5ab-4fbe-826f-38baba8500e2"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:17.624752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-22e9bf25-f6ba-4219-9f27-c9d5aa9b28c1 req-6fe58dfa-3b8a-4280-b2f5-5060bf324003 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.625469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-22e9bf25-f6ba-4219-9f27-c9d5aa9b28c1 req-6fe58dfa-3b8a-4280-b2f5-5060bf324003 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.638332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-22e9bf25-f6ba-4219-9f27-c9d5aa9b28c1 req-6fe58dfa-3b8a-4280-b2f5-5060bf324003 service nova] Creating event network-vif-deleted:f4fab8ca-b5ab-4fbe-826f-38baba8500e2 for instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 on nch2-master-1 May 14 21:32:17.644850 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-22e9bf25-f6ba-4219-9f27-c9d5aa9b28c1 req-6fe58dfa-3b8a-4280-b2f5-5060bf324003 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033732 May 14 21:32:17.644850 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2443/5269] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:17.654227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:17.654950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:17.675616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.676085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.676877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.684386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.806604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:17.834224 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-df7f6b73-6b32-4ebc-9900-ec79113d744c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1279 microversion: 2.1 time: 0.176360 May 14 21:32:17.834224 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2444/5270] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:17 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:17.854150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b88521a-74b6-4d26-9924-6c992af5d79d tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a702b3a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:17.946872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9b88521a-74b6-4d26-9924-6c992af5d79d tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 288 microversion: 2.1 time: 0.118518 May 14 21:32:17.947761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2445/5271] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:17 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 288 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:17.954539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:17.957666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:17.979414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.981437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:17.982393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:17.984831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:18.016880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:18.038829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:18.041405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:18.048168 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-826e29ee-35e8-430e-8258-e691f7058e66 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.827693 May 14 21:32:18.056548 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2827/5272] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:17 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:18.064617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3fd6dc39-f8c0-45ac-9f66-bf26df7ba56e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a70e09d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:18.064883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:18.065457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:18.066462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lazy-loading 'fault' on Instance uuid 5097366c-3a6d-4520-b622-a2b5efbf3e67 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:32:18.522882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:18.535370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:18.538130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ad81cc85a4146199c0d1a8c17f8aa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241cdff4cf3483c9b0dbdf7bf4e0ceb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:18.539621 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31f08038-7938-4ad2-bf51-2a2b090c8d83 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 200 len: 1349 microversion: 2.21 time: 0.590536 May 14 21:32:18.552005 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2446/5273] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:17 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 1349 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:18.629634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:18.630228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:18.640042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:18.640786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:18.642020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:18.642619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.189937 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3fd6dc39-f8c0-45ac-9f66-bf26df7ba56e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 202 len: 0 microversion: 2.1 time: 1.136447 May 14 21:32:19.193620 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2828/5274] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:32:18 2022] DELETE /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:32:19.200606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:19.203334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:19.231736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.232207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.233009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.236038 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.331315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:19.347553 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-10df2d1f-3f87-4300-81eb-58ee975ef3fb tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1671 microversion: 2.1 time: 0.724646 May 14 21:32:19.350469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2447/5275] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:18 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1671 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:19.353663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:19.356031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:19.369110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.373127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.374527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.375141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.462652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:19.474368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5087f6b7-a893-454e-9ed2-5b119e24905a tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1277 microversion: 2.1 time: 0.282611 May 14 21:32:19.483791 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2829/5276] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:19 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1277 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:19.486870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a99c20ea-1a19-4205-915b-e7a21cd0da7e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1b96c6820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:19.556486 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a99c20ea-1a19-4205-915b-e7a21cd0da7e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.074193 May 14 21:32:19.556486 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2830/5277] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:19 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:19.569247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:19.570024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:19.589095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.590300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.591589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.593607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.662563 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] HTTP exception thrown: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Request method failure captured: May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 HTTP/1.1 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_JzIpgw66xNnPm0qStJ10L6k2-LsJwUBL5WGLygOeRuXwKwOfew7TRJ6FYj3sRV4nMv5FPdOBIy2hgmvsHGx_1vAl-dMZaup0KKd5CysDUtMb0O-OQl2mg66mppyLT26DTP2RS_KqXTMWcIFKNqfiVjK0sNSe8wPsg8uuMURafUdo May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.21 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5241cdff4cf3483c9b0dbdf7bf4e0ceb May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5241cdff4cf3483c9b0dbdf7bf4e0ceb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5241cdff4cf3483c9b0dbdf7bf4e0ceb May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-InstanceActionsV221TestJSON-1441468009-project May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 4ad81cc85a4146199c0d1a8c17f8aa21 May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-InstanceActionsV221TestJSON-1441468009-project May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '5097366c-3a6d-4520-b622-a2b5efbf3e67'} May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:19.665496 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:19.670017 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:19.676358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Returning 404 to user: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:19.684472 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97bee3c7-9913-4d89-be4b-97a197a053cd tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 404 len: 111 microversion: 2.21 time: 0.120463 May 14 21:32:19.687064 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2831/5278] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:19 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:32:19.696040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1b811e23-5234-406b-919d-7f2e5b838c21 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '.version_select at 0x7fb1b96c68b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:19.697022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1b811e23-5234-406b-919d-7f2e5b838c21 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:19.705264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b811e23-5234-406b-919d-7f2e5b838c21 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.706004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b811e23-5234-406b-919d-7f2e5b838c21 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.707007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b811e23-5234-406b-919d-7f2e5b838c21 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.707687 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1b811e23-5234-406b-919d-7f2e5b838c21 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.951987 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1b811e23-5234-406b-919d-7f2e5b838c21 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.261054 May 14 21:32:19.952938 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2832/5279] 10.222.0.52 () {60 vars in 1336 bytes} [Sat May 14 21:32:19 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67/os-instance-actions => generated 611 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:32:19.971661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:19.973532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:19.985922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.990081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:19.990081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:19.990081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.015924 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] HTTP exception thrown: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Request method failure captured: May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 HTTP/1.1 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_JzIpgw66xNnPm0qStJ10L6k2-LsJwUBL5WGLygOeRuXwKwOfew7TRJ6FYj3sRV4nMv5FPdOBIy2hgmvsHGx_1vAl-dMZaup0KKd5CysDUtMb0O-OQl2mg66mppyLT26DTP2RS_KqXTMWcIFKNqfiVjK0sNSe8wPsg8uuMURafUdo May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.21 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5241cdff4cf3483c9b0dbdf7bf4e0ceb May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5241cdff4cf3483c9b0dbdf7bf4e0ceb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5241cdff4cf3483c9b0dbdf7bf4e0ceb May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-InstanceActionsV221TestJSON-1441468009-project May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 4ad81cc85a4146199c0d1a8c17f8aa21 May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-InstanceActionsV221TestJSON-1441468009-project May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '5097366c-3a6d-4520-b622-a2b5efbf3e67'} May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:32:20.023053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Returning 404 to user: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c1618ebc-b2a1-485d-8287-b8d84761540d tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 404 len: 111 microversion: 2.21 time: 0.059741 May 14 21:32:20.030661 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2833/5280] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:32:19 2022] DELETE /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:32:20.033442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:20.035059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] [instance: 5097366c-3a6d-4520-b622-a2b5efbf3e67] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:20.057494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.057494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.057494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.057494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.078615 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] HTTP exception thrown: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Request method failure captured: May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 HTTP/1.1 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_JzIpgw66xNnPm0qStJ10L6k2-LsJwUBL5WGLygOeRuXwKwOfew7TRJ6FYj3sRV4nMv5FPdOBIy2hgmvsHGx_1vAl-dMZaup0KKd5CysDUtMb0O-OQl2mg66mppyLT26DTP2RS_KqXTMWcIFKNqfiVjK0sNSe8wPsg8uuMURafUdo May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.21 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 5241cdff4cf3483c9b0dbdf7bf4e0ceb May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5241cdff4cf3483c9b0dbdf7bf4e0ceb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5241cdff4cf3483c9b0dbdf7bf4e0ceb", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 5241cdff4cf3483c9b0dbdf7bf4e0ceb May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1441468009 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-InstanceActionsV221TestJSON-1441468009-project May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 4ad81cc85a4146199c0d1a8c17f8aa21 May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-InstanceActionsV221TestJSON-1441468009-project May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '5097366c-3a6d-4520-b622-a2b5efbf3e67'} May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.081966 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] Returning 404 to user: Instance 5097366c-3a6d-4520-b622-a2b5efbf3e67 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f552ea7d-162d-4095-810e-ad4ba4587369 tempest-InstanceActionsV221TestJSON-1441468009 tempest-InstanceActionsV221TestJSON-1441468009-project] 10.222.0.52 "GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67" status: 404 len: 111 microversion: 2.21 time: 0.054467 May 14 21:32:20.087046 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2834/5281] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:20 2022] GET /compute/v2.1/servers/5097366c-3a6d-4520-b622-a2b5efbf3e67 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 14 21:32:20.210309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:20.234723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:20.239186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:20.240488 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c6bc8ae6-04c4-477b-a911-4baaf3625376 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.890851 May 14 21:32:20.241373 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2448/5282] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:19 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:20.367031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:20.367858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:20.385587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.385587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.385587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.385587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.386122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29218ba2-b4e3-4e95-90d2-822bd9140cfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:20.386122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29218ba2-b4e3-4e95-90d2-822bd9140cfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:20.402649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29218ba2-b4e3-4e95-90d2-822bd9140cfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.408600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29218ba2-b4e3-4e95-90d2-822bd9140cfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.408600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29218ba2-b4e3-4e95-90d2-822bd9140cfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.408600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29218ba2-b4e3-4e95-90d2-822bd9140cfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.489547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29218ba2-b4e3-4e95-90d2-822bd9140cfe tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "POST /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e/action" status: 200 len: 24587 microversion: 2.32 time: 0.403751 May 14 21:32:20.491266 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2835/5283] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:32:20 2022] POST /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e/action => generated 24587 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 14 21:32:20.500009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:20.503223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:20.517982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.522320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.522320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:20.522320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:20.873760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:20.882529 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-955c5623-a8d9-4380-8e9c-ac800d5a5ae2 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.389590 May 14 21:32:20.889002 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2836/5284] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:20 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:20.903315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-30894add-c11f-4c6d-87a7-71211d7d40a6 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6cf9af0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:20.969578 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-30894add-c11f-4c6d-87a7-71211d7d40a6 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.080159 May 14 21:32:20.973467 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2837/5285] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:20 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:21.259274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:21.262110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:21.287868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:21.288991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:21.292754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:21.293454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:21.803991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:21.815757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:21.817760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:21.819755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c07a5a86-4cef-4c21-aec9-d916637403aa tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.564108 May 14 21:32:21.833319 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2838/5286] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:21 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:21.838789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0bff3aba-7594-4076-833e-accb886c5f58 req-fe2baeb7-93d4-42de-88d4-268f89f95b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3052d147-1dbb-4370-97c7-1d8170765e60", "name": "network-vif-unplugged", "status": "completed", "tag": "eeffe894-ffc8-46c9-9c14-d40a84ece6ac"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:21.848493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0bff3aba-7594-4076-833e-accb886c5f58 req-fe2baeb7-93d4-42de-88d4-268f89f95b0b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:21.849653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0bff3aba-7594-4076-833e-accb886c5f58 req-fe2baeb7-93d4-42de-88d4-268f89f95b0b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:21.866438 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0bff3aba-7594-4076-833e-accb886c5f58 req-fe2baeb7-93d4-42de-88d4-268f89f95b0b service nova] Creating event network-vif-unplugged:eeffe894-ffc8-46c9-9c14-d40a84ece6ac for instance 3052d147-1dbb-4370-97c7-1d8170765e60 on nch1-master-1 May 14 21:32:21.875050 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0bff3aba-7594-4076-833e-accb886c5f58 req-fe2baeb7-93d4-42de-88d4-268f89f95b0b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039891 May 14 21:32:21.876541 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2839/5287] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:21.938267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:21.940549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:21.959186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:21.960652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:21.963793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:21.966298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:21.984855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:21.993556 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e63f4137-0ad8-4027-a9d9-9574f7449c00 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1671 microversion: 2.1 time: 1.630752 May 14 21:32:21.999626 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2449/5288] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:20 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1671 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:22.012667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-884f21b7-95a7-4174-8a80-5962f042776c tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6ff1820>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:22.069011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-884f21b7-95a7-4174-8a80-5962f042776c tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.067933 May 14 21:32:22.069708 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2450/5289] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:21 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:22.829335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:22.845289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:22.846368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:22.854155 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1204f6c-cfa3-4755-8931-2a6fa14e5ddf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.946579 May 14 21:32:22.861147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:22.861865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:22.872916 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2840/5290] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:21 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:22.877994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:22.877994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:23.019180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:23.020116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:23.035869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:23.036685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:23.038443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:23.039139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:23.134605 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:23.143605 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19898e44-d776-41dc-a5e6-68c14eab9edc tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1605 microversion: 2.1 time: 0.129340 May 14 21:32:23.144455 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2841/5291] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:23 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1605 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:23.157363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-625d0a51-aeff-402f-b9dc-3190be0f2ca5 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6cb59d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:23.194214 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-625d0a51-aeff-402f-b9dc-3190be0f2ca5 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.048393 May 14 21:32:23.194943 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2842/5292] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:23 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:23.542452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:23.550836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:23.552398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:23.553593 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-65120e2a-bbe6-428c-bedf-d95be6b9b459 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.718221 May 14 21:32:23.554169 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2451/5293] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:22 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:23.670864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-49f431d4-4a66-4693-925b-d3389a623392 req-62b49b4e-893a-4f9d-aa1f-e6cf23ff6255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3052d147-1dbb-4370-97c7-1d8170765e60", "name": "network-vif-deleted", "tag": "eeffe894-ffc8-46c9-9c14-d40a84ece6ac"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:23.680728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-49f431d4-4a66-4693-925b-d3389a623392 req-62b49b4e-893a-4f9d-aa1f-e6cf23ff6255 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:23.681326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-49f431d4-4a66-4693-925b-d3389a623392 req-62b49b4e-893a-4f9d-aa1f-e6cf23ff6255 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:23.693679 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-49f431d4-4a66-4693-925b-d3389a623392 req-62b49b4e-893a-4f9d-aa1f-e6cf23ff6255 service nova] Creating event network-vif-deleted:eeffe894-ffc8-46c9-9c14-d40a84ece6ac for instance 3052d147-1dbb-4370-97c7-1d8170765e60 on nch1-master-1 May 14 21:32:23.699819 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-49f431d4-4a66-4693-925b-d3389a623392 req-62b49b4e-893a-4f9d-aa1f-e6cf23ff6255 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033730 May 14 21:32:23.701016 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2843/5294] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:23.872856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:23.873683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:23.880190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:23.880836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:23.881788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:23.882388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:24.161808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:24.162596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:24.173596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:24.177357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:24.178279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:24.178734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:24.260439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:24.276358 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f45a556e-9f57-4736-a0fd-9f1981d89301 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.404636 May 14 21:32:24.288462 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2452/5295] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:23 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:24.294453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3c9b2c81-caff-4c10-9b0c-d64fc07bc0af tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a7e1a550>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:24.299828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:24.309571 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9bbb44fb-e92c-465c-84e2-4762811f7ec6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1605 microversion: 2.1 time: 0.150878 May 14 21:32:24.310196 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2844/5296] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:24 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1605 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:32:24.341929 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3c9b2c81-caff-4c10-9b0c-d64fc07bc0af tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 200 len: 287 microversion: 2.1 time: 0.046615 May 14 21:32:24.350479 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2453/5297] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:24 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:24.572616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:24.574820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:24.595756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:24.596443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:24.597300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:24.597756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:24.855772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:24.872800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:24.894030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:24.896376 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ba0bf60-df87-4761-af8c-743b68079718 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.327788 May 14 21:32:24.907377 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2845/5298] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:24 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:25.295821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:25.296559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:25.310788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:25.311591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:25.313527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:25.317138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:25.329896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:25.330667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:25.341103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:25.343158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:25.347123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:25.347885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:25.437547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:25.438186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:25.439188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lazy-loading 'fault' on Instance uuid 3052d147-1dbb-4370-97c7-1d8170765e60 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:32:25.534095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5586a3a946a0490498c42cb71f39ce1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6641b342c1d440aea451919f391bc5db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:25.563394 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-28f3a8ff-57fa-4853-864c-4b5e3a40e987 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 200 len: 1327 microversion: 2.1 time: 0.236808 May 14 21:32:25.564831 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2846/5299] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:25 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 1327 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:25.576037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f4b3fa5-785a-4160-b59e-35625fcbc0ce tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6c5c040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:25.607258 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-6f4b3fa5-785a-4160-b59e-35625fcbc0ce tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] HTTP exception thrown: Snapshot b37d9e4b-d59e-445f-8880-97f68de7f7ce could not be found. May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f4b3fa5-785a-4160-b59e-35625fcbc0ce tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Request method failure captured: May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce HTTP/1.1 May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_YfL02NCPTckYo_aNJErvFFKG-I87I7Z7T7JOFtL4vD2QlLyUHWoQfaE8ZF8197wZp9j1im3kKa6rVHceLOtMtCSqwqfd4ibRb2TNdFE8MR--6WuSG93ympMYvLA40orx37_kd_ZWqQnM229pxU3IH6twDeP49AMiXqV2HVm_fL1g May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a1393fd6fd94533b439ca5f156d94ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 0e40446fedca416883f7321a3de390bf May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: exception: Snapshot b37d9e4b-d59e-445f-8880-97f68de7f7ce could not be found. May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b37d9e4b-d59e-445f-8880-97f68de7f7ce'} May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b37d9e4b-d59e-445f-8880-97f68de7f7ce could not be found. (HTTP 404) (Request-ID: req-5130cf24-0de0-4b79-83e7-924cf9481a46) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:32:25.619312 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b37d9e4b-d59e-445f-8880-97f68de7f7ce could not be found. May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b37d9e4b-d59e-445f-8880-97f68de7f7ce could not be found. May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b37d9e4b-d59e-445f-8880-97f68de7f7ce could not be found. May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6f4b3fa5-785a-4160-b59e-35625fcbc0ce tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Returning 404 to user: Snapshot b37d9e4b-d59e-445f-8880-97f68de7f7ce could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6f4b3fa5-785a-4160-b59e-35625fcbc0ce tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce" status: 404 len: 111 microversion: 2.1 time: 0.056342 May 14 21:32:25.631235 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2847/5300] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 21:32:25 2022] GET /compute/v2.1/os-snapshots/b37d9e4b-d59e-445f-8880-97f68de7f7ce => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:32:25.642518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-88f8c7cc-39a9-47f7-ab02-42adae5040dd tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6c0f940>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:25.963378 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-88f8c7cc-39a9-47f7-ab02-42adae5040dd tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 202 len: 0 microversion: 2.1 time: 0.334708 May 14 21:32:25.966160 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2848/5301] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:32:25 2022] DELETE /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:32:25.985413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-0b8df51c-f888-463a-930f-c252790b2ea0 req-9467c3ee-93af-4a00-ac44-41d7084f81ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5aab0f-f971-443e-b949-5430a66f746e", "tag": "8a97af7f-e8ff-41fa-b059-8c13a6ced336"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:26.002202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0b8df51c-f888-463a-930f-c252790b2ea0 req-9467c3ee-93af-4a00-ac44-41d7084f81ef service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:26.002849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-0b8df51c-f888-463a-930f-c252790b2ea0 req-9467c3ee-93af-4a00-ac44-41d7084f81ef service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:26.016097 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-0b8df51c-f888-463a-930f-c252790b2ea0 req-9467c3ee-93af-4a00-ac44-41d7084f81ef service nova] Creating event network-changed:8a97af7f-e8ff-41fa-b059-8c13a6ced336 for instance 8b5aab0f-f971-443e-b949-5430a66f746e on nch1-master-1 May 14 21:32:26.021707 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-0b8df51c-f888-463a-930f-c252790b2ea0 req-9467c3ee-93af-4a00-ac44-41d7084f81ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053354 May 14 21:32:26.022621 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2849/5302] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:26.029149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:26.029821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:26.037414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:26.038140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:26.038931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:26.039412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:26.060463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:26.068689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37226079-6561-4962-9479-13f4213b941c tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.778374 May 14 21:32:26.078934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2454/5303] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:25 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:26.084321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-73147367-8a5b-40ac-9eda-6d1c757e58d3 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6f06310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:26.148822 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-73147367-8a5b-40ac-9eda-6d1c757e58d3 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.068360 May 14 21:32:26.153240 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2455/5304] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:26 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:26.412980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:26.422793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:26.424535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:26.425820 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea316941-54b2-450f-9680-cc57990a8a26 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.401712 May 14 21:32:26.426877 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2850/5305] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:26 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:26.581838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:26.583117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:26.596421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:26.611851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:26.611851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:26.611851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:26.635595 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] HTTP exception thrown: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Request method failure captured: May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 HTTP/1.1 May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB7dR5Br-85r_xroEIubjtcujEO9DjMhMRQAo-sNEQSWq_kbkbjio1ibNIrita8v-LjHR84K6mX87wrKF6VBTpqyb7bqQC-nGsg3aVVDGcNwoxaZjMQjTlZihE1SMH0rqWbyt_lyLml2ycUbSCUtr_nQCKw00gutDx4iulYuLKoKmlo May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 6641b342c1d440aea451919f391bc5db May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6641b342c1d440aea451919f391bc5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6641b342c1d440aea451919f391bc5db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 6641b342c1d440aea451919f391bc5db May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 5586a3a946a0490498c42cb71f39ce1e May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3052d147-1dbb-4370-97c7-1d8170765e60'} May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:26.641709 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:32:26.646135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Returning 404 to user: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:26.646774 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d2bc2fe-9347-4f26-8cc2-3a16c53de67f tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 404 len: 111 microversion: 2.1 time: 0.068681 May 14 21:32:26.651105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2456/5306] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:26 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:32:26.657661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bb426722-729c-4cb0-8418-5f333de7e4c1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '.version_select at 0x7fb1a6c74550>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:26.755632 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bb426722-729c-4cb0-8418-5f333de7e4c1 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-743069403" status: 202 len: 0 microversion: 2.1 time: 0.102678 May 14 21:32:26.756242 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2851/5307] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:32:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-743069403 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 21:32:27.086420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:27.087259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:27.100770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:27.101494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:27.102479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:27.103208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:27.164020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a76ec1e-644b-462a-9ec9-2fde193089ef tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1b96c6430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:27.221343 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a76ec1e-644b-462a-9ec9-2fde193089ef tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.061691 May 14 21:32:27.222110 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2852/5308] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:27 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:32:27.445838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:27.447674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:27.456892 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:27.463594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:27.463594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:27.463594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:27.468744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:27.488454 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3db61830-e1e4-4b08-851e-b22dc4440caf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.403218 May 14 21:32:27.488454 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2457/5309] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:27 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:27.945226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:27.957017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:27.960726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:27.970931 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-298e0922-2391-4311-8789-3d6916b25478 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.529310 May 14 21:32:27.972385 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2853/5310] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:27 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:28.239339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a2630b4-bf2f-4eb4-b418-4ec35e25db50 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6fe1f70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:28.296872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a2630b4-bf2f-4eb4-b418-4ec35e25db50 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.060842 May 14 21:32:28.297564 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2458/5311] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:28 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:28.507131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:28.508856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:28.518028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:28.518501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:28.519585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:28.520175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:28.740503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:28.752505 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8e8e1f37-d882-4e4a-a726-234e1aa75374 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.253807 May 14 21:32:28.753488 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2854/5312] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:28 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:28.992021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:28.992981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:29.005695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:29.008465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:29.011703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:29.012534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:29.308898 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-48de06d7-8393-48c8-ace8-65abbe31674e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6c055e0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:29.382800 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-48de06d7-8393-48c8-ace8-65abbe31674e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.077989 May 14 21:32:29.383581 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2855/5313] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:29 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:32:29.735503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:29.746424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:29.748280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:29.759689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-748b2c36-f4ea-4f7a-9883-2f1c356cb0ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.762861 May 14 21:32:29.759689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2459/5314] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:28 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:29.773106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:29.774323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:29.783982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:29.793804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:29.793804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:29.793804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:29.814166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2ffc55de-4d05-4e33-beed-1b9c973f58c7 req-ab81378d-41a1-4f8f-8ec2-e5d8eb2f4a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "name": "network-vif-plugged", "status": "completed", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:29.829004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2ffc55de-4d05-4e33-beed-1b9c973f58c7 req-ab81378d-41a1-4f8f-8ec2-e5d8eb2f4a78 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:29.829462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2ffc55de-4d05-4e33-beed-1b9c973f58c7 req-ab81378d-41a1-4f8f-8ec2-e5d8eb2f4a78 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:29.862895 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2ffc55de-4d05-4e33-beed-1b9c973f58c7 req-ab81378d-41a1-4f8f-8ec2-e5d8eb2f4a78 service nova] Creating event network-vif-plugged:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch1-master-1 May 14 21:32:29.869675 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2ffc55de-4d05-4e33-beed-1b9c973f58c7 req-ab81378d-41a1-4f8f-8ec2-e5d8eb2f4a78 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059514 May 14 21:32:29.871282 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2460/5315] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:32:30.248503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:30.269432 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9e5c3610-f080-438d-95f0-965154ff5fee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.502111 May 14 21:32:30.270048 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2856/5316] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:29 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:30.399386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-12732b44-f9e6-452f-a4bb-5c71823df6a9 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a70730d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:30.513799 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-12732b44-f9e6-452f-a4bb-5c71823df6a9 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.119965 May 14 21:32:30.514276 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2461/5317] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:30 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:30.769373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:30.770186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:30.778443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:30.779804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:30.780904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:30.781512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:31.127292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:31.146748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:31.149009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:31.159929 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c5459dd-98a0-4280-9af9-78224f4fd298 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.391179 May 14 21:32:31.160691 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2857/5318] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:30 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:31.288274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:31.289578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:31.297026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:31.297500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:31.298291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:31.298748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:31.527254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-13546a6e-1d79-43d6-a1d1-14b6479b5e30 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1b96c68b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:31.585283 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-13546a6e-1d79-43d6-a1d1-14b6479b5e30 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.062688 May 14 21:32:31.586733 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2858/5319] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:31 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:32:31.653561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:31.663303 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f4b7208-5c4c-4baf-b012-e142a1f413d1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.379667 May 14 21:32:31.664441 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2462/5320] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:31 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:31.897401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-9910ccf2-712b-4310-94a8-3b43ccf4471b req-c7cd28f7-4875-4009-a623-f09afd8353d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5aab0f-f971-443e-b949-5430a66f746e", "name": "network-vif-plugged", "status": "completed", "tag": "8a97af7f-e8ff-41fa-b059-8c13a6ced336"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:31.918288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9910ccf2-712b-4310-94a8-3b43ccf4471b req-c7cd28f7-4875-4009-a623-f09afd8353d6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:31.918747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9910ccf2-712b-4310-94a8-3b43ccf4471b req-c7cd28f7-4875-4009-a623-f09afd8353d6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:31.939160 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9910ccf2-712b-4310-94a8-3b43ccf4471b req-c7cd28f7-4875-4009-a623-f09afd8353d6 service nova] Creating event network-vif-plugged:8a97af7f-e8ff-41fa-b059-8c13a6ced336 for instance 8b5aab0f-f971-443e-b949-5430a66f746e on nch1-master-1 May 14 21:32:31.945234 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-9910ccf2-712b-4310-94a8-3b43ccf4471b req-c7cd28f7-4875-4009-a623-f09afd8353d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051705 May 14 21:32:31.945903 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2859/5321] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:32.179799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:32.180434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:32.194084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:32.194559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:32.195369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:32.195871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:32.379998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:32.393651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:32.396160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:32.397885 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19d112f4-b393-485a-9b2e-a19d377db243 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.222266 May 14 21:32:32.399347 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2463/5322] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:32 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:32.598914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d92de4a8-fcb2-41cc-9355-444254f2e9e6 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6b99310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:32.681683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:32.683280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:32.694157 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d92de4a8-fcb2-41cc-9355-444254f2e9e6 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.099484 May 14 21:32:32.695043 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2860/5323] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:32 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:32.697096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:32.699337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:32.704195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:32.704899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:32.935432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:32.944740 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-837d386f-2d81-47ab-bb00-1d9d0bbb67ff tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1319 microversion: 2.1 time: 0.268024 May 14 21:32:32.946012 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2464/5324] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:32 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:32:33.422982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:33.426962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:33.453732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:33.454849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:33.455709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:33.456377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:33.708457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1ad3cc5-165c-4c5e-9ec9-d53746f2d22e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a7015e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:33.735445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:33.744019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:33.745615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:33.746958 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-96e3f979-eb2e-42e8-aa25-72cf5393e77b tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1729 microversion: 2.20 time: 0.332467 May 14 21:32:33.747565 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2861/5325] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:33 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1729 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:32:33.767944 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d1ad3cc5-165c-4c5e-9ec9-d53746f2d22e tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.064178 May 14 21:32:33.768645 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2465/5326] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:33 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:32:33.961484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:33.962135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:33.971735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:33.972198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:33.972992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:33.973438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:34.263177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:34.279436 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5dbc4255-643d-4c59-8547-21ef85f8e303 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1507 microversion: 2.1 time: 0.319587 May 14 21:32:34.283660 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2862/5327] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:33 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1507 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:34.767603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:34.768316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:34.781768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ee9b0b4-b3d3-4ab4-91f1-15fba4d2c11f tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6c4d040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:34.789271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:34.790185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:34.791298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:34.792776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:34.887201 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ee9b0b4-b3d3-4ab4-91f1-15fba4d2c11f tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.109339 May 14 21:32:34.888214 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2863/5328] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:34 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:32:35.902484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-26363432-9f29-4a93-b681-ef259ac30de7 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6be0310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:35.953724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:35.966100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:35.981254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:35.984422 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c61da8e9-c2bd-4e76-85b0-7c13b28d2ac9 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1716 microversion: 2.20 time: 1.222333 May 14 21:32:35.990278 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2466/5329] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:32:34 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1716 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:32:36.036540 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-26363432-9f29-4a93-b681-ef259ac30de7 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 200 len: 338 microversion: 2.1 time: 0.139036 May 14 21:32:36.045266 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2864/5330] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:35 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 338 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:36.616931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2144992732", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:36.706123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] validate_networks() for [('80d87f84-7a26-47b5-8752-d965abc19974', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:32:37.052095 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0641401a-7080-499c-b38e-27e30fdd04e2 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6cda700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:37.087403 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0641401a-7080-499c-b38e-27e30fdd04e2 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] HTTP exception thrown: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0641401a-7080-499c-b38e-27e30fdd04e2 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Request method failure captured: May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb HTTP/1.1 May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_YfL02NCPTckYo_aNJErvFFKG-I87I7Z7T7JOFtL4vD2QlLyUHWoQfaE8ZF8197wZp9j1im3kKa6rVHceLOtMtCSqwqfd4ibRb2TNdFE8MR--6WuSG93ympMYvLA40orx37_kd_ZWqQnM229pxU3IH6twDeP49AMiXqV2HVm_fL1g May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a1393fd6fd94533b439ca5f156d94ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 0e40446fedca416883f7321a3de390bf May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: exception: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6ab899de-8a3b-4d6c-85de-5c4440b09dfb'} May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. (HTTP 404) (Request-ID: req-2f924b68-2e16-4627-b7eb-13e29c6f1706) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:32:37.090897 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.095421 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.106153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0641401a-7080-499c-b38e-27e30fdd04e2 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Returning 404 to user: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:37.108152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0641401a-7080-499c-b38e-27e30fdd04e2 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 404 len: 109 microversion: 2.1 time: 0.060559 May 14 21:32:37.116954 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2865/5331] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:37 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:32:37.125478 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c729581-95ec-4f2c-8c4d-d853b92d2309 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a6c05f70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:37.159085 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0c729581-95ec-4f2c-8c4d-d853b92d2309 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] HTTP exception thrown: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c729581-95ec-4f2c-8c4d-d853b92d2309 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Request method failure captured: May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb HTTP/1.1 May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_YfL02NCPTckYo_aNJErvFFKG-I87I7Z7T7JOFtL4vD2QlLyUHWoQfaE8ZF8197wZp9j1im3kKa6rVHceLOtMtCSqwqfd4ibRb2TNdFE8MR--6WuSG93ympMYvLA40orx37_kd_ZWqQnM229pxU3IH6twDeP49AMiXqV2HVm_fL1g May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a1393fd6fd94533b439ca5f156d94ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 0e40446fedca416883f7321a3de390bf May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: exception: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6ab899de-8a3b-4d6c-85de-5c4440b09dfb'} May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. (HTTP 404) (Request-ID: req-5387123c-7c89-4006-959f-1873a506e63b) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:32:37.161647 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0c729581-95ec-4f2c-8c4d-d853b92d2309 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Returning 404 to user: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0c729581-95ec-4f2c-8c4d-d853b92d2309 tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 404 len: 109 microversion: 2.1 time: 0.043360 May 14 21:32:37.167655 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2866/5332] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:32:37 2022] DELETE /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:32:37.175779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27bf6036-845a-4894-a260-54581a4c8c3a tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Calling method '.version_select at 0x7fb1a70940d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:37.210725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-27bf6036-845a-4894-a260-54581a4c8c3a tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] HTTP exception thrown: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27bf6036-845a-4894-a260-54581a4c8c3a tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Request method failure captured: May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb HTTP/1.1 May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_YfL02NCPTckYo_aNJErvFFKG-I87I7Z7T7JOFtL4vD2QlLyUHWoQfaE8ZF8197wZp9j1im3kKa6rVHceLOtMtCSqwqfd4ibRb2TNdFE8MR--6WuSG93ympMYvLA40orx37_kd_ZWqQnM229pxU3IH6twDeP49AMiXqV2HVm_fL1g May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2a1393fd6fd94533b439ca5f156d94ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2a1393fd6fd94533b439ca5f156d94ee", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 2a1393fd6fd94533b439ca5f156d94ee May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2001944209 May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 0e40446fedca416883f7321a3de390bf May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2001944209-project May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: exception: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6ab899de-8a3b-4d6c-85de-5c4440b09dfb'} May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. (HTTP 404) (Request-ID: req-c3366a10-ab05-4dd0-96b4-117d7b052c3e) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:32:37.213502 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. May 14 21:32:37.217724 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:37.232886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-27bf6036-845a-4894-a260-54581a4c8c3a tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] Returning 404 to user: Volume 6ab899de-8a3b-4d6c-85de-5c4440b09dfb could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:37.235957 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-27bf6036-845a-4894-a260-54581a4c8c3a tempest-VolumesSnapshotsTestJSON-2001944209 tempest-VolumesSnapshotsTestJSON-2001944209-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb" status: 404 len: 109 microversion: 2.1 time: 0.067263 May 14 21:32:37.237145 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2867/5333] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:32:37 2022] GET /compute/v2.1/os-volumes/6ab899de-8a3b-4d6c-85de-5c4440b09dfb => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:32:37.696422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:32:37.697530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:32:37.699552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:32:37.700224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:32:37.700791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:32:37.722773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:37.727921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:37.728878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:37.732930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:37.790782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:32:37.807699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for user cbb8c5cf2d144e3791171eb3d6f83eca and project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:32:37.831977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:32:37.835076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:32:38.036055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-40b9f886-dd5b-4c90-9527-ec2f05c6b89c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.648629 May 14 21:32:38.038766 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2467/5334] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:32:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:32:38.051591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-62f6d181-4535-4cf7-8bfd-ad4c44d385b7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:38.052459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-62f6d181-4535-4cf7-8bfd-ad4c44d385b7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:38.199948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-62f6d181-4535-4cf7-8bfd-ad4c44d385b7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:38.207378 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-62f6d181-4535-4cf7-8bfd-ad4c44d385b7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1222 microversion: 2.1 time: 0.160654 May 14 21:32:38.212219 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2868/5335] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:38 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1222 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:38.705448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-113387407", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:38.799902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] validate_networks() for [('80d87f84-7a26-47b5-8752-d965abc19974', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:32:40.572425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:32:40.574094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:32:40.576510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:32:40.578089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:32:40.581035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:32:40.609754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:40.610351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:40.611257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:40.611871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:40.649122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:32:40.656469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for user cbb8c5cf2d144e3791171eb3d6f83eca and project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:32:40.674085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:32:40.676971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:32:40.836908 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18c53a41-79ab-4e6d-91dc-2ee93558b42f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.134558 May 14 21:32:40.844478 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2468/5336] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:32:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:32:40.852123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d7a2024b-1a2e-4194-adcd-2dd1a3eee269 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:40.853542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d7a2024b-1a2e-4194-adcd-2dd1a3eee269 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:40.948285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d7a2024b-1a2e-4194-adcd-2dd1a3eee269 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:40.954201 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d7a2024b-1a2e-4194-adcd-2dd1a3eee269 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1221 microversion: 2.1 time: 0.107370 May 14 21:32:40.955121 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2869/5337] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:40 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:41.981807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3abef726-ca68-480d-a346-fd188ac07944 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:41.981807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3abef726-ca68-480d-a346-fd188ac07944 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:42.115966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3abef726-ca68-480d-a346-fd188ac07944 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:42.160497 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3abef726-ca68-480d-a346-fd188ac07944 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1221 microversion: 2.1 time: 0.191893 May 14 21:32:42.161112 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2469/5338] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:41 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1221 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:43.178732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:43.179416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:43.194812 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:43.195606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:43.211799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:43.212484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:43.242552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7319dc25-4ec5-41f9-8d8a-4fd776325416 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd3708f6-e860-49e0-862f-98ce06d603c8", "device": "/dev/sdb"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:43.244000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7319dc25-4ec5-41f9-8d8a-4fd776325416 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:43.258189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7319dc25-4ec5-41f9-8d8a-4fd776325416 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:43.265369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7319dc25-4ec5-41f9-8d8a-4fd776325416 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:43.270626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7319dc25-4ec5-41f9-8d8a-4fd776325416 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:43.273494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7319dc25-4ec5-41f9-8d8a-4fd776325416 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:43.381241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:43.390288 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-142fb7f1-d6e5-448d-ab22-2b92b0b41140 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1273 microversion: 2.1 time: 0.215175 May 14 21:32:43.395274 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2870/5339] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:43 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:44.412639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:44.413267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:44.420326 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:44.420813 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:44.421587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:44.422026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:44.502267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:44.523186 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9122992-392b-44df-9a6c-43cf673ea5f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1279 microversion: 2.1 time: 0.116553 May 14 21:32:44.533688 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2871/5340] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:44 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:32:44.599379 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7319dc25-4ec5-41f9-8d8a-4fd776325416 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "POST /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.359137 May 14 21:32:44.599379 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2470/5341] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:32:43 2022] POST /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e/os-volume_attachments => generated 194 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:45.543737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:45.544387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:45.553012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:45.553600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:45.557558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:45.557558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:45.630624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:45.640295 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-44548a16-26c7-460f-9db1-2934e1a05791 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1279 microversion: 2.1 time: 0.101782 May 14 21:32:45.641883 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2872/5342] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:45 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:46.659991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:46.661465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:46.669783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:46.686073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:46.691711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:46.692352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:47.272067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:47.283826 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b443f4e6-68a1-459f-93a2-e0f94a8b494f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.629288 May 14 21:32:47.284943 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2471/5343] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:46 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:47.397889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8d944397-f9b8-4893-8ebf-2cad2fcab96f req-43760b06-b305-43d3-bdad-ad86044eb6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f98eb2-6910-4d90-86c1-bc42958e30ca", "tag": "3bd86955-065d-4044-84d3-96660ce658cb"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:47.422360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8d944397-f9b8-4893-8ebf-2cad2fcab96f req-43760b06-b305-43d3-bdad-ad86044eb6ff service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:47.425045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8d944397-f9b8-4893-8ebf-2cad2fcab96f req-43760b06-b305-43d3-bdad-ad86044eb6ff service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:47.445639 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8d944397-f9b8-4893-8ebf-2cad2fcab96f req-43760b06-b305-43d3-bdad-ad86044eb6ff service nova] Creating event network-changed:3bd86955-065d-4044-84d3-96660ce658cb for instance d1f98eb2-6910-4d90-86c1-bc42958e30ca on nch2-master-1 May 14 21:32:47.451231 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8d944397-f9b8-4893-8ebf-2cad2fcab96f req-43760b06-b305-43d3-bdad-ad86044eb6ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057728 May 14 21:32:47.452240 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2873/5344] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:48.303267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:48.303950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:48.345316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:48.352286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:48.352916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:48.353381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:48.880529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:48.888908 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-57ec321b-8332-48bd-8f5d-84cc2c976e30 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.590317 May 14 21:32:48.890342 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2472/5345] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:48 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:49.497596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-7a3805e0-e1aa-429d-bd09-1283ca6abff9 req-8129486b-1b90-4a7e-8e77-c4ad9aee8522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c8a0510-504e-4380-b02e-0e0f3c522ba9", "tag": "3bdd3c6d-f517-4fec-8956-4ac2b17c2b04"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:49.545714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7a3805e0-e1aa-429d-bd09-1283ca6abff9 req-8129486b-1b90-4a7e-8e77-c4ad9aee8522 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:49.546172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-7a3805e0-e1aa-429d-bd09-1283ca6abff9 req-8129486b-1b90-4a7e-8e77-c4ad9aee8522 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:49.605362 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-7a3805e0-e1aa-429d-bd09-1283ca6abff9 req-8129486b-1b90-4a7e-8e77-c4ad9aee8522 service nova] Creating event network-changed:3bdd3c6d-f517-4fec-8956-4ac2b17c2b04 for instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 on nch2-master-1 May 14 21:32:49.626389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-7a3805e0-e1aa-429d-bd09-1283ca6abff9 req-8129486b-1b90-4a7e-8e77-c4ad9aee8522 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137470 May 14 21:32:49.627497 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2874/5346] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:49.910355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:49.911877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:49.925321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:49.926142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:49.928412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:49.930022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:50.205602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:50.206542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:50.217165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:50.217943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:50.220303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:50.221162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:50.242439 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] HTTP exception thrown: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Request method failure captured: May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 HTTP/1.1 May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dR5Br-85r_xroEIubjtcujEO9DjMhMRQAo-sNEQSWq_kbkbjio1ibNIrita8v-LjHR84K6mX87wrKF6VBTpqyb7bqQC-nGsg3aVVDGcNwoxaZjMQjTlZihE1SMH0rqWbyt_lyLml2ycUbSCUtr_nQCKw00gutDx4iulYuLKoKmlo May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6641b342c1d440aea451919f391bc5db May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6641b342c1d440aea451919f391bc5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6641b342c1d440aea451919f391bc5db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6641b342c1d440aea451919f391bc5db May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 5586a3a946a0490498c42cb71f39ce1e May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '3052d147-1dbb-4370-97c7-1d8170765e60'} May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:32:50.244928 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.248655 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.250642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Returning 404 to user: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:50.252437 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07ddd722-0be8-49ad-b346-a4df3806a30a tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 404 len: 111 microversion: 2.1 time: 0.052389 May 14 21:32:50.256879 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2875/5347] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:32:50 2022] DELETE /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:32:50.272385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:50.273418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 3052d147-1dbb-4370-97c7-1d8170765e60] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:50.280983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:50.281549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:50.282738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:50.283391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:50.304660 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] HTTP exception thrown: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Request method failure captured: May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 HTTP/1.1 May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dR5Br-85r_xroEIubjtcujEO9DjMhMRQAo-sNEQSWq_kbkbjio1ibNIrita8v-LjHR84K6mX87wrKF6VBTpqyb7bqQC-nGsg3aVVDGcNwoxaZjMQjTlZihE1SMH0rqWbyt_lyLml2ycUbSCUtr_nQCKw00gutDx4iulYuLKoKmlo May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6641b342c1d440aea451919f391bc5db May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6641b342c1d440aea451919f391bc5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6641b342c1d440aea451919f391bc5db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6641b342c1d440aea451919f391bc5db May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 5586a3a946a0490498c42cb71f39ce1e May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '3052d147-1dbb-4370-97c7-1d8170765e60'} May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:32:50.307163 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.310868 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:32:50.310868 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:32:50.310868 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:32:50.310868 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:32:50.310868 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:32:50.310868 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. May 14 21:32:50.310868 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:32:50.311242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:50.312886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Returning 404 to user: Instance 3052d147-1dbb-4370-97c7-1d8170765e60 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:32:50.314205 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ed2c543e-ab58-4c73-8128-334adb88eec9 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60" status: 404 len: 111 microversion: 2.1 time: 0.055972 May 14 21:32:50.319250 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2876/5348] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:50 2022] GET /compute/v2.1/servers/3052d147-1dbb-4370-97c7-1d8170765e60 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:32:50.329744 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd3df145-c34f-4f3b-87ca-9b2dfe9b24e3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.424988 May 14 21:32:50.329744 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2473/5349] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:49 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:51.345885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:51.346561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:51.354134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:51.358828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:51.359969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:51.360581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:51.542765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:51.553498 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f215b293-304f-483a-84ca-8b0f8cee8e0a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.212194 May 14 21:32:51.562083 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2877/5350] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:51 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:52.576037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:52.576661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:52.588894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:52.589474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:52.590502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:52.591147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:52.855377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:52.862876 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2fa639f3-adc9-4aba-b5f8-9c32bd9f8207 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.291510 May 14 21:32:52.864583 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2474/5351] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:52 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:53.623855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-15bdb6e4-de2c-4646-bd9f-a900c7dcc327 req-cae119a0-e805-4452-a245-4f8ecd66e60f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f98eb2-6910-4d90-86c1-bc42958e30ca", "name": "network-vif-plugged", "status": "completed", "tag": "3bd86955-065d-4044-84d3-96660ce658cb"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:53.631847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-15bdb6e4-de2c-4646-bd9f-a900c7dcc327 req-cae119a0-e805-4452-a245-4f8ecd66e60f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:53.632306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-15bdb6e4-de2c-4646-bd9f-a900c7dcc327 req-cae119a0-e805-4452-a245-4f8ecd66e60f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:53.643970 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-15bdb6e4-de2c-4646-bd9f-a900c7dcc327 req-cae119a0-e805-4452-a245-4f8ecd66e60f service nova] Creating event network-vif-plugged:3bd86955-065d-4044-84d3-96660ce658cb for instance d1f98eb2-6910-4d90-86c1-bc42958e30ca on nch2-master-1 May 14 21:32:53.648867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-15bdb6e4-de2c-4646-bd9f-a900c7dcc327 req-cae119a0-e805-4452-a245-4f8ecd66e60f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157937 May 14 21:32:53.649457 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2878/5352] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:53.882172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:53.882958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:53.902928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:53.903712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:53.904700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:53.905305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:54.158618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:54.171102 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-267a2f47-6af8-4969-86bb-bd80664948e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.292626 May 14 21:32:54.173335 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2475/5353] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:53 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:55.193409 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:55.194914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:55.203390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:55.204008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:55.205089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:55.205630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:55.405652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:55.413461 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c2a28dce-5b71-45cf-9da7-66bc39e39dde tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.228151 May 14 21:32:55.419287 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2879/5354] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:55 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:55.779348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-87e7edc2-44c7-4b45-93ea-f15d67e3a7fe req-c738f169-4333-441c-8edc-a1e620bdf4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8a0510-504e-4380-b02e-0e0f3c522ba9", "name": "network-vif-plugged", "status": "completed", "tag": "3bdd3c6d-f517-4fec-8956-4ac2b17c2b04"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:55.788772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-87e7edc2-44c7-4b45-93ea-f15d67e3a7fe req-c738f169-4333-441c-8edc-a1e620bdf4e6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:55.789216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-87e7edc2-44c7-4b45-93ea-f15d67e3a7fe req-c738f169-4333-441c-8edc-a1e620bdf4e6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:55.801503 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-87e7edc2-44c7-4b45-93ea-f15d67e3a7fe req-c738f169-4333-441c-8edc-a1e620bdf4e6 service nova] Creating event network-vif-plugged:3bdd3c6d-f517-4fec-8956-4ac2b17c2b04 for instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 on nch2-master-1 May 14 21:32:55.812261 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-87e7edc2-44c7-4b45-93ea-f15d67e3a7fe req-c738f169-4333-441c-8edc-a1e620bdf4e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032218 May 14 21:32:55.812261 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2476/5355] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:32:56.434182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:56.435292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:56.445402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:56.446072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:56.446852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:56.448627 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:56.689149 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:56.713665 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ff4f0a70-65d1-4564-a6fa-ab0d72e3b5bc tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1321 microversion: 2.1 time: 0.275484 May 14 21:32:56.713665 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2880/5356] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:56 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:32:57.727079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:57.732086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:57.750646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:57.752048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:57.753149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:57.754331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:58.029239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:58.039200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3eb3b079-23ed-443d-93fb-6e4d966f4737 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1515 microversion: 2.1 time: 0.322015 May 14 21:32:58.039923 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2477/5357] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:57 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1515 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:32:58.063953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:32:58.066096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:58.074124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:58.074587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:58.078740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:58.078740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:58.102378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lazy-loading 'flavor' on Instance uuid 0c8a0510-504e-4380-b02e-0e0f3c522ba9 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:32:58.524989 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-74a6d973-e31b-4409-a8d8-5177ee30022c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action" status: 200 len: 32 microversion: 2.1 time: 0.465616 May 14 21:32:58.526293 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2881/5358] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:32:58 2022] POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:32:58.538002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:32:58.539071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:32:58.552254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:58.552750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:58.553935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:32:58.556087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:32:59.212195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:32:59.231077 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c89bc65e-23ea-4e89-ac68-38146c38fd80 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.697427 May 14 21:32:59.231755 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2478/5359] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:32:58 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:00.267600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:00.268591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:00.289377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:00.290978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:00.291911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:00.292379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:00.676375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:00.685279 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-29caf6ce-cac5-4097-b55d-c8cda3ec0afe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.431445 May 14 21:33:00.691928 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2882/5360] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:00 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:00.762722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:00.764875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:00.773747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:00.774226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:00.775107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:00.776123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:00.792538 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] HTTP exception thrown: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Request method failure captured: May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f HTTP/1.1 May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB7dR5Br-85r_xroEIubjtcujEO9DjMhMRQAo-sNEQSWq_kbkbjio1ibNIrita8v-LjHR84K6mX87wrKF6VBTpqyb7bqQC-nGsg3aVVDGcNwoxaZjMQjTlZihE1SMH0rqWbyt_lyLml2ycUbSCUtr_nQCKw00gutDx4iulYuLKoKmlo May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 6641b342c1d440aea451919f391bc5db May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6641b342c1d440aea451919f391bc5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6641b342c1d440aea451919f391bc5db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeTestJSON-1845080071 May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 6641b342c1d440aea451919f391bc5db May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 5586a3a946a0490498c42cb71f39ce1e May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '6a91c0da-3308-4367-b3f4-ecc73bd8ee3f'} May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:00.794380 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Returning 404 to user: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-937bf69c-c5a8-4a73-a64d-3fc80965d2d6 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "DELETE /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 404 len: 111 microversion: 2.1 time: 0.043809 May 14 21:33:00.798892 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2479/5361] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:33:00 2022] DELETE /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:33:00.804944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:00.805686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] [instance: 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:00.812045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:00.812809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:00.816432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:00.816960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:00.831539 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] HTTP exception thrown: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Request method failure captured: May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f HTTP/1.1 May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB7dR5Br-85r_xroEIubjtcujEO9DjMhMRQAo-sNEQSWq_kbkbjio1ibNIrita8v-LjHR84K6mX87wrKF6VBTpqyb7bqQC-nGsg3aVVDGcNwoxaZjMQjTlZihE1SMH0rqWbyt_lyLml2ycUbSCUtr_nQCKw00gutDx4iulYuLKoKmlo May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 6641b342c1d440aea451919f391bc5db May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6641b342c1d440aea451919f391bc5db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6641b342c1d440aea451919f391bc5db"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6641b342c1d440aea451919f391bc5db", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeTestJSON-1845080071 May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 6641b342c1d440aea451919f391bc5db May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1845080071 May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 5586a3a946a0490498c42cb71f39ce1e May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeTestJSON-1845080071-project May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '6a91c0da-3308-4367-b3f4-ecc73bd8ee3f'} May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:00.838819 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] Returning 404 to user: Instance 6a91c0da-3308-4367-b3f4-ecc73bd8ee3f could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ddcb3f00-f511-4f06-9d5d-802f29377924 tempest-AttachVolumeTestJSON-1845080071 tempest-AttachVolumeTestJSON-1845080071-project] 10.222.0.52 "GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f" status: 404 len: 111 microversion: 2.1 time: 0.033586 May 14 21:33:00.843865 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2883/5362] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:00 2022] GET /compute/v2.1/servers/6a91c0da-3308-4367-b3f4-ecc73bd8ee3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:33:01.703358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:01.704313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:01.715105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:01.715947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:01.716945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:01.717914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:02.393577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:02.402514 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3c99ed5d-853b-4322-ad01-ed51eab1463b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.703640 May 14 21:33:02.403420 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2480/5363] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:01 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:03.420260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:03.420888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:03.433380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:03.434046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:03.435188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:03.437893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:03.723511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:03.741845 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7f315165-460f-4219-aecc-921fbe7b5479 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.324463 May 14 21:33:03.744289 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2884/5364] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:03 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:04.759392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:04.760657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:04.770193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:04.770671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:04.771534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:04.772050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:05.063964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:05.085288 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c30aec54-028b-44fd-a163-7c98ea4f934f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.329816 May 14 21:33:05.086566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2481/5365] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:04 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:06.107613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:06.109676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:06.125485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.126559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:06.127563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.128243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:06.382797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7dabdfe6-e603-487f-9a4e-25240f2ea14a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:06.384096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7dabdfe6-e603-487f-9a4e-25240f2ea14a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:06.418466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dabdfe6-e603-487f-9a4e-25240f2ea14a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.420258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dabdfe6-e603-487f-9a4e-25240f2ea14a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:06.421098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dabdfe6-e603-487f-9a4e-25240f2ea14a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.421967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7dabdfe6-e603-487f-9a4e-25240f2ea14a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:06.467965 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7dabdfe6-e603-487f-9a4e-25240f2ea14a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.090016 May 14 21:33:06.472302 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2482/5366] 10.222.0.52 () {60 vars in 1342 bytes} [Sat May 14 21:33:06 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:06.542694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:06.551752 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f53f7f94-8bad-4ef3-8670-de798e79d1ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.452380 May 14 21:33:06.552874 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2885/5367] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:06 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:06.576266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:06.576802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:06.590503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.591172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:06.592380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.593208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:06.627585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:33:06.967209 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6892f0ff-3862-46e6-9f4a-0429f7973c7a tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 204 len: 0 microversion: 2.20 time: 0.394032 May 14 21:33:06.967979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2483/5368] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:33:06 2022] DELETE /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:33:06.976407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:06.977265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:06.988228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.990365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:06.991216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:06.994966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:07.351131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:07.366771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:07.371355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:07.373154 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0078b12-0e2d-48e6-9312-0f2562896b64 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.400634 May 14 21:33:07.374342 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2886/5369] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:33:06 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:33:07.570855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:07.571531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:07.583352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:07.584084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:07.587963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:07.588979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:07.941476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:07.953134 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45160d05-497f-4543-a251-9aea9308fb3e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.386377 May 14 21:33:07.959965 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2484/5370] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:07 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:08.397860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:08.399495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:08.416954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:08.419595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:08.420706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:08.423815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:08.715314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:08.733364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:08.734834 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:08.736334 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0c59628-9159-4d4b-947e-e50b570e8c44 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.346238 May 14 21:33:08.736910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2887/5371] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:33:08 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:33:08.976147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:08.977555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:08.986182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:08.986987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:08.988077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:08.988713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:09.272318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:09.289756 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a8db571-377d-4373-ab89-93289d0c19f5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.323262 May 14 21:33:09.291737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2485/5372] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:08 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:09.754330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:09.755753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:09.766456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:09.767188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:09.783558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:09.784617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:10.077739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:10.089257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:10.091222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:10.092743 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-897f6744-c825-439e-b1f0-8768d24ddbda tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1722 microversion: 2.20 time: 0.342327 May 14 21:33:10.104742 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2888/5373] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:33:09 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:33:10.309422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:10.310053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:10.319723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:10.321201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:10.323466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:10.324321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:10.772303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:10.785100 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c9e6661-48ea-4f94-aea6-17fec4c6ef27 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.481229 May 14 21:33:10.785718 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2486/5374] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:10 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:11.070577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2601fe68-9036-41a8-8df3-7ff6d52b3d01 req-c46531a5-6449-4f94-b74d-72ee0748724e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db0cc056-41d6-4656-ab5e-714ac048819b", "name": "network-vif-deleted", "tag": "3a71fedd-378c-474b-8ed3-687958dee25b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:33:11.095586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2601fe68-9036-41a8-8df3-7ff6d52b3d01 req-c46531a5-6449-4f94-b74d-72ee0748724e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:11.096301 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2601fe68-9036-41a8-8df3-7ff6d52b3d01 req-c46531a5-6449-4f94-b74d-72ee0748724e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:11.116740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:11.117373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:11.126998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:11.127268 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2601fe68-9036-41a8-8df3-7ff6d52b3d01 req-c46531a5-6449-4f94-b74d-72ee0748724e service nova] Creating event network-vif-deleted:3a71fedd-378c-474b-8ed3-687958dee25b for instance db0cc056-41d6-4656-ab5e-714ac048819b on nch1-master-1 May 14 21:33:11.127920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:11.129146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:11.129941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:11.149710 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2601fe68-9036-41a8-8df3-7ff6d52b3d01 req-c46531a5-6449-4f94-b74d-72ee0748724e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086786 May 14 21:33:11.150421 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2889/5375] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:33:11.293824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:11.304901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:11.310266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04e48304473d40ebb8c0c5386c4c3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4989c480608c4b86bd1cd7615fba4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:11.313770 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c2291d9-1673-4e80-adc3-bffd20e832cf tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 200 len: 1655 microversion: 2.20 time: 0.201656 May 14 21:33:11.315555 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2487/5376] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:33:11 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 1655 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:33:11.803357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:11.804278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:11.815232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:11.817131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:11.822472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:11.823222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:12.142638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:12.163632 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6678df15-42cd-4f75-b844-7328f77e146f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.360107 May 14 21:33:12.163632 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2890/5377] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:11 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:12.336245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:12.338335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:12.360087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:12.365516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:12.366608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:12.371246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:12.418612 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] HTTP exception thrown: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Request method failure captured: May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b HTTP/1.1 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB604rebpQeLnyYI852JXnERPYC8krWfoXtVWkh4nDcimyiojWSh2eGdPTLybHYevbyIK-Pa-gSj3ZDPEuMi3deCkuSSS48R-w6YMG5zWSLw9zar0yUOCC0XTqv5Y3AlVsXuKwKTyVDwQcSLFd7xRiCasmFSoIa1Ds_2eKFjDywncr4 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.20 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4989c480608c4b86bd1cd7615fba4d20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 04e48304473d40ebb8c0c5386c4c3592 May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'db0cc056-41d6-4656-ab5e-714ac048819b'} May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:12.424819 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:12.430241 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:12.436388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Returning 404 to user: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:12.437496 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a68f4ca0-a470-4bd3-8136-10bc4ff91e55 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 404 len: 111 microversion: 2.20 time: 0.106674 May 14 21:33:12.449592 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2488/5378] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:33:12 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:33:12.459275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6bfba196-32a9-490e-88a4-52cf918eb5e6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '.version_select at 0x7fb1b96c6430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:12.590363 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6bfba196-32a9-490e-88a4-52cf918eb5e6 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-994967664" status: 204 len: 0 microversion: 2.20 time: 0.135504 May 14 21:33:12.594164 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2891/5379] 10.222.0.52 () {60 vars in 1258 bytes} [Sat May 14 21:33:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-994967664 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:33:13.179428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:13.180108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:13.194361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:13.194845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:13.201479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:13.201971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:13.522702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:13.541282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ae18f77-d89f-4c75-8b27-0e7a9d00c738 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.365813 May 14 21:33:13.546043 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2489/5380] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:13 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:14.565970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:14.567723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:14.588876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:14.588876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:14.588876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:14.588876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:15.313467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:15.335780 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edfd3671-00b6-454b-a550-de144a888c55 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.769542 May 14 21:33:15.339346 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2892/5381] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:14 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:16.357580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:16.358351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:16.373639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:16.378912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:16.378912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:16.378912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:16.706411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:16.718392 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01aef3d7-8b41-4811-9cdc-b7180a92b858 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.366805 May 14 21:33:16.719646 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2490/5382] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:16 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:17.739143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:17.740051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:17.754503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:17.755034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:17.756286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:17.756953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:17.996974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:18.007427 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-abceb8d1-b12f-414b-9852-32367695d525 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.272840 May 14 21:33:18.008466 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2893/5383] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:17 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:19.029978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:19.032592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:19.042842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:19.044271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:19.045320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:19.045978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:19.272845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:19.284258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1cb366cc-bb89-4a3f-82d5-486c1c754ca3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.261860 May 14 21:33:19.296689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2491/5384] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:19 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:20.304536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:20.307760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:20.318367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:20.319241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:20.320298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:20.322031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:20.634855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:20.646144 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-05b3b25d-7fce-49aa-98fc-201e3fa338ca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.345004 May 14 21:33:20.648403 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2894/5385] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:20 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:21.662324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:21.663558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:21.677671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:21.678402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:21.679365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:21.679998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:22.076718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:22.098795 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45947579-5c75-4470-9a27-f0fbdedac1b3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.440358 May 14 21:33:22.101084 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2492/5386] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:21 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:23.121066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:23.122531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:23.142402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:23.142876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:23.145343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:23.148710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:23.916445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:23.938862 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-380d21c1-8d1b-4fba-a31e-5d8a3972b4e5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.823407 May 14 21:33:23.951737 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2895/5387] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:23 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:24.240410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:24.241516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:24.252189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:24.269720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:24.269720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:24.269720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:24.303469 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] HTTP exception thrown: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Request method failure captured: May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b HTTP/1.1 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB604rebpQeLnyYI852JXnERPYC8krWfoXtVWkh4nDcimyiojWSh2eGdPTLybHYevbyIK-Pa-gSj3ZDPEuMi3deCkuSSS48R-w6YMG5zWSLw9zar0yUOCC0XTqv5Y3AlVsXuKwKTyVDwQcSLFd7xRiCasmFSoIa1Ds_2eKFjDywncr4 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.20 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4989c480608c4b86bd1cd7615fba4d20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 04e48304473d40ebb8c0c5386c4c3592 May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'db0cc056-41d6-4656-ab5e-714ac048819b'} May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:24.306443 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Returning 404 to user: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd89cf32-02ee-42c4-86c1-94531ec358b2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 404 len: 111 microversion: 2.20 time: 0.071549 May 14 21:33:24.314167 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2493/5388] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:33:24 2022] DELETE /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: db0cc056-41d6-4656-ab5e-714ac048819b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] HTTP exception thrown: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Request method failure captured: May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b HTTP/1.1 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB604rebpQeLnyYI852JXnERPYC8krWfoXtVWkh4nDcimyiojWSh2eGdPTLybHYevbyIK-Pa-gSj3ZDPEuMi3deCkuSSS48R-w6YMG5zWSLw9zar0yUOCC0XTqv5Y3AlVsXuKwKTyVDwQcSLFd7xRiCasmFSoIa1Ds_2eKFjDywncr4 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.20 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4989c480608c4b86bd1cd7615fba4d20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 04e48304473d40ebb8c0c5386c4c3592 May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:24.484864 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'db0cc056-41d6-4656-ab5e-714ac048819b'} May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Returning 404 to user: Instance db0cc056-41d6-4656-ab5e-714ac048819b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3fd862e7-650d-4173-aa65-08623237e408 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b" status: 404 len: 111 microversion: 2.20 time: 0.042890 May 14 21:33:24.491598 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2896/5389] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:33:24 2022] GET /compute/v2.1/servers/db0cc056-41d6-4656-ab5e-714ac048819b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:33:24.962615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:24.962615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:24.971250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:24.971767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:24.972592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:24.973049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:25.236817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:25.244891 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5056bc74-5933-4a79-84b4-83fc7c9f203b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.291313 May 14 21:33:25.246485 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2494/5390] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:24 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:26.263155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:26.264528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:26.280344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:26.283612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:26.284763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:26.285444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:26.671293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:26.685419 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fbc8d262-1097-4a2c-9098-d7474dd57dca tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1521 microversion: 2.1 time: 0.426919 May 14 21:33:26.697854 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2897/5391] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:26 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:27.705996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:27.707950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:27.726256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:27.728157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:27.731711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:27.732285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:27.975158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:27.986439 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eac5da0a-fab0-43d4-a8a0-1755023d8589 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1501 microversion: 2.1 time: 0.285002 May 14 21:33:27.987343 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2495/5392] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:27 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:28.004774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:28.005480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:28.013333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:28.020644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:28.020644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:28.020644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:28.410976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:28.419848 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f0abe510-de9a-4012-898a-0991703f996c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1516 microversion: 2.1 time: 0.420742 May 14 21:33:28.420637 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2898/5393] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:27 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1516 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:28.448957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae461e03-05eb-4991-9cb8-1cc4c813983b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:33:28.451676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae461e03-05eb-4991-9cb8-1cc4c813983b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 37ff4ca1-d540-423d-8ee1-fc739de0983e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:28.459698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ae461e03-05eb-4991-9cb8-1cc4c813983b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Instance 37ff4ca1-d540-423d-8ee1-fc739de0983e could not be found. May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae461e03-05eb-4991-9cb8-1cc4c813983b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/37ff4ca1-d540-423d-8ee1-fc739de0983e/action HTTP/1.1 May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 14 May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: {"rescue": {}} May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 37ff4ca1-d540-423d-8ee1-fc739de0983e could not be found. May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '37ff4ca1-d540-423d-8ee1-fc739de0983e', 'body': {'rescue': {}}} May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37ff4ca1-d540-423d-8ee1-fc739de0983e could not be found. May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37ff4ca1-d540-423d-8ee1-fc739de0983e could not be found. May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:28.470786 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37ff4ca1-d540-423d-8ee1-fc739de0983e could not be found. May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae461e03-05eb-4991-9cb8-1cc4c813983b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 404 to user: Instance 37ff4ca1-d540-423d-8ee1-fc739de0983e could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae461e03-05eb-4991-9cb8-1cc4c813983b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/37ff4ca1-d540-423d-8ee1-fc739de0983e/action" status: 404 len: 111 microversion: 2.1 time: 0.035381 May 14 21:33:28.475455 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2496/5394] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:33:28 2022] POST /compute/v2.1/servers/37ff4ca1-d540-423d-8ee1-fc739de0983e/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:33:28.482185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9ff50347-c489-4595-845a-e563fd75688e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:33:28.483027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9ff50347-c489-4595-845a-e563fd75688e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:28.489397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff50347-c489-4595-845a-e563fd75688e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:28.489863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff50347-c489-4595-845a-e563fd75688e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:28.490647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff50347-c489-4595-845a-e563fd75688e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:28.491092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ff50347-c489-4595-845a-e563fd75688e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:28.767669 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9ff50347-c489-4595-845a-e563fd75688e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action" status: 202 len: 0 microversion: 2.1 time: 0.288984 May 14 21:33:28.771519 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2899/5395] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:33:28 2022] POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:33:28.792712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:28.794366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:28.804835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:28.806636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:28.807625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:28.808297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:29.071401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:29.085270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fcb29376-91e6-4f43-ae07-5ea409ff0988 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1521 microversion: 2.1 time: 0.311264 May 14 21:33:29.089035 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2497/5396] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:28 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:30.108055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:30.109593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:30.119900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.120853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.121871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.122745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.307430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:30.319008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e57d83f9-81c1-406f-9e20-8c1d196f6e7f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1501 microversion: 2.1 time: 0.214960 May 14 21:33:30.320242 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2900/5397] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:30 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1501 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:30.337527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:33:30.339615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:30.347302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.348079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.348917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.349510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.386479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lazy-loading 'flavor' on Instance uuid d1f98eb2-6910-4d90-86c1-bc42958e30ca {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:33:30.402935 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Cannot 'rescue' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state paused May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action HTTP/1.1 May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 14 May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: {"rescue": {}} May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'rescue' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state paused May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd1f98eb2-6910-4d90-86c1-bc42958e30ca', 'body': {'rescue': {}}} May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca in vm_state paused. Cannot rescue while the instance is in this state. May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state paused May 14 21:33:30.405335 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state paused May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 409 to user: Cannot 'rescue' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state paused {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9b324a10-f756-4a50-9562-2163b5702937 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action" status: 409 len: 144 microversion: 2.1 time: 0.073875 May 14 21:33:30.409512 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2498/5398] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:33:30 2022] POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action => generated 144 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:33:30.416056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9381340e-8868-44ba-acde-382bb6aa5e2d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:33:30.416666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9381340e-8868-44ba-acde-382bb6aa5e2d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:30.422760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9381340e-8868-44ba-acde-382bb6aa5e2d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.423218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9381340e-8868-44ba-acde-382bb6aa5e2d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.424260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9381340e-8868-44ba-acde-382bb6aa5e2d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.424769 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9381340e-8868-44ba-acde-382bb6aa5e2d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.728070 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9381340e-8868-44ba-acde-382bb6aa5e2d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action" status: 202 len: 0 microversion: 2.1 time: 0.314744 May 14 21:33:30.728442 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2901/5399] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:33:30 2022] POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:33:30.738823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:30.739510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:30.750828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.756873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.756873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:30.756873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:30.924905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:30.936760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c03ad815-eddc-47e7-be07-232d4966ff37 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1508 microversion: 2.1 time: 0.203348 May 14 21:33:30.937744 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2499/5400] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:30 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:31.955087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:31.955814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:31.962684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:31.963139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:31.963929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:31.964365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:32.107946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:32.115420 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58fbceb3-7433-4938-be98-22c302a9b646 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1508 microversion: 2.1 time: 0.164915 May 14 21:33:32.116239 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2902/5401] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:31 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:33.133672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:33.137969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:33.146475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:33.146953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:33.150405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:33.150987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:33.457331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:33.468293 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-15b9dcf9-cda6-46db-8063-1476e82cd376 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1508 microversion: 2.1 time: 0.336837 May 14 21:33:33.480177 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2500/5402] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:33 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:34.488345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:34.489438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:34.499305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:34.500041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:34.501212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:34.501810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:34.554868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:34.573559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:34.616740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:34.618000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:34.618957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:34.619611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:34.646255 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] HTTP exception thrown: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Request method failure captured: May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 HTTP/1.1 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB604rebpQeLnyYI852JXnERPYC8krWfoXtVWkh4nDcimyiojWSh2eGdPTLybHYevbyIK-Pa-gSj3ZDPEuMi3deCkuSSS48R-w6YMG5zWSLw9zar0yUOCC0XTqv5Y3AlVsXuKwKTyVDwQcSLFd7xRiCasmFSoIa1Ds_2eKFjDywncr4 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.20 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4989c480608c4b86bd1cd7615fba4d20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 04e48304473d40ebb8c0c5386c4c3592 May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '4097156a-300a-4d17-87df-60620c836925'} May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:34.648741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.653816 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.656849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Returning 404 to user: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:34.658430 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-801408d6-c4e2-4c16-9552-191b22b9c9ed tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 404 len: 111 microversion: 2.20 time: 0.107819 May 14 21:33:34.662361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2501/5403] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:33:34 2022] DELETE /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:33:34.674781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:34.675680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] [instance: 4097156a-300a-4d17-87df-60620c836925] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:34.684322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:34.684794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:34.685847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:34.686927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:34.706488 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] HTTP exception thrown: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Request method failure captured: May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 HTTP/1.1 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB604rebpQeLnyYI852JXnERPYC8krWfoXtVWkh4nDcimyiojWSh2eGdPTLybHYevbyIK-Pa-gSj3ZDPEuMi3deCkuSSS48R-w6YMG5zWSLw9zar0yUOCC0XTqv5Y3AlVsXuKwKTyVDwQcSLFd7xRiCasmFSoIa1Ds_2eKFjDywncr4 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.20 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4989c480608c4b86bd1cd7615fba4d20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4989c480608c4b86bd1cd7615fba4d20", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 4989c480608c4b86bd1cd7615fba4d20 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565426114 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 04e48304473d40ebb8c0c5386c4c3592 May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565426114-project May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '4097156a-300a-4d17-87df-60620c836925'} May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.712013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. May 14 21:33:34.716865 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:33:34.718414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] Returning 404 to user: Instance 4097156a-300a-4d17-87df-60620c836925 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:33:34.720851 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0b6118f-f613-4b52-b3ea-1026858034d2 tempest-AttachVolumeShelveTestJSON-565426114 tempest-AttachVolumeShelveTestJSON-565426114-project] 10.222.0.52 "GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925" status: 404 len: 111 microversion: 2.20 time: 0.057181 May 14 21:33:34.725624 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2502/5404] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:33:34 2022] GET /compute/v2.1/servers/4097156a-300a-4d17-87df-60620c836925 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:33:34.854077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:34.865542 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5006ffee-b85f-4813-a293-aa58a67b5491 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1508 microversion: 2.1 time: 0.381377 May 14 21:33:34.866406 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2903/5405] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:34 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1508 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:35.887808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:35.889859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:35.909232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:35.909951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:35.910922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:35.911504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:36.331889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:36.345176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83e3d381-1c6f-4413-82ff-f2800bbcdf4b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1508 microversion: 2.1 time: 0.463060 May 14 21:33:36.346099 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2503/5406] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:35 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1508 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:37.363554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:37.364794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:37.372164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:37.372622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:37.373405 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:37.373847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:38.026110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:38.045205 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-281e48b3-9974-41e4-af3e-ccb330e49673 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1516 microversion: 2.1 time: 0.685790 May 14 21:33:38.047205 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2904/5407] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:37 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1516 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:41.623315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:33:41.624354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:41.641680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:41.643353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:41.654803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:41.656372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:41.727460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lazy-loading 'flavor' on Instance uuid d1f98eb2-6910-4d90-86c1-bc42958e30ca {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:33:42.184427 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e5578527-23b2-4f9a-ac81-337ad146c1d5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action" status: 200 len: 32 microversion: 2.1 time: 0.566856 May 14 21:33:42.189345 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2504/5408] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:33:41 2022] POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action => generated 32 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:33:42.195795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:42.197281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:42.225842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:42.226607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:42.227739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:42.240850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:42.727402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:42.746375 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-791afccc-972e-4c8e-9421-8a27f72479e7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.550350 May 14 21:33:42.746375 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2905/5409] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:42 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:43.764380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:43.765788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:43.784618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:43.786241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:43.787183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:43.789321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:44.203052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:44.225283 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6e42e547-c936-490f-8b70-239c331196fe tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.469131 May 14 21:33:44.236242 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2505/5410] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:43 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:45.244290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:45.245243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:45.255072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:45.255072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:45.255072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:45.259375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:45.611386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:45.619280 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cbffcf1-68ed-447c-9e15-ecb043b565d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.380668 May 14 21:33:45.634241 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2906/5411] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:45 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:46.651816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:46.651816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:46.658227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:46.658886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:46.660054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:46.660505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:47.003957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:47.018950 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-167d115e-7e9f-47b9-9b16-40817f60b32a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.373580 May 14 21:33:47.021328 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2506/5412] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:46 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:48.044337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:48.045018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:48.058751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:48.058751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:48.058751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:48.058751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:48.361464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:48.369465 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8fe17168-fd21-4d3c-961b-905d1f54923a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.336007 May 14 21:33:48.378924 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2907/5413] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:48 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:49.387829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:49.389208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:49.396181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:49.399155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:49.399155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:49.399155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:49.799031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:49.809061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7033eb5c-2e6b-4f04-9298-923ea00b9995 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.426613 May 14 21:33:49.810145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2507/5414] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:49 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:50.827762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:50.828574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:50.851286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:50.851286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:50.851286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:50.851286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:51.225209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:51.229088 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8191b625-609f-4967-9e81-4e38a01bc080 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.405251 May 14 21:33:51.229687 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2908/5415] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:50 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:52.246920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:52.247569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:52.254147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:52.254836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:52.255661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:52.256111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:52.405264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:52.417311 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cdbfd44f-21b4-43ca-925d-18b41f22dce5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.173676 May 14 21:33:52.417717 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2508/5416] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:52 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:53.435467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:53.436156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:53.450699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:53.451169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:53.457314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:53.457775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:53.619469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:53.627030 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8893b740-6b84-42b7-921e-278262cc2827 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.196056 May 14 21:33:53.627655 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2909/5417] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:53 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:54.650689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:54.651994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:54.668793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:54.668793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:54.668793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:54.668793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:54.824966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:54.833290 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb397931-e6df-4749-aecd-f0103ffede5e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.192286 May 14 21:33:54.833880 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2509/5418] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:54 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:55.850213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:55.850935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:55.859212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:55.863207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:55.863207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:55.863207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:56.057497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:56.067634 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6ba7f85d-edf1-4d88-95fc-f760dd568cfa tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.221069 May 14 21:33:56.068215 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2910/5419] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:55 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:57.085943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:57.086499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:57.093922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:57.098190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:57.098190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:57.098190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:57.261821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:57.270731 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-beb26c19-4f97-4b5e-bbce-ac1bb9e78923 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.188733 May 14 21:33:57.271397 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2510/5420] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:57 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:58.290058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:58.290693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:58.297668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:58.298130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:58.298912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:58.299359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:58.462794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:58.471996 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a4fcdfdb-b44d-4485-940a-7e5ccb67eb57 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.185577 May 14 21:33:58.472586 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2911/5421] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:58 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:33:59.490395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:33:59.491026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:33:59.498111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:59.498575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:59.499362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:33:59.499833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:33:59.646722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:33:59.655982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e10d033d-c03c-49d9-a5de-8cb8cccdc682 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.169633 May 14 21:33:59.657301 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2511/5422] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:33:59 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:00.673613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:00.674236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:00.681255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:00.681717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:00.682497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:00.682942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:00.844431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:00.854389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-13af1ded-3dc2-4491-9057-0a5fef651135 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 0.184508 May 14 21:34:00.855549 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2912/5423] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:00 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:01.871397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:01.872800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:01.880012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:01.880803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:01.881837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:01.882570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:02.039045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:02.047572 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a86ac674-5a7e-46de-ba9f-98683bac7484 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1502 microversion: 2.1 time: 0.180352 May 14 21:34:02.048175 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2512/5424] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:01 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:02.079513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba6689c8-5731-4271-ab38-0b3532441e18"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:02.080950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:02.087396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:02.087894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:02.088680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:02.089125 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:02.116210 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Cannot 'attach_volume' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state rescued May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/os-volume_attachments HTTP/1.1 May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 74 May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: {"volumeAttachment": {"volumeId": "ba6689c8-5731-4271-ab38-0b3532441e18"}} May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: exception: Cannot 'attach_volume' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state rescued May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': 'd1f98eb2-6910-4d90-86c1-bc42958e30ca', 'body': {'volumeAttachment': {'volumeId': 'ba6689c8-5731-4271-ab38-0b3532441e18'}}} May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca in vm_state rescued. Cannot attach_volume while the instance is in this state. May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 14 21:34:02.117984 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state rescued May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state rescued May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 409 to user: Cannot 'attach_volume' instance d1f98eb2-6910-4d90-86c1-bc42958e30ca while it is in vm_state rescued {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-062e4aad-da93-4e55-921a-a4fc1a98f3bf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044325 May 14 21:34:02.127600 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2913/5425] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:34:02 2022] POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:34:02.135550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f6e0aef-21df-4c65-a330-c7158110fb9a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:02.136104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f6e0aef-21df-4c65-a330-c7158110fb9a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:02.147970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f6e0aef-21df-4c65-a330-c7158110fb9a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:02.148543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f6e0aef-21df-4c65-a330-c7158110fb9a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:02.150041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f6e0aef-21df-4c65-a330-c7158110fb9a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:02.150699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f6e0aef-21df-4c65-a330-c7158110fb9a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:02.402255 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f6e0aef-21df-4c65-a330-c7158110fb9a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action" status: 202 len: 0 microversion: 2.1 time: 0.270863 May 14 21:34:02.403025 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2513/5426] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:34:02 2022] POST /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:34:02.411820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:02.414542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:02.427139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:02.428053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:02.429224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:02.430148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:02.848286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:02.858330 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-900eadee-aa10-48ec-ae49-3e6bb019cbcd tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1510 microversion: 2.1 time: 0.450772 May 14 21:34:02.859439 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2914/5427] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:02 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1510 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:03.890366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:03.891803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:03.911037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:03.915921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:03.915921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:03.915921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:04.639375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:04.648777 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-748ea9b4-fb43-4b42-b712-0b9bb8b7d1db tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1510 microversion: 2.1 time: 0.775760 May 14 21:34:04.649912 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2514/5428] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:03 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1510 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:05.667930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:05.668571 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:05.675140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:05.686454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:05.686454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:05.686909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:05.927658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:05.937981 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4d4520db-c403-4b03-916c-31f58a5607e0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1516 microversion: 2.1 time: 0.275500 May 14 21:34:05.951379 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2915/5429] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:05 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:08.765674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c996e23b-9059-4e6e-9976-e9ee780e2a3a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'create', calling method: .version_select at 0x7fb1a6bde280>, body: {"keypair": {"name": "tempest-keypair-1539251507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+t3btRN8lQJdsiafOr213OScEYQUPSrUe97ktYyxtG1g9yjw+YbJKdRRZuzuj8xvbEIipzGUHGPHGzUfMuunT5n9lZ7IxG7CuG1OrXkHPyGURTE6+bp18DD/2DZWfMPQ=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:08.781044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c996e23b-9059-4e6e-9976-e9ee780e2a3a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:34:08.786206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c996e23b-9059-4e6e-9976-e9ee780e2a3a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for user cbb8c5cf2d144e3791171eb3d6f83eca and project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:34:08.967570 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c996e23b-9059-4e6e-9976-e9ee780e2a3a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.205904 May 14 21:34:08.969408 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2515/5430] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:34:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:34:11.924134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-164392436", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80d87f84-7a26-47b5-8752-d965abc19974"}], "security_groups": [{"name": "tempest-securitygroup--430793766"}], "key_name": "tempest-keypair-1539251507", "user_data": "}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:12.057639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] validate_networks() for [('80d87f84-7a26-47b5-8752-d965abc19974', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:34:13.345320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:34:13.345967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:34:13.346470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:34:13.346991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:34:13.348852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:34:13.366466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:13.367234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:13.370757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:13.373020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:13.475275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:34:13.493001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Getting quotas for user cbb8c5cf2d144e3791171eb3d6f83eca and project 59c0f4df562340e5bb096ef2eed9239e. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:34:13.527964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:34:13.536437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:34:13.718955 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8722fd55-0ad7-4a20-9739-7398102db951 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.798992 May 14 21:34:13.722419 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2916/5431] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:34:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:34:13.731050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-795c077d-1ed0-469d-b1a6-f5bd374c78be tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:13.732680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-795c077d-1ed0-469d-b1a6-f5bd374c78be tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:13.827834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-795c077d-1ed0-469d-b1a6-f5bd374c78be tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:13.839191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-795c077d-1ed0-469d-b1a6-f5bd374c78be tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1245 microversion: 2.1 time: 0.113102 May 14 21:34:13.848558 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2516/5432] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:13 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:14.857345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d806d94c-132d-4525-b15b-1df9ad1db8a5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:14.858043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d806d94c-132d-4525-b15b-1df9ad1db8a5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:14.960363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d806d94c-132d-4525-b15b-1df9ad1db8a5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:15.010317 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d806d94c-132d-4525-b15b-1df9ad1db8a5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1245 microversion: 2.1 time: 0.156485 May 14 21:34:15.026661 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2917/5433] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:14 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1245 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:16.031944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:16.032591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:16.046408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:16.046861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:16.055709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:16.056182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:16.170240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:16.182290 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ce998db4-ecc1-466e-9689-e3da8050c717 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1297 microversion: 2.1 time: 0.153331 May 14 21:34:16.184717 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2517/5434] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:16 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1297 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:17.202402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:17.203872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:17.222290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:17.222755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:17.223775 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:17.224219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:17.346606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:17.358915 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d094624d-1a04-4eb2-a662-2df557c822de tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1303 microversion: 2.1 time: 0.160315 May 14 21:34:17.359910 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2918/5435] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:17 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1303 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:18.377359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:18.378073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:18.394080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:18.394732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:18.395757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:18.396538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:18.784772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:18.796981 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a634e3a6-059c-4084-864d-df4b64381cba tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1370 microversion: 2.1 time: 0.423580 May 14 21:34:18.797894 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2518/5436] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:18 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:19.815532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:19.817078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:19.829250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:19.836742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:19.836742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:19.836742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:20.109377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:20.120349 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6cc182e7-bcde-4891-aef7-079448e7c245 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1370 microversion: 2.1 time: 0.308743 May 14 21:34:20.121297 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2919/5437] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:19 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:20.633779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-13d5f783-1a81-49cd-93cd-065723ff3bcd req-19b033a5-fae3-4939-91c4-425e40072b7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9fd379-b825-4ca8-958b-48f636ce03ff", "tag": "f7f8effc-6019-4774-a90b-8629243b910b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:20.662873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-13d5f783-1a81-49cd-93cd-065723ff3bcd req-19b033a5-fae3-4939-91c4-425e40072b7a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:20.662873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-13d5f783-1a81-49cd-93cd-065723ff3bcd req-19b033a5-fae3-4939-91c4-425e40072b7a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:20.686179 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-13d5f783-1a81-49cd-93cd-065723ff3bcd req-19b033a5-fae3-4939-91c4-425e40072b7a service nova] Creating event network-changed:f7f8effc-6019-4774-a90b-8629243b910b for instance fd9fd379-b825-4ca8-958b-48f636ce03ff on nch2-master-1 May 14 21:34:20.697368 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-13d5f783-1a81-49cd-93cd-065723ff3bcd req-19b033a5-fae3-4939-91c4-425e40072b7a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067400 May 14 21:34:20.698843 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2519/5438] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:34:21.140672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:21.141977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:21.153007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:21.153825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:21.156402 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:21.157946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:21.550435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:21.565959 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e344cec4-6c81-49c8-8cea-8be3c687a95b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1370 microversion: 2.1 time: 0.432125 May 14 21:34:21.575658 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2920/5439] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:21 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1370 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:22.584590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:22.585312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:22.600727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:22.601703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:22.603058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:22.603764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:22.781913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:22.789803 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-df314173-29bb-446e-8f33-6d74696c7396 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1370 microversion: 2.1 time: 0.210397 May 14 21:34:22.790386 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2520/5440] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:22 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1370 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:23.807570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:23.817931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:23.817931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:23.818570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:23.819625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:23.820923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:23.998256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:24.008393 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-64c77597-c113-41be-91a1-445b14419906 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1370 microversion: 2.1 time: 0.204367 May 14 21:34:24.009574 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2921/5441] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:23 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:25.027275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:25.028579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:25.037336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:25.038131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:25.040208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:25.040663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:25.332925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:25.343611 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-564f9744-574f-43ac-9301-fab6bbf55d1d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1370 microversion: 2.1 time: 0.321311 May 14 21:34:25.346434 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2521/5442] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:25 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1370 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:26.036543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-81cda4d1-e8bd-4c88-8495-40b213a32b5d req-4d7b6f32-387b-4f35-b74d-360955341c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9fd379-b825-4ca8-958b-48f636ce03ff", "name": "network-vif-plugged", "status": "completed", "tag": "f7f8effc-6019-4774-a90b-8629243b910b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:26.042675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-81cda4d1-e8bd-4c88-8495-40b213a32b5d req-4d7b6f32-387b-4f35-b74d-360955341c0f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:26.043303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-81cda4d1-e8bd-4c88-8495-40b213a32b5d req-4d7b6f32-387b-4f35-b74d-360955341c0f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:26.061506 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-81cda4d1-e8bd-4c88-8495-40b213a32b5d req-4d7b6f32-387b-4f35-b74d-360955341c0f service nova] Creating event network-vif-plugged:f7f8effc-6019-4774-a90b-8629243b910b for instance fd9fd379-b825-4ca8-958b-48f636ce03ff on nch2-master-1 May 14 21:34:26.074721 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-81cda4d1-e8bd-4c88-8495-40b213a32b5d req-4d7b6f32-387b-4f35-b74d-360955341c0f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053038 May 14 21:34:26.075518 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2922/5443] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:34:26.363057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:26.363909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:26.371927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:26.375285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:26.375285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:26.375285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:26.928297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:26.941420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e6d392d-b8ff-4eb8-865b-8ade88c8484e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1370 microversion: 2.1 time: 0.582196 May 14 21:34:26.942029 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2522/5444] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:26 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1370 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:27.961222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:27.962041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:27.988851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:27.989431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:27.990462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:27.993429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:28.306845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:28.323730 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fa3cd911-7d15-4a93-b6e1-865fb9125049 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1563 microversion: 2.1 time: 0.369020 May 14 21:34:28.324976 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2923/5445] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:27 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1563 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:28.362785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be9228ef-f960-4b21-8111-1c19544898ae tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:28.362785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be9228ef-f960-4b21-8111-1c19544898ae tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:28.375223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9228ef-f960-4b21-8111-1c19544898ae tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:28.375909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9228ef-f960-4b21-8111-1c19544898ae tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:28.376817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9228ef-f960-4b21-8111-1c19544898ae tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:28.377506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9228ef-f960-4b21-8111-1c19544898ae tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:28.580136 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be9228ef-f960-4b21-8111-1c19544898ae tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.237411 May 14 21:34:28.588341 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2523/5446] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:34:28 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:34:30.997890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a06cf4cb-48e5-4436-a228-d6e344d2e050 req-51fe84ff-2c85-4977-b727-8757a2010489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9fd379-b825-4ca8-958b-48f636ce03ff", "tag": "f7f8effc-6019-4774-a90b-8629243b910b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:31.026454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a06cf4cb-48e5-4436-a228-d6e344d2e050 req-51fe84ff-2c85-4977-b727-8757a2010489 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:31.031799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a06cf4cb-48e5-4436-a228-d6e344d2e050 req-51fe84ff-2c85-4977-b727-8757a2010489 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:31.055429 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a06cf4cb-48e5-4436-a228-d6e344d2e050 req-51fe84ff-2c85-4977-b727-8757a2010489 service nova] Creating event network-changed:f7f8effc-6019-4774-a90b-8629243b910b for instance fd9fd379-b825-4ca8-958b-48f636ce03ff on nch2-master-1 May 14 21:34:31.064191 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a06cf4cb-48e5-4436-a228-d6e344d2e050 req-51fe84ff-2c85-4977-b727-8757a2010489 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.545880 May 14 21:34:31.065049 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2924/5447] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:34:40.102878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:40.104229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:40.133269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:40.133269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:40.133269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:40.133269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:40.305529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lazy-loading 'services' on Instance uuid 8b5aab0f-f971-443e-b949-5430a66f746e {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:34:40.615012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-acd86b49-07e4-4d57-908e-ffbda7bfb489 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e/os-volume_attachments/cd3708f6-e860-49e0-862f-98ce06d603c8" status: 202 len: 0 microversion: 2.1 time: 0.520833 May 14 21:34:40.616273 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2524/5448] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:34:40 2022] DELETE /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e/os-volume_attachments/cd3708f6-e860-49e0-862f-98ce06d603c8 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:34:41.795361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:41.796588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:41.803644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:41.804543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:41.805515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:41.806143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:41.833186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:34:42.328711 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-09580b9b-5e45-4f9c-b35b-61faaef6ffee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 204 len: 0 microversion: 2.1 time: 0.538215 May 14 21:34:42.334784 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2925/5449] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:34:41 2022] DELETE /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:34:42.341687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:42.343062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:42.350094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:42.351019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:42.352047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:42.352712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:42.653748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:42.669436 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1b119886-8781-49bf-8568-034745e3351d tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1513 microversion: 2.1 time: 0.332422 May 14 21:34:42.674404 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2525/5450] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:42 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1513 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:43.686707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:43.687421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:43.703516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:43.707538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:43.708364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:43.708814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:44.105750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:44.114352 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-af04386f-666b-4b87-9513-f35ccdb60579 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1513 microversion: 2.1 time: 0.431747 May 14 21:34:44.115451 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2926/5451] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:43 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1513 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:45.072244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f1774b7e-2c83-4cdc-95e7-1eded64ea85c req-f63a39fc-1fbd-49fd-8dbd-b9e97c655dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5aab0f-f971-443e-b949-5430a66f746e", "name": "network-vif-deleted", "tag": "8a97af7f-e8ff-41fa-b059-8c13a6ced336"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:34:45.094028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f1774b7e-2c83-4cdc-95e7-1eded64ea85c req-f63a39fc-1fbd-49fd-8dbd-b9e97c655dfb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:45.094629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f1774b7e-2c83-4cdc-95e7-1eded64ea85c req-f63a39fc-1fbd-49fd-8dbd-b9e97c655dfb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:45.124906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f1774b7e-2c83-4cdc-95e7-1eded64ea85c req-f63a39fc-1fbd-49fd-8dbd-b9e97c655dfb service nova] Creating event network-vif-deleted:8a97af7f-e8ff-41fa-b059-8c13a6ced336 for instance 8b5aab0f-f971-443e-b949-5430a66f746e on nch1-master-1 May 14 21:34:45.130681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f1774b7e-2c83-4cdc-95e7-1eded64ea85c req-f63a39fc-1fbd-49fd-8dbd-b9e97c655dfb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068731 May 14 21:34:45.131690 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2526/5452] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:34:45.133668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:45.134308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:45.142719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:45.143333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:45.144515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:45.145397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:45.226377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:45.238944 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8b1941d-a72f-4ed3-b85d-0a9ecf611380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1471 microversion: 2.1 time: 0.110488 May 14 21:34:45.246972 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2927/5453] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:45 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1471 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:46.791864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:46.793597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:46.801355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:46.810637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:46.810637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:46.810637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:46.849728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:46.850572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:46.851425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lazy-loading 'fault' on Instance uuid 8b5aab0f-f971-443e-b949-5430a66f746e {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:34:46.960983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:34:46.983906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f043e15-82da-4b68-b31f-f4e25ef54638 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 200 len: 1309 microversion: 2.1 time: 0.724868 May 14 21:34:46.989718 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2527/5454] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:46 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 1309 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:34:47.996151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:34:47.996978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 8b5aab0f-f971-443e-b949-5430a66f746e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:34:48.017025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:48.017025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:48.019142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:34:48.019942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:34:48.036322 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] HTTP exception thrown: Instance 8b5aab0f-f971-443e-b949-5430a66f746e could not be found. May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Request method failure captured: May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e HTTP/1.1 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB9Jgu-LL_92xfAXe3A_NLvoV1n7ll8yb3HSsiJPCm3o54MQCtPm_7B4yTQLy7P5FevkYkFYrGPg-xWmOMOnAeJVpjBTJS71gdLLhCKkx_a3sCzIEAmabH6PykoytgR71LI0Ye7G2aUzG4Gs_TRni9sE3Wu15a8x58-03p9xAb3PVys May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 162610ac2697486d8a05f41713cc5ba2 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1533504236 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/162610ac2697486d8a05f41713cc5ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/162610ac2697486d8a05f41713cc5ba2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/162610ac2697486d8a05f41713cc5ba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_162610ac2697486d8a05f41713cc5ba2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesSnapshotTestJSON-1533504236 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 162610ac2697486d8a05f41713cc5ba2 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1533504236 May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesSnapshotTestJSON-1533504236-project May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a8e967d05266477dbc5748ed77b8c69e May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesSnapshotTestJSON-1533504236-project May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 8b5aab0f-f971-443e-b949-5430a66f746e could not be found. May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '8b5aab0f-f971-443e-b949-5430a66f746e'} May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5aab0f-f971-443e-b949-5430a66f746e could not be found. May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5aab0f-f971-443e-b949-5430a66f746e could not be found. May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:34:48.051643 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5aab0f-f971-443e-b949-5430a66f746e could not be found. May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Returning 404 to user: Instance 8b5aab0f-f971-443e-b949-5430a66f746e could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5240d6b0-2e2e-416e-ac9b-3f21c7ac8abf tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e" status: 404 len: 111 microversion: 2.1 time: 0.062527 May 14 21:34:48.056902 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2928/5455] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:34:47 2022] GET /compute/v2.1/servers/8b5aab0f-f971-443e-b949-5430a66f746e => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:35:04.113781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-070ba21a-054f-4be0-9939-67819ebe595d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ee16695-14bc-482f-8ed9-e3a38eb3ecc6"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:04.114904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-070ba21a-054f-4be0-9939-67819ebe595d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:04.122127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-070ba21a-054f-4be0-9939-67819ebe595d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:04.122590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-070ba21a-054f-4be0-9939-67819ebe595d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:04.123377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-070ba21a-054f-4be0-9939-67819ebe595d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:04.123881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-070ba21a-054f-4be0-9939-67819ebe595d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:05.144391 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-070ba21a-054f-4be0-9939-67819ebe595d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.039103 May 14 21:35:05.145736 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2528/5456] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:35:04 2022] POST /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:05.633421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-129838944", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "f6b7d9d1-0c8a-4575-b44c-15c1cddb85d8"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:05.716693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] validate_networks() for [('f6b7d9d1-0c8a-4575-b44c-15c1cddb85d8', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:35:06.684450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:35:06.685573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:35:06.686268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:35:06.686848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:35:06.687818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:35:06.698745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:06.699728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:06.701554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:06.704168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:06.727982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Getting quotas for project 162610ac2697486d8a05f41713cc5ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:35:06.733701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Getting quotas for user a8e967d05266477dbc5748ed77b8c69e and project 162610ac2697486d8a05f41713cc5ba2. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:35:06.748541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:35:06.749617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:35:06.958870 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-36848381-23ff-42b7-8f6f-30edf456a52e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.329449 May 14 21:35:06.963283 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2929/5457] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:35:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:35:06.977804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8114dcaf-9ce4-4512-b425-8177d107b6b4 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:06.980532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8114dcaf-9ce4-4512-b425-8177d107b6b4 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:07.106663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8114dcaf-9ce4-4512-b425-8177d107b6b4 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:07.121197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8114dcaf-9ce4-4512-b425-8177d107b6b4 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1218 microversion: 2.1 time: 0.150988 May 14 21:35:07.121795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2529/5458] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:06 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:08.140313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7ac7f8a8-72d0-4400-b733-28a08c4b729b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:08.140945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7ac7f8a8-72d0-4400-b733-28a08c4b729b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:08.274085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7ac7f8a8-72d0-4400-b733-28a08c4b729b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:08.284295 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7ac7f8a8-72d0-4400-b733-28a08c4b729b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1218 microversion: 2.1 time: 0.149608 May 14 21:35:08.287663 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2930/5459] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:08 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:09.303747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:09.304383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:09.321070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:09.321529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:09.322337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:09.322777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:09.463906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:09.474076 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8af7b39a-8db3-4ddb-9404-91a063e6f26e tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1270 microversion: 2.1 time: 0.175185 May 14 21:35:09.475238 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2530/5460] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:09 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:09.846022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:09.847750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:09.869356 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:09.872252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:09.875096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:09.876657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:09.930176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lazy-loading 'flavor' on Instance uuid fd9fd379-b825-4ca8-958b-48f636ce03ff {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:35:10.443919 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-246d1c36-7881-4ff6-857e-57a46cf5ff06 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/action" status: 200 len: 32 microversion: 2.1 time: 0.604607 May 14 21:35:10.444886 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2931/5461] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:35:09 2022] POST /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/action => generated 32 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:35:10.455349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:10.456815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:10.470336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:10.476028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:10.481957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:10.482698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:10.495735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:10.496476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:10.512399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:10.512873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:10.513675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:10.520626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:10.651487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:10.659894 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-827721fe-0ed3-4ee5-8829-3c6676c462c8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1276 microversion: 2.1 time: 0.169532 May 14 21:35:10.661515 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2932/5462] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:10 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:10.992603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:11.006657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba23bfdb-ffd4-44b6-9423-826d95dcbf0b tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.552500 May 14 21:35:11.006657 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2531/5463] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:10 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:11.684398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:11.685261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:11.714448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:11.716202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:11.722359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:11.722359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:11.859838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:11.868434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aae8d145-4ce2-4659-8f12-f58d1883ad46 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1276 microversion: 2.1 time: 0.192847 May 14 21:35:11.873462 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2933/5464] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:11 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:12.024416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:12.025655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:12.034989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:12.035460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:12.036277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:12.037055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:12.886003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:12.887057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:12.897655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:12.898177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:12.899343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:12.899938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:12.910122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:12.932056 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-384823a2-0b56-4021-a9fd-8620fa14c977 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.914726 May 14 21:35:12.934083 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2532/5465] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:12 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:35:13.175837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:13.185441 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71e6458e-6618-4657-9e1d-082e81673ae8 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.303959 May 14 21:35:13.185984 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2934/5466] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:12 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:35:13.963210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:13.964535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:14.006309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:14.006806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:14.008084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:14.008691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:14.202474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:14.203746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:14.216882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:14.217778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:14.220677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:14.221147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:14.281080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:14.296099 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7d3a112-d5ca-42dc-98c8-62844bf6e9ee tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.341722 May 14 21:35:14.298114 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2533/5467] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:13 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:14.888583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-01c44631-e25b-4dc2-829e-d0cb0b1e89ac req-60c173a7-6231-48b3-8fd4-7a7e6f9c05ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "294b2ea9-8fff-4f45-89fd-dba8b7ed5dba", "tag": "915f0324-ec51-454d-8c23-f1ecbc0d832a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:14.897964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-01c44631-e25b-4dc2-829e-d0cb0b1e89ac req-60c173a7-6231-48b3-8fd4-7a7e6f9c05ae service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:14.898712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-01c44631-e25b-4dc2-829e-d0cb0b1e89ac req-60c173a7-6231-48b3-8fd4-7a7e6f9c05ae service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:14.911111 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-01c44631-e25b-4dc2-829e-d0cb0b1e89ac req-60c173a7-6231-48b3-8fd4-7a7e6f9c05ae service nova] Creating event network-changed:915f0324-ec51-454d-8c23-f1ecbc0d832a for instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba on nch1-master-1 May 14 21:35:14.919526 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-01c44631-e25b-4dc2-829e-d0cb0b1e89ac req-60c173a7-6231-48b3-8fd4-7a7e6f9c05ae service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034621 May 14 21:35:14.920418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2534/5468] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:35:15.031175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:15.046257 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-df9330d4-bd7c-4777-804a-902848d644ee tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.847712 May 14 21:35:15.047027 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2935/5469] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:14 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:35:15.316995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:15.317788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:15.331119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:15.331752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:15.336118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:15.336604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:15.692148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:15.709567 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ecc19707-02d8-4340-b720-7c9fa4b6824d tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.397339 May 14 21:35:15.710755 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2535/5470] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:15 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:16.063897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:16.064654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:16.082663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:16.083467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:16.084496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:16.085344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:16.419300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:16.429171 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b365241f-8271-490e-bbbb-a3b9ab6135dd tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.369121 May 14 21:35:16.433000 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2936/5471] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:16 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:16.728491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:16.729207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:16.743077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:16.743927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:16.746248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:16.752590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:17.189240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:17.206206 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-650661b9-80fe-44ec-8452-cfc7b2742654 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.476263 May 14 21:35:17.216552 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2536/5472] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:16 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:17.455951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:17.456519 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:17.471575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:17.484879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:17.487527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:17.491518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:18.020891 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:18.053973 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2395bf9a-31d5-4e75-8fa4-7ddf5dae1073 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.604800 May 14 21:35:18.060699 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2937/5473] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:17 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:18.227402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:18.228400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:18.240871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:18.241608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:18.242630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:18.243603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:18.710902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:18.732557 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86ebac17-4bfe-414f-8d6c-a1fadcbe1805 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.511428 May 14 21:35:18.733714 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2537/5474] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:18 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:19.078472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:19.079287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:19.089903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:19.094040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:19.095782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:19.108327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:19.627252 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:19.655030 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ceaaa6b-94c0-4f22-bba1-03c18bd24eb1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.580474 May 14 21:35:19.661769 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2938/5475] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:19 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:19.751768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:19.753677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:19.794829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:19.800919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:19.802207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:19.803978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:20.520123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:20.534915 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-776f46d1-eeae-4f7f-b1a8-2e1d73a75d89 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.788390 May 14 21:35:20.536149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2538/5476] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:19 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:20.680645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:20.680645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:20.694545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:20.695002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:20.700799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:20.701277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:21.101165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:21.110633 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d31cf46-a670-40a3-a808-c245ee95a155 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.436576 May 14 21:35:21.116130 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2939/5477] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:20 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:21.555142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:21.555822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:21.564582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:21.565896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:21.566907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:21.567567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:21.853705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:21.863440 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-454646f2-2f59-40a4-bae1-70b5b1dff608 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.313784 May 14 21:35:21.881929 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2539/5478] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:21 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:22.133827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:22.134476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:22.147072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:22.148752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:22.151155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:22.151963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:22.575726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:22.584130 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a1fe0812-ac56-4d37-b64c-e0af74882380 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.456103 May 14 21:35:22.588629 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2940/5479] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:22 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:22.882642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:22.883375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:22.896308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:22.902169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:22.902169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:22.902169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:23.331158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:23.344015 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-298facb1-72dd-4539-8438-60f7bb98dca5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1734 microversion: 2.1 time: 0.466007 May 14 21:35:23.353903 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2540/5480] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:22 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1734 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:23.610235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:23.612421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:23.626912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:23.628123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:23.628971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:23.632902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:24.021726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ffab1b6b-5a0e-4065-8cb8-4d9d1a53b213 req-af7e826c-fa2f-439a-8cf7-589e5f59157f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294b2ea9-8fff-4f45-89fd-dba8b7ed5dba", "name": "network-vif-plugged", "status": "completed", "tag": "915f0324-ec51-454d-8c23-f1ecbc0d832a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:24.041514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ffab1b6b-5a0e-4065-8cb8-4d9d1a53b213 req-af7e826c-fa2f-439a-8cf7-589e5f59157f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:24.042244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ffab1b6b-5a0e-4065-8cb8-4d9d1a53b213 req-af7e826c-fa2f-439a-8cf7-589e5f59157f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:24.079418 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ffab1b6b-5a0e-4065-8cb8-4d9d1a53b213 req-af7e826c-fa2f-439a-8cf7-589e5f59157f service nova] Creating event network-vif-plugged:915f0324-ec51-454d-8c23-f1ecbc0d832a for instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba on nch1-master-1 May 14 21:35:24.105064 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ffab1b6b-5a0e-4065-8cb8-4d9d1a53b213 req-af7e826c-fa2f-439a-8cf7-589e5f59157f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087871 May 14 21:35:24.108875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2541/5481] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:35:24.373162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:24.374025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:24.401226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:24.401914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:24.403061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:24.403757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:24.566665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:24.584517 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e148b7f4-3be3-416d-8d11-5485acc71891 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1318 microversion: 2.1 time: 0.982363 May 14 21:35:24.613530 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2941/5482] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:23 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1318 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:25.026158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:25.040898 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ebfdacca-30d3-483b-978f-07a71a1e9a74 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1714 microversion: 2.1 time: 0.672241 May 14 21:35:25.057641 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2542/5483] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:24 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1714 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:35:25.227740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:25.228367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:25.235568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.236370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:25.237581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.238318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:25.402255 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Cannot 'detach_volume' instance fd9fd379-b825-4ca8-958b-48f636ce03ff while it is in vm_state rescued May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments/9ee16695-14bc-482f-8ed9-e3a38eb3ecc6 HTTP/1.1 May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: exception: Cannot 'detach_volume' instance fd9fd379-b825-4ca8-958b-48f636ce03ff while it is in vm_state rescued May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'server_id': 'fd9fd379-b825-4ca8-958b-48f636ce03ff', 'id': '9ee16695-14bc-482f-8ed9-e3a38eb3ecc6'} May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd9fd379-b825-4ca8-958b-48f636ce03ff in vm_state rescued. Cannot detach_volume while the instance is in this state. May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fd9fd379-b825-4ca8-958b-48f636ce03ff while it is in vm_state rescued May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:35:25.405292 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:35:25.409353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:35:25.409353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:35:25.409353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:35:25.409353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:35:25.409353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fd9fd379-b825-4ca8-958b-48f636ce03ff while it is in vm_state rescued May 14 21:35:25.409353 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:35:25.409353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 409 to user: Cannot 'detach_volume' instance fd9fd379-b825-4ca8-958b-48f636ce03ff while it is in vm_state rescued {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:35:25.409927 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1fbcd19b-7dc2-4a32-a11c-7326bf4b5a71 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments/9ee16695-14bc-482f-8ed9-e3a38eb3ecc6" status: 409 len: 152 microversion: 2.1 time: 0.185049 May 14 21:35:25.412193 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2942/5484] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:35:25 2022] DELETE /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments/9ee16695-14bc-482f-8ed9-e3a38eb3ecc6 => generated 152 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:35:25.421411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d4d7fbef-bc9b-415b-92cc-ca27a155724e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:25.421970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4d7fbef-bc9b-415b-92cc-ca27a155724e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:25.429567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbef-bc9b-415b-92cc-ca27a155724e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.430038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbef-bc9b-415b-92cc-ca27a155724e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:25.431424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbef-bc9b-415b-92cc-ca27a155724e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.432289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4d7fbef-bc9b-415b-92cc-ca27a155724e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:25.617980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:25.618598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:25.629611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.630083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:25.631213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.637555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:25.708030 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d4d7fbef-bc9b-415b-92cc-ca27a155724e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/action" status: 202 len: 0 microversion: 2.1 time: 0.291019 May 14 21:35:25.712129 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2543/5485] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:35:25 2022] POST /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:35:25.732361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:25.733653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:25.741477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.742486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:25.743699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:25.744377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:26.303701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:26.311902 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d4d5b23-f4d4-4677-892c-305c82dd99a7 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1506 microversion: 2.1 time: 0.698596 May 14 21:35:26.312491 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2943/5486] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:25 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:35:26.330649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ff59fc35-332c-4664-b233-f36c9401a4a1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c221be08-99e4-4f09-a858-6fffe81fd931", "device": "/dev/sdb"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:26.332680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ff59fc35-332c-4664-b233-f36c9401a4a1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:26.340257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff59fc35-332c-4664-b233-f36c9401a4a1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:26.341028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff59fc35-332c-4664-b233-f36c9401a4a1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:26.342064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff59fc35-332c-4664-b233-f36c9401a4a1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:26.342671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ff59fc35-332c-4664-b233-f36c9401a4a1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:26.627949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:26.645124 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8aba6f7c-ac43-4086-9feb-fe73fe2b300c tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1722 microversion: 2.1 time: 0.927699 May 14 21:35:26.649209 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2544/5487] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:25 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1722 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:27.404804 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ff59fc35-332c-4664-b233-f36c9401a4a1 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "POST /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077733 May 14 21:35:27.412934 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2944/5488] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:35:26 2022] POST /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba/os-volume_attachments => generated 194 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:35:27.690585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:27.701558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:27.717215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:27.717919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:27.719166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:27.721771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:28.092276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:28.104811 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cf84415-a872-420f-9d36-dc5a710716d9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1722 microversion: 2.1 time: 0.433890 May 14 21:35:28.115823 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2545/5489] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:27 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:29.127903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:29.129304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:29.159637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:29.160434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:29.162037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:29.178471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:29.630711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:29.645249 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-50e77da0-ad65-4c6d-bbf9-2ad8a186f248 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1722 microversion: 2.1 time: 0.523149 May 14 21:35:29.649626 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2945/5490] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:29 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:30.668420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:30.669232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:30.681678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:30.682154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:30.682992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:30.684118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:31.261399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:31.273033 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-877fc02f-31ba-4c59-b205-a67755b2ec41 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1728 microversion: 2.1 time: 0.608683 May 14 21:35:31.273636 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2546/5491] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:35:30 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1728 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:35:31.290511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c280d40-e220-447b-b681-3972777dfb8e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:31.291051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c280d40-e220-447b-b681-3972777dfb8e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:31.298302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c280d40-e220-447b-b681-3972777dfb8e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:31.299052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c280d40-e220-447b-b681-3972777dfb8e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:31.300180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c280d40-e220-447b-b681-3972777dfb8e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:31.300802 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c280d40-e220-447b-b681-3972777dfb8e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:31.474926 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c280d40-e220-447b-b681-3972777dfb8e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.187935 May 14 21:35:31.475562 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2946/5492] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 21:35:31 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:33.838731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1166ba14-2144-45ec-8dd6-a438776a9149 req-f7e3eceb-58e9-4105-9357-ba6a8eef398d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9fd379-b825-4ca8-958b-48f636ce03ff", "tag": "f7f8effc-6019-4774-a90b-8629243b910b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:33.854493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1166ba14-2144-45ec-8dd6-a438776a9149 req-f7e3eceb-58e9-4105-9357-ba6a8eef398d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:33.868388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1166ba14-2144-45ec-8dd6-a438776a9149 req-f7e3eceb-58e9-4105-9357-ba6a8eef398d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:33.881320 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1166ba14-2144-45ec-8dd6-a438776a9149 req-f7e3eceb-58e9-4105-9357-ba6a8eef398d service nova] Creating event network-changed:f7f8effc-6019-4774-a90b-8629243b910b for instance fd9fd379-b825-4ca8-958b-48f636ce03ff on nch2-master-1 May 14 21:35:33.888217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1166ba14-2144-45ec-8dd6-a438776a9149 req-f7e3eceb-58e9-4105-9357-ba6a8eef398d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053705 May 14 21:35:33.889462 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2547/5493] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:35.944103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-06e37868-d851-4a7d-a140-1bcb1f038761 req-8548ecb9-1404-4d8b-8038-81125beaf277 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd9fd379-b825-4ca8-958b-48f636ce03ff", "tag": "f7f8effc-6019-4774-a90b-8629243b910b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:35.953643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-06e37868-d851-4a7d-a140-1bcb1f038761 req-8548ecb9-1404-4d8b-8038-81125beaf277 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:35.954419 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-06e37868-d851-4a7d-a140-1bcb1f038761 req-8548ecb9-1404-4d8b-8038-81125beaf277 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:35.987143 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-06e37868-d851-4a7d-a140-1bcb1f038761 req-8548ecb9-1404-4d8b-8038-81125beaf277 service nova] Creating event network-changed:f7f8effc-6019-4774-a90b-8629243b910b for instance fd9fd379-b825-4ca8-958b-48f636ce03ff on nch2-master-1 May 14 21:35:36.000130 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-06e37868-d851-4a7d-a140-1bcb1f038761 req-8548ecb9-1404-4d8b-8038-81125beaf277 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063585 May 14 21:35:36.001779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2947/5494] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:35:47.809193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1c90c59-d8b8-488c-98a7-7fd4e8bc269a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:47.810314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c1c90c59-d8b8-488c-98a7-7fd4e8bc269a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:47.823315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1c90c59-d8b8-488c-98a7-7fd4e8bc269a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:47.823958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1c90c59-d8b8-488c-98a7-7fd4e8bc269a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:47.825032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1c90c59-d8b8-488c-98a7-7fd4e8bc269a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:47.825625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1c90c59-d8b8-488c-98a7-7fd4e8bc269a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:47.892796 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c1c90c59-d8b8-488c-98a7-7fd4e8bc269a tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "POST /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e/action" status: 200 len: 32492 microversion: 2.32 time: 0.089105 May 14 21:35:47.894043 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2548/5495] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:35:47 2022] POST /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e/action => generated 32492 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 14 21:35:47.913212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:47.913729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:47.959637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:47.964161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:47.965000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:47.967246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:48.019772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:35:48.434712 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d17b1d83-8a83-4a94-87b9-7688426f40d9 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "DELETE /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 204 len: 0 microversion: 2.32 time: 0.527800 May 14 21:35:48.436610 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2948/5496] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:35:47 2022] DELETE /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 21:35:48.447147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:48.448273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:48.456631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:48.456631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:48.456910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:48.457399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:48.842309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:48.857571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:48.861423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:48.863197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22b8366b-8e96-4ee1-9f7d-5a5d270115ff tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2957 microversion: 2.32 time: 0.422026 May 14 21:35:48.865111 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2549/5497] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:48 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2957 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:35:49.900379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:49.901709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:49.911270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:49.916499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:49.933398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:49.934593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:50.448186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:50.459933 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:50.466096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:50.467525 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-773c1235-3cc2-4d43-91b9-06a41abf8a7d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2957 microversion: 2.32 time: 0.576001 May 14 21:35:50.468104 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2949/5498] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:49 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2957 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:35:51.490264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:51.491033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:51.503143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:51.503643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:51.504476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:51.504931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:51.904201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:51.919524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:51.930025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:51.934969 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ea358f29-8f20-4f1c-bcfc-0498160532c0 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2936 microversion: 2.32 time: 0.449287 May 14 21:35:51.938942 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2550/5499] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:51 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2936 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:35:52.899793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2f761ac4-9da2-46ec-bd74-5e0caf15d7ac req-82ace421-8136-48bb-aa51-2057f79e6b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-unplugged", "status": "completed", "tag": "a3973166-07b4-4aaf-95b2-bd95a9578877"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:52.925486 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2f761ac4-9da2-46ec-bd74-5e0caf15d7ac req-82ace421-8136-48bb-aa51-2057f79e6b6a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:52.926445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2f761ac4-9da2-46ec-bd74-5e0caf15d7ac req-82ace421-8136-48bb-aa51-2057f79e6b6a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:52.945404 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2f761ac4-9da2-46ec-bd74-5e0caf15d7ac req-82ace421-8136-48bb-aa51-2057f79e6b6a service nova] Creating event network-vif-unplugged:a3973166-07b4-4aaf-95b2-bd95a9578877 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:52.953295 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2f761ac4-9da2-46ec-bd74-5e0caf15d7ac req-82ace421-8136-48bb-aa51-2057f79e6b6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064952 May 14 21:35:52.954950 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2950/5500] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:52.962598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:52.964262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:52.973848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:52.974978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:52.976147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:52.976823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:53.686609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:53.698118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:53.705778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:53.709061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45164a57-d5c2-4edd-9109-9d4c9a4b9085 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2915 microversion: 2.32 time: 0.750867 May 14 21:35:53.711613 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2551/5501] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:52 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2915 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:35:53.728344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a61de28f-213d-4768-b3ec-cae686d708ff req-5ddc2d30-cf62-41ce-8866-0d0937e7de52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-deleted", "tag": "fa577191-77f9-4d03-a86c-1dae3aad889a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:53.741969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a61de28f-213d-4768-b3ec-cae686d708ff req-5ddc2d30-cf62-41ce-8866-0d0937e7de52 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:53.742469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a61de28f-213d-4768-b3ec-cae686d708ff req-5ddc2d30-cf62-41ce-8866-0d0937e7de52 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:53.776840 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a61de28f-213d-4768-b3ec-cae686d708ff req-5ddc2d30-cf62-41ce-8866-0d0937e7de52 service nova] Creating event network-vif-deleted:fa577191-77f9-4d03-a86c-1dae3aad889a for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:53.783126 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a61de28f-213d-4768-b3ec-cae686d708ff req-5ddc2d30-cf62-41ce-8866-0d0937e7de52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063434 May 14 21:35:53.783839 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2951/5502] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:54.732837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:54.734143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:54.747261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:54.747934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:54.748894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:54.750566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:54.974426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8458f8a9-0ae9-45ec-a753-d2b669b42460 req-49f1e7f9-fad0-4a8b-9b61-2fcb3e9ade20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-unplugged", "status": "completed", "tag": "4663d148-3f78-4667-9e22-e6be0e34d3da"}, {"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-unplugged", "status": "completed", "tag": "39024741-3b76-4bb3-aecf-4392e5246961"}, {"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-unplugged", "status": "completed", "tag": "edfac6c5-c706-4629-944c-81d0943a6af1"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:54.992972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8458f8a9-0ae9-45ec-a753-d2b669b42460 req-49f1e7f9-fad0-4a8b-9b61-2fcb3e9ade20 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:54.993797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8458f8a9-0ae9-45ec-a753-d2b669b42460 req-49f1e7f9-fad0-4a8b-9b61-2fcb3e9ade20 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:55.057867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8458f8a9-0ae9-45ec-a753-d2b669b42460 req-49f1e7f9-fad0-4a8b-9b61-2fcb3e9ade20 service nova] Creating event network-vif-unplugged:4663d148-3f78-4667-9e22-e6be0e34d3da for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:55.058425 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8458f8a9-0ae9-45ec-a753-d2b669b42460 req-49f1e7f9-fad0-4a8b-9b61-2fcb3e9ade20 service nova] Creating event network-vif-unplugged:39024741-3b76-4bb3-aecf-4392e5246961 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:55.058953 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8458f8a9-0ae9-45ec-a753-d2b669b42460 req-49f1e7f9-fad0-4a8b-9b61-2fcb3e9ade20 service nova] Creating event network-vif-unplugged:edfac6c5-c706-4629-944c-81d0943a6af1 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:55.079728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:55.086067 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8458f8a9-0ae9-45ec-a753-d2b669b42460 req-49f1e7f9-fad0-4a8b-9b61-2fcb3e9ade20 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.113809 May 14 21:35:55.087117 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2952/5503] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:55.090753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:55.092490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:55.093979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d7c6b570-6a77-413c-8474-0d46b351d45b tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2754 microversion: 2.32 time: 0.365533 May 14 21:35:55.094772 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2552/5504] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:54 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2754 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:35:55.868061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-414e1425-6884-4095-9fb3-05e58a438e97 req-64f020c9-12ae-4e48-9cb1-688f49eae149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-deleted", "tag": "4663d148-3f78-4667-9e22-e6be0e34d3da"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:55.900885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-414e1425-6884-4095-9fb3-05e58a438e97 req-64f020c9-12ae-4e48-9cb1-688f49eae149 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:55.901729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-414e1425-6884-4095-9fb3-05e58a438e97 req-64f020c9-12ae-4e48-9cb1-688f49eae149 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:55.939458 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-414e1425-6884-4095-9fb3-05e58a438e97 req-64f020c9-12ae-4e48-9cb1-688f49eae149 service nova] Creating event network-vif-deleted:4663d148-3f78-4667-9e22-e6be0e34d3da for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:55.947022 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-414e1425-6884-4095-9fb3-05e58a438e97 req-64f020c9-12ae-4e48-9cb1-688f49eae149 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087184 May 14 21:35:55.948755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2953/5505] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:56.123145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:56.124653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:56.143521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:56.144048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:56.146185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:56.146931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:56.499542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:56.510339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:56.512610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:56.514072 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18d78136-e236-4880-8ac6-d5d0a1c95deb tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2546 microversion: 2.32 time: 0.398180 May 14 21:35:56.532502 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2553/5506] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:56 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2546 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:35:57.541808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:57.542636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:57.554500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:57.556511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:57.557339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:57.557788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:57.791682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:57.809978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:57.813197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:57.817253 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-863193ca-17ae-4c41-8519-70b47dae14d6 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2499 microversion: 2.32 time: 0.281544 May 14 21:35:57.837229 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2954/5507] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:57 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2499 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:35:58.010606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-465f5926-6f04-4b1c-8ae9-555d1a1888b5 req-4f24c7f9-0f8f-42a5-bea7-143c75d1938e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-deleted", "tag": "edfac6c5-c706-4629-944c-81d0943a6af1"}, {"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-deleted", "tag": "39024741-3b76-4bb3-aecf-4392e5246961"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:35:58.029189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-465f5926-6f04-4b1c-8ae9-555d1a1888b5 req-4f24c7f9-0f8f-42a5-bea7-143c75d1938e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:58.029654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-465f5926-6f04-4b1c-8ae9-555d1a1888b5 req-4f24c7f9-0f8f-42a5-bea7-143c75d1938e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:58.063099 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-465f5926-6f04-4b1c-8ae9-555d1a1888b5 req-4f24c7f9-0f8f-42a5-bea7-143c75d1938e service nova] Creating event network-vif-deleted:edfac6c5-c706-4629-944c-81d0943a6af1 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:58.063591 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-465f5926-6f04-4b1c-8ae9-555d1a1888b5 req-4f24c7f9-0f8f-42a5-bea7-143c75d1938e service nova] Creating event network-vif-deleted:39024741-3b76-4bb3-aecf-4392e5246961 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:35:58.079376 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-465f5926-6f04-4b1c-8ae9-555d1a1888b5 req-4f24c7f9-0f8f-42a5-bea7-143c75d1938e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075615 May 14 21:35:58.080044 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2554/5508] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:35:58.844768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:35:58.846053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:35:58.853920 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:58.854712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:58.855711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:35:58.856317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:35:59.048804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:59.061184 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:59.063069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:35:59.064434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c4391cc0-de42-4c98-af0d-1026e565a89d tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2227 microversion: 2.32 time: 0.223610 May 14 21:35:59.065365 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2955/5509] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:35:58 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2227 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:36:00.091289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:00.095388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:00.105059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:00.105928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:00.108085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:00.109620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:00.541870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:00.555032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:00.557533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:00.559230 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c01a6029-40fd-4025-b076-99b0e5e00568 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2227 microversion: 2.32 time: 0.474768 May 14 21:36:00.560013 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2555/5510] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:36:00 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2227 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 14 21:36:01.582538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:01.583931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:01.613006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:01.613509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:01.620963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:01.621122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:01.835971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:01.864392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:01.868632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:01.877821 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6ce7f3c0-4697-4944-a222-d7249c90cca1 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 2159 microversion: 2.32 time: 0.299928 May 14 21:36:01.884068 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2956/5511] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:36:01 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 2159 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:36:02.017581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-228da8e5-874e-4f85-aec4-3cc94db8b293 req-4a57122d-2fc7-42b8-a3eb-b6dedca4085b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28a0c595-7a68-4d4e-80c6-d5f1970ca64e", "name": "network-vif-deleted", "tag": "a3973166-07b4-4aaf-95b2-bd95a9578877"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:36:02.034907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-228da8e5-874e-4f85-aec4-3cc94db8b293 req-4a57122d-2fc7-42b8-a3eb-b6dedca4085b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:02.041662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-228da8e5-874e-4f85-aec4-3cc94db8b293 req-4a57122d-2fc7-42b8-a3eb-b6dedca4085b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:02.088164 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-228da8e5-874e-4f85-aec4-3cc94db8b293 req-4a57122d-2fc7-42b8-a3eb-b6dedca4085b service nova] Creating event network-vif-deleted:a3973166-07b4-4aaf-95b2-bd95a9578877 for instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e on nch1-master-1 May 14 21:36:02.105306 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-228da8e5-874e-4f85-aec4-3cc94db8b293 req-4a57122d-2fc7-42b8-a3eb-b6dedca4085b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089058 May 14 21:36:02.106293 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2556/5512] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:36:02.908428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:02.909635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:02.927619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:02.931915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:02.934481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:02.937101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:03.354408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:03.377599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:03.397599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '22a06bece449427d91289ade79c94822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1df1ae61bf82472dadc4830840421a63', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:03.400591 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84379e11-f892-4580-ba82-5a927843c803 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 200 len: 1604 microversion: 2.32 time: 0.502553 May 14 21:36:03.405793 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2957/5513] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:36:02 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 1604 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:36:04.433278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:04.444235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] [instance: 28a0c595-7a68-4d4e-80c6-d5f1970ca64e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:04.471716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:04.473806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:04.475036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:04.475774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:04.496602 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] HTTP exception thrown: Instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e could not be found. May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Request method failure captured: May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e HTTP/1.1 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB6XkW48LwKkbUdXJlMIQIjfkO7yg7ruQuq69A5SW0c4mcehba-zFpLyPLkiYjAxIs-jneNhYpLOQGFxu2GSyRU4fe3naMxHZuinCJLJZXjhYUjMD0Y3FKKz4hpgchUDVKdujCU6zihF7n5dxZKDqPOxHR7Sa6kzvXH8vf8tEIozmuQ May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Openstack-Nova-Api-Version: 2.32 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 1df1ae61bf82472dadc4830840421a63 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TaggedBootDevicesTest-1853898337 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1df1ae61bf82472dadc4830840421a63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/1df1ae61bf82472dadc4830840421a63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/1df1ae61bf82472dadc4830840421a63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_1df1ae61bf82472dadc4830840421a63", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TaggedBootDevicesTest-1853898337 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 1df1ae61bf82472dadc4830840421a63 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1853898337 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TaggedBootDevicesTest-1853898337-project May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 22a06bece449427d91289ade79c94822 May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TaggedBootDevicesTest-1853898337-project May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e could not be found. May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '28a0c595-7a68-4d4e-80c6-d5f1970ca64e'} May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e could not be found. May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e could not be found. May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:04.498776 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:04.507389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:04.507389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:04.507389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:04.507389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:36:04.507389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:36:04.507389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e could not be found. May 14 21:36:04.507389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:04.512215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Returning 404 to user: Instance 28a0c595-7a68-4d4e-80c6-d5f1970ca64e could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:36:04.513388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-134659b8-0fff-4106-93f5-fa76b394e650 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e" status: 404 len: 111 microversion: 2.32 time: 0.091716 May 14 21:36:04.514679 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2557/5514] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:36:04 2022] GET /compute/v2.1/servers/28a0c595-7a68-4d4e-80c6-d5f1970ca64e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:36:04.528660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-de4299ca-a3f6-4425-a000-323d1f0a3600 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] Calling method '.version_select at 0x7fb1b96c6ca0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:04.654947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-de4299ca-a3f6-4425-a000-323d1f0a3600 tempest-TaggedBootDevicesTest-1853898337 tempest-TaggedBootDevicesTest-1853898337-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027249644" status: 204 len: 0 microversion: 2.32 time: 0.131508 May 14 21:36:04.655749 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2958/5515] 10.222.0.52 () {60 vars in 1261 bytes} [Sat May 14 21:36:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027249644 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 14 21:36:05.860533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:05.866408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:05.873665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:05.874430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:05.875403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:05.876033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:06.080698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lazy-loading 'services' on Instance uuid fd9fd379-b825-4ca8-958b-48f636ce03ff {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:36:06.431812 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efc37362-30e7-4d87-a04f-2021396c7fd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments/9ee16695-14bc-482f-8ed9-e3a38eb3ecc6" status: 202 len: 0 microversion: 2.1 time: 0.575294 May 14 21:36:06.436199 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2558/5516] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:36:05 2022] DELETE /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments/9ee16695-14bc-482f-8ed9-e3a38eb3ecc6 => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:36:06.443533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6de90725-6cf1-4299-ae9e-9bf1241d5dd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:06.444492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6de90725-6cf1-4299-ae9e-9bf1241d5dd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:06.458211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6de90725-6cf1-4299-ae9e-9bf1241d5dd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:06.461201 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6de90725-6cf1-4299-ae9e-9bf1241d5dd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:06.464912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6de90725-6cf1-4299-ae9e-9bf1241d5dd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:06.464912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6de90725-6cf1-4299-ae9e-9bf1241d5dd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:06.515276 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6de90725-6cf1-4299-ae9e-9bf1241d5dd4 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073988 May 14 21:36:06.522166 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2959/5517] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:36:06 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:36:07.531586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22c1d494-7804-4728-a518-d19aae67bccb tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:07.532748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22c1d494-7804-4728-a518-d19aae67bccb tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:07.553650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c1d494-7804-4728-a518-d19aae67bccb tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.557335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c1d494-7804-4728-a518-d19aae67bccb tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.558234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c1d494-7804-4728-a518-d19aae67bccb tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.558695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22c1d494-7804-4728-a518-d19aae67bccb tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.596551 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22c1d494-7804-4728-a518-d19aae67bccb tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071404 May 14 21:36:07.602184 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2559/5518] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 21:36:07 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:36:07.700235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:36:07.701640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:07.728874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.728874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.728874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.738594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.788667 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Cannot 'reboot' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action HTTP/1.1 May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 28 May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: {"reboot": {"type": "HARD"}} May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: exception: Cannot 'reboot' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '0c8a0510-504e-4380-b02e-0e0f3c522ba9', 'body': {'reboot': {'type': 'HARD'}}} May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:36:07.790618 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 409 to user: Cannot 'reboot' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:36:07.795449 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-edec008a-90b3-46a5-9ded-cbfd0de1e3cf tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action" status: 409 len: 145 microversion: 2.1 time: 0.098115 May 14 21:36:07.799126 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2960/5519] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:36:07 2022] POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action => generated 145 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:36:07.809275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:36:07.810731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:07.825670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.828716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.837061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.837061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.876045 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Cannot 'rebuild' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action HTTP/1.1 May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 65 May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: exception: Cannot 'rebuild' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0c8a0510-504e-4380-b02e-0e0f3c522ba9', 'body': {'rebuild': {'imageRef': 'b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e'}}} May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 in vm_state rescued. Cannot rebuild while the instance is in this state. May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:36:07.880424 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued May 14 21:36:07.885304 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:07.887804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 409 to user: Cannot 'rebuild' instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 while it is in vm_state rescued {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:36:07.889200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3716b13f-fe79-470f-99d4-2a3206775252 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action" status: 409 len: 146 microversion: 2.1 time: 0.084139 May 14 21:36:07.890903 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2560/5520] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:36:07 2022] POST /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9/action => generated 146 bytes in 86 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 14 21:36:07.901658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:07.902512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:07.909030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.909494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.915739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:07.915739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:07.970648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:36:08.305722 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-22a01d02-2ae3-490e-b3e0-9dc93d1993f9 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 204 len: 0 microversion: 2.1 time: 0.407663 May 14 21:36:08.307439 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2961/5521] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:36:07 2022] DELETE /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:36:08.315440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:08.316374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:08.327575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:08.328341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:08.329375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:08.332552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:08.669351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:08.692703 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be39d7b6-916e-468c-8349-5771657ed5e1 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1688 microversion: 2.1 time: 0.381034 May 14 21:36:08.695272 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2561/5522] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:08 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1688 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:09.729162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:09.731049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:09.749269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:09.749866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:09.755422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:09.757308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:10.374397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:10.383305 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-68b2d4b7-ff2f-41cb-9162-bdc126cfc59f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1688 microversion: 2.1 time: 0.673001 May 14 21:36:10.386015 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2962/5523] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:09 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1688 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:11.404205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:11.405509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:11.433750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:11.434548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:11.435873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:11.436732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:11.949776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:11.968403 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c40028c-3595-4df0-a26c-dff533636b8f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1688 microversion: 2.1 time: 0.567917 May 14 21:36:11.969962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2562/5524] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:11 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1688 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:12.986194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:12.986832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:13.003319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:13.003986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:13.004798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:13.005248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:13.830688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:13.860749 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-41c9ade3-46ee-4f61-8aba-b4cc63c2cbd3 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1688 microversion: 2.1 time: 0.876522 May 14 21:36:13.860749 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2963/5525] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:12 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1688 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:14.270339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-4dd248d1-4391-40a0-be84-b35d51b3b1a4 req-4a990ff5-cc57-4847-ae1a-82407e7de4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd9fd379-b825-4ca8-958b-48f636ce03ff", "name": "network-vif-deleted", "tag": "f7f8effc-6019-4774-a90b-8629243b910b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:36:14.281127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4dd248d1-4391-40a0-be84-b35d51b3b1a4 req-4a990ff5-cc57-4847-ae1a-82407e7de4e0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:14.281624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4dd248d1-4391-40a0-be84-b35d51b3b1a4 req-4a990ff5-cc57-4847-ae1a-82407e7de4e0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:14.294906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-4dd248d1-4391-40a0-be84-b35d51b3b1a4 req-4a990ff5-cc57-4847-ae1a-82407e7de4e0 service nova] Creating event network-vif-deleted:f7f8effc-6019-4774-a90b-8629243b910b for instance fd9fd379-b825-4ca8-958b-48f636ce03ff on nch2-master-1 May 14 21:36:14.300908 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-4dd248d1-4391-40a0-be84-b35d51b3b1a4 req-4a990ff5-cc57-4847-ae1a-82407e7de4e0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034551 May 14 21:36:14.304927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2563/5526] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:36:14.876042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:14.876620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:14.888300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:14.888763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:14.889561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:14.900311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:14.967130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:14.967890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:14.968522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lazy-loading 'fault' on Instance uuid fd9fd379-b825-4ca8-958b-48f636ce03ff {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:36:15.063416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:15.089431 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b027f6c8-a398-441f-8cd0-e9983b1e1327 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 200 len: 1335 microversion: 2.1 time: 0.217501 May 14 21:36:15.092365 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2964/5527] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:14 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 1335 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:16.116994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:16.118615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: fd9fd379-b825-4ca8-958b-48f636ce03ff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:16.129475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:16.130273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:16.131663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:16.135325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:16.168294 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Instance fd9fd379-b825-4ca8-958b-48f636ce03ff could not be found. May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff HTTP/1.1 May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance fd9fd379-b825-4ca8-958b-48f636ce03ff could not be found. May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'fd9fd379-b825-4ca8-958b-48f636ce03ff'} May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd9fd379-b825-4ca8-958b-48f636ce03ff could not be found. May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd9fd379-b825-4ca8-958b-48f636ce03ff could not be found. May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:16.171737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:16.176014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:16.176014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:16.176014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:16.176014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:36:16.176014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:36:16.176014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd9fd379-b825-4ca8-958b-48f636ce03ff could not be found. May 14 21:36:16.176014 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:16.179100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 404 to user: Instance fd9fd379-b825-4ca8-958b-48f636ce03ff could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:36:16.180838 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd49b9b6-1b43-4704-9676-5eec513b8bf5 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff" status: 404 len: 111 microversion: 2.1 time: 0.070347 May 14 21:36:16.182260 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2564/5528] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:16 2022] GET /compute/v2.1/servers/fd9fd379-b825-4ca8-958b-48f636ce03ff => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:36:16.191433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a794fa43-0dda-473a-9e69-34c809650ab7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '.version_select at 0x7fb1a6fa6f70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:16.372695 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a794fa43-0dda-473a-9e69-34c809650ab7 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539251507" status: 202 len: 0 microversion: 2.1 time: 0.185799 May 14 21:36:16.377538 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2965/5529] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 21:36:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1539251507 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:36:35.484134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:35.484687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:35.492038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:35.492504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:35.499405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:35.500420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:35.557977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:36:35.898484 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8558bb61-4c0e-472e-822d-8ad8ed5574f0 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 204 len: 0 microversion: 2.1 time: 0.418573 May 14 21:36:35.910523 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2565/5530] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:36:35 2022] DELETE /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:36:35.917113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:35.918448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:35.934819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:35.944237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:35.945477 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:35.946320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:36.462271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:36.500681 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c12be363-757d-46df-9111-45534893307f tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1507 microversion: 2.1 time: 0.571175 May 14 21:36:36.500681 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2966/5531] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:35 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1507 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:37.521326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:37.522805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:37.533763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:37.534691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:37.536351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:37.537038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:38.593766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:38.645106 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04d53a0a-3c99-4b00-bc0a-9997cab2a67a tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1507 microversion: 2.1 time: 1.128147 May 14 21:36:38.647866 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2566/5532] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:37 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1507 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:39.046416 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 21:36:39.050758 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 21:36:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 21:36:39.664969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:39.666114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:39.683452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:39.683995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:39.684795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:39.685253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:40.718503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:40.728385 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c3f443ad-9e0e-4020-9cde-b32e81c4db68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1507 microversion: 2.1 time: 1.067411 May 14 21:36:40.751252 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2967/5533] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:39 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1507 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:41.105344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-494a3560-dc3e-4fcd-8f29-a805e70a4022 req-a9adf4c8-a14f-45f1-888c-4e2aa930e460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c8a0510-504e-4380-b02e-0e0f3c522ba9", "name": "network-vif-deleted", "tag": "3bdd3c6d-f517-4fec-8956-4ac2b17c2b04"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:36:41.169093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-494a3560-dc3e-4fcd-8f29-a805e70a4022 req-a9adf4c8-a14f-45f1-888c-4e2aa930e460 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:41.171557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-494a3560-dc3e-4fcd-8f29-a805e70a4022 req-a9adf4c8-a14f-45f1-888c-4e2aa930e460 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:41.200390 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-494a3560-dc3e-4fcd-8f29-a805e70a4022 req-a9adf4c8-a14f-45f1-888c-4e2aa930e460 service nova] Creating event network-vif-deleted:3bdd3c6d-f517-4fec-8956-4ac2b17c2b04 for instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 on nch2-master-1 May 14 21:36:41.209239 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-494a3560-dc3e-4fcd-8f29-a805e70a4022 req-a9adf4c8-a14f-45f1-888c-4e2aa930e460 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112806 May 14 21:36:41.218531 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2567/5534] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:36:41.759495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:41.760187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:41.778438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:41.781502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:41.791689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:41.792398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:41.867143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:41.869943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:41.870476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lazy-loading 'fault' on Instance uuid 0c8a0510-504e-4380-b02e-0e0f3c522ba9 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:36:41.964155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:41.975658 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-59cffc8d-47f1-40b5-b7ad-0d9b6d9662d6 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 200 len: 1311 microversion: 2.1 time: 0.220375 May 14 21:36:41.978476 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2968/5535] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:41 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 1311 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:43.000475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:43.007664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: 0c8a0510-504e-4380-b02e-0e0f3c522ba9] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:43.013739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:43.014210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:43.015024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:43.015515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:43.057428 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 could not be found. May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 HTTP/1.1 May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 could not be found. May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0c8a0510-504e-4380-b02e-0e0f3c522ba9'} May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 could not be found. May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 could not be found. May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:43.059151 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 could not be found. May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 404 to user: Instance 0c8a0510-504e-4380-b02e-0e0f3c522ba9 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8550789c-baed-4dc5-9695-be3fd64df104 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9" status: 404 len: 111 microversion: 2.1 time: 0.064856 May 14 21:36:43.063805 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2568/5536] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:42 2022] GET /compute/v2.1/servers/0c8a0510-504e-4380-b02e-0e0f3c522ba9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:36:43.070370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:43.071659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:43.085924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:43.086591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:43.087624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:43.090397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:43.128644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:36:43.553359 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5232df13-3ecd-4515-8fe4-85bf9b78ff2e tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 204 len: 0 microversion: 2.1 time: 0.487229 May 14 21:36:43.554663 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2969/5537] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:36:43 2022] DELETE /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:36:43.562667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:43.564611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:43.571762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:43.572500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:43.573644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:43.575535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:44.789413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:44.809928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-41bf8ee5-175d-4d9a-b214-511cd027d151 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 1.249809 May 14 21:36:44.809928 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2569/5538] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:43 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:45.828845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:45.830728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:45.846820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:45.847253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:45.848168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:45.855104 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:47.011075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:47.050369 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6348af06-6f2a-45ca-88f0-b17ceaaaaa51 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1522 microversion: 2.1 time: 1.226731 May 14 21:36:47.067879 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2970/5539] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:45 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1522 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:48.072427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:48.075385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:48.162557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:48.168181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:48.171442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:48.171442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:48.179143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2ab04d75-35b2-4ae2-bab5-38ffcd298759 req-d15c3c9e-bdd2-4dc8-82db-b94b7aa92714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f98eb2-6910-4d90-86c1-bc42958e30ca", "name": "network-vif-deleted", "tag": "3bd86955-065d-4044-84d3-96660ce658cb"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:36:48.204217 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2ab04d75-35b2-4ae2-bab5-38ffcd298759 req-d15c3c9e-bdd2-4dc8-82db-b94b7aa92714 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:48.204676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2ab04d75-35b2-4ae2-bab5-38ffcd298759 req-d15c3c9e-bdd2-4dc8-82db-b94b7aa92714 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:48.235391 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2ab04d75-35b2-4ae2-bab5-38ffcd298759 req-d15c3c9e-bdd2-4dc8-82db-b94b7aa92714 service nova] Creating event network-vif-deleted:3bd86955-065d-4044-84d3-96660ce658cb for instance d1f98eb2-6910-4d90-86c1-bc42958e30ca on nch2-master-1 May 14 21:36:48.260261 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2ab04d75-35b2-4ae2-bab5-38ffcd298759 req-d15c3c9e-bdd2-4dc8-82db-b94b7aa92714 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073934 May 14 21:36:48.260997 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2971/5540] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:36:48.385536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbb8c5cf2d144e3791171eb3d6f83eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0f4df562340e5bb096ef2eed9239e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:36:48.396616 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 200 len: 1480 microversion: 2.1 time: 0.331076 May 14 21:36:48.397231 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2570/5541] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:48 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 1480 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:36:49.415039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:36:49.415801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] [instance: d1f98eb2-6910-4d90-86c1-bc42958e30ca] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:36:49.426468 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:49.426881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:49.427722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:36:49.428169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:36:49.469719 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] HTTP exception thrown: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca could not be found. May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Request method failure captured: May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca HTTP/1.1 May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigB_0G1cMiDXGXHvgZQWvQs41flPVOo6z7UmmwGHp_fYyGvG4PCZY9Mm9pUAiluVWMvmOR54_ScoPTOGqfNErEqlbIXkPxfiN6JrYQso7KzVPpeyrlaCcv1exxZoXXkSPvN1l0BpPInRG1kgPcMhfJg9EQGTInvnQB-8eZQK-cH-4yDA May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/59c0f4df562340e5bb096ef2eed9239e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_59c0f4df562340e5bb096ef2eed9239e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 59c0f4df562340e5bb096ef2eed9239e May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-879335362 May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cbb8c5cf2d144e3791171eb3d6f83eca May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerRescueNegativeTestJSON-879335362-project May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca could not be found. May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'd1f98eb2-6910-4d90-86c1-bc42958e30ca'} May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca could not be found. May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca could not be found. May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:36:49.473483 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:49.477716 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:36:49.477716 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:36:49.477716 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:36:49.477716 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:36:49.477716 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:36:49.477716 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca could not be found. May 14 21:36:49.477716 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:36:49.488198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Returning 404 to user: Instance d1f98eb2-6910-4d90-86c1-bc42958e30ca could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:36:49.489561 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca" status: 404 len: 111 microversion: 2.1 time: 0.079137 May 14 21:36:49.490262 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2972/5542] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:36:49 2022] GET /compute/v2.1/servers/d1f98eb2-6910-4d90-86c1-bc42958e30ca => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:37:05.631422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:05.632484 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001441 May 14 21:37:05.632837 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2571/5543] 10.222.0.52 () {56 vars in 885 bytes} [Sat May 14 21:37:05 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 14 21:37:05.641482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:05.645629 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.004690 May 14 21:37:05.667693 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2973/5544] 10.222.0.52 () {54 vars in 1034 bytes} [Sat May 14 21:37:05 2022] GET /compute/v2/ => generated 379 bytes in 18 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) May 14 21:37:05.667893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:05.667893 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9dacd921-7156-43d0-a0ff-967c27591f68 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004901 May 14 21:37:05.670820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:05.672027 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9c9adc25-b191-4d34-9e00-50e551fff448 tempest-ServerRescueNegativeTestJSON-879335362 tempest-ServerRescueNegativeTestJSON-879335362-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001604 May 14 21:37:05.672603 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2974/5546] 10.222.0.52 () {56 vars in 885 bytes} [Sat May 14 21:37:05 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 14 21:37:05.679992 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2572/5546] 10.222.0.52 () {54 vars in 1040 bytes} [Sat May 14 21:37:05 2022] GET /compute/v2.1/ => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:20.095348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:20.095348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:20.113020 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:20.113537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:20.114753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:20.115273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:20.284437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lazy-loading 'services' on Instance uuid 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:37:20.596836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4138fbef-040d-40e4-8988-0bf4ca963685 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "DELETE /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba/os-volume_attachments/c221be08-99e4-4f09-a858-6fffe81fd931" status: 202 len: 0 microversion: 2.1 time: 0.505574 May 14 21:37:20.597757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-915343657", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "5d2fb178-d172-4ba8-bb55-be2d01fb2ee1"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:20.603946 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2975/5547] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:37:20 2022] DELETE /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba/os-volume_attachments/c221be08-99e4-4f09-a858-6fffe81fd931 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:37:20.703042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] validate_networks() for [('5d2fb178-d172-4ba8-bb55-be2d01fb2ee1', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:37:21.866598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:21.868017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:21.880794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:21.881279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:21.882087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:21.882545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:21.948105 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:37:22.459274 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-100dc7e8-96c9-4a89-b45b-01f849aea55f tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "DELETE /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 204 len: 0 microversion: 2.1 time: 0.596699 May 14 21:37:22.460220 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2976/5548] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:37:21 2022] DELETE /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:37:22.473962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:22.474956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:22.488859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:22.491025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:22.493047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:22.498542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:22.902305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:37:22.904936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:37:22.904936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:37:22.904936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:37:22.905628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:37:22.922766 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:22.943632 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ebc44ee4-1f9e-42ed-b4f6-ea2004bcbe29 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1512 microversion: 2.1 time: 0.478934 May 14 21:37:22.944124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:22.944280 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2977/5549] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:22 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1512 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:37:22.951216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:22.952539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:22.953523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:23.003865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Getting quotas for project 37fb22eb2ef44be9a5bc66079c2ad71f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:37:23.026659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Getting quotas for user 1096012950d645a0ab7050ea661826db and project 37fb22eb2ef44be9a5bc66079c2ad71f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:37:23.042561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:37:23.048513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:37:23.231641 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ff810af-cee7-4226-88a6-5a94d41de618 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.832468 May 14 21:37:23.244892 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2573/5550] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:37:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:37:23.597845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2135503031", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "5d2fb178-d172-4ba8-bb55-be2d01fb2ee1"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:23.716625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] validate_networks() for [('5d2fb178-d172-4ba8-bb55-be2d01fb2ee1', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:37:23.963968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:23.965298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:23.989225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:23.992926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:23.995410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:23.996211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:25.264746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:25.283887 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afe69a2e-263d-484c-b428-1de9b4b12f81 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1512 microversion: 2.1 time: 1.326488 May 14 21:37:25.284741 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2574/5551] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:23 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1512 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:25.311776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:37:25.312889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:37:25.314597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:37:25.315214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:37:25.315917 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:37:25.340537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:25.348423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:25.352771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:25.356236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:25.460962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Getting quotas for project 37fb22eb2ef44be9a5bc66079c2ad71f. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:37:25.481767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Getting quotas for user 1096012950d645a0ab7050ea661826db and project 37fb22eb2ef44be9a5bc66079c2ad71f. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:37:25.534576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:37:25.537117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:37:25.793905 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ed577ea5-9063-4355-8574-4e017f82d647 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.187231 May 14 21:37:25.794689 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2978/5552] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:37:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:37:26.226946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1146038395", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "451", "networks": [{"uuid": "5d2fb178-d172-4ba8-bb55-be2d01fb2ee1"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:26.306890 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:26.308948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:26.335220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:26.337277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:26.339773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:26.343562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:26.353360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] validate_networks() for [('5d2fb178-d172-4ba8-bb55-be2d01fb2ee1', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:37:27.301096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:27.326573 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-21fd2175-1e1e-4131-979e-5bd303286302 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1512 microversion: 2.1 time: 1.027369 May 14 21:37:27.327907 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2979/5553] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:26 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1512 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:27.659165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-535aeda4-e230-4efc-b0af-4d4a9f71a44b req-8fb0c253-2bb7-4b1c-845f-5c5a719e67e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "294b2ea9-8fff-4f45-89fd-dba8b7ed5dba", "name": "network-vif-deleted", "tag": "915f0324-ec51-454d-8c23-f1ecbc0d832a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:27.700292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-535aeda4-e230-4efc-b0af-4d4a9f71a44b req-8fb0c253-2bb7-4b1c-845f-5c5a719e67e1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:27.701040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-535aeda4-e230-4efc-b0af-4d4a9f71a44b req-8fb0c253-2bb7-4b1c-845f-5c5a719e67e1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:27.736544 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-535aeda4-e230-4efc-b0af-4d4a9f71a44b req-8fb0c253-2bb7-4b1c-845f-5c5a719e67e1 service nova] Creating event network-vif-deleted:915f0324-ec51-454d-8c23-f1ecbc0d832a for instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba on nch1-master-1 May 14 21:37:27.748045 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-535aeda4-e230-4efc-b0af-4d4a9f71a44b req-8fb0c253-2bb7-4b1c-845f-5c5a719e67e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.416736 May 14 21:37:27.749502 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2980/5554] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:28.351392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:28.352190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:28.363742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:28.365077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:28.366164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:28.366850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:28.412946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:28.414729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:28.420594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lazy-loading 'fault' on Instance uuid 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:37:28.509549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8e967d05266477dbc5748ed77b8c69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '162610ac2697486d8a05f41713cc5ba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:28.527282 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ccffef20-4ba2-41be-874b-485cd28d1c6b tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 200 len: 1308 microversion: 2.1 time: 0.185374 May 14 21:37:28.528786 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2981/5555] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:28 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:28.858085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:37:28.858800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:37:28.860708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:37:28.861397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:37:28.869363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:37:28.876436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:28.876898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:28.877714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:28.878160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:28.908519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Getting quotas for project 37fb22eb2ef44be9a5bc66079c2ad71f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:37:28.916430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Getting quotas for user 1096012950d645a0ab7050ea661826db and project 37fb22eb2ef44be9a5bc66079c2ad71f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:37:28.943415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:37:28.946213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:37:29.141658 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5924e34-0f4e-493b-b970-b7abaf1b8780 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.919128 May 14 21:37:29.143129 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2575/5556] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:37:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:37:29.156588 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84cf6c6b-65b5-448b-abf3-0366fba6b871 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:29.159630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84cf6c6b-65b5-448b-abf3-0366fba6b871 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:29.442683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84cf6c6b-65b5-448b-abf3-0366fba6b871 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:29.452561 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84cf6c6b-65b5-448b-abf3-0366fba6b871 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1221 microversion: 2.1 time: 0.302691 May 14 21:37:29.453177 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2982/5557] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:29 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1221 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:29.547237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:29.548749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] [instance: 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:29.557249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:29.557767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:29.558834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:29.559285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:29.574938 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] HTTP exception thrown: Instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba could not be found. May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Request method failure captured: May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba HTTP/1.1 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigB9Jgu-LL_92xfAXe3A_NLvoV1n7ll8yb3HSsiJPCm3o54MQCtPm_7B4yTQLy7P5FevkYkFYrGPg-xWmOMOnAeJVpjBTJS71gdLLhCKkx_a3sCzIEAmabH6PykoytgR71LI0Ye7G2aUzG4Gs_TRni9sE3Wu15a8x58-03p9xAb3PVys May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 162610ac2697486d8a05f41713cc5ba2 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1533504236 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/162610ac2697486d8a05f41713cc5ba2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/162610ac2697486d8a05f41713cc5ba2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/162610ac2697486d8a05f41713cc5ba2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_162610ac2697486d8a05f41713cc5ba2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-VolumesSnapshotTestJSON-1533504236 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 162610ac2697486d8a05f41713cc5ba2 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1533504236 May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-VolumesSnapshotTestJSON-1533504236-project May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: a8e967d05266477dbc5748ed77b8c69e May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-VolumesSnapshotTestJSON-1533504236-project May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba could not be found. May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '294b2ea9-8fff-4f45-89fd-dba8b7ed5dba'} May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba could not be found. May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba could not be found. May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:37:29.576548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba could not be found. May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] Returning 404 to user: Instance 294b2ea9-8fff-4f45-89fd-dba8b7ed5dba could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5f68af6-2769-4872-b24f-96f9116fffd3 tempest-VolumesSnapshotTestJSON-1533504236 tempest-VolumesSnapshotTestJSON-1533504236-project] 10.222.0.52 "GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba" status: 404 len: 111 microversion: 2.1 time: 0.036191 May 14 21:37:29.583548 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2576/5558] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:29 2022] GET /compute/v2.1/servers/294b2ea9-8fff-4f45-89fd-dba8b7ed5dba => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:37:30.472825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a70ff648-b265-4b4f-ac24-c4118597af4b tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:30.474213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a70ff648-b265-4b4f-ac24-c4118597af4b tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:30.721365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a70ff648-b265-4b4f-ac24-c4118597af4b tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:30.741418 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a70ff648-b265-4b4f-ac24-c4118597af4b tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1221 microversion: 2.1 time: 0.275864 May 14 21:37:30.742032 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2983/5559] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:30 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1221 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:31.764305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:31.764305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:31.774798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:31.775270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:31.776295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:31.776753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:31.861798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:31.874363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97baab39-4726-44de-8260-60715aa515f7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1273 microversion: 2.1 time: 0.116245 May 14 21:37:31.874975 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2577/5560] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:31 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:32.892971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:32.893697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:32.901007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:32.901721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:32.902928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:32.904530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:32.988157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:32.999328 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-109c7f66-f515-4244-81c6-8fe513df7078 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1279 microversion: 2.1 time: 0.111315 May 14 21:37:32.999959 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2984/5561] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:32 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:34.017295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:34.017945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:34.025495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:34.026035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:34.026890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:34.027406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:34.155230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d2a8ead9-2073-49df-89d5-b928db97afea req-0b36a6a5-ca14-4ba4-816a-18fc4cb1a927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb364f29-79d9-4981-91f5-1958ed8d7c05", "tag": "9ac0575b-7e67-4d15-8dba-2cf9a938d951"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:34.177118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d2a8ead9-2073-49df-89d5-b928db97afea req-0b36a6a5-ca14-4ba4-816a-18fc4cb1a927 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:34.178002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d2a8ead9-2073-49df-89d5-b928db97afea req-0b36a6a5-ca14-4ba4-816a-18fc4cb1a927 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:34.201667 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d2a8ead9-2073-49df-89d5-b928db97afea req-0b36a6a5-ca14-4ba4-816a-18fc4cb1a927 service nova] Creating event network-changed:9ac0575b-7e67-4d15-8dba-2cf9a938d951 for instance fb364f29-79d9-4981-91f5-1958ed8d7c05 on nch2-master-1 May 14 21:37:34.221004 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d2a8ead9-2073-49df-89d5-b928db97afea req-0b36a6a5-ca14-4ba4-816a-18fc4cb1a927 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069737 May 14 21:37:34.221977 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2985/5562] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:34.227927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:34.242369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2949ab3b-b50c-4229-8064-46b7e8fed0d6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1279 microversion: 2.1 time: 0.229140 May 14 21:37:34.244059 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2578/5563] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:34 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1279 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:35.260684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:35.263490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:35.277062 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:35.277826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:35.278886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:35.279592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:35.493516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:35.506763 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-170eee99-aac7-4147-a3ba-1aa65b921990 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1279 microversion: 2.1 time: 0.247612 May 14 21:37:35.509087 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2986/5564] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:35 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:36.484964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-352bc8d6-7097-49f6-83ba-e89adbd05724 req-0e7997b6-88cf-431f-9819-0a3ae48c1e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05f0aba-3b46-4920-a63a-1480098dbee2", "tag": "83947358-d8a9-4842-b44e-98a77b0acf3f"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:36.521172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-352bc8d6-7097-49f6-83ba-e89adbd05724 req-0e7997b6-88cf-431f-9819-0a3ae48c1e6f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:36.521511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-352bc8d6-7097-49f6-83ba-e89adbd05724 req-0e7997b6-88cf-431f-9819-0a3ae48c1e6f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:36.525355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:36.525815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:36.547942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:36.549432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:36.551986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:36.552728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:36.588877 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-352bc8d6-7097-49f6-83ba-e89adbd05724 req-0e7997b6-88cf-431f-9819-0a3ae48c1e6f service nova] Creating event network-changed:83947358-d8a9-4842-b44e-98a77b0acf3f for instance b05f0aba-3b46-4920-a63a-1480098dbee2 on nch1-master-1 May 14 21:37:36.613646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-352bc8d6-7097-49f6-83ba-e89adbd05724 req-0e7997b6-88cf-431f-9819-0a3ae48c1e6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133984 May 14 21:37:36.620105 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2579/5565] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:37.117140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:37.128482 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-178a13ab-4efe-4c86-b7a0-8ada186c7a01 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.605480 May 14 21:37:37.129135 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2987/5566] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:36 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:37:38.155605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:38.156846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:38.170895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:38.175751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:38.175751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:38.187414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:39.385926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:39.400571 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c8914bb-0bd9-4b50-b3dd-57089da3983e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 1.256311 May 14 21:37:39.416376 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2580/5567] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:38 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:40.420550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:40.421200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:40.441860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:40.442751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:40.456145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:40.456145 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:40.835497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:40.860508 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-14b77380-8407-457d-bfa8-8d0da81fbdd6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.442364 May 14 21:37:40.861233 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2988/5568] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:40 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:41.762346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c27dcd9d-2bd0-4e71-bc51-56c43514eb98 req-7c9fc464-f1ba-434d-ae88-4dc232af145d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb364f29-79d9-4981-91f5-1958ed8d7c05", "name": "network-vif-plugged", "status": "completed", "tag": "9ac0575b-7e67-4d15-8dba-2cf9a938d951"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:41.783007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c27dcd9d-2bd0-4e71-bc51-56c43514eb98 req-7c9fc464-f1ba-434d-ae88-4dc232af145d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:41.785288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c27dcd9d-2bd0-4e71-bc51-56c43514eb98 req-7c9fc464-f1ba-434d-ae88-4dc232af145d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:41.813681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c27dcd9d-2bd0-4e71-bc51-56c43514eb98 req-7c9fc464-f1ba-434d-ae88-4dc232af145d service nova] Creating event network-vif-plugged:9ac0575b-7e67-4d15-8dba-2cf9a938d951 for instance fb364f29-79d9-4981-91f5-1958ed8d7c05 on nch2-master-1 May 14 21:37:41.820545 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c27dcd9d-2bd0-4e71-bc51-56c43514eb98 req-7c9fc464-f1ba-434d-ae88-4dc232af145d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066872 May 14 21:37:41.826334 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2581/5569] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:41.878261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:41.879806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:41.900550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:41.902721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:41.903856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:41.906902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:42.217285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:42.225514 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f23453f6-bc06-46de-808e-523bc20c40ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.352057 May 14 21:37:42.235396 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2989/5570] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:41 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:43.146981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d2bcaec6-aeef-42e2-8d13-646eb6c5f0f8 req-b2a8399a-2261-4024-9430-236a706ab4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52885e0c-c76a-45ae-95aa-a3fbc320ec5b", "tag": "0d782936-f399-4ddf-8074-140eadf30553"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:43.164746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d2bcaec6-aeef-42e2-8d13-646eb6c5f0f8 req-b2a8399a-2261-4024-9430-236a706ab4ec service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:43.165221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d2bcaec6-aeef-42e2-8d13-646eb6c5f0f8 req-b2a8399a-2261-4024-9430-236a706ab4ec service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:43.190146 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d2bcaec6-aeef-42e2-8d13-646eb6c5f0f8 req-b2a8399a-2261-4024-9430-236a706ab4ec service nova] Creating event network-changed:0d782936-f399-4ddf-8074-140eadf30553 for instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b on nch2-master-1 May 14 21:37:43.201322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d2bcaec6-aeef-42e2-8d13-646eb6c5f0f8 req-b2a8399a-2261-4024-9430-236a706ab4ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056853 May 14 21:37:43.205766 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2582/5571] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:43.244870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:43.247705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:43.267714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:43.268855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:43.271773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:43.271773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:43.829295 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:43.837520 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3290bda3-b48b-445a-9965-efbe91e2f624 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.598762 May 14 21:37:43.848460 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2990/5572] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:43 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:44.856050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:44.856970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:44.872317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:44.875121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:44.876274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:44.877075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:45.078781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-1e340edf-531b-457f-a472-f83800c517ea req-3a9f024a-a05b-4bd4-b1f2-5f1e89170691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05f0aba-3b46-4920-a63a-1480098dbee2", "name": "network-vif-plugged", "status": "completed", "tag": "83947358-d8a9-4842-b44e-98a77b0acf3f"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:45.104515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1e340edf-531b-457f-a472-f83800c517ea req-3a9f024a-a05b-4bd4-b1f2-5f1e89170691 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:45.105174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-1e340edf-531b-457f-a472-f83800c517ea req-3a9f024a-a05b-4bd4-b1f2-5f1e89170691 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:45.135856 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-1e340edf-531b-457f-a472-f83800c517ea req-3a9f024a-a05b-4bd4-b1f2-5f1e89170691 service nova] Creating event network-vif-plugged:83947358-d8a9-4842-b44e-98a77b0acf3f for instance b05f0aba-3b46-4920-a63a-1480098dbee2 on nch1-master-1 May 14 21:37:45.150082 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-1e340edf-531b-457f-a472-f83800c517ea req-3a9f024a-a05b-4bd4-b1f2-5f1e89170691 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088037 May 14 21:37:45.151208 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2991/5573] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:45.229374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:45.241066 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-596195f2-ecd7-4f25-9ad8-a77fd62f29f5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.390114 May 14 21:37:45.250145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2583/5574] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:44 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:46.258370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:46.259709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:46.270668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:46.271432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:46.273756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:46.274703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:46.607729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:46.638685 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-99619252-6fe2-417c-b6b9-4860ab8b5f96 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.384664 May 14 21:37:46.650381 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2992/5575] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:46 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:47.656412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:47.657189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:47.669074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:47.669540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:47.670391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:47.670839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:48.153206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:48.162078 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e61ce17f-bf22-4d9b-9e46-29d19aa91278 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.509642 May 14 21:37:48.162983 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2584/5576] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:47 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:49.183233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:49.187742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:49.196330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:49.197303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:49.199255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:49.200406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:49.396390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-68bc5fcf-de44-4ceb-bda1-669730e16d58 req-64a2f154-d4f7-4be1-9e01-833432db8482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52885e0c-c76a-45ae-95aa-a3fbc320ec5b", "name": "network-vif-plugged", "status": "completed", "tag": "0d782936-f399-4ddf-8074-140eadf30553"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:49.408299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-68bc5fcf-de44-4ceb-bda1-669730e16d58 req-64a2f154-d4f7-4be1-9e01-833432db8482 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:49.409083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-68bc5fcf-de44-4ceb-bda1-669730e16d58 req-64a2f154-d4f7-4be1-9e01-833432db8482 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:49.423186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-68bc5fcf-de44-4ceb-bda1-669730e16d58 req-64a2f154-d4f7-4be1-9e01-833432db8482 service nova] Creating event network-vif-plugged:0d782936-f399-4ddf-8074-140eadf30553 for instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b on nch2-master-1 May 14 21:37:49.429124 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-68bc5fcf-de44-4ceb-bda1-669730e16d58 req-64a2f154-d4f7-4be1-9e01-833432db8482 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036902 May 14 21:37:49.430564 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2585/5577] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:49.541442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:49.572157 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9fa77463-04cb-4127-ba3a-0574d48f9f05 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.394792 May 14 21:37:49.587837 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2993/5578] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:49 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:50.596549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:50.600989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:50.617349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:50.618247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:50.619434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:50.620355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:51.463561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:51.471977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8d4ba10-68dd-4170-a90b-db95759eb408 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1321 microversion: 2.1 time: 0.884861 May 14 21:37:51.473618 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2586/5579] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:50 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1321 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:52.495028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:52.497094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:52.505303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:52.505761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:52.506625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:52.507049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:52.728821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:52.740198 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cd85700e-ff48-45fb-9b99-6fd099d81846 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1512 microversion: 2.1 time: 0.253985 May 14 21:37:52.741450 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2994/5580] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:52 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1512 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:52.762260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:52.762860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:52.772295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:52.772750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:52.773547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:52.773978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:53.326467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:53.340344 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ede96652-17ad-4b36-aee2-66b8a84e7e4a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1510 microversion: 2.1 time: 0.581959 May 14 21:37:53.357356 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2587/5581] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:52 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1510 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:53.366173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:53.367569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:53.378953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:53.392458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:53.406743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:53.411563 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:53.649681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:53.658865 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7a1870ca-e812-46fb-9572-e55800c0b6be tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 200 len: 1511 microversion: 2.1 time: 0.299879 May 14 21:37:53.673623 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2995/5582] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:53 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 1511 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:53.677411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:53.681885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:53.682791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:53.698097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:53.698561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:53.699522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:53.707078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:53.832830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:53.935309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:53.944307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:53.945120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:54.344629 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-95eabfc7-bf40-4436-8579-94bc062f3005 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.671660 May 14 21:37:54.345225 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2588/5583] 10.222.0.52 () {58 vars in 1166 bytes} [Sat May 14 21:37:53 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:54.368759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:54.376228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:54.378181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-915343657', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:54.393067 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:54.394614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:54.396181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:54.399764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:54.557118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:54.669399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:54.678489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:54.679316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:55.221783 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4de0f591-0ad7-41d1-bfa4-54067915412d tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-915343657" status: 200 len: 1513 microversion: 2.1 time: 0.857635 May 14 21:37:55.223015 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2996/5584] 10.222.0.52 () {58 vars in 1260 bytes} [Sat May 14 21:37:54 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-915343657 => generated 1513 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:55.242692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:55.248116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:55.248580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:55.257886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:55.258598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:55.259634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:55.260513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:55.442204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:55.564771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:55.578718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:55.579988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:56.022821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aabcb75a-feed-4a11-a096-7cd4da6b25c6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.785437 May 14 21:37:56.025728 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2589/5585] 10.222.0.52 () {58 vars in 1172 bytes} [Sat May 14 21:37:55 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:37:56.054003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:56.060076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:56.060873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.servers [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Removing options 'limit' from query {{(pid=130638) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 14 21:37:56.063684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:56.080958 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:56.081819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:56.083655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:56.084114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:56.152479 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:56.161461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:56.162690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:56.632879 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-82a0cbf0-d7c7-47a9-b730-c4300947e9cd tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.583847 May 14 21:37:56.633492 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2997/5586] 10.222.0.52 () {58 vars in 1160 bytes} [Sat May 14 21:37:56 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:56.654584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:56.658695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:56.663181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:56.678162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:56.678632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:56.679442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:56.679925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:56.758701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:56.843529 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-51e27be5-93dc-4a0e-894d-2cbae323f854 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.192182 May 14 21:37:56.851947 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2590/5587] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:37:56 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:56.865006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:56.879845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:56.886591 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.servers [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Removing options 'limit' from query {{(pid=130638) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 14 21:37:56.887400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:56.914315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:56.915569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:56.921022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:56.923603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:57.075746 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:57.184965 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-848b13fa-af31-41f2-b469-90909aedbbdb tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.324795 May 14 21:37:57.187662 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2998/5588] 10.222.0.52 () {58 vars in 1149 bytes} [Sat May 14 21:37:56 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:57.203795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:57.207350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:57.208063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:57.222971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:57.223665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:57.224659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:57.225845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:57.300099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:57.343449 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eda709e5-0c48-49b4-827d-ff9af315030c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.149959 May 14 21:37:57.344757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2591/5589] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 21:37:57 2022] GET /compute/v2.1/servers => generated 1011 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:37:57.357200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:57.362189 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:57.366163 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:57.399560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:57.400288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:57.401816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:57.403765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:57.671707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:57.820931 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1029c4b0-3f39-4e31-85c7-8fbd366570ac tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.468207 May 14 21:37:57.834650 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 2999/5590] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:37:57 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:57.850133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:57.859811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:57.860740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.compute.servers [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Removing options 'limit' from query {{(pid=130637) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 14 21:37:57.861594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:57.869227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:57.894836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:57.900602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:57.902993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:57.962763 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf90552d-253f-4705-803f-7e31e964eea0 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.119612 May 14 21:37:57.966601 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2592/5591] 10.222.0.52 () {58 vars in 1139 bytes} [Sat May 14 21:37:57 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:57.978314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:57.998732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:57.999964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-915343657', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:37:58.008672 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:58.009131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:58.009932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:58.010376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:58.234745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:37:58.422700 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e840ad26-81f5-4924-9428-ca9e7b11a0d1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-915343657" status: 200 len: 345 microversion: 2.1 time: 0.448185 May 14 21:37:58.426196 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3000/5592] 10.222.0.52 () {58 vars in 1239 bytes} [Sat May 14 21:37:57 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-915343657 => generated 345 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:37:58.444473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3697cd7f-082c-4dca-8d54-26d752fea69e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:37:58.463570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3697cd7f-082c-4dca-8d54-26d752fea69e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:58.464049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3697cd7f-082c-4dca-8d54-26d752fea69e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:58.526793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3697cd7f-082c-4dca-8d54-26d752fea69e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Going to try to stop instance {{(pid=130637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 21:37:58.792546 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3697cd7f-082c-4dca-8d54-26d752fea69e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "POST /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05/action" status: 202 len: 0 microversion: 2.1 time: 0.357413 May 14 21:37:58.793459 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2593/5593] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:37:58 2022] POST /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:37:58.805001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:37:58.805240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:37:58.815449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:58.819921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:58.822590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:37:58.823662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:37:59.338785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:37:59.378253 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a075ce91-58ba-4def-9474-cc575d58c27e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.579096 May 14 21:37:59.381453 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3001/5594] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:37:58 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:00.401033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:00.401779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:00.409681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:00.410480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:00.411518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:00.412197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:01.012996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:01.022453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7cd4f34-de7e-4ad2-b541-7289ca447b80 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.627273 May 14 21:38:01.027160 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2594/5595] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:00 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:02.043213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:02.044694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:02.052633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:02.053342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:02.054410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:02.055027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:02.408341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:02.417897 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-568aa3dd-7e2c-4f29-ac90-b897beda1417 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.378445 May 14 21:38:02.425080 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3002/5596] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:02 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:03.441521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:03.443204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:03.467256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:03.467256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:03.477464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:03.478740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:03.884998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:03.927601 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11ba705a-563e-483f-afa7-47ef6c65b9d4 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.491825 May 14 21:38:03.930014 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2595/5597] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:03 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:04.951364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:04.954150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:04.963999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:04.964650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:04.965998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:04.966634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:05.390836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:05.403731 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bc6ccbf5-6850-4b6b-97a0-d55917ba1105 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.457806 May 14 21:38:05.407979 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3003/5598] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:04 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:06.429851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:06.431293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:06.443814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:06.444286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:06.445087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:06.445533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:06.803554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:06.818018 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc42c61e-bbbc-43b4-9d22-b1344698e457 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.396833 May 14 21:38:06.833208 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2596/5599] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:06 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:07.837351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:07.838808 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:07.846901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:07.847980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:07.849131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:07.849835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:08.398080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:08.429687 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-80061d03-2086-458e-9cae-a3d4f0766eb5 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.595057 May 14 21:38:08.432050 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3004/5600] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:07 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:09.450412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:09.451686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:09.463194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:09.470107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:09.472489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:09.473287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:09.997513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:10.012311 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d850f26-0c5a-4bd9-87b9-0b408e912435 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.565976 May 14 21:38:10.013089 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2597/5601] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:09 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:11.029839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:11.031824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:11.042150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:11.046426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:11.050190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:11.051109 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:11.673235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:11.702277 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c67d868-dd2f-4779-982b-d74b94868d14 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.676258 May 14 21:38:11.702886 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3005/5602] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:11 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:12.723197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:12.740319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:12.760475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:12.761263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:12.764039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:12.765282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:13.080934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:13.087643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e246f9b-523f-404a-a7c2-d3d153e7cbcf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.372089 May 14 21:38:13.100074 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2598/5603] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:12 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:14.110512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:14.111186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:14.140352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:14.141167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:14.147349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:14.147819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:14.884377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:14.914273 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3da36451-cd11-475b-bb29-eb704fd4dbde tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.809918 May 14 21:38:14.919194 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3006/5604] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:14 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:15.934645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:15.935264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:15.948437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:15.948892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:15.949866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:15.950463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:16.529685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:16.537960 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ae15ce3-81fe-4cfe-b2bb-18f2a6878179 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.607013 May 14 21:38:16.538559 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2599/5605] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:15 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:17.560321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:17.560321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:17.572734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:17.573449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:17.574548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:17.575048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:18.044935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:18.055397 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3ad77b2a-4d3a-47cf-968c-cf2b29c193b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.503343 May 14 21:38:18.065715 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3007/5606] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:17 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:19.074705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:19.075335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:19.087859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:19.088338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:19.094369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:19.095670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:19.346069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:19.384751 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d99969f5-d507-4474-a46b-95e2786ad81c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1520 microversion: 2.1 time: 0.315089 May 14 21:38:19.393566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2600/5607] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:19 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1520 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:20.402707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:20.403348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:20.415667 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:20.416132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:20.440538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:20.441317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:20.973336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:20.982598 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3da89179-08bf-440f-a786-1c43f00d7836 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1497 microversion: 2.1 time: 0.583897 May 14 21:38:20.996280 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3008/5608] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:20 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1497 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:21.005730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:21.007919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:21.008940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:21.020393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:21.020847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:21.021662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:21.022101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:21.064120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:21.105454 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b186b839-2b8d-4aea-a6e5-6749e92a8079 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.108582 May 14 21:38:21.106720 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2601/5609] 10.222.0.52 () {58 vars in 1153 bytes} [Sat May 14 21:38:20 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:38:21.118337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3fecca34-70b0-4bc5-ac4a-10b9289a7fb7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:38:21.128365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fecca34-70b0-4bc5-ac4a-10b9289a7fb7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:21.129123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3fecca34-70b0-4bc5-ac4a-10b9289a7fb7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:21.183658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3fecca34-70b0-4bc5-ac4a-10b9289a7fb7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Going to try to start instance {{(pid=130638) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 21:38:21.466662 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3fecca34-70b0-4bc5-ac4a-10b9289a7fb7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "POST /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05/action" status: 202 len: 0 microversion: 2.1 time: 0.353444 May 14 21:38:21.472249 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3009/5610] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:38:21 2022] POST /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:38:21.481861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:21.483643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:21.495001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:21.496299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:21.497733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:21.499874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:22.479266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:22.487812 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52215537-b87f-4535-80df-1ff9c70d0f8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1506 microversion: 2.1 time: 1.012995 May 14 21:38:22.497734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2602/5611] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:21 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1506 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:23.516707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:23.517463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:23.538760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:23.539437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:23.541782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:23.542424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:23.909177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:23.938035 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-03750615-a32e-4679-83fd-c59faa87d219 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1506 microversion: 2.1 time: 0.436664 May 14 21:38:23.940781 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3010/5612] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:23 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:24.957352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:24.958585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:24.975275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:24.976032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:24.977247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:24.977867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.140614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:25.149324 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ef2484af-c4cf-41ad-ac54-f65d1c79962c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1510 microversion: 2.1 time: 0.196065 May 14 21:38:25.150155 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2603/5613] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:24 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:25.170228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:25.174703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:25.175557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.compute.servers [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Removing options 'limit' from query {{(pid=130638) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 14 21:38:25.179995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:25.179995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.179995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.180756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.181927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.183358 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e4610177-fb2a-4d80-8e53-73a3facce1e6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.018804 May 14 21:38:25.184020 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3011/5614] 10.222.0.52 () {58 vars in 1139 bytes} [Sat May 14 21:38:25 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:38:25.206484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:25.207121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:25.213408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.214109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.215507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.216153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.493091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:25.513467 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4492e891-aa39-4049-8629-19e178e5ea81 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1510 microversion: 2.1 time: 0.319104 May 14 21:38:25.531563 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2604/5615] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:25 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:25.542047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:25.542684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:25.560146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.563619 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.565582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.566307 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.924820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:25.945460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-47ecc3e8-1379-4746-a39c-97a53704579c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 200 len: 1511 microversion: 2.1 time: 0.408235 May 14 21:38:25.946988 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3012/5616] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:25 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 1511 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:25.969673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:25.976288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:25.991003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.991588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:25.992477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:25.992940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:26.602605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:26.646143 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eaf4bfe9-fec2-4ad6-ad9a-3c71144787b1 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1512 microversion: 2.1 time: 0.677753 May 14 21:38:26.651410 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2605/5617] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:25 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1512 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:26.666777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:26.670572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:26.671267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:27.033306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:27.033765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:27.035874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:27.036498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:27.186720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:27.262095 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1d8a485c-51e6-4677-86b4-b3edd99413bc tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.599213 May 14 21:38:27.276484 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3013/5618] 10.222.0.52 () {58 vars in 1153 bytes} [Sat May 14 21:38:26 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:38:27.291838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:27.293304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:27.333166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:27.345454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:27.347677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:27.349236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:27.949506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:27.988455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-52742d87-bbda-4ee5-a7f5-a031c26c6350 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1510 microversion: 2.1 time: 0.701903 May 14 21:38:27.996449 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2606/5619] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:27 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1510 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:28.015350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:28.016758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:28.033824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:28.034436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:28.035367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:28.038413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:28.417549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:28.427457 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ed7d689d-0290-4327-a421-da82a4a669c2 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 200 len: 1511 microversion: 2.1 time: 0.416564 May 14 21:38:28.432533 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3014/5620] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:28 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 1511 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:28.448386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:28.449098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:28.464181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:28.469765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:28.469765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:28.469765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:29.347705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:29.357108 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-41e7a1b3-300d-4618-9fb8-b34487651346 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1512 microversion: 2.1 time: 0.912738 May 14 21:38:29.374154 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2607/5621] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:28 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1512 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:29.385317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:29.392922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:29.393707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:29.413575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:29.414039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:29.427642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:29.428090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:29.535811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:29.625998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:29.643765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:29.644925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:29.908502 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0956e844-9688-4019-88f2-c303cba4db21 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.531682 May 14 21:38:29.909129 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3015/5622] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 21:38:29 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:29.933130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:29.948072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:29.948072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:30.555657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:30.556252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:30.557314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:30.557829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:30.747376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:30.895336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a1a6433-b04a-4c1b-8701-ab9185525abf tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.967001 May 14 21:38:30.903334 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2608/5623] 10.222.0.52 () {58 vars in 1149 bytes} [Sat May 14 21:38:29 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:30.938991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:30.941798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:30.942740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:30.953744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:30.955072 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:30.956874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:30.957495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:31.190233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:31.338093 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5fcfe2fd-0a52-4919-8306-8cadfc084130 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.426260 May 14 21:38:31.341315 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3016/5624] 10.222.0.52 () {58 vars in 1211 bytes} [Sat May 14 21:38:30 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:31.352700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:31.359654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:31.360355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:31.376610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:31.379691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:31.382539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:31.382854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:31.490375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:31.602544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9bb9e9f7-455d-40c9-a073-9cc62d767148 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.253594 May 14 21:38:31.607256 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2609/5625] 10.222.0.52 () {58 vars in 1195 bytes} [Sat May 14 21:38:31 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:31.617160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:31.620783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:31.622480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'name': '-915343657', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:31.639442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:31.641471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:31.643893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:31.647174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:31.829143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:31.958408 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89d053c9-0a84-405f-8148-c46fd6192b35 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-915343657" status: 200 len: 345 microversion: 2.1 time: 0.345550 May 14 21:38:31.964029 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3017/5626] 10.222.0.52 () {58 vars in 1155 bytes} [Sat May 14 21:38:31 2022] GET /compute/v2.1/servers?name=-915343657 => generated 345 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:38:31.973994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:31.979048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:31.979987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:31.988496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:31.989229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:31.990510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:31.991454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:32.645132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:32.707872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-95343392-c6b7-4b44-a86a-bc2b7c60669c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.738872 May 14 21:38:32.708818 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2610/5627] 10.222.0.52 () {58 vars in 1153 bytes} [Sat May 14 21:38:31 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:32.723226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:32.728662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:32.729615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-91534365', 'deleted': False, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f'} {{(pid=130638) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 21:38:32.739624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:32.741019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:32.742087 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:32.743337 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:32.871459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.multi_cell_list [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130638) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 21:38:32.985898 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-94d891e4-a9d7-4636-94c1-eeb789a63d26 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-91534365" status: 200 len: 345 microversion: 2.1 time: 0.269816 May 14 21:38:32.987612 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3018/5628] 10.222.0.52 () {58 vars in 1225 bytes} [Sat May 14 21:38:32 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-91534365 => generated 345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:38:33.003438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:33.004175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:33.020548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:33.020979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:33.021792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:33.022249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:33.056757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:38:33.446319 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-16b0781a-27bc-4702-b97a-9f6f80c222f6 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "DELETE /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 204 len: 0 microversion: 2.1 time: 0.446917 May 14 21:38:33.447002 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2611/5629] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:38:32 2022] DELETE /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:38:33.456640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:33.457567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:33.464172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:33.464951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:33.465978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:33.466699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:33.720202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:33.738602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4da435bc-83c1-48cf-81c6-9345696d5273 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1518 microversion: 2.1 time: 0.285962 May 14 21:38:33.749738 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3019/5630] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:33 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1518 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:34.765564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:34.765564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:34.780114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:34.780587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:34.781950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:34.788650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:35.814469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:35.826305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3284292-55e7-4716-8b5e-d4eecd06767f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1518 microversion: 2.1 time: 1.071802 May 14 21:38:35.829054 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2612/5631] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:34 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1518 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:36.845414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:36.846058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:36.865454 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:36.866255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:36.868912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d7e48866-2211-4494-91eb-0d81de5cc35f req-e98a2a34-1a84-4d99-b5a0-869dd4165755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52885e0c-c76a-45ae-95aa-a3fbc320ec5b", "name": "network-vif-deleted", "tag": "0d782936-f399-4ddf-8074-140eadf30553"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:38:36.869615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:36.870259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:36.908200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d7e48866-2211-4494-91eb-0d81de5cc35f req-e98a2a34-1a84-4d99-b5a0-869dd4165755 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:36.911327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d7e48866-2211-4494-91eb-0d81de5cc35f req-e98a2a34-1a84-4d99-b5a0-869dd4165755 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:36.934090 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d7e48866-2211-4494-91eb-0d81de5cc35f req-e98a2a34-1a84-4d99-b5a0-869dd4165755 service nova] Creating event network-vif-deleted:0d782936-f399-4ddf-8074-140eadf30553 for instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b on nch2-master-1 May 14 21:38:36.941161 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d7e48866-2211-4494-91eb-0d81de5cc35f req-e98a2a34-1a84-4d99-b5a0-869dd4165755 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076072 May 14 21:38:36.941722 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2613/5632] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:38:37.218694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:37.235008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1a20f7ef-c734-4f98-922d-b7819993fa1e tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1476 microversion: 2.1 time: 0.394070 May 14 21:38:37.236116 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3020/5633] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:36 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1476 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:38.255256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:38.256010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:38.292188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:38.295841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:38.300652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:38.300652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:38.390503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:38.390982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:38.391464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lazy-loading 'fault' on Instance uuid 52885e0c-c76a-45ae-95aa-a3fbc320ec5b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:38:38.554660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:38.574476 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1efd3950-8982-4595-8ae0-351b8245737c tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 200 len: 1311 microversion: 2.1 time: 0.324543 May 14 21:38:38.585968 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2614/5634] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:38 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:39.595100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:39.595786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: 52885e0c-c76a-45ae-95aa-a3fbc320ec5b] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:39.606815 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:39.609900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:39.612191 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:39.613424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:39.652489 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] HTTP exception thrown: Instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b could not be found. May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Request method failure captured: May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b HTTP/1.1 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCEPGwNeMrgLKvpCmrmHod9fGaKBCvnSJOUToivbD1otVia0ZWH8rlf-8Z8Ea5DGqWPNWz7wlMdBLeH4b1Q3oECMJESL042RVeZZu8sIbLvOUG6NYHdH1ro6flO2Xgz9OzGth2i82_SHWqtRb3FVAxZZnV1lQp6F8eOAG0HODwJujq0 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 37fb22eb2ef44be9a5bc66079c2ad71f May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37fb22eb2ef44be9a5bc66079c2ad71f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 37fb22eb2ef44be9a5bc66079c2ad71f May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServerFiltersTestJSON-175990810-project May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1096012950d645a0ab7050ea661826db May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServerFiltersTestJSON-175990810-project May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b could not be found. May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '52885e0c-c76a-45ae-95aa-a3fbc320ec5b'} May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b could not be found. May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b could not be found. May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:38:39.655102 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:39.660753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:39.660753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:38:39.660753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:38:39.660753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:38:39.660753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:38:39.660753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b could not be found. May 14 21:38:39.660753 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:39.663240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Returning 404 to user: Instance 52885e0c-c76a-45ae-95aa-a3fbc320ec5b could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:38:39.665066 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0bfac3ae-16ae-4272-861f-8a23f7e7bb8a tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b" status: 404 len: 111 microversion: 2.1 time: 0.074023 May 14 21:38:39.666020 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3021/5635] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:39 2022] GET /compute/v2.1/servers/52885e0c-c76a-45ae-95aa-a3fbc320ec5b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:38:39.674571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:39.676071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:39.688541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:39.692942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:39.694027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:39.696887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:39.738433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:38:40.213457 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a884713c-5be1-4710-b0d0-bdc103fec4df tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 204 len: 0 microversion: 2.1 time: 0.543095 May 14 21:38:40.214075 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2615/5636] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:38:39 2022] DELETE /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:38:40.223234 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:40.224400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:40.252401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:40.253792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:40.254912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:40.258296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:40.475564 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:40.493081 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-71fea08f-39e6-443b-908c-5e83db466642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 200 len: 1517 microversion: 2.1 time: 0.273667 May 14 21:38:40.494019 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3022/5637] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:40 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:38:41.525864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:41.526605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:41.553198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:41.553682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:41.559782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:41.560880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:42.173699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:42.183707 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bab4a60-824c-4fde-99ae-81b165cdc642 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 200 len: 1517 microversion: 2.1 time: 0.672136 May 14 21:38:42.194274 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2616/5638] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:41 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 1517 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:43.201574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:43.202622 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:43.227427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:43.229904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:43.232340 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:43.234108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:43.303809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0b8b1275-cbc6-498b-b5a2-4d96a74f0cb5 req-85ab20d4-4848-4896-a498-563b36c56dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05f0aba-3b46-4920-a63a-1480098dbee2", "name": "network-vif-deleted", "tag": "83947358-d8a9-4842-b44e-98a77b0acf3f"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:38:43.345540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0b8b1275-cbc6-498b-b5a2-4d96a74f0cb5 req-85ab20d4-4848-4896-a498-563b36c56dd7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:43.349232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0b8b1275-cbc6-498b-b5a2-4d96a74f0cb5 req-85ab20d4-4848-4896-a498-563b36c56dd7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:43.417024 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0b8b1275-cbc6-498b-b5a2-4d96a74f0cb5 req-85ab20d4-4848-4896-a498-563b36c56dd7 service nova] Creating event network-vif-deleted:83947358-d8a9-4842-b44e-98a77b0acf3f for instance b05f0aba-3b46-4920-a63a-1480098dbee2 on nch1-master-1 May 14 21:38:43.426162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:43.444223 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0b8b1275-cbc6-498b-b5a2-4d96a74f0cb5 req-85ab20d4-4848-4896-a498-563b36c56dd7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146761 May 14 21:38:43.448757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2617/5639] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:38:43.475990 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e5cfc3f-c7c2-4f82-a608-3adac4227d55 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 200 len: 1475 microversion: 2.1 time: 0.271805 May 14 21:38:43.482656 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3023/5640] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:43 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 1475 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:44.499997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:44.501549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:44.510160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:44.510953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:44.513003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:44.514076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:44.576783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:44.577467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:44.578151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lazy-loading 'fault' on Instance uuid b05f0aba-3b46-4920-a63a-1480098dbee2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:38:44.708559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:44.716127 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e83af20f-693e-4b25-8096-685c6dd73734 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 200 len: 1311 microversion: 2.1 time: 0.223879 May 14 21:38:44.718379 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2618/5641] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:44 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 1311 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:45.734497 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:45.735126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: b05f0aba-3b46-4920-a63a-1480098dbee2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:45.751918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:45.757377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:45.757377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:45.757377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:45.777090 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] HTTP exception thrown: Instance b05f0aba-3b46-4920-a63a-1480098dbee2 could not be found. May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Request method failure captured: May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 HTTP/1.1 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCEPGwNeMrgLKvpCmrmHod9fGaKBCvnSJOUToivbD1otVia0ZWH8rlf-8Z8Ea5DGqWPNWz7wlMdBLeH4b1Q3oECMJESL042RVeZZu8sIbLvOUG6NYHdH1ro6flO2Xgz9OzGth2i82_SHWqtRb3FVAxZZnV1lQp6F8eOAG0HODwJujq0 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 37fb22eb2ef44be9a5bc66079c2ad71f May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37fb22eb2ef44be9a5bc66079c2ad71f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 37fb22eb2ef44be9a5bc66079c2ad71f May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServerFiltersTestJSON-175990810-project May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1096012950d645a0ab7050ea661826db May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServerFiltersTestJSON-175990810-project May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance b05f0aba-3b46-4920-a63a-1480098dbee2 could not be found. May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'b05f0aba-3b46-4920-a63a-1480098dbee2'} May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05f0aba-3b46-4920-a63a-1480098dbee2 could not be found. May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05f0aba-3b46-4920-a63a-1480098dbee2 could not be found. May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:38:45.778950 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05f0aba-3b46-4920-a63a-1480098dbee2 could not be found. May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Returning 404 to user: Instance b05f0aba-3b46-4920-a63a-1480098dbee2 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-47826d1d-1e79-4ebe-b993-b04eb5f95d73 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2" status: 404 len: 111 microversion: 2.1 time: 0.050678 May 14 21:38:45.789951 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3024/5642] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:45 2022] GET /compute/v2.1/servers/b05f0aba-3b46-4920-a63a-1480098dbee2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:38:45.792166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:45.792706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:45.799870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:45.800423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:45.801292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:45.801787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:45.839691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:38:46.251506 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b3faefdb-9d9f-490e-9524-4140cdc73da3 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 204 len: 0 microversion: 2.1 time: 0.465195 May 14 21:38:46.255035 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2619/5643] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:38:45 2022] DELETE /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:38:46.262151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:46.262876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:46.291993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:46.292878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:46.294347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:46.296582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:46.581711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:46.601971 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1363a3f3-06bf-47b6-8898-b78c347eae8f tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1516 microversion: 2.1 time: 0.344704 May 14 21:38:46.605056 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3025/5644] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:46 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1516 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:47.625024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:47.626008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:47.635963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:47.636675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:47.639977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:47.641116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:47.877521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:47.888219 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8e71eafc-0d2c-4c7a-b7e2-23c7df703960 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1516 microversion: 2.1 time: 0.268534 May 14 21:38:47.897726 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2620/5645] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:47 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:48.675449 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-9bde984d-6823-4505-8e48-35c22094a731 req-aeccb914-7ee1-484c-94e7-c7e9c5a32bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb364f29-79d9-4981-91f5-1958ed8d7c05", "name": "network-vif-deleted", "tag": "9ac0575b-7e67-4d15-8dba-2cf9a938d951"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:38:48.684587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9bde984d-6823-4505-8e48-35c22094a731 req-aeccb914-7ee1-484c-94e7-c7e9c5a32bd9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:48.685681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-9bde984d-6823-4505-8e48-35c22094a731 req-aeccb914-7ee1-484c-94e7-c7e9c5a32bd9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:48.700103 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-9bde984d-6823-4505-8e48-35c22094a731 req-aeccb914-7ee1-484c-94e7-c7e9c5a32bd9 service nova] Creating event network-vif-deleted:9ac0575b-7e67-4d15-8dba-2cf9a938d951 for instance fb364f29-79d9-4981-91f5-1958ed8d7c05 on nch2-master-1 May 14 21:38:48.705989 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-9bde984d-6823-4505-8e48-35c22094a731 req-aeccb914-7ee1-484c-94e7-c7e9c5a32bd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034575 May 14 21:38:48.709775 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3026/5646] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:38:48.914063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:48.939024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:48.975754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:48.985211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:48.986794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:48.987464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:49.167029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1096012950d645a0ab7050ea661826db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37fb22eb2ef44be9a5bc66079c2ad71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:49.181356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-351a9ac9-02ed-4a70-aba2-11b8e4f6cdc7 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 200 len: 1305 microversion: 2.1 time: 0.279761 May 14 21:38:49.187932 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2621/5647] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:48 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:38:50.204616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:50.205377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] [instance: fb364f29-79d9-4981-91f5-1958ed8d7c05] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:50.214596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:50.226535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:50.229367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:50.230471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:50.266996 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] HTTP exception thrown: Instance fb364f29-79d9-4981-91f5-1958ed8d7c05 could not be found. May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Request method failure captured: May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 HTTP/1.1 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCEPGwNeMrgLKvpCmrmHod9fGaKBCvnSJOUToivbD1otVia0ZWH8rlf-8Z8Ea5DGqWPNWz7wlMdBLeH4b1Q3oECMJESL042RVeZZu8sIbLvOUG6NYHdH1ro6flO2Xgz9OzGth2i82_SHWqtRb3FVAxZZnV1lQp6F8eOAG0HODwJujq0 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 37fb22eb2ef44be9a5bc66079c2ad71f May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/37fb22eb2ef44be9a5bc66079c2ad71f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_37fb22eb2ef44be9a5bc66079c2ad71f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 37fb22eb2ef44be9a5bc66079c2ad71f May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-175990810 May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ListServerFiltersTestJSON-175990810-project May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 1096012950d645a0ab7050ea661826db May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ListServerFiltersTestJSON-175990810-project May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance fb364f29-79d9-4981-91f5-1958ed8d7c05 could not be found. May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'fb364f29-79d9-4981-91f5-1958ed8d7c05'} May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb364f29-79d9-4981-91f5-1958ed8d7c05 could not be found. May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb364f29-79d9-4981-91f5-1958ed8d7c05 could not be found. May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:38:50.270214 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:50.276073 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:38:50.276073 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:38:50.276073 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:38:50.276073 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:38:50.276073 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:38:50.276073 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb364f29-79d9-4981-91f5-1958ed8d7c05 could not be found. May 14 21:38:50.276073 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:38:50.281484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] Returning 404 to user: Instance fb364f29-79d9-4981-91f5-1958ed8d7c05 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:38:50.283062 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-06a1702d-3f7c-4c39-adf4-9f2ba0545d08 tempest-ListServerFiltersTestJSON-175990810 tempest-ListServerFiltersTestJSON-175990810-project] 10.222.0.52 "GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05" status: 404 len: 111 microversion: 2.1 time: 0.084041 May 14 21:38:50.283885 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3027/5648] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:38:50 2022] GET /compute/v2.1/servers/fb364f29-79d9-4981-91f5-1958ed8d7c05 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:38:58.375684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1553531314", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": "none"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:38:58.463053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:38:58.463694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:38:58.464320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:38:58.464873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:38:58.465427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:38:58.477576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:58.478191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:58.479411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:38:58.480041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:38:58.501070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Getting quotas for project 7f66f58506884bf29cc157ef4943b9fc. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:38:58.508426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Getting quotas for user abe90f4c283040e3bfeca78955a01bd2 and project 7f66f58506884bf29cc157ef4943b9fc. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:38:58.524081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:38:58.527654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:38:58.729949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd477ee4-a146-4fe3-95ca-83819036d06a tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.795570 May 14 21:38:58.730820 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2622/5649] 10.222.0.52 () {62 vars in 1187 bytes} [Sat May 14 21:38:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 14 21:38:58.747235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-59e5d820-823f-4c82-ba5c-df31bfecf9a4 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:38:58.755103 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-59e5d820-823f-4c82-ba5c-df31bfecf9a4 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:38:59.022151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-59e5d820-823f-4c82-ba5c-df31bfecf9a4 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:59.040308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-59e5d820-823f-4c82-ba5c-df31bfecf9a4 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:59.045887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-59e5d820-823f-4c82-ba5c-df31bfecf9a4 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:38:59.049465 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-59e5d820-823f-4c82-ba5c-df31bfecf9a4 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1281 microversion: 2.47 time: 0.308467 May 14 21:38:59.050769 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3028/5650] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:38:58 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1281 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:00.074448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5bd7e7e5-120b-48c4-87ad-f4d7057a0eff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:00.076374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5bd7e7e5-120b-48c4-87ad-f4d7057a0eff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:00.335041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5bd7e7e5-120b-48c4-87ad-f4d7057a0eff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:00.357692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5bd7e7e5-120b-48c4-87ad-f4d7057a0eff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:00.357692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5bd7e7e5-120b-48c4-87ad-f4d7057a0eff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:00.369787 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5bd7e7e5-120b-48c4-87ad-f4d7057a0eff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1281 microversion: 2.47 time: 0.302742 May 14 21:39:00.383131 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2623/5651] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:00 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1281 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:01.389792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:01.390694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:01.410089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:01.413547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:01.416207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:01.417400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:01.541182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:01.553734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:01.555312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:01.556592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b7a5561b-8bd4-4cd3-b7c7-e0d0bd17507e tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1285 microversion: 2.47 time: 0.171961 May 14 21:39:01.557161 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3029/5652] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:01 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:02.576528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:02.578199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:02.591500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:02.592310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:02.594591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:02.595409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:02.697712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:02.707598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:02.709211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:02.710370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f02413f-10b8-49e9-931b-02a3214642c0 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1351 microversion: 2.47 time: 0.139308 May 14 21:39:02.711267 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2624/5653] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:02 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:03.732032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:03.732869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:03.768116 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:03.774650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:03.775986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:03.777393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:03.881347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:03.891671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:03.893786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:03.895556 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d2451d33-db3d-4fd6-8dfc-1f5a02473dcf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1339 microversion: 2.47 time: 0.169186 May 14 21:39:03.896990 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3030/5654] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:03 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1339 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:04.915704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:04.916341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:04.927606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:04.928299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:04.929370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:04.929967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:05.049308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:05.064205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:05.068064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:05.069178 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-08e37a68-96ac-478f-9936-ce4cfe7517fe tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1339 microversion: 2.47 time: 0.158835 May 14 21:39:05.073887 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2625/5655] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:04 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:06.090499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:06.095594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:06.109680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:06.110140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:06.112604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:06.116101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:06.234535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:06.254180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:06.257108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:06.260638 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-def13c12-6ffb-4d09-89ad-205e55503a20 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1360 microversion: 2.47 time: 0.174439 May 14 21:39:06.264543 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3031/5656] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:06 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:06.287834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-414c5df7-5c4b-4df3-b99d-7a1ae1b296ff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2134619727"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:06.290428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-414c5df7-5c4b-4df3-b99d-7a1ae1b296ff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:06.299092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-414c5df7-5c4b-4df3-b99d-7a1ae1b296ff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:06.299581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-414c5df7-5c4b-4df3-b99d-7a1ae1b296ff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:06.301258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-414c5df7-5c4b-4df3-b99d-7a1ae1b296ff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:06.301894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-414c5df7-5c4b-4df3-b99d-7a1ae1b296ff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:07.068187 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-414c5df7-5c4b-4df3-b99d-7a1ae1b296ff tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "POST /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7/action" status: 202 len: 52 microversion: 2.47 time: 0.787448 May 14 21:39:07.068841 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2626/5657] 10.222.0.52 () {62 vars in 1318 bytes} [Sat May 14 21:39:06 2022] POST /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7/action => generated 52 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) May 14 21:39:07.079608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:07.080122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:07.094611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:07.094611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:07.094611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:07.094611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:07.119362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:39:07.511269 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-47877306-f933-4790-b7f6-7746a568c4bc tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 204 len: 0 microversion: 2.47 time: 0.435413 May 14 21:39:07.512039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3032/5658] 10.222.0.52 () {60 vars in 1279 bytes} [Sat May 14 21:39:07 2022] DELETE /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 14 21:39:07.522167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:07.523693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:07.538337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:07.541372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:07.542465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:07.544099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:07.633508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:07.645174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:07.648822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:07.650071 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-843d6b28-5697-4d20-b5a8-052915a60ff1 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1366 microversion: 2.47 time: 0.132706 May 14 21:39:07.650979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2627/5659] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:07 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:08.671029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:08.672318 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:08.678751 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:08.680263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:08.681206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:08.681818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:08.760033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:08.768555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:08.770400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:08.771574 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a36a03e8-2a8b-4b00-9ccc-0097cda5fbbf tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1366 microversion: 2.47 time: 0.106180 May 14 21:39:08.772159 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3033/5660] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:08 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:09.790699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:09.791341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:09.805506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:09.810417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:09.811294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:09.811806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:10.289177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:10.302158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:10.303640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abe90f4c283040e3bfeca78955a01bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f66f58506884bf29cc157ef4943b9fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:10.308645 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37650914-d68f-4f0f-a85d-0c3374b452f2 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 200 len: 1366 microversion: 2.47 time: 0.522048 May 14 21:39:10.311045 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2628/5661] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:09 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 14 21:39:11.331546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:11.332489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] [instance: 1b3d922e-65c0-4915-b19d-55c74ca0c5a7] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:11.343669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:11.348241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:11.348241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:11.348241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:11.378380 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] HTTP exception thrown: Instance 1b3d922e-65c0-4915-b19d-55c74ca0c5a7 could not be found. May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Request method failure captured: May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 HTTP/1.1 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCFxQvPMjUuHuQmrkjPwRGO19SUJ3Au8tt47naanuxpWOhlhCaV8BBCQVnrLem-6d9HUzXnmSJzU5IWMk0N16KuqYDJer5f9Bew5F5P1Ml6mGsra2yfV0l6RGlnP5xFVUEHzZ-sC4ljCwqAoc5IbKor-SqxoUeihfEsB6c6M2gENuAA May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Openstack-Nova-Api-Version: 2.47 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 7f66f58506884bf29cc157ef4943b9fc May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersAaction247Test-876057235 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f66f58506884bf29cc157ef4943b9fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/7f66f58506884bf29cc157ef4943b9fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/7f66f58506884bf29cc157ef4943b9fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_7f66f58506884bf29cc157ef4943b9fc", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersAaction247Test-876057235 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 7f66f58506884bf29cc157ef4943b9fc May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersAaction247Test-876057235 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersAaction247Test-876057235-project May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: abe90f4c283040e3bfeca78955a01bd2 May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersAaction247Test-876057235-project May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 1b3d922e-65c0-4915-b19d-55c74ca0c5a7 could not be found. May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '1b3d922e-65c0-4915-b19d-55c74ca0c5a7'} May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3d922e-65c0-4915-b19d-55c74ca0c5a7 could not be found. May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3d922e-65c0-4915-b19d-55c74ca0c5a7 could not be found. May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:39:11.380906 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:11.384114 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:39:11.384114 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:39:11.384114 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:39:11.384114 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:39:11.384114 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:39:11.384114 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3d922e-65c0-4915-b19d-55c74ca0c5a7 could not be found. May 14 21:39:11.384114 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:11.388423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] Returning 404 to user: Instance 1b3d922e-65c0-4915-b19d-55c74ca0c5a7 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:39:11.390290 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8ef2dbf0-746a-4ecc-9bcc-a8e4fa528267 tempest-ServersAaction247Test-876057235 tempest-ServersAaction247Test-876057235-project] 10.222.0.52 "GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7" status: 404 len: 111 microversion: 2.47 time: 0.064977 May 14 21:39:11.391076 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3034/5662] 10.222.0.52 () {60 vars in 1276 bytes} [Sat May 14 21:39:11 2022] GET /compute/v2.1/servers/1b3d922e-65c0-4915-b19d-55c74ca0c5a7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 14 21:39:17.963227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-376137487", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "28709e91-37e2-4f45-9d8d-06271aa5bf55"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:18.028827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] validate_networks() for [('28709e91-37e2-4f45-9d8d-06271aa5bf55', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:39:19.020441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:39:19.021468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:39:19.022119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:39:19.022689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:39:19.023122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:39:19.040396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:19.042021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:19.043566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:19.044172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:19.065635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Getting quotas for project 18722465cc2449ee96995dd0c487479c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:39:19.071376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Getting quotas for user 6e6ed7d44e3d4b9bb6af16f20cb6ecae and project 18722465cc2449ee96995dd0c487479c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:39:19.084882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:39:19.087280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:39:19.252545 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53d4b77f-9305-4767-be3c-2d60cb9f4a7f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.478173 May 14 21:39:19.253220 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2629/5663] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:39:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:39:19.278374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-db175a89-acd8-468f-afe9-9fd449ec2b5f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:19.279608 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-db175a89-acd8-468f-afe9-9fd449ec2b5f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:19.464138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-db175a89-acd8-468f-afe9-9fd449ec2b5f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:19.475084 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-db175a89-acd8-468f-afe9-9fd449ec2b5f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1215 microversion: 2.1 time: 0.214134 May 14 21:39:19.475727 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3035/5664] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:19 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:20.492094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4b47bd3-9ace-4815-b891-a265c7a9b12c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:20.492723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4b47bd3-9ace-4815-b891-a265c7a9b12c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:20.570685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4b47bd3-9ace-4815-b891-a265c7a9b12c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:20.578986 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4b47bd3-9ace-4815-b891-a265c7a9b12c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1215 microversion: 2.1 time: 0.091604 May 14 21:39:20.579622 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2630/5665] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:20 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:21.596159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:21.596784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:21.604195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:21.604910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:21.605964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:21.606559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:21.698536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:21.738759 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-86ead1c7-c002-49b5-88ee-05c100e58d76 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1211 microversion: 2.1 time: 0.134037 May 14 21:39:21.738759 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3036/5666] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:21 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1211 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:22.751321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:22.754387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:22.762241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:22.763114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:22.764602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:22.765051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:22.907617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:22.921326 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f932428-96c3-4b5a-b4e8-da3c41813b7c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1285 microversion: 2.1 time: 0.177936 May 14 21:39:22.928746 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2631/5667] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:22 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:23.946364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:23.946988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:23.960649 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:23.961843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:23.962779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:23.963232 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:24.120068 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:24.131935 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c272284-bb6f-4193-a875-fc5fbc5b9a44 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1315 microversion: 2.1 time: 0.189158 May 14 21:39:24.132754 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3037/5668] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:23 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:25.053406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-60ad70ad-605f-4f61-a62d-c28a05c0918e req-0ab4e036-11eb-4baf-a3c3-035a31ba1a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2438b0e-34c5-492f-ba81-8111fc7ee21c", "tag": "bf8bce7b-222b-4c4f-9fcb-512d2378ed5e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:25.064657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-60ad70ad-605f-4f61-a62d-c28a05c0918e req-0ab4e036-11eb-4baf-a3c3-035a31ba1a82 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:25.065345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-60ad70ad-605f-4f61-a62d-c28a05c0918e req-0ab4e036-11eb-4baf-a3c3-035a31ba1a82 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:25.080322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-60ad70ad-605f-4f61-a62d-c28a05c0918e req-0ab4e036-11eb-4baf-a3c3-035a31ba1a82 service nova] Creating event network-changed:bf8bce7b-222b-4c4f-9fcb-512d2378ed5e for instance e2438b0e-34c5-492f-ba81-8111fc7ee21c on nch1-master-1 May 14 21:39:25.087664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-60ad70ad-605f-4f61-a62d-c28a05c0918e req-0ab4e036-11eb-4baf-a3c3-035a31ba1a82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038153 May 14 21:39:25.090534 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2632/5669] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:39:25.155327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:25.156584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:25.165036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:25.165554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:25.166383 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:25.166821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:25.423692 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:25.435728 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c74d7341-c8be-4c43-ad02-266d033a5716 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1315 microversion: 2.1 time: 0.285109 May 14 21:39:25.436557 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3038/5670] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:25 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:26.459631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:26.461829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:26.474073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:26.477544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:26.479004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:26.481036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:26.662553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:26.670315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f384d40-959c-4721-a284-b058165383cb tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1315 microversion: 2.1 time: 0.219468 May 14 21:39:26.672491 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2633/5671] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:26 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:27.700434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:27.705500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:27.713784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:27.714456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:27.715975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:27.716569 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:27.900720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:27.910335 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac4e4546-816f-408e-b994-e4383d5dfc09 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1315 microversion: 2.1 time: 0.220687 May 14 21:39:27.918329 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3039/5672] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:27 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:28.928332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:28.929167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:28.942159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:28.943692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:28.945102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:28.946297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:29.273476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:29.285563 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fa3e51e0-79a4-4d83-b3ae-a2eb81a1150c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1315 microversion: 2.1 time: 0.361778 May 14 21:39:29.288300 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2634/5673] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:28 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:29.713396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-527ab618-9a20-40f3-8ca5-68619f76dc75 req-7f4a68db-2c4c-4b41-9854-ed01b969fa3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2438b0e-34c5-492f-ba81-8111fc7ee21c", "name": "network-vif-plugged", "status": "completed", "tag": "bf8bce7b-222b-4c4f-9fcb-512d2378ed5e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:29.727233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-527ab618-9a20-40f3-8ca5-68619f76dc75 req-7f4a68db-2c4c-4b41-9854-ed01b969fa3e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:29.731387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-527ab618-9a20-40f3-8ca5-68619f76dc75 req-7f4a68db-2c4c-4b41-9854-ed01b969fa3e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:29.757991 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-527ab618-9a20-40f3-8ca5-68619f76dc75 req-7f4a68db-2c4c-4b41-9854-ed01b969fa3e service nova] Creating event network-vif-plugged:bf8bce7b-222b-4c4f-9fcb-512d2378ed5e for instance e2438b0e-34c5-492f-ba81-8111fc7ee21c on nch1-master-1 May 14 21:39:29.764575 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-527ab618-9a20-40f3-8ca5-68619f76dc75 req-7f4a68db-2c4c-4b41-9854-ed01b969fa3e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289206 May 14 21:39:29.765991 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3040/5674] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:39:30.301915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:30.302543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:30.310275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:30.310734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:30.311598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:30.312058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:30.491134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:30.499870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efb2ba71-0973-40c5-b9f7-b27ef7bd2f3b tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1315 microversion: 2.1 time: 0.201637 May 14 21:39:30.503529 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2635/5675] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:30 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:31.519118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:31.520994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:31.527798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:31.533226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:31.533226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:31.533226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:31.801499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:31.811830 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-31184995-9cfc-4cab-9541-4236b373c9e8 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1503 microversion: 2.1 time: 0.298078 May 14 21:39:31.823232 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3041/5676] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:31 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1503 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:31.829116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-384d6b74-303e-4632-b735-65c60e8f1f6c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:31.829659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-384d6b74-303e-4632-b735-65c60e8f1f6c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:31.840186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384d6b74-303e-4632-b735-65c60e8f1f6c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:31.840542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384d6b74-303e-4632-b735-65c60e8f1f6c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:31.841353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384d6b74-303e-4632-b735-65c60e8f1f6c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:31.841811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384d6b74-303e-4632-b735-65c60e8f1f6c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:32.026752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-384d6b74-303e-4632-b735-65c60e8f1f6c tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.201837 May 14 21:39:32.029685 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2636/5677] 10.222.0.52 () {58 vars in 1295 bytes} [Sat May 14 21:39:31 2022] DELETE /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c/os-server-password => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:39:32.038604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-021c22be-c6cc-477a-bb4d-de5c8768e771 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:32.039172 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-021c22be-c6cc-477a-bb4d-de5c8768e771 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:32.050516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-021c22be-c6cc-477a-bb4d-de5c8768e771 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:32.051190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-021c22be-c6cc-477a-bb4d-de5c8768e771 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:32.052157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-021c22be-c6cc-477a-bb4d-de5c8768e771 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:32.052749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-021c22be-c6cc-477a-bb4d-de5c8768e771 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:32.079452 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-021c22be-c6cc-477a-bb4d-de5c8768e771 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.044805 May 14 21:39:32.080072 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3042/5678] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:39:32 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c/os-server-password => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 14 21:39:32.090444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:32.090961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:32.096974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:32.101666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:32.101666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:32.101666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:32.135832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:39:32.550522 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cbf2bb6d-de41-46af-84f6-f0c72153ecdd tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 204 len: 0 microversion: 2.1 time: 0.463924 May 14 21:39:32.551835 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2637/5679] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:39:32 2022] DELETE /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:39:32.564628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:32.566587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:32.580411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:32.581289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:32.582314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:32.583225 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:32.975203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:32.987753 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84adcacd-5350-4811-a403-bb25a3d0f56f tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1509 microversion: 2.1 time: 0.427096 May 14 21:39:32.988160 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3043/5680] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:32 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1509 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:34.015716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:34.016551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:34.033821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:34.034310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:34.035136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:34.038390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:34.318886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:34.330409 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88833189-ff6c-47e6-9fcb-fd12809723fe tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1509 microversion: 2.1 time: 0.327013 May 14 21:39:34.339312 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2638/5681] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:34 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:35.082290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-739d8272-66f7-4590-a01f-3e8ee9f4c942 req-d0934984-fbc5-4f40-9ce9-325abb012e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2438b0e-34c5-492f-ba81-8111fc7ee21c", "name": "network-vif-deleted", "tag": "bf8bce7b-222b-4c4f-9fcb-512d2378ed5e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:35.099915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-739d8272-66f7-4590-a01f-3e8ee9f4c942 req-d0934984-fbc5-4f40-9ce9-325abb012e57 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:35.113235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-739d8272-66f7-4590-a01f-3e8ee9f4c942 req-d0934984-fbc5-4f40-9ce9-325abb012e57 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:35.155469 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-739d8272-66f7-4590-a01f-3e8ee9f4c942 req-d0934984-fbc5-4f40-9ce9-325abb012e57 service nova] Creating event network-vif-deleted:bf8bce7b-222b-4c4f-9fcb-512d2378ed5e for instance e2438b0e-34c5-492f-ba81-8111fc7ee21c on nch1-master-1 May 14 21:39:35.167151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-739d8272-66f7-4590-a01f-3e8ee9f4c942 req-d0934984-fbc5-4f40-9ce9-325abb012e57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089295 May 14 21:39:35.170450 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3044/5682] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:39:35.361062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:35.361709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:35.376594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:35.391819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:35.392862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:35.396372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:35.595654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e6ed7d44e3d4b9bb6af16f20cb6ecae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18722465cc2449ee96995dd0c487479c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:35.614460 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd1e1899-36ce-413d-8756-f982d940a748 tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 200 len: 1300 microversion: 2.1 time: 0.253560 May 14 21:39:35.614460 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2639/5683] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:35 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 1300 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:36.622772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:36.623522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] [instance: e2438b0e-34c5-492f-ba81-8111fc7ee21c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:36.643794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:36.648124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:36.648124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:36.648124 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:36.710671 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] HTTP exception thrown: Instance e2438b0e-34c5-492f-ba81-8111fc7ee21c could not be found. May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Request method failure captured: May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c HTTP/1.1 May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCGFbXsbza3alEoyH6vjVJ6NFafKehPvusjyN5G08WyFp-zj4yvWZXsqTGk4b23bbhwNo5iOUQkrTFUo15g4x0XOzk5meXAn1lF5U3XhZyw8HtKEegSmQFWbfWcswCG1QBwLMFh35JEJiSFbd2JOIS4su_K7JBncv6fAoikPcUb5zsw May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 18722465cc2449ee96995dd0c487479c May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServerPasswordTestJSON-1081340821 May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18722465cc2449ee96995dd0c487479c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/18722465cc2449ee96995dd0c487479c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/18722465cc2449ee96995dd0c487479c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_18722465cc2449ee96995dd0c487479c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServerPasswordTestJSON-1081340821 May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 18722465cc2449ee96995dd0c487479c May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1081340821 May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServerPasswordTestJSON-1081340821-project May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 6e6ed7d44e3d4b9bb6af16f20cb6ecae May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServerPasswordTestJSON-1081340821-project May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance e2438b0e-34c5-492f-ba81-8111fc7ee21c could not be found. May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'e2438b0e-34c5-492f-ba81-8111fc7ee21c'} May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2438b0e-34c5-492f-ba81-8111fc7ee21c could not be found. May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2438b0e-34c5-492f-ba81-8111fc7ee21c could not be found. May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:39:36.724835 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2438b0e-34c5-492f-ba81-8111fc7ee21c could not be found. May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] Returning 404 to user: Instance e2438b0e-34c5-492f-ba81-8111fc7ee21c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:39:36.728593 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-745b0e93-935f-46f7-ba3a-6d608e2bb7aa tempest-ServerPasswordTestJSON-1081340821 tempest-ServerPasswordTestJSON-1081340821-project] 10.222.0.52 "GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c" status: 404 len: 111 microversion: 2.1 time: 0.110824 May 14 21:39:36.737381 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3045/5684] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:36 2022] GET /compute/v2.1/servers/e2438b0e-34c5-492f-ba81-8111fc7ee21c => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:39:44.971186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86b082d9-8b91-4304-9597-108c05be6cfe tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'create', calling method: .version_select at 0x7fb1a6f4a940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1578881628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSzefRq+KXCgqG8z9lyPBHNXiP9twGsId7EDS/ZrfK0SdSr6kF+sDoHNNQRqqvqgbpHvXNy4elORJabu+HtgX71Q1PedcUkajOsuIfGSnLVd+Ds2CzvGCXbu1eOKNdY3Q=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:45.038892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-86b082d9-8b91-4304-9597-108c05be6cfe tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:39:45.051539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-86b082d9-8b91-4304-9597-108c05be6cfe tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for user cab5a299e003422286f01bd44fda92bc and project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:39:45.082724 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-86b082d9-8b91-4304-9597-108c05be6cfe tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [9b8a9a2d-6f97-4c29-b4d6-e0eefda37e18] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 21:39:46.092676 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [None req-86b082d9-8b91-4304-9597-108c05be6cfe tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [9b8a9a2d-6f97-4c29-b4d6-e0eefda37e18] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48150. May 14 21:39:46.238870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86b082d9-8b91-4304-9597-108c05be6cfe tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.272562 May 14 21:39:46.240519 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2640/5685] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:39:44 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:39:50.787748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-844317736", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "fb6b8bd4-f50e-46c4-a16c-102a54ed8344"}], "key_name": "tempest-TestNetworkBasicOps-1578881628", "security_groups": [{"name": "tempest-secgroup-smoke-1645645064"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:51.038111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] validate_networks() for [('fb6b8bd4-f50e-46c4-a16c-102a54ed8344', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:39:51.583946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-150986712", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "76ae4352-6850-4c58-b543-b60c328b4636"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:51.635803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] validate_networks() for [('76ae4352-6850-4c58-b543-b60c328b4636', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:39:52.087538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:39:52.088033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:39:52.088414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:39:52.089012 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:39:52.089424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:39:52.103616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:52.104081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:52.105964 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:52.106411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:52.143918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:39:52.152089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for user cab5a299e003422286f01bd44fda92bc and project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:39:52.168016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:39:52.170390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:39:52.314113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:39:52.314518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:39:52.315365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:39:52.316044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:39:52.316181 ncdv-master-1 devstack@n-api.service[130638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [4354ceac-0c7c-4460-9d05-9d748e53a7d0] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 21:39:52.316757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:39:52.327615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:52.328071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:52.329173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:52.329622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:52.349725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Getting quotas for project 882c775cc8694e0aab28c39b98827f8c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:39:52.363507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Getting quotas for user 43b8ae7176574269b187ce6f4a3344ac and project 882c775cc8694e0aab28c39b98827f8c. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:39:52.374711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:39:52.377241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:39:52.657468 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c81c75ae-d762-433c-adde-0be314b4f21e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.490964 May 14 21:39:52.658789 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2641/5686] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:39:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:39:52.668375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1fb6a56-d469-43cb-8906-5ad246a02c2c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:52.669226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a1fb6a56-d469-43cb-8906-5ad246a02c2c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:52.754053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a1fb6a56-d469-43cb-8906-5ad246a02c2c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:52.767675 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a1fb6a56-d469-43cb-8906-5ad246a02c2c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1227 microversion: 2.1 time: 0.103301 May 14 21:39:52.768801 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2642/5687] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:52 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1227 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:39:53.327051 ncdv-master-1 devstack@n-api.service[130638]: INFO oslo.messaging._drivers.impl_rabbit [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [4354ceac-0c7c-4460-9d05-9d748e53a7d0] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48472. May 14 21:39:53.332465 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e44c2a6f-2131-4ae9-898f-ecb5ee51f79c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.548619 May 14 21:39:53.340207 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3046/5688] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:39:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 2557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:39:53.346059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c467a49-ea90-4ac5-a215-a87dac5122c0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:53.346906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c467a49-ea90-4ac5-a215-a87dac5122c0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:53.414052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c467a49-ea90-4ac5-a215-a87dac5122c0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:53.426689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c467a49-ea90-4ac5-a215-a87dac5122c0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1248 microversion: 2.1 time: 0.086640 May 14 21:39:53.436173 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2643/5689] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:53 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:39:53.784650 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f6458b88-bcb3-4c43-82c4-b9a670a9ea12 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:53.785280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f6458b88-bcb3-4c43-82c4-b9a670a9ea12 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:53.893971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f6458b88-bcb3-4c43-82c4-b9a670a9ea12 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:53.906947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f6458b88-bcb3-4c43-82c4-b9a670a9ea12 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1227 microversion: 2.1 time: 0.125779 May 14 21:39:53.918380 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3047/5690] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:53 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1227 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:54.446359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e476ffe1-63b3-4f77-a384-db5b5f106ad3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:54.447126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e476ffe1-63b3-4f77-a384-db5b5f106ad3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:54.544348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e476ffe1-63b3-4f77-a384-db5b5f106ad3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:54.551068 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e476ffe1-63b3-4f77-a384-db5b5f106ad3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1248 microversion: 2.1 time: 0.109226 May 14 21:39:54.551970 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2644/5691] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:54 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1248 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:54.924596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:54.925905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:54.935818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:54.936674 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:54.937859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:54.938575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:55.065266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:55.077368 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ad71ec94-c409-4843-a3bf-12db4b5c1f01 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1279 microversion: 2.1 time: 0.157019 May 14 21:39:55.089562 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3048/5692] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:54 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:55.575158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:55.575763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:55.583636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:55.584587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:55.585383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:55.586008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:55.670686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:55.677755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-096c4487-ddc1-4ec8-8808-427145f8cf0d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1300 microversion: 2.1 time: 0.109957 May 14 21:39:55.678348 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2645/5693] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:55 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:56.095837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:56.096467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:56.103253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:56.103740 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:56.104628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:56.105142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:56.181595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:56.193635 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7299e283-ca95-4462-bb32-c4b7f2e68288 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1285 microversion: 2.1 time: 0.099920 May 14 21:39:56.193635 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3049/5694] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:56 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:56.695324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:56.696998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:56.712834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:56.713299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:56.714496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:56.715039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:56.958280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:56.968409 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28fc324a-99cf-4ebe-ad9a-0855076ba6f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1306 microversion: 2.1 time: 0.276735 May 14 21:39:56.970530 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2646/5695] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:56 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1306 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:57.210418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:57.211047 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:57.218577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:57.219054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:57.219872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:57.220316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:57.417568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:57.426283 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bad9887b-ca1d-48e1-ba77-b99524ff522d tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.219778 May 14 21:39:57.427433 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3050/5696] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:57 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:57.986963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:57.988284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:57.995002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:57.995471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:57.996285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:57.996974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:58.282745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:58.290784 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d52a1e4a-2623-4bc8-9907-9a021048f0b9 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.307797 May 14 21:39:58.291524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2647/5697] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:57 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:58.454957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:58.454957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:58.483811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:58.484398 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:58.485467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:58.487573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:58.749676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:58.759955 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-971f25da-bbe6-4ea4-b00b-5f1f00285191 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.318297 May 14 21:39:58.761312 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3051/5698] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:58 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:39:58.904432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5d36673f-d05b-4f07-9347-c27364b6b618 req-e7a7b684-de00-4710-98da-f43da2cd016a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba93e685-7b76-46c5-bf4d-7908df93d552", "tag": "81aeb6ab-b3fc-4683-8fbe-eb965dd78e87"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:39:58.924058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5d36673f-d05b-4f07-9347-c27364b6b618 req-e7a7b684-de00-4710-98da-f43da2cd016a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:58.924862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5d36673f-d05b-4f07-9347-c27364b6b618 req-e7a7b684-de00-4710-98da-f43da2cd016a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:58.942592 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5d36673f-d05b-4f07-9347-c27364b6b618 req-e7a7b684-de00-4710-98da-f43da2cd016a service nova] Creating event network-changed:81aeb6ab-b3fc-4683-8fbe-eb965dd78e87 for instance ba93e685-7b76-46c5-bf4d-7908df93d552 on nch2-master-1 May 14 21:39:58.956759 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5d36673f-d05b-4f07-9347-c27364b6b618 req-e7a7b684-de00-4710-98da-f43da2cd016a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055529 May 14 21:39:58.957675 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2648/5699] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:39:59.308453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:59.309288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:59.315577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:59.316032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:59.317040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:59.317487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:59.659251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:39:59.671643 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac9b2db2-5e10-46d7-becd-56fe8053dadf tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.367771 May 14 21:39:59.681175 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3052/5700] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:59 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:39:59.780262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:39:59.781001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:39:59.788792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:59.789268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:39:59.790230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:39:59.790688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:00.088105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:00.105463 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45c942fa-491b-4723-af54-11fdfaf99304 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.330957 May 14 21:40:00.108266 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2649/5701] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:39:59 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:00.690420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:00.691044 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:00.699679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:00.700139 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:00.700929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:00.701374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:00.852123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:00.861577 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-943772d1-6d02-4d9f-87ae-767766a69b34 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.175450 May 14 21:40:00.862636 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3053/5702] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:00 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:00.992308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-904aff92-160b-4c97-8e29-03afb1893807 req-103e3e72-0071-47ec-a93b-f4a524136833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ac6508-83b6-4cfe-b712-4017cec6484e", "tag": "54a7015c-7611-47b4-b979-2e2c14eb7ec7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:01.008065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-904aff92-160b-4c97-8e29-03afb1893807 req-103e3e72-0071-47ec-a93b-f4a524136833 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:01.009464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-904aff92-160b-4c97-8e29-03afb1893807 req-103e3e72-0071-47ec-a93b-f4a524136833 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:01.030790 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-904aff92-160b-4c97-8e29-03afb1893807 req-103e3e72-0071-47ec-a93b-f4a524136833 service nova] Creating event network-changed:54a7015c-7611-47b4-b979-2e2c14eb7ec7 for instance e2ac6508-83b6-4cfe-b712-4017cec6484e on nch2-master-1 May 14 21:40:01.043435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-904aff92-160b-4c97-8e29-03afb1893807 req-103e3e72-0071-47ec-a93b-f4a524136833 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056270 May 14 21:40:01.044138 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2650/5703] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:01.124268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:01.125119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:01.131524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:01.132060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:01.132918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:01.133585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:01.303705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:01.318445 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3a9749f7-92d8-4419-badc-60f0c1b97d72 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.198072 May 14 21:40:01.319782 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3054/5704] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:01 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:01.880532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:01.881381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:01.888826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:01.889445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:01.890276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:01.890733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:02.046508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:02.058679 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c22e24ba-86bf-4d6a-8dc7-7f59fad6ef41 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.179332 May 14 21:40:02.058679 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2651/5705] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:01 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:02.336182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:02.336962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:02.344522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:02.344977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:02.345743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:02.346182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:02.495618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:02.508360 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24164fc4-cfb8-41d1-ac8e-0f3b65eefe32 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.176038 May 14 21:40:02.508983 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3055/5706] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:02 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:40:03.074531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:03.075146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:03.081984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:03.082440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:03.083406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:03.084014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:03.366501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:03.374542 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-85208a3c-7835-4e1a-9ff7-c468d24620ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.304617 May 14 21:40:03.375273 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2652/5707] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:03 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:03.527083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:03.527771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:03.534539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:03.534988 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:03.535787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:03.536224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:03.674924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:03.682483 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-66e698bf-d846-4225-8718-3f860ef4b435 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.160313 May 14 21:40:03.691789 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3056/5708] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:03 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:04.391275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:04.393736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:04.399604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:04.400113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:04.401591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:04.402054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:04.621797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:04.629598 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6d2d3f6a-dc1b-4446-96e9-34205fd196c6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.242708 May 14 21:40:04.630506 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2653/5709] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:04 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:04.698373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:04.698994 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:04.706132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:04.706640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:04.707418 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:04.707884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:04.844198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:04.852404 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-359536db-b62f-498c-9eaa-ffd93a70751e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.157802 May 14 21:40:04.853361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3057/5710] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:04 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:05.646424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:05.647070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:05.655593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:05.656309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:05.657273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:05.657720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:05.713699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-89864439-99bf-4761-8b5b-649f2915a086 req-0671d2dc-de8a-4fbc-9cb1-0d9fdb2e8504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba93e685-7b76-46c5-bf4d-7908df93d552", "name": "network-vif-plugged", "status": "completed", "tag": "81aeb6ab-b3fc-4683-8fbe-eb965dd78e87"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:05.724128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-89864439-99bf-4761-8b5b-649f2915a086 req-0671d2dc-de8a-4fbc-9cb1-0d9fdb2e8504 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:05.724500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-89864439-99bf-4761-8b5b-649f2915a086 req-0671d2dc-de8a-4fbc-9cb1-0d9fdb2e8504 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:05.736004 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-89864439-99bf-4761-8b5b-649f2915a086 req-0671d2dc-de8a-4fbc-9cb1-0d9fdb2e8504 service nova] Creating event network-vif-plugged:81aeb6ab-b3fc-4683-8fbe-eb965dd78e87 for instance ba93e685-7b76-46c5-bf4d-7908df93d552 on nch2-master-1 May 14 21:40:05.742173 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-89864439-99bf-4761-8b5b-649f2915a086 req-0671d2dc-de8a-4fbc-9cb1-0d9fdb2e8504 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032301 May 14 21:40:05.743006 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3058/5711] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:40:05.870381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:05.871090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:05.888140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:05.888956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:05.890016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:05.892168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:05.911867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:05.913808 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e875ffdc-e100-4247-92f2-9b8f5ad8c1a8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.271003 May 14 21:40:05.926372 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2654/5712] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:05 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:06.088003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:06.096360 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4446bdd0-2c8a-4451-ab2c-0b636af10fb3 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.230686 May 14 21:40:06.096944 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3059/5713] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:05 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:40:06.934512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:06.935083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:06.942259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:06.942761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:06.943709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:06.944342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:07.120825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:07.120825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:07.128491 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:07.128944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:07.129929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:07.130368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:07.314293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:07.339849 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-220f74c2-0eac-4fa4-b7be-126e8d652e4e tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1327 microversion: 2.1 time: 0.219759 May 14 21:40:07.339849 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3060/5714] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:07 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1327 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:07.570723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:07.579622 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c9d1ed89-7be1-4910-896b-876c042bdcdb tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.651344 May 14 21:40:07.587464 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2655/5715] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:06 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:07.758545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-50bfe1aa-ec82-461b-93bf-a5c443c691d6 req-058ee52c-3d8a-48a7-b2ee-056ecd360a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac6508-83b6-4cfe-b712-4017cec6484e", "name": "network-vif-plugged", "status": "completed", "tag": "54a7015c-7611-47b4-b979-2e2c14eb7ec7"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:07.767353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-50bfe1aa-ec82-461b-93bf-a5c443c691d6 req-058ee52c-3d8a-48a7-b2ee-056ecd360a00 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:07.767856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-50bfe1aa-ec82-461b-93bf-a5c443c691d6 req-058ee52c-3d8a-48a7-b2ee-056ecd360a00 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:07.779988 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-50bfe1aa-ec82-461b-93bf-a5c443c691d6 req-058ee52c-3d8a-48a7-b2ee-056ecd360a00 service nova] Creating event network-vif-plugged:54a7015c-7611-47b4-b979-2e2c14eb7ec7 for instance e2ac6508-83b6-4cfe-b712-4017cec6484e on nch2-master-1 May 14 21:40:07.784883 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-50bfe1aa-ec82-461b-93bf-a5c443c691d6 req-058ee52c-3d8a-48a7-b2ee-056ecd360a00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030184 May 14 21:40:07.785495 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3061/5716] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:08.347359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:08.348013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:08.355814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:08.357772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:08.357772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:08.357772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:08.581205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:08.589437 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2afb3e9a-ce9b-4012-ac77-f3e4affb8224 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1526 microversion: 2.1 time: 0.246288 May 14 21:40:08.590483 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2656/5717] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:08 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1526 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:08.598844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:08.599593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:08.606822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:08.607285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:08.608273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:08.608725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:08.611677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:08.612333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:08.619601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:08.620535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:08.623553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:08.623553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:08.759209 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:08.768527 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e75311a-eb25-45f5-badf-7b794af28658 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1374 microversion: 2.1 time: 0.175512 May 14 21:40:08.772936 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3062/5718] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:08 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:08.826277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:08.834717 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb7c7b63-57c3-4750-bac3-2715447840bf tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1526 microversion: 2.1 time: 0.230801 May 14 21:40:08.835412 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2657/5719] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:08 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1526 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:09.037685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:09.038278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:09.046864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.047329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.051175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.051175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.064135 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] HTTP exception thrown: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Request method failure captured: May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 HTTP/1.1 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCGmU_NC6sBCE7Tg5ll9_8fcsEB8axe0nFaw68RcSLjRyJy9LKXTIuwzO0bzjQufzFH0WWBOWa7ewwKOzQhJuPOP_wnpk7hbCdWl_eo8faTruqqd6QFWbHfaPvU7wfS-YsiIiG6ezVZQIgaEjFGcWa57pbvmxHuVGVmS_8imsWdwBa4 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 61d01ae70a4f41fea28c0fcb35d9323f May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1592788863 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/61d01ae70a4f41fea28c0fcb35d9323f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/61d01ae70a4f41fea28c0fcb35d9323f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/61d01ae70a4f41fea28c0fcb35d9323f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_61d01ae70a4f41fea28c0fcb35d9323f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1592788863 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 61d01ae70a4f41fea28c0fcb35d9323f May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1592788863 May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1592788863-project May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ded1fd35ea4845e39ee1cbaba5afc7fa May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1592788863-project May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ba93e685-7b76-46c5-bf4d-7908df93d552'} May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:40:09.065830 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Returning 404 to user: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:40:09.069434 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d1d990b2-d1b6-4746-9f01-0b13a3344eda tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 404 len: 111 microversion: 2.1 time: 0.221279 May 14 21:40:09.075040 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3063/5720] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:40:08 2022] DELETE /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:40:09.085967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:09.086608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:09.094101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.095034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.095369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.095847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.255314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:09.258838 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c1d9b762-1e3b-4ce4-9e9e-c95e5dc2e4f9 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1526 microversion: 2.1 time: 0.182399 May 14 21:40:09.259418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2658/5721] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:09 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1526 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:09.277166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Action: 'update', calling method: >, body: {"server": {"name": "ba93e685-7b76-46c5-bf4d-7908df93d552_new"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:09.277932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:09.284715 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.285169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.285975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.286411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.308947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] HTTP exception thrown: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Request method failure captured: May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: request: PUT /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 HTTP/1.1 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 64 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCGmU_NC6sBCE7Tg5ll9_8fcsEB8axe0nFaw68RcSLjRyJy9LKXTIuwzO0bzjQufzFH0WWBOWa7ewwKOzQhJuPOP_wnpk7hbCdWl_eo8faTruqqd6QFWbHfaPvU7wfS-YsiIiG6ezVZQIgaEjFGcWa57pbvmxHuVGVmS_8imsWdwBa4 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 61d01ae70a4f41fea28c0fcb35d9323f May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1592788863 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/61d01ae70a4f41fea28c0fcb35d9323f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/61d01ae70a4f41fea28c0fcb35d9323f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/61d01ae70a4f41fea28c0fcb35d9323f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_61d01ae70a4f41fea28c0fcb35d9323f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1592788863 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 61d01ae70a4f41fea28c0fcb35d9323f May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1592788863 May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1592788863-project May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: ded1fd35ea4845e39ee1cbaba5afc7fa May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1592788863-project May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: {"server": {"name": "ba93e685-7b76-46c5-bf4d-7908df93d552_new"}} May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ba93e685-7b76-46c5-bf4d-7908df93d552', 'body': {'server': {'name': 'ba93e685-7b76-46c5-bf4d-7908df93d552_new'}}} May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 14 21:40:09.312333 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] Returning 404 to user: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2b248d66-01af-4fc0-9468-6274e28d2ac0 tempest-ServersNegativeTestMultiTenantJSON-1592788863 tempest-ServersNegativeTestMultiTenantJSON-1592788863-project] 10.222.0.52 "PUT /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 404 len: 111 microversion: 2.1 time: 0.042974 May 14 21:40:09.316878 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3064/5722] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 21:40:09 2022] PUT /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:40:09.325624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:09.326147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:09.337808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.338502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.339470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.340140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.371104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:40:09.790219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:09.790844 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:09.798388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.798843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.799655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.800099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.841886 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c93e9aa-bb4c-490b-99ee-8c23da50def1 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 204 len: 0 microversion: 2.1 time: 0.519393 May 14 21:40:09.843143 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2659/5723] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:40:09 2022] DELETE /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:40:09.855383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:09.856429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:09.863427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.863919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.864713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.865154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.946756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:09.954611 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43e6b9dc-dc8a-4090-9ee7-bd58744a7c77 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1546 microversion: 2.1 time: 0.168389 May 14 21:40:09.955191 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3065/5724] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:09 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:40:09.982085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:09.982703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:09.988617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.989076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:09.989886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:09.990335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:10.060685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:10.071218 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-84f42f74-186c-4c2b-b3a2-e78bfdb51473 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1532 microversion: 2.1 time: 0.221403 May 14 21:40:10.073936 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2660/5725] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:09 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1532 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:10.143796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:10.156630 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a01370d7-cd91-468f-8ba0-ad433bc2390c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1546 microversion: 2.1 time: 0.175428 May 14 21:40:10.156630 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3066/5726] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:09 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:40:11.095689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:11.096493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:11.112477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:11.113055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:11.113969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:11.114523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:11.396418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:11.412045 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-909322dc-df50-4235-9dc6-23243632233c tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1532 microversion: 2.1 time: 0.320403 May 14 21:40:11.422619 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2661/5727] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:11 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1532 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:12.293263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2ec961d5-3926-4844-9abb-903ed7a9a983 req-a71a06df-49cd-4bb8-b71d-ccd5c5dd6676 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba93e685-7b76-46c5-bf4d-7908df93d552", "name": "network-vif-deleted", "tag": "81aeb6ab-b3fc-4683-8fbe-eb965dd78e87"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:12.302793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2ec961d5-3926-4844-9abb-903ed7a9a983 req-a71a06df-49cd-4bb8-b71d-ccd5c5dd6676 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:12.303241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2ec961d5-3926-4844-9abb-903ed7a9a983 req-a71a06df-49cd-4bb8-b71d-ccd5c5dd6676 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:12.315982 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2ec961d5-3926-4844-9abb-903ed7a9a983 req-a71a06df-49cd-4bb8-b71d-ccd5c5dd6676 service nova] Creating event network-vif-deleted:81aeb6ab-b3fc-4683-8fbe-eb965dd78e87 for instance ba93e685-7b76-46c5-bf4d-7908df93d552 on nch2-master-1 May 14 21:40:12.327579 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2ec961d5-3926-4844-9abb-903ed7a9a983 req-a71a06df-49cd-4bb8-b71d-ccd5c5dd6676 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038764 May 14 21:40:12.328701 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3067/5728] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:12.433650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:12.435026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:12.458539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:12.459668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:12.460952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:12.461551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:12.558276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43b8ae7176574269b187ce6f4a3344ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '882c775cc8694e0aab28c39b98827f8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:12.567155 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-55758230-b5a6-4e89-9fcd-f6dcf5408199 tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 200 len: 1312 microversion: 2.1 time: 0.140426 May 14 21:40:12.568012 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2662/5729] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:12 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:13.585080 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:13.585793 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] [instance: ba93e685-7b76-46c5-bf4d-7908df93d552] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:13.594736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:13.595713 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:13.596651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:13.597241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:13.616028 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] HTTP exception thrown: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Request method failure captured: May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 HTTP/1.1 May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCGjHmi6pcqkr60SyVG2dDoXx4HCf_zVUNQrVyORzhlDPiCnQo0t2L_gopCSoiD0p1W_Zy0Ykj0g5v1j457GnTxwTncjU5HgrGnox2J8bVQp301nSiDXve-d32cwQs9yaiL7G-ZtwkBKftNd2r-rNyKu6_PgKWQ0UkSkxwFD9kWZN-I May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 882c775cc8694e0aab28c39b98827f8c May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1062823250 May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/882c775cc8694e0aab28c39b98827f8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/882c775cc8694e0aab28c39b98827f8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/882c775cc8694e0aab28c39b98827f8c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_882c775cc8694e0aab28c39b98827f8c", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1062823250 May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 882c775cc8694e0aab28c39b98827f8c May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1062823250 May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1062823250-project May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 43b8ae7176574269b187ce6f4a3344ac May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1062823250-project May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'ba93e685-7b76-46c5-bf4d-7908df93d552'} May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:13.617887 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. May 14 21:40:13.623470 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:13.626836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Returning 404 to user: Instance ba93e685-7b76-46c5-bf4d-7908df93d552 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:40:13.628264 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552" status: 404 len: 111 microversion: 2.1 time: 0.047691 May 14 21:40:13.632627 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3068/5730] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:13 2022] GET /compute/v2.1/servers/ba93e685-7b76-46c5-bf4d-7908df93d552 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:40:14.360423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-654315b9-cf31-451c-988c-d138cae373df req-f7557c75-d01d-451d-a852-49bd590db982 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ac6508-83b6-4cfe-b712-4017cec6484e", "tag": "54a7015c-7611-47b4-b979-2e2c14eb7ec7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:14.377780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-654315b9-cf31-451c-988c-d138cae373df req-f7557c75-d01d-451d-a852-49bd590db982 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:14.378253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-654315b9-cf31-451c-988c-d138cae373df req-f7557c75-d01d-451d-a852-49bd590db982 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:14.411156 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-654315b9-cf31-451c-988c-d138cae373df req-f7557c75-d01d-451d-a852-49bd590db982 service nova] Creating event network-changed:54a7015c-7611-47b4-b979-2e2c14eb7ec7 for instance e2ac6508-83b6-4cfe-b712-4017cec6484e on nch2-master-1 May 14 21:40:14.418315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-654315b9-cf31-451c-988c-d138cae373df req-f7557c75-d01d-451d-a852-49bd590db982 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289273 May 14 21:40:14.419609 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2663/5731] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:19.250895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:19.252252 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f8c78ee3-9077-495b-9a34-6ef90ba1724f tempest-ServersNegativeTestMultiTenantJSON-1062823250 tempest-ServersNegativeTestMultiTenantJSON-1062823250-project] 10.222.0.52 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001728 May 14 21:40:19.253183 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3069/5732] 10.222.0.52 () {56 vars in 885 bytes} [Sat May 14 21:40:19 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 14 21:40:24.812465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-daf35f82-1687-4659-aef4-c59a8e33e4f4 tempest-ComputeTenantNetworksTest-1661799535 tempest-ComputeTenantNetworksTest-1661799535-project] Calling method '.version_select at 0x7fb1a6fc3280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:25.031471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-daf35f82-1687-4659-aef4-c59a8e33e4f4 tempest-ComputeTenantNetworksTest-1661799535 tempest-ComputeTenantNetworksTest-1661799535-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.539855 May 14 21:40:25.032136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2664/5733] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 21:40:24 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:25.047245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-058d1ab7-817e-4fad-86f8-d449ab759eb6 tempest-ComputeTenantNetworksTest-1661799535 tempest-ComputeTenantNetworksTest-1661799535-project] Calling method '.version_select at 0x7fb1a70a49d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:25.175010 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-058d1ab7-817e-4fad-86f8-d449ab759eb6 tempest-ComputeTenantNetworksTest-1661799535 tempest-ComputeTenantNetworksTest-1661799535-project] 10.222.0.52 "GET /compute/v2.1/os-tenant-networks/3f17912d-bf0c-471d-ac34-ccb59094c19a" status: 200 len: 140 microversion: 2.1 time: 0.136749 May 14 21:40:25.175880 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3070/5734] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:40:25 2022] GET /compute/v2.1/os-tenant-networks/3f17912d-bf0c-471d-ac34-ccb59094c19a => generated 140 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:28.038775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-39ccddcb-297f-49d1-b679-9381469ce894 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Action: 'create', calling method: .version_select at 0x7fb1a7016310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-747665335", "metadata": {"Type": "work"}}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:28.885214 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-39ccddcb-297f-49d1-b679-9381469ce894 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.983637 May 14 21:40:28.885847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2665/5735] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:40:27 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 986 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 14 21:40:28.897935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b86097d7-d06a-43f9-99a0-8972283681f0 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a77c1280>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:28.955746 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b86097d7-d06a-43f9-99a0-8972283681f0 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.058914 May 14 21:40:28.955746 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3071/5736] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:28 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:29.973224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-30abbddc-a274-4356-a703-a1e93d11f2b3 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a6fc34c0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:30.014120 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-30abbddc-a274-4356-a703-a1e93d11f2b3 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.053523 May 14 21:40:30.014802 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2666/5737] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:29 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:31.030657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-11529443-4f71-4b89-8e0d-5c140ac21777 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a709c700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:31.088725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-11529443-4f71-4b89-8e0d-5c140ac21777 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 346 microversion: 2.1 time: 0.064363 May 14 21:40:31.089453 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3072/5738] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:31 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:31.101584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22083e0b-d6bc-4884-8734-29b14b0c9b88 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a6c6a160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:31.155238 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22083e0b-d6bc-4884-8734-29b14b0c9b88 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 346 microversion: 2.1 time: 0.058332 May 14 21:40:31.155848 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2667/5739] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:31 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:31.169178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b019998-6fcd-43d8-ad1a-5b6164939820 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a719c820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:31.429000 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b019998-6fcd-43d8-ad1a-5b6164939820 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 202 len: 0 microversion: 2.1 time: 0.264408 May 14 21:40:31.429701 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3073/5740] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:40:31 2022] DELETE /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:40:31.438319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-436e4c12-a9bc-497e-9f9c-08b8469d92d3 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a6c7da60>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:31.487472 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-436e4c12-a9bc-497e-9f9c-08b8469d92d3 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.052906 May 14 21:40:31.488431 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2668/5741] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:31 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:32.501976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-934c39ea-d1eb-4def-8713-3e550a2fe6f7 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a781caf0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:32.550289 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-934c39ea-d1eb-4def-8713-3e550a2fe6f7 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.053441 May 14 21:40:32.550863 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3074/5742] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:32 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:33.564460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8ac1067-6e47-41bb-a5ed-f6ac6932716f tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a6be1ca0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:33.611085 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8ac1067-6e47-41bb-a5ed-f6ac6932716f tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.051823 May 14 21:40:33.611813 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2669/5743] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:33 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:34.625070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-70284c8d-34e6-4d24-a7b8-5477b6c0e426 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a71e6e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:34.672439 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-70284c8d-34e6-4d24-a7b8-5477b6c0e426 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.051957 May 14 21:40:34.673016 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3075/5744] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:34 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:40:34.717517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82d6d362-60ec-463a-9706-02e908fe90cd tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:34.719144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82d6d362-60ec-463a-9706-02e908fe90cd tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:34.725817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d6d362-60ec-463a-9706-02e908fe90cd tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:34.726282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d6d362-60ec-463a-9706-02e908fe90cd tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:34.727085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d6d362-60ec-463a-9706-02e908fe90cd tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:34.728663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82d6d362-60ec-463a-9706-02e908fe90cd tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:34.781176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82d6d362-60ec-463a-9706-02e908fe90cd tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e/action" status: 200 len: 24567 microversion: 2.1 time: 0.068512 May 14 21:40:34.787450 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2670/5745] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:40:34 2022] POST /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e/action => generated 24567 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:40:35.685747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5828eb1e-f072-46cf-8add-4bbabf016a1c tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a77d2670>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:35.734079 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5828eb1e-f072-46cf-8add-4bbabf016a1c tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.053098 May 14 21:40:35.737906 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3076/5746] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:35 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:36.748181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-32f1cd1e-545c-4b88-b0ab-45831ce1ed7e tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a6d80820>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:36.801244 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-32f1cd1e-545c-4b88-b0ab-45831ce1ed7e tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.058722 May 14 21:40:36.801973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2671/5747] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:36 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:37.819522 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-456fc3b8-a1af-491c-b38f-bf2b9dbce5aa tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1b41259d0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:37.867323 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-456fc3b8-a1af-491c-b38f-bf2b9dbce5aa tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.052587 May 14 21:40:37.868072 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3077/5748] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:37 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:38.880790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad2938cd-9922-4199-86e1-985d0dd4f550 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a6d80dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:38.951898 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad2938cd-9922-4199-86e1-985d0dd4f550 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.075982 May 14 21:40:38.952486 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2672/5749] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:38 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:39.964828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca937152-7a4e-4881-b5fa-b1e57f304a96 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a71861f0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:40.019729 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca937152-7a4e-4881-b5fa-b1e57f304a96 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.059268 May 14 21:40:40.020307 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3078/5750] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:39 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:41.033394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-257328f5-1430-467f-a78c-7f96f5f67773 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a6d50e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:41.236786 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-257328f5-1430-467f-a78c-7f96f5f67773 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 200 len: 345 microversion: 2.1 time: 0.206845 May 14 21:40:41.237675 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2673/5751] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:41 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 345 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:42.250854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a75c9e52-bdb7-495e-aa29-a75dd6a3ac85 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Calling method '.version_select at 0x7fb1a77ea430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:42.278957 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-a75c9e52-bdb7-495e-aa29-a75dd6a3ac85 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] HTTP exception thrown: Volume 73066e68-2746-4d0a-9bd5-037246d03f73 could not be found. May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a75c9e52-bdb7-495e-aa29-a75dd6a3ac85 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Request method failure captured: May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 HTTP/1.1 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCHLwi4EhKRdKw9ILHVuhFl4XzmfKnFM2v5ptPe7i7gqUBLaoibtUu_WcDnbw0nZLxirHoILs7YOHi_EWShbJk-O3tVGnxXd0bfae5UxuDhKLV0E9Cb4_Rpb3440-CIPmjY55407eCqEi6TQimyFfWrbMGalUE5tvhZbyOTWkhzmqzU May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: ea1927109a494e6a9c8edae7c8ea87cd May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesGetTestJSON-1485306589 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea1927109a494e6a9c8edae7c8ea87cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ea1927109a494e6a9c8edae7c8ea87cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ea1927109a494e6a9c8edae7c8ea87cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ea1927109a494e6a9c8edae7c8ea87cd", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesGetTestJSON-1485306589 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: ea1927109a494e6a9c8edae7c8ea87cd May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesGetTestJSON-1485306589 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesGetTestJSON-1485306589-project May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 49d724c1b2454a1c988e4c8b5d361b35 May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesGetTestJSON-1485306589-project May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: exception: Volume 73066e68-2746-4d0a-9bd5-037246d03f73 could not be found. May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '73066e68-2746-4d0a-9bd5-037246d03f73'} May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73066e68-2746-4d0a-9bd5-037246d03f73 could not be found. (HTTP 404) (Request-ID: req-8df13aec-d160-4ff6-bdee-257551886543) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:40:42.280948 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73066e68-2746-4d0a-9bd5-037246d03f73 could not be found. May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73066e68-2746-4d0a-9bd5-037246d03f73 could not be found. May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73066e68-2746-4d0a-9bd5-037246d03f73 could not be found. May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a75c9e52-bdb7-495e-aa29-a75dd6a3ac85 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] Returning 404 to user: Volume 73066e68-2746-4d0a-9bd5-037246d03f73 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a75c9e52-bdb7-495e-aa29-a75dd6a3ac85 tempest-VolumesGetTestJSON-1485306589 tempest-VolumesGetTestJSON-1485306589-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73" status: 404 len: 109 microversion: 2.1 time: 0.036418 May 14 21:40:42.286216 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3079/5752] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:42 2022] GET /compute/v2.1/os-volumes/73066e68-2746-4d0a-9bd5-037246d03f73 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:40:47.927979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96b679c2-7cf2-4880-b7f4-2fb7d6fb54f4 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a6bc0e50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:47.987794 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96b679c2-7cf2-4880-b7f4-2fb7d6fb54f4 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0081333d-662b-4fe5-9d3c-2827b4734492" status: 200 len: 343 microversion: 2.1 time: 0.059856 May 14 21:40:47.987794 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2674/5753] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:47 2022] GET /compute/v2.1/os-volumes/0081333d-662b-4fe5-9d3c-2827b4734492 => generated 343 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:49.225039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-052229c5-7c2b-497a-b4cd-7359a83e7086 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'create', calling method: .version_select at 0x7fb1a77eab80>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-643371256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMtbMDuwEeQ8T2Bjb3uaff5+4vh+MDbMqsdQYVLSv0kQjsUrr6X/VMSUPIb81+9bZukFfNUM1cX3WT2/9c77f+csB97ZbbZbllM6561wKiv6CbcRtkWAhJvEFjalIP4w=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:49.242258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-052229c5-7c2b-497a-b4cd-7359a83e7086 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:40:49.250034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-052229c5-7c2b-497a-b4cd-7359a83e7086 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for user cab5a299e003422286f01bd44fda92bc and project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:40:49.379796 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-052229c5-7c2b-497a-b4cd-7359a83e7086 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.161542 May 14 21:40:49.380411 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3080/5754] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:40:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:52.398652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-558052405", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "2e0a3baa-b7a2-4522-8690-27030780e277"}], "key_name": "tempest-TestNetworkBasicOps-643371256", "security_groups": [{"name": "tempest-secgroup-smoke-663736860"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:52.516086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] validate_networks() for [('2e0a3baa-b7a2-4522-8690-27030780e277', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:40:52.924476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:40:52.925383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:40:52.926235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:40:52.926960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:40:52.927732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:40:52.939377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:52.939893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:52.940691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:52.941141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:52.960845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:40:52.965833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for user cab5a299e003422286f01bd44fda92bc and project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:40:52.978985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:40:52.981581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:40:53.138548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00cb9e7d-267c-47d4-9fb6-71ead81607da tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.746539 May 14 21:40:53.144524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2675/5755] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:40:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:40:53.158881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04313607-d91e-41c9-9686-0163695a485f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:53.159238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04313607-d91e-41c9-9686-0163695a485f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:53.239857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04313607-d91e-41c9-9686-0163695a485f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:53.246803 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04313607-d91e-41c9-9686-0163695a485f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1247 microversion: 2.1 time: 0.101295 May 14 21:40:53.247450 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3081/5756] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:53 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1247 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:40:54.263629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:54.264256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:54.275170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:54.277695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:54.278702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:54.281143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:54.365130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:54.373424 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-815ac505-fc3c-4775-b1ce-c39aa1aacc16 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1251 microversion: 2.1 time: 0.113693 May 14 21:40:54.374299 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2676/5757] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:54 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1251 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:55.391147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:55.392470 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:55.402464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:55.402923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:55.403857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:55.404297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:55.522414 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:55.532046 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b8873de4-9f9a-4395-a61d-89a9dc877995 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1299 microversion: 2.1 time: 0.144826 May 14 21:40:55.532947 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3082/5758] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:55 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:40:56.551432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:56.552852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:56.564188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:56.565536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:56.566662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:56.567364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:56.770123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:56.779145 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01556170-e17e-4eaa-8b54-b5b02a50d01b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1372 microversion: 2.1 time: 0.233586 May 14 21:40:56.780030 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2677/5759] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:56 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1372 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:57.662618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e3d04fe3-2041-4027-83bf-91c78a572549 req-482b559a-8054-42a4-8988-204d37fcf010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a66aa525-111f-4c5d-9bb3-4ee4773fb850", "tag": "661b64f1-16e6-4e3f-b7bf-d18692c09a31"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:40:57.674624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e3d04fe3-2041-4027-83bf-91c78a572549 req-482b559a-8054-42a4-8988-204d37fcf010 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:57.675077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e3d04fe3-2041-4027-83bf-91c78a572549 req-482b559a-8054-42a4-8988-204d37fcf010 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:57.689163 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e3d04fe3-2041-4027-83bf-91c78a572549 req-482b559a-8054-42a4-8988-204d37fcf010 service nova] Creating event network-changed:661b64f1-16e6-4e3f-b7bf-d18692c09a31 for instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 on nch1-master-1 May 14 21:40:57.694224 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e3d04fe3-2041-4027-83bf-91c78a572549 req-482b559a-8054-42a4-8988-204d37fcf010 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035320 May 14 21:40:57.695931 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3083/5760] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:57.805065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:57.805992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:57.812973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:57.813442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:57.814246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:57.814700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:58.072409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:58.095172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b47db978-b67b-4235-b7ad-877671eeb65f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1372 microversion: 2.1 time: 0.301574 May 14 21:40:58.105652 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2678/5761] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:57 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1372 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:40:58.185268 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02f3a20d-ac31-4f4f-bd0d-ad981937a00a tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a719cf70>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:58.255454 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02f3a20d-ac31-4f4f-bd0d-ad981937a00a tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/a49a968d-ae9a-42e3-9f36-1a7388b3a57a" status: 200 len: 344 microversion: 2.1 time: 0.074406 May 14 21:40:58.256120 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3084/5762] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:40:58 2022] GET /compute/v2.1/os-volumes/a49a968d-ae9a-42e3-9f36-1a7388b3a57a => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:40:59.115509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:40:59.116151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:40:59.123939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:59.125293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:59.126330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:40:59.127569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:40:59.276325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:40:59.284011 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6e7ce11f-514d-470b-886f-ad6f802e35ec tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1372 microversion: 2.1 time: 0.172750 May 14 21:40:59.284596 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2679/5763] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:40:59 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1372 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:00.302747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:00.304215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:00.312586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:00.313317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:00.314258 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:00.314857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:00.487265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:00.500325 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37b70c4d-1521-4e83-b13c-4a9d1c050fe2 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1372 microversion: 2.1 time: 0.202162 May 14 21:41:00.501438 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3085/5764] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:00 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:01.133666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8fafb02-8de7-44b6-8a60-553b274270ec tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a75f5700>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:01.185420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8fafb02-8de7-44b6-8a60-553b274270ec tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/1f8e3a83-ebb1-4ff9-a436-767fd40be90c" status: 200 len: 344 microversion: 2.1 time: 0.056249 May 14 21:41:01.186067 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2680/5765] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/os-volumes/1f8e3a83-ebb1-4ff9-a436-767fd40be90c => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:01.200458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aa5014de-d752-4767-b6fc-3cfcd0f6c37c tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a719caf0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:01.359802 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aa5014de-d752-4767-b6fc-3cfcd0f6c37c tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.162979 May 14 21:41:01.360591 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3086/5766] 10.222.0.52 () {58 vars in 1133 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:01.377124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45d2d13c-d66c-4477-9223-7b0b94048c2b tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a7924d30>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:01.488911 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45d2d13c-d66c-4477-9223-7b0b94048c2b tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.117033 May 14 21:41:01.489630 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2681/5767] 10.222.0.52 () {58 vars in 1148 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 681 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:01.503274 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-95cb1c18-f2d2-4300-8fcf-1194b2a23ada tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a77e3430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:01.518646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:01.519755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:01.528793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:01.528793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:01.529658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:01.530462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:01.602738 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-95cb1c18-f2d2-4300-8fcf-1194b2a23ada tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.104635 May 14 21:41:01.610948 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3087/5768] 10.222.0.52 () {58 vars in 1133 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:01.617471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-19ee9369-ad3c-403d-8fca-b2bb3c52c36a tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a71b3b80>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:01.757155 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-19ee9369-ad3c-403d-8fca-b2bb3c52c36a tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.144721 May 14 21:41:01.758309 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3088/5769] 10.222.0.52 () {58 vars in 1166 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:01.769683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-64f1bfa3-a247-4f01-ac4d-4159cde9b361 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a719ca60>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:01.804506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:01.816991 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1447d9d9-20ab-40ce-af85-6cdb814dabc7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1372 microversion: 2.1 time: 0.303298 May 14 21:41:01.819648 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2682/5770] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:01.910161 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-64f1bfa3-a247-4f01-ac4d-4159cde9b361 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.144074 May 14 21:41:01.910740 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3089/5771] 10.222.0.52 () {58 vars in 1169 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 681 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:01.934709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-443e8cce-c756-489d-9d09-37865802bc1b tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1b9807940>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:02.026891 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-443e8cce-c756-489d-9d09-37865802bc1b tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.103267 May 14 21:41:02.027500 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2683/5772] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:41:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:02.042947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-046332e9-134a-4d75-9ccb-a6fedf58b449 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1b4125820>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:02.075117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-77b57365-da05-4e11-8a3c-d27d4ba03a38 req-a12df59a-1d2d-4c0e-af4a-4b063cd322b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66aa525-111f-4c5d-9bb3-4ee4773fb850", "name": "network-vif-plugged", "status": "completed", "tag": "661b64f1-16e6-4e3f-b7bf-d18692c09a31"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:02.095102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-77b57365-da05-4e11-8a3c-d27d4ba03a38 req-a12df59a-1d2d-4c0e-af4a-4b063cd322b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:02.095604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-77b57365-da05-4e11-8a3c-d27d4ba03a38 req-a12df59a-1d2d-4c0e-af4a-4b063cd322b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:02.118192 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-77b57365-da05-4e11-8a3c-d27d4ba03a38 req-a12df59a-1d2d-4c0e-af4a-4b063cd322b7 service nova] Creating event network-vif-plugged:661b64f1-16e6-4e3f-b7bf-d18692c09a31 for instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 on nch1-master-1 May 14 21:41:02.125034 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-77b57365-da05-4e11-8a3c-d27d4ba03a38 req-a12df59a-1d2d-4c0e-af4a-4b063cd322b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055356 May 14 21:41:02.130875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2684/5773] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:41:02.174759 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-046332e9-134a-4d75-9ccb-a6fedf58b449 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.139915 May 14 21:41:02.182259 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3090/5774] 10.222.0.52 () {58 vars in 1187 bytes} [Sat May 14 21:41:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:02.192763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ce0f93e-0e70-41e6-a37a-0bd9492708c0 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] Calling method '.version_select at 0x7fb1a6cb2dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:02.381948 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ce0f93e-0e70-41e6-a37a-0bd9492708c0 tempest-VolumesTestJSON-1883546231 tempest-VolumesTestJSON-1883546231-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.196871 May 14 21:41:02.383730 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2685/5775] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:41:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:02.854385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:02.856285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:02.864788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:02.865979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:02.867755 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:02.868363 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:03.440329 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:03.448374 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-40181282-6c42-4501-b7f8-94c1f8c7085a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1372 microversion: 2.1 time: 0.615047 May 14 21:41:03.449174 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3091/5776] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:02 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1372 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:04.467056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:04.467836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:04.474861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:04.475326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:04.476166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:04.476749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:04.691603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:04.699235 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ee6a697-4b9d-4abf-bd92-2f826ecea932 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1544 microversion: 2.1 time: 0.237237 May 14 21:41:04.699852 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2686/5777] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:04 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1544 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:04.717720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:04.717720 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:04.722830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:04.723280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:04.724090 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:04.724533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:04.868665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:04.878095 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0a3994da-6d00-4772-ad0d-d6e8ad48b88b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1544 microversion: 2.1 time: 0.166328 May 14 21:41:04.881211 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3092/5778] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:04 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1544 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:05.396366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-170483229", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:05.472572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:41:05.925114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:41:05.930178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:41:05.930178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:41:05.930178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:41:05.930178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:41:05.950850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:05.958062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:05.958062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:05.958062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:05.979863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Getting quotas for project 5f29dab7e48a4a9bba08ffffacbe5c8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:41:05.988868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Getting quotas for user b61e5fd331864e21b5c6aa52dde37bec and project 5f29dab7e48a4a9bba08ffffacbe5c8a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:41:06.007443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:41:06.011925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:41:06.170888 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f70e2746-af35-45c8-b6e8-b0056b4b83aa tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779311 May 14 21:41:06.171940 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2687/5779] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:41:06.183137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-455b5257-372f-4656-8430-438838cebc57 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:06.185661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-455b5257-372f-4656-8430-438838cebc57 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:06.238882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-455b5257-372f-4656-8430-438838cebc57 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:06.246490 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-455b5257-372f-4656-8430-438838cebc57 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1214 microversion: 2.1 time: 0.068515 May 14 21:41:06.247073 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3093/5780] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:06 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:07.265432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e7498d0-ae1a-46b4-9f06-feb4cfa6934e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:07.267806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5e7498d0-ae1a-46b4-9f06-feb4cfa6934e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:07.348506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5e7498d0-ae1a-46b4-9f06-feb4cfa6934e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:07.355689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e7498d0-ae1a-46b4-9f06-feb4cfa6934e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1214 microversion: 2.1 time: 0.095107 May 14 21:41:07.356472 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2688/5781] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:07 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:08.373779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:08.375075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:08.383996 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:08.384618 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:08.385437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:08.386060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:08.473694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:08.482129 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c3f49e02-03ad-4cf7-952f-205129548600 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1266 microversion: 2.1 time: 0.112352 May 14 21:41:08.483310 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3094/5782] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:08 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:09.505735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:09.506453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:09.515371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:09.516003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:09.516808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:09.517321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:09.608881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:09.631929 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb541608-1ba6-407d-b243-68078175937f tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1272 microversion: 2.1 time: 0.129023 May 14 21:41:09.650680 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2689/5783] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:09 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:10.671882 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:10.672349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:10.703190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:10.704406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:10.706651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:10.708230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:11.047697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:11.062068 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a5f22a9a-9ae2-43c3-9651-54c436ec3a18 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.392929 May 14 21:41:11.076089 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3095/5784] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:10 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:12.081606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:12.082241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:12.090186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:12.090649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:12.091435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:12.092344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:12.386433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:12.393889 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f68f38fe-0330-4baf-a672-cec6a08ee687 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.316321 May 14 21:41:12.394473 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2690/5785] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:12 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:12.517057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-19940613-2469-4d7c-9c08-132052e92a9e req-5eedbc5c-9604-4286-98d0-3263ae79d3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e18016-b382-4548-91fa-1595ec29eef6", "tag": "7b2374e2-8c32-4760-b6d5-397a0092bac6"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:12.529548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-19940613-2469-4d7c-9c08-132052e92a9e req-5eedbc5c-9604-4286-98d0-3263ae79d3a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:12.530059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-19940613-2469-4d7c-9c08-132052e92a9e req-5eedbc5c-9604-4286-98d0-3263ae79d3a4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:12.547686 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-19940613-2469-4d7c-9c08-132052e92a9e req-5eedbc5c-9604-4286-98d0-3263ae79d3a4 service nova] Creating event network-changed:7b2374e2-8c32-4760-b6d5-397a0092bac6 for instance 18e18016-b382-4548-91fa-1595ec29eef6 on nch2-master-1 May 14 21:41:12.552799 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-19940613-2469-4d7c-9c08-132052e92a9e req-5eedbc5c-9604-4286-98d0-3263ae79d3a4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041196 May 14 21:41:12.553364 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3096/5786] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:41:13.412151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:13.412780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:13.420098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:13.420556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:13.421349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:13.421869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:13.679242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:13.687734 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ae5ece1-a2d4-4951-ad3f-93a9942ac7fd tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.279575 May 14 21:41:13.690597 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2691/5787] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:13 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:14.706825 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:14.707455 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:14.715065 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:14.715543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:14.716333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:14.716779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:14.880323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:14.888807 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3d06046e-656d-4843-97dc-4f55ced25d74 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.187236 May 14 21:41:14.899121 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3097/5788] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:14 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:15.907558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:15.908228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:15.915015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:15.915495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:15.916355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:15.916824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:16.063799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:16.072348 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-519d4ff0-b757-46f3-97b7-73162abcc442 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.169946 May 14 21:41:16.073039 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2692/5789] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:15 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:17.089388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:17.090077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:17.096935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:17.097399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:17.098181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:17.098626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:17.238102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:17.248197 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0cf2168f-050a-4dbb-89a0-9e1bbc6bca4b tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.163252 May 14 21:41:17.248787 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3098/5790] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:17 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:18.265192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:18.265828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:18.273076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:18.273772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:18.277005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:18.277005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:18.414038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:18.422427 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de84783d-ad47-48d8-bb66-19082d6e458c tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.161170 May 14 21:41:18.423008 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2693/5791] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:18 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:19.438805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:19.439747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:19.447269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:19.447756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:19.448539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:19.448981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:19.595558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:19.615855 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dda2b19b-8848-4f81-a09a-ed6d591c9b76 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.180866 May 14 21:41:19.623408 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3099/5792] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:19 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:19.722284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a265803b-4754-4a71-bb3e-0b6dbb41efde req-362dd6b3-8a2b-4e65-9b77-3a2695a7427d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e18016-b382-4548-91fa-1595ec29eef6", "name": "network-vif-plugged", "status": "completed", "tag": "7b2374e2-8c32-4760-b6d5-397a0092bac6"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:19.733295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a265803b-4754-4a71-bb3e-0b6dbb41efde req-362dd6b3-8a2b-4e65-9b77-3a2695a7427d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:19.733875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a265803b-4754-4a71-bb3e-0b6dbb41efde req-362dd6b3-8a2b-4e65-9b77-3a2695a7427d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:19.745807 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a265803b-4754-4a71-bb3e-0b6dbb41efde req-362dd6b3-8a2b-4e65-9b77-3a2695a7427d service nova] Creating event network-vif-plugged:7b2374e2-8c32-4760-b6d5-397a0092bac6 for instance 18e18016-b382-4548-91fa-1595ec29eef6 on nch2-master-1 May 14 21:41:19.751462 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a265803b-4754-4a71-bb3e-0b6dbb41efde req-362dd6b3-8a2b-4e65-9b77-3a2695a7427d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034884 May 14 21:41:19.752175 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2694/5793] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:20.638223 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:20.638836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:20.645716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:20.646422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:20.647181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:20.647712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:20.786248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:20.795402 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ea741ffb-a86c-4899-9557-3b827cd42c61 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1314 microversion: 2.1 time: 0.162049 May 14 21:41:20.796219 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3100/5794] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:20 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:21.815507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:21.816227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:21.822945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:21.823412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:21.824234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:21.824686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:21.964895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:21.972961 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54d32f25-bb04-40e0-8e76-e51456070374 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1464 microversion: 2.1 time: 0.161961 May 14 21:41:21.973631 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2695/5795] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:21 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1464 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:22.013166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:22.013648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:22.020474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:22.021196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:22.022025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:22.022452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:22.048060 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:41:22.300651 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24752e4c-ac89-43b3-956f-c31f0599c3a0 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "DELETE /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 204 len: 0 microversion: 2.1 time: 0.291116 May 14 21:41:22.301285 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3101/5796] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:41:22 2022] DELETE /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:41:22.309684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:22.310311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:22.316652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:22.317116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:22.317920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:22.318373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:22.466572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:22.474131 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8dc29ad2-1da1-4c23-beb5-6d2694014b01 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1470 microversion: 2.1 time: 0.168357 May 14 21:41:22.474710 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2696/5797] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:22 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:23.502291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:23.510648 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:23.518288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:23.518980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:23.520245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:23.521943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:23.821736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:23.832425 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-001747d0-67a0-4db8-908a-079cf6e00d4e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1470 microversion: 2.1 time: 0.342958 May 14 21:41:23.842808 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3102/5798] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:23 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:24.338195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0934e8a7-e374-4331-8d91-f7fc4681b5ff req-c791faf0-d0f1-4101-8ddd-2e2945fd6447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e18016-b382-4548-91fa-1595ec29eef6", "name": "network-vif-deleted", "tag": "7b2374e2-8c32-4760-b6d5-397a0092bac6"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:24.351150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0934e8a7-e374-4331-8d91-f7fc4681b5ff req-c791faf0-d0f1-4101-8ddd-2e2945fd6447 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:24.351852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0934e8a7-e374-4331-8d91-f7fc4681b5ff req-c791faf0-d0f1-4101-8ddd-2e2945fd6447 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:24.372890 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0934e8a7-e374-4331-8d91-f7fc4681b5ff req-c791faf0-d0f1-4101-8ddd-2e2945fd6447 service nova] Creating event network-vif-deleted:7b2374e2-8c32-4760-b6d5-397a0092bac6 for instance 18e18016-b382-4548-91fa-1595ec29eef6 on nch2-master-1 May 14 21:41:24.388999 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0934e8a7-e374-4331-8d91-f7fc4681b5ff req-c791faf0-d0f1-4101-8ddd-2e2945fd6447 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056815 May 14 21:41:24.391645 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2697/5799] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:41:24.850986 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:24.851814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:24.861680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:24.862323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:24.863200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:24.863670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:24.905127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:24.905416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:24.906086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lazy-loading 'fault' on Instance uuid 18e18016-b382-4548-91fa-1595ec29eef6 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:41:24.954590 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b61e5fd331864e21b5c6aa52dde37bec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f29dab7e48a4a9bba08ffffacbe5c8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:24.970654 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6424bda4-e00b-49e5-a1c7-dbf42cba2e1e tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 200 len: 1304 microversion: 2.1 time: 0.124418 May 14 21:41:24.971256 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3103/5800] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:24 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:25.993332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:25.993332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] [instance: 18e18016-b382-4548-91fa-1595ec29eef6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:26.000237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:26.000841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:26.001757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:26.004719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:26.029599 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] HTTP exception thrown: Instance 18e18016-b382-4548-91fa-1595ec29eef6 could not be found. May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Request method failure captured: May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 HTTP/1.1 May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCHtsmBSftFBP-v1vTSwsDsf0hhjbGHjn3RLHSK_NWl2uU-ebS3QUkJ3bPayVz_UqwphXMgTKQJvlEcU21aU7E4DW5rdcdwggs7DURwmoPaYpF8YhZ3p0O5k5V2ZN4xlI6g_TQ0Yzpce3Df9Ee9dlWK8HdUAQ18qREh3szss19KWBDQ May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5f29dab7e48a4a9bba08ffffacbe5c8a May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-VolumesNegativeTest-342437217 May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f29dab7e48a4a9bba08ffffacbe5c8a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5f29dab7e48a4a9bba08ffffacbe5c8a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5f29dab7e48a4a9bba08ffffacbe5c8a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5f29dab7e48a4a9bba08ffffacbe5c8a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-VolumesNegativeTest-342437217 May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5f29dab7e48a4a9bba08ffffacbe5c8a May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-VolumesNegativeTest-342437217 May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-VolumesNegativeTest-342437217-project May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b61e5fd331864e21b5c6aa52dde37bec May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-VolumesNegativeTest-342437217-project May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 18e18016-b382-4548-91fa-1595ec29eef6 could not be found. May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '18e18016-b382-4548-91fa-1595ec29eef6'} May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e18016-b382-4548-91fa-1595ec29eef6 could not be found. May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e18016-b382-4548-91fa-1595ec29eef6 could not be found. May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:26.031840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:26.037480 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:26.037480 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:26.037480 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:26.037480 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:41:26.037480 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:41:26.037480 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e18016-b382-4548-91fa-1595ec29eef6 could not be found. May 14 21:41:26.037480 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:26.041156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] Returning 404 to user: Instance 18e18016-b382-4548-91fa-1595ec29eef6 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:26.042347 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d7e9a6ff-498f-4960-ab26-8eaa8c0407f6 tempest-VolumesNegativeTest-342437217 tempest-VolumesNegativeTest-342437217-project] 10.222.0.52 "GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6" status: 404 len: 111 microversion: 2.1 time: 0.057792 May 14 21:41:26.051845 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2698/5801] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:25 2022] GET /compute/v2.1/servers/18e18016-b382-4548-91fa-1595ec29eef6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:41:30.505135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:30.505508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:30.513158 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:30.514609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:30.514609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:30.515415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:30.558744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:41:30.931119 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-46cb4822-fef0-4c26-b1f1-7b0dcb0f05ee tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 204 len: 0 microversion: 2.1 time: 0.430808 May 14 21:41:30.932388 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3104/5802] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:41:30 2022] DELETE /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:41:30.941559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:30.942974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:30.954636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:30.964729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:30.966063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:30.966736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:31.384044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:31.401635 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd503a51-b063-4fee-97a6-b591e65c2533 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1550 microversion: 2.1 time: 0.464467 May 14 21:41:31.402533 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2699/5803] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:30 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1550 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:31.579412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1896438355", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a0d6c244-ba10-44a1-b532-1388d1aab436"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:31.662574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] validate_networks() for [('a0d6c244-ba10-44a1-b532-1388d1aab436', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:41:31.765686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6b83475-1294-430a-b547-36d0071bba16 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Action: 'create', calling method: .version_select at 0x7fb1a7774160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1051503558", "metadata": {"Type": "work"}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6b83475-1294-430a-b547-36d0071bba16 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Request method failure captured: May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 122 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCILspRWnMcB4pKKudur1kaBQHPrqZh-KA19aC0yExVZikKiQDCsEjEC5Br2CKsyK3QBpVC8MEFNJ_7l_VX9fh1HnDyvn3M7BA93pdNkH6ipdPLmsGASpISCphBdKYQ3UPsc5LORxbShh16IsDZyEdLNEVhSD7gVyJENRZOn40TiFuo May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89652ca7af0b40a7bea9c596343a0a2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 817c75d1fa3243b2af48f6926f347867 May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1051503558", "metadata": {"Type": "work"}}} May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1051503558', 'metadata': {'Type': 'work'}}}} May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['volume']: May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi '#$%' May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:41:31.770855 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 14 21:41:31.775239 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.778514 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6b83475-1294-430a-b547-36d0071bba16 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:31.779641 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6b83475-1294-430a-b547-36d0071bba16 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.284297 May 14 21:41:31.780755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3105/5804] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:41:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:41:31.791854 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3423134a-d242-4faf-afe5-62a355774219 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Action: 'create', calling method: .version_select at 0x7fb1a781cdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-189901730", "metadata": {"Type": "work"}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3423134a-d242-4faf-afe5-62a355774219 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Request method failure captured: May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 119 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCILspRWnMcB4pKKudur1kaBQHPrqZh-KA19aC0yExVZikKiQDCsEjEC5Br2CKsyK3QBpVC8MEFNJ_7l_VX9fh1HnDyvn3M7BA93pdNkH6ipdPLmsGASpISCphBdKYQ3UPsc5LORxbShh16IsDZyEdLNEVhSD7gVyJENRZOn40TiFuo May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89652ca7af0b40a7bea9c596343a0a2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 817c75d1fa3243b2af48f6926f347867 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-189901730", "metadata": {"Type": "work"}}} May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-189901730', 'metadata': {'Type': 'work'}}}} May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['volume']: May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi '0' May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:41:31.800726 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.806317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3423134a-d242-4faf-afe5-62a355774219 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:31.808311 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3423134a-d242-4faf-afe5-62a355774219 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021809 May 14 21:41:31.813079 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3106/5805] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:41:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 21:41:31.819460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3270197c-ea98-4baf-9c2f-000d3debdb2d tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Action: 'create', calling method: .version_select at 0x7fb1a794d040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1286665483", "metadata": {"Type": "work"}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3270197c-ea98-4baf-9c2f-000d3debdb2d tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Request method failure captured: May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 119 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCILspRWnMcB4pKKudur1kaBQHPrqZh-KA19aC0yExVZikKiQDCsEjEC5Br2CKsyK3QBpVC8MEFNJ_7l_VX9fh1HnDyvn3M7BA93pdNkH6ipdPLmsGASpISCphBdKYQ3UPsc5LORxbShh16IsDZyEdLNEVhSD7gVyJENRZOn40TiFuo May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89652ca7af0b40a7bea9c596343a0a2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 817c75d1fa3243b2af48f6926f347867 May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1286665483", "metadata": {"Type": "work"}}} May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1286665483', 'metadata': {'Type': 'work'}}}} May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise error May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi On instance['volume']: May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi '' May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 21:41:31.823213 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3270197c-ea98-4baf-9c2f-000d3debdb2d tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3270197c-ea98-4baf-9c2f-000d3debdb2d tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009221 May 14 21:41:31.840439 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3107/5806] 10.222.0.52 () {60 vars in 1155 bytes} [Sat May 14 21:41:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 14 21:41:31.844915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-519f419b-1611-423f-b897-f2f2d307cc4f tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Calling method '.version_select at 0x7fb1a77ea040>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:31.879873 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-519f419b-1611-423f-b897-f2f2d307cc4f tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] HTTP exception thrown: Volume tempest-invalid-1301044203 could not be found. May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-519f419b-1611-423f-b897-f2f2d307cc4f tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Request method failure captured: May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1301044203 HTTP/1.1 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCILspRWnMcB4pKKudur1kaBQHPrqZh-KA19aC0yExVZikKiQDCsEjEC5Br2CKsyK3QBpVC8MEFNJ_7l_VX9fh1HnDyvn3M7BA93pdNkH6ipdPLmsGASpISCphBdKYQ3UPsc5LORxbShh16IsDZyEdLNEVhSD7gVyJENRZOn40TiFuo May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89652ca7af0b40a7bea9c596343a0a2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 817c75d1fa3243b2af48f6926f347867 May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: exception: Volume tempest-invalid-1301044203 could not be found. May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'tempest-invalid-1301044203'} May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1301044203 could not be found. (HTTP 404) (Request-ID: req-d8a82502-f830-4f77-b969-21a77347ebb0) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:41:31.881871 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1301044203 could not be found. May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1301044203 could not be found. May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1301044203 could not be found. May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.886471 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-519f419b-1611-423f-b897-f2f2d307cc4f tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Returning 404 to user: Volume tempest-invalid-1301044203 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:31.889063 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-519f419b-1611-423f-b897-f2f2d307cc4f tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1301044203" status: 404 len: 99 microversion: 2.1 time: 0.042214 May 14 21:41:31.889063 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3108/5807] 10.222.0.52 () {58 vars in 1217 bytes} [Sat May 14 21:41:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1301044203 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 14 21:41:31.903184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dff03f2a-53d5-4c32-a3ec-653969b74efb tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010707 May 14 21:41:31.903792 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3109/5808] 10.222.0.52 () {58 vars in 1139 bytes} [Sat May 14 21:41:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 14 21:41:31.920410 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bd26b889-d856-47b4-bd2b-3d3fab6c28e8 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008501 May 14 21:41:31.921250 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3110/5809] 10.222.0.52 () {58 vars in 1136 bytes} [Sat May 14 21:41:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 14 21:41:31.942123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e6b3ff6-fddb-4d0e-8f8a-844705e10775 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Calling method '.version_select at 0x7fb1a71fc430>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:31.986630 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-2e6b3ff6-fddb-4d0e-8f8a-844705e10775 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] HTTP exception thrown: Volume 68af1683-7ff2-4f34-9c47-7eeb75b795c3 could not be found. May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e6b3ff6-fddb-4d0e-8f8a-844705e10775 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Request method failure captured: May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: request: DELETE /compute/v2.1/os-volumes/68af1683-7ff2-4f34-9c47-7eeb75b795c3 HTTP/1.1 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCILspRWnMcB4pKKudur1kaBQHPrqZh-KA19aC0yExVZikKiQDCsEjEC5Br2CKsyK3QBpVC8MEFNJ_7l_VX9fh1HnDyvn3M7BA93pdNkH6ipdPLmsGASpISCphBdKYQ3UPsc5LORxbShh16IsDZyEdLNEVhSD7gVyJENRZOn40TiFuo May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89652ca7af0b40a7bea9c596343a0a2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 817c75d1fa3243b2af48f6926f347867 May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesNegativeTest-18454733-project May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: exception: Volume 68af1683-7ff2-4f34-9c47-7eeb75b795c3 could not be found. May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '68af1683-7ff2-4f34-9c47-7eeb75b795c3'} May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68af1683-7ff2-4f34-9c47-7eeb75b795c3 could not be found. (HTTP 404) (Request-ID: req-e67111dc-ac1a-440a-8fc0-3bbadd50530a) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:41:31.988807 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68af1683-7ff2-4f34-9c47-7eeb75b795c3 could not be found. May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68af1683-7ff2-4f34-9c47-7eeb75b795c3 could not be found. May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68af1683-7ff2-4f34-9c47-7eeb75b795c3 could not be found. May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e6b3ff6-fddb-4d0e-8f8a-844705e10775 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Returning 404 to user: Volume 68af1683-7ff2-4f34-9c47-7eeb75b795c3 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e6b3ff6-fddb-4d0e-8f8a-844705e10775 tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/68af1683-7ff2-4f34-9c47-7eeb75b795c3" status: 404 len: 109 microversion: 2.1 time: 0.063661 May 14 21:41:31.992809 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3111/5810] 10.222.0.52 () {58 vars in 1247 bytes} [Sat May 14 21:41:31 2022] DELETE /compute/v2.1/os-volumes/68af1683-7ff2-4f34-9c47-7eeb75b795c3 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:41:32.005942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e957d3b4-9f80-4993-b977-1e44b177cafc tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Calling method '.version_select at 0x7fb1b97a78b0>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:32.052190 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-e957d3b4-9f80-4993-b977-1e44b177cafc tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] HTTP exception thrown: Volume 0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 could not be found. May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e957d3b4-9f80-4993-b977-1e44b177cafc tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Request method failure captured: May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/os-volumes/0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 HTTP/1.1 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCILspRWnMcB4pKKudur1kaBQHPrqZh-KA19aC0yExVZikKiQDCsEjEC5Br2CKsyK3QBpVC8MEFNJ_7l_VX9fh1HnDyvn3M7BA93pdNkH6ipdPLmsGASpISCphBdKYQ3UPsc5LORxbShh16IsDZyEdLNEVhSD7gVyJENRZOn40TiFuo May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89652ca7af0b40a7bea9c596343a0a2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89652ca7af0b40a7bea9c596343a0a2e", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesNegativeTest-18454733 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 89652ca7af0b40a7bea9c596343a0a2e May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesNegativeTest-18454733 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesNegativeTest-18454733-project May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 817c75d1fa3243b2af48f6926f347867 May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesNegativeTest-18454733-project May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: method: May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: exception: Volume 0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 could not be found. May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '0cfeed02-13d6-4e1e-83c7-256e1ccdcde5'} May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 could not be found. (HTTP 404) (Request-ID: req-1dee0277-8bb0-4187-81e7-295468ff9e1b) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 14 21:41:32.054910 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi item = cinderclient( May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 could not be found. May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 could not be found. May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 could not be found. May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e957d3b4-9f80-4993-b977-1e44b177cafc tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] Returning 404 to user: Volume 0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e957d3b4-9f80-4993-b977-1e44b177cafc tempest-VolumesNegativeTest-18454733 tempest-VolumesNegativeTest-18454733-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/0cfeed02-13d6-4e1e-83c7-256e1ccdcde5" status: 404 len: 109 microversion: 2.1 time: 0.057587 May 14 21:41:32.066940 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3112/5811] 10.222.0.52 () {58 vars in 1244 bytes} [Sat May 14 21:41:32 2022] GET /compute/v2.1/os-volumes/0cfeed02-13d6-4e1e-83c7-256e1ccdcde5 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:41:32.422220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:32.422981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:32.434050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:32.440716 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:32.443271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:32.443771 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:32.705978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:41:32.707095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:41:32.707763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:41:32.708352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:41:32.708977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:41:32.738078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:32.738556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:32.739381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:32.739858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:32.792047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Getting quotas for project 02f7a491fa1c45c896f1af07217a303a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:41:32.810415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Getting quotas for user 9b156d4dd0064d63b2809fa6327ed8aa and project 02f7a491fa1c45c896f1af07217a303a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:41:32.835519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:41:32.842491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:41:32.980182 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-55e4494e-4fa3-4834-ad18-9bd27e53976c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.403824 May 14 21:41:32.988377 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2700/5812] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:41:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:41:32.998426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e50f0c93-cfa7-46e9-a3ff-ee44c9cd04c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:33.000210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e50f0c93-cfa7-46e9-a3ff-ee44c9cd04c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:33.120208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:33.141919 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b92854e7-90a1-4de2-a775-7acdad46f2bc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1550 microversion: 2.1 time: 0.725099 May 14 21:41:33.147035 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3113/5813] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:32 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1550 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:33.192922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e50f0c93-cfa7-46e9-a3ff-ee44c9cd04c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:33.201132 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e50f0c93-cfa7-46e9-a3ff-ee44c9cd04c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1214 microversion: 2.1 time: 0.211617 May 14 21:41:33.213505 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2701/5814] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:32 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:34.139244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-b0b16235-69a7-4080-8019-b619ed3378a3 req-29da5c2b-f88b-4692-9b1e-b1ff473c983a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a66aa525-111f-4c5d-9bb3-4ee4773fb850", "name": "network-vif-deleted", "tag": "661b64f1-16e6-4e3f-b7bf-d18692c09a31"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:34.165236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:34.165236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:34.165893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b0b16235-69a7-4080-8019-b619ed3378a3 req-29da5c2b-f88b-4692-9b1e-b1ff473c983a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:34.166350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b0b16235-69a7-4080-8019-b619ed3378a3 req-29da5c2b-f88b-4692-9b1e-b1ff473c983a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:34.178416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:34.180786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:34.183368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:34.184095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:34.207987 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-b0b16235-69a7-4080-8019-b619ed3378a3 req-29da5c2b-f88b-4692-9b1e-b1ff473c983a service nova] Creating event network-vif-deleted:661b64f1-16e6-4e3f-b7bf-d18692c09a31 for instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 on nch1-master-1 May 14 21:41:34.227223 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-b0b16235-69a7-4080-8019-b619ed3378a3 req-29da5c2b-f88b-4692-9b1e-b1ff473c983a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092276 May 14 21:41:34.228814 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3114/5815] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:34.235643 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bcaef43a-6175-4806-b7e5-17b5b36c5ce8 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:34.236632 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bcaef43a-6175-4806-b7e5-17b5b36c5ce8 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:34.310406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bcaef43a-6175-4806-b7e5-17b5b36c5ce8 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:34.318013 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bcaef43a-6175-4806-b7e5-17b5b36c5ce8 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1214 microversion: 2.1 time: 0.087657 May 14 21:41:34.327394 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3115/5816] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:34 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:34.339991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:34.350960 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3f3dc02e-b6eb-44d6-98df-6c30c3839cb8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 200 len: 1483 microversion: 2.1 time: 0.190811 May 14 21:41:34.353058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2702/5817] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:34 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 1483 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:35.335367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:35.337057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:35.354400 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:35.354856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:35.355699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:35.356198 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:35.370908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:35.376770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: a66aa525-111f-4c5d-9bb3-4ee4773fb850] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:35.379031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:35.379771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:35.380723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:35.381420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] HTTP exception thrown: Instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 could not be found. May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Request method failure captured: May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 HTTP/1.1 May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCGPzvzQx4M9urm-BS_8yUFO9mzxYPafHOFRPIXrXWiCEGDoVOaebEVpZqH4NmnDtdduA43Yl9oL6zh5XNm8Haf2ibTUkU-Ry-cW4QDO9T0b1ujXqQzTJOs04wWt94d39OfozxPYwr52RzjBh7B797VxBxyvuSGB9H-InYkGHMb-4oM May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a5d1195cf21b4146ae0c49a9c95ab8fa May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkBasicOps-845713673 May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5d1195cf21b4146ae0c49a9c95ab8fa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkBasicOps-845713673 May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a5d1195cf21b4146ae0c49a9c95ab8fa May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkBasicOps-845713673 May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkBasicOps-845713673-project May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: cab5a299e003422286f01bd44fda92bc May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkBasicOps-845713673-project May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 could not be found. May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'a66aa525-111f-4c5d-9bb3-4ee4773fb850'} May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 could not be found. May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:41:35.413454 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 could not be found. May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 could not be found. May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Returning 404 to user: Instance a66aa525-111f-4c5d-9bb3-4ee4773fb850 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cefb90d5-14cc-4067-828e-5959723ef99f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850" status: 404 len: 111 microversion: 2.1 time: 0.044913 May 14 21:41:35.417954 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2703/5818] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:35 2022] GET /compute/v2.1/servers/a66aa525-111f-4c5d-9bb3-4ee4773fb850 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:41:35.446983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:35.456818 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-84c3726a-6573-4715-8649-ddf43f1515cd tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1210 microversion: 2.1 time: 0.125889 May 14 21:41:35.458418 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3116/5819] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:35 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:35.664823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a966cd08-76e0-4d01-ac1c-3ca46f66b0dc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '.version_select at 0x7fb1a6bc9280>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:35.760767 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a966cd08-76e0-4d01-ac1c-3ca46f66b0dc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-643371256" status: 202 len: 0 microversion: 2.1 time: 0.099801 May 14 21:41:35.761372 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2704/5820] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:41:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-643371256 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:41:36.476792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:36.477542 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:36.489133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:36.490032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:36.496410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:36.497177 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:36.624709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:36.634310 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b192c9e4-24a7-4ed6-8aae-a99a483b0954 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1272 microversion: 2.1 time: 0.160067 May 14 21:41:36.634477 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3117/5821] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:36 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1272 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:37.655342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:37.657647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:37.673959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:37.674720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:37.675916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:37.676616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:38.095196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:38.104727 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54de178f-9f20-4495-8192-ba82d4cb2c01 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.457797 May 14 21:41:38.107642 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2705/5822] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:37 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:39.122463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:39.128871 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:39.133718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:39.134530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:39.135757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:39.136513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:39.300987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:39.310570 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6481e96a-8629-4eee-a1be-a9a2b3746cf5 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.192997 May 14 21:41:39.320801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3118/5823] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:39 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:39.574697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d8d85405-2b24-403e-8075-3a7db302b702 req-6d1700ce-a0c5-446f-8eb6-6eb1402a29b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30cccea2-386c-432b-ae51-d41981ed64ce", "tag": "3fff6970-5ac3-43e2-b4fd-509756f09b34"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:39.587455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d8d85405-2b24-403e-8075-3a7db302b702 req-6d1700ce-a0c5-446f-8eb6-6eb1402a29b0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:39.588316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d8d85405-2b24-403e-8075-3a7db302b702 req-6d1700ce-a0c5-446f-8eb6-6eb1402a29b0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:39.612123 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d8d85405-2b24-403e-8075-3a7db302b702 req-6d1700ce-a0c5-446f-8eb6-6eb1402a29b0 service nova] Creating event network-changed:3fff6970-5ac3-43e2-b4fd-509756f09b34 for instance 30cccea2-386c-432b-ae51-d41981ed64ce on nch2-master-1 May 14 21:41:39.620191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d8d85405-2b24-403e-8075-3a7db302b702 req-6d1700ce-a0c5-446f-8eb6-6eb1402a29b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049750 May 14 21:41:39.625918 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2706/5824] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:39.835719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:39.836879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:39.851778 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:39.852323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:39.853133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:39.853580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:39.891098 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:41:40.284532 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-733617ee-fd30-4224-be2b-77c66b329104 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "DELETE /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 204 len: 0 microversion: 2.1 time: 0.452665 May 14 21:41:40.285212 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3119/5825] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:41:39 2022] DELETE /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:41:40.303284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:40.304511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:40.316284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:40.317475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:40.318613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:40.319436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:40.330046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:40.335663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:40.342018 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:40.342483 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:40.346985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:40.348086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:40.676452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:40.686890 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ce193e93-fb16-463c-a846-6de3260d4dd5 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1671 microversion: 2.1 time: 0.395557 May 14 21:41:40.687688 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2707/5826] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:40 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1671 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:40.880544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:40.890535 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a6054eed-25bb-498a-99d3-582eb806ae6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.567259 May 14 21:41:40.891605 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3120/5827] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:40 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:41.651210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-99db2541-c98a-4b20-8343-ef090971eae7 req-38174dc5-964e-47ec-9369-3bac01932e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ac6508-83b6-4cfe-b712-4017cec6484e", "tag": "54a7015c-7611-47b4-b979-2e2c14eb7ec7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:41.671335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-99db2541-c98a-4b20-8343-ef090971eae7 req-38174dc5-964e-47ec-9369-3bac01932e88 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:41.671335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-99db2541-c98a-4b20-8343-ef090971eae7 req-38174dc5-964e-47ec-9369-3bac01932e88 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:41.700138 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-99db2541-c98a-4b20-8343-ef090971eae7 req-38174dc5-964e-47ec-9369-3bac01932e88 service nova] Creating event network-changed:54a7015c-7611-47b4-b979-2e2c14eb7ec7 for instance e2ac6508-83b6-4cfe-b712-4017cec6484e on nch2-master-1 May 14 21:41:41.706394 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:41.707664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:41.712493 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-99db2541-c98a-4b20-8343-ef090971eae7 req-38174dc5-964e-47ec-9369-3bac01932e88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067131 May 14 21:41:41.716425 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2708/5828] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:41.726218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:41.728754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:41.730006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:41.730691 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:41.917004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:41.919189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:41.936510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:41.939985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:41.942074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:41.942697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:42.217291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:42.225149 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-321dda7b-730b-4cc4-958d-ff427343100a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1671 microversion: 2.1 time: 0.523307 May 14 21:41:42.225749 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3121/5829] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:41 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1671 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:42.470644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:42.490014 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d1f20bc7-7edb-499b-a38c-6b85d5420266 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.582575 May 14 21:41:42.497047 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2709/5830] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:41 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:41:43.243799 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:43.244404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:43.251168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:43.251660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:43.252560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:43.253235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:43.319857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:43.328179 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-77f2d262-ba4d-4332-88f8-678e220fff7f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1603 microversion: 2.1 time: 0.088812 May 14 21:41:43.328686 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3122/5831] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:43 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1603 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:43.514981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:43.516235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:43.530861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:43.531326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:43.534012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:43.534729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:43.749254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-e80b6691-966e-47dc-a480-cfc657834e81 req-7c8d3591-117d-4ec3-8c48-e0ef411f6c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ac6508-83b6-4cfe-b712-4017cec6484e", "name": "network-vif-deleted", "tag": "54a7015c-7611-47b4-b979-2e2c14eb7ec7"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:43.761872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e80b6691-966e-47dc-a480-cfc657834e81 req-7c8d3591-117d-4ec3-8c48-e0ef411f6c61 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:43.762331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-e80b6691-966e-47dc-a480-cfc657834e81 req-7c8d3591-117d-4ec3-8c48-e0ef411f6c61 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:43.793662 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-e80b6691-966e-47dc-a480-cfc657834e81 req-7c8d3591-117d-4ec3-8c48-e0ef411f6c61 service nova] Creating event network-vif-deleted:54a7015c-7611-47b4-b979-2e2c14eb7ec7 for instance e2ac6508-83b6-4cfe-b712-4017cec6484e on nch2-master-1 May 14 21:41:43.806380 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-e80b6691-966e-47dc-a480-cfc657834e81 req-7c8d3591-117d-4ec3-8c48-e0ef411f6c61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060649 May 14 21:41:43.807783 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3123/5832] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:44.022274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:44.033612 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9ffa5ba-cd84-4dc3-852d-09ae94e9ad52 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.523377 May 14 21:41:44.034741 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2710/5833] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:43 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:44.348282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:44.349046 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:44.355827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:44.356289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:44.357102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:44.357584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:44.392220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:44.392681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:44.393144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lazy-loading 'fault' on Instance uuid e2ac6508-83b6-4cfe-b712-4017cec6484e {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:41:44.487781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:44.496331 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5a5da8f-37d9-4a90-87ce-60bd615c11b7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 200 len: 1338 microversion: 2.1 time: 0.153336 May 14 21:41:44.496957 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3124/5834] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:44 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 1338 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:45.051464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:45.052791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:45.060963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:45.061492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:45.062281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:45.063024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:45.317223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:45.332853 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b8476afa-f997-4936-9731-fee2c99318ed tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.285204 May 14 21:41:45.336998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2711/5835] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:45 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:45.520747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:45.521712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: e2ac6508-83b6-4cfe-b712-4017cec6484e] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:45.534238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:45.535987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:45.536968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:45.537556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:45.570778 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] HTTP exception thrown: Instance e2ac6508-83b6-4cfe-b712-4017cec6484e could not be found. May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Request method failure captured: May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e HTTP/1.1 May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCGPzvzQx4M9urm-BS_8yUFO9mzxYPafHOFRPIXrXWiCEGDoVOaebEVpZqH4NmnDtdduA43Yl9oL6zh5XNm8Haf2ibTUkU-Ry-cW4QDO9T0b1ujXqQzTJOs04wWt94d39OfozxPYwr52RzjBh7B797VxBxyvuSGB9H-InYkGHMb-4oM May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a5d1195cf21b4146ae0c49a9c95ab8fa May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestNetworkBasicOps-845713673 May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5d1195cf21b4146ae0c49a9c95ab8fa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestNetworkBasicOps-845713673 May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a5d1195cf21b4146ae0c49a9c95ab8fa May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestNetworkBasicOps-845713673 May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestNetworkBasicOps-845713673-project May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cab5a299e003422286f01bd44fda92bc May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestNetworkBasicOps-845713673-project May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance e2ac6508-83b6-4cfe-b712-4017cec6484e could not be found. May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'e2ac6508-83b6-4cfe-b712-4017cec6484e'} May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ac6508-83b6-4cfe-b712-4017cec6484e could not be found. May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ac6508-83b6-4cfe-b712-4017cec6484e could not be found. May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:45.572936 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:45.576975 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:45.576975 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:45.576975 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:45.576975 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:41:45.576975 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:41:45.576975 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ac6508-83b6-4cfe-b712-4017cec6484e could not be found. May 14 21:41:45.576975 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:41:45.578615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Returning 404 to user: Instance e2ac6508-83b6-4cfe-b712-4017cec6484e could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:45.579832 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c45b43d2-be6d-4257-b3cc-26a62a6b4a0e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e" status: 404 len: 111 microversion: 2.1 time: 0.064450 May 14 21:41:45.581783 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3125/5836] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:45 2022] GET /compute/v2.1/servers/e2ac6508-83b6-4cfe-b712-4017cec6484e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:41:45.990452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-29cfe1e4-9c55-4467-958a-6960c23aa54d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '.version_select at 0x7fb1a6f6f5e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:46.124767 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-29cfe1e4-9c55-4467-958a-6960c23aa54d tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1578881628" status: 202 len: 0 microversion: 2.1 time: 0.144080 May 14 21:41:46.135130 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2712/5837] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:41:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1578881628 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:41:46.354169 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:46.354951 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:46.361435 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:46.361894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:46.362680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:46.363120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:46.665737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:46.673725 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5358799-e876-4078-b292-cc714256579e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.324209 May 14 21:41:46.674589 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3126/5838] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:46 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:47.692449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:47.693743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:47.702535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:47.703464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:47.705172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:47.705850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:48.077416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-083d8d8c-3e93-4c9c-90ac-d560205dcaf7 req-57f700ec-ae1e-4ef1-97c1-c044b5cde8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cccea2-386c-432b-ae51-d41981ed64ce", "name": "network-vif-plugged", "status": "completed", "tag": "3fff6970-5ac3-43e2-b4fd-509756f09b34"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:48.093420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-083d8d8c-3e93-4c9c-90ac-d560205dcaf7 req-57f700ec-ae1e-4ef1-97c1-c044b5cde8bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:48.093875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-083d8d8c-3e93-4c9c-90ac-d560205dcaf7 req-57f700ec-ae1e-4ef1-97c1-c044b5cde8bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:48.107338 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-083d8d8c-3e93-4c9c-90ac-d560205dcaf7 req-57f700ec-ae1e-4ef1-97c1-c044b5cde8bd service nova] Creating event network-vif-plugged:3fff6970-5ac3-43e2-b4fd-509756f09b34 for instance 30cccea2-386c-432b-ae51-d41981ed64ce on nch2-master-1 May 14 21:41:48.112392 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-083d8d8c-3e93-4c9c-90ac-d560205dcaf7 req-57f700ec-ae1e-4ef1-97c1-c044b5cde8bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038883 May 14 21:41:48.112997 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3127/5839] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:41:48.237422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:48.249967 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3fec26a8-ba3d-4015-af14-f46837d7784e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.560756 May 14 21:41:48.251886 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2713/5840] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:47 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:49.271940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:49.274724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:49.291042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:49.291931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:49.315451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:49.323866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:50.040385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:50.057869 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-960e06de-ffc2-4a9c-80f6-9da087b52187 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1314 microversion: 2.1 time: 0.792654 May 14 21:41:50.061288 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3128/5841] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:49 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:51.086489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:51.087889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:51.098176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:51.099207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:51.102490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:51.103235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:51.482509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:51.507566 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-69b6d6fe-2de2-4492-b211-12d2f9d4a282 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1498 microversion: 2.1 time: 0.430496 May 14 21:41:51.510370 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2714/5842] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:51 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1498 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:52.686493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:52.687039 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:52.701978 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:52.702448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:52.703255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:52.703761 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:52.767074 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:41:53.220075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-843b64a9-a885-40de-976d-dd90d68fa07e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "DELETE /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 204 len: 0 microversion: 2.1 time: 0.535241 May 14 21:41:53.220995 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3129/5843] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:41:52 2022] DELETE /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:41:53.237204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:53.241002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:53.255886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:53.256373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:53.259843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:53.261362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:53.456019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:53.465247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a08cde9-2d6e-4d6f-b12a-a777e2ef336a tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1504 microversion: 2.1 time: 0.239832 May 14 21:41:53.465834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2715/5844] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:53 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:54.482724 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:54.483462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:54.500334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:54.500785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:54.502364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:54.502987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:54.842351 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:54.850037 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5050f57b-dd84-4d82-924c-88e111ab5f39 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1504 microversion: 2.1 time: 0.371486 May 14 21:41:54.850614 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3130/5845] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:54 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1504 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:55.700666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c1538c87-ade5-4d9e-9dc4-478fe0e32d26 req-cf485a80-8d2e-4eb1-b736-76007b0e8413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30cccea2-386c-432b-ae51-d41981ed64ce", "name": "network-vif-deleted", "tag": "3fff6970-5ac3-43e2-b4fd-509756f09b34"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:55.713065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c1538c87-ade5-4d9e-9dc4-478fe0e32d26 req-cf485a80-8d2e-4eb1-b736-76007b0e8413 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:55.713908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c1538c87-ade5-4d9e-9dc4-478fe0e32d26 req-cf485a80-8d2e-4eb1-b736-76007b0e8413 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:55.727802 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c1538c87-ade5-4d9e-9dc4-478fe0e32d26 req-cf485a80-8d2e-4eb1-b736-76007b0e8413 service nova] Creating event network-vif-deleted:3fff6970-5ac3-43e2-b4fd-509756f09b34 for instance 30cccea2-386c-432b-ae51-d41981ed64ce on nch2-master-1 May 14 21:41:55.735377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c1538c87-ade5-4d9e-9dc4-478fe0e32d26 req-cf485a80-8d2e-4eb1-b736-76007b0e8413 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040033 May 14 21:41:55.740656 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2716/5846] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:41:55.867459 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:55.869054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:55.886580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:55.887408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:55.888658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:55.889600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:55.972078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:55.984877 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d70a0b84-fc8a-42a2-a3ff-0160d812b7ee tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 200 len: 1299 microversion: 2.1 time: 0.121989 May 14 21:41:55.986379 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3131/5847] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:55 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 1299 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:57.003012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:57.004330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 30cccea2-386c-432b-ae51-d41981ed64ce] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:57.012737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:57.013195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:57.014219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:57.014806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:57.031364 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] HTTP exception thrown: Instance 30cccea2-386c-432b-ae51-d41981ed64ce could not be found. May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Request method failure captured: May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce HTTP/1.1 May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCIH0lPm714rqaKKCBkmRwtzp9n5-loVV1RcYN4pmKKxxAzmLo4z9PrmUNoGe3wC2kcpYQTzs4Rx0t1FTKhkFVQrPDi8cx_Z2RgH_WSRh3KNvshcjY2B109hlp9HbuGke9dIxjhTbezckTLpW-1xaIkqj-4Tc-gIE9E-h71l51YQVUc May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 02f7a491fa1c45c896f1af07217a303a May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-VolumesActionsTest-1847628510 May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02f7a491fa1c45c896f1af07217a303a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02f7a491fa1c45c896f1af07217a303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02f7a491fa1c45c896f1af07217a303a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02f7a491fa1c45c896f1af07217a303a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-VolumesActionsTest-1847628510 May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 02f7a491fa1c45c896f1af07217a303a May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-VolumesActionsTest-1847628510 May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-VolumesActionsTest-1847628510-project May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 9b156d4dd0064d63b2809fa6327ed8aa May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-VolumesActionsTest-1847628510-project May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 30cccea2-386c-432b-ae51-d41981ed64ce could not be found. May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '30cccea2-386c-432b-ae51-d41981ed64ce'} May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30cccea2-386c-432b-ae51-d41981ed64ce could not be found. May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30cccea2-386c-432b-ae51-d41981ed64ce could not be found. May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:41:57.033116 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30cccea2-386c-432b-ae51-d41981ed64ce could not be found. May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Returning 404 to user: Instance 30cccea2-386c-432b-ae51-d41981ed64ce could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:41:57.037497 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae9f5d0c-e2ae-406e-9f69-fe1c5c5545fc tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce" status: 404 len: 111 microversion: 2.1 time: 0.036074 May 14 21:41:57.045384 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2717/5848] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:56 2022] GET /compute/v2.1/servers/30cccea2-386c-432b-ae51-d41981ed64ce => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:41:57.180880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1957353644", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a0d6c244-ba10-44a1-b532-1388d1aab436"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:41:57.251357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] validate_networks() for [('a0d6c244-ba10-44a1-b532-1388d1aab436', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:41:57.853505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:41:57.853937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:41:57.854413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:41:57.855001 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:41:57.855625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:41:57.874197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:57.876847 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:57.877832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:57.878355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:57.923868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Getting quotas for project 02f7a491fa1c45c896f1af07217a303a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:41:57.938070 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Getting quotas for user 9b156d4dd0064d63b2809fa6327ed8aa and project 02f7a491fa1c45c896f1af07217a303a. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:41:57.966935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:41:57.969280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:41:58.507627 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-318691a3-2ef9-4c79-ae85-f19d0720e154 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.330473 May 14 21:41:58.509494 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3132/5849] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:41:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:41:58.523567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21207c9c-0a9f-410d-b70d-6b7f285e9675 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:58.526907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21207c9c-0a9f-410d-b70d-6b7f285e9675 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:58.713127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-21207c9c-0a9f-410d-b70d-6b7f285e9675 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:58.739934 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21207c9c-0a9f-410d-b70d-6b7f285e9675 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1214 microversion: 2.1 time: 0.214431 May 14 21:41:58.753558 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2718/5850] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:58 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1214 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:41:59.761243 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:41:59.765972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:41:59.784656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:59.785204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:59.786027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:41:59.787673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:41:59.923432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:41:59.939798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a457f03d-aa70-48b2-a6e2-1134b7aa3c6c tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1218 microversion: 2.1 time: 0.183748 May 14 21:41:59.943849 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3133/5851] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:41:59 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:00.965059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:00.971645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:00.991759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:00.991996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:00.992686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:00.993132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:01.090158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:01.114872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-39e48d6c-8c97-4495-942c-cf066c15c2b1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1266 microversion: 2.1 time: 0.157663 May 14 21:42:01.126488 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2719/5852] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:00 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:02.134744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:02.135379 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:02.145391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:02.145858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:02.146928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:02.147375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:02.252342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:02.264986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a85358e1-c20f-410e-b202-130edf4b2ee6 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1272 microversion: 2.1 time: 0.136410 May 14 21:42:02.265705 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3134/5853] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:02 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1272 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:03.287297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:03.296665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:03.306909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:03.307301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:03.308228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:03.308838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:04.319567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:04.329381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3b0814f-10e3-405a-ae00-51038647fe78 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1314 microversion: 2.1 time: 1.050949 May 14 21:42:04.330341 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2720/5854] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:03 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1314 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:05.072241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1796938910", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "8d0a40c5-3971-475b-af74-95cb156c2e8b"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:05.192752 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] validate_networks() for [('8d0a40c5-3971-475b-af74-95cb156c2e8b', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:42:05.347696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:05.348327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:05.356281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:05.356747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:05.357544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:05.358079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:05.776845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:05.786609 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe037f90-46a7-4f2c-8f1d-0b65cec24f2f tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1314 microversion: 2.1 time: 0.442379 May 14 21:42:05.810139 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2721/5855] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:05 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:05.946929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9757e675-ce31-411d-8ac6-997343d575b3 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1679132644", "availability_zone": "foo_zone"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:05.948950 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:05.948950 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:42:05.949998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.aggregate [None req-9757e675-ce31-411d-8ac6-997343d575b3 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Generated uuid b2266056-fe3b-4ce1-824e-30eba3016d32 for aggregate {{(pid=130637) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 14 21:42:06.063644 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9757e675-ce31-411d-8ac6-997343d575b3 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.251896 May 14 21:42:06.065289 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2722/5856] 10.222.0.52 () {60 vars in 1163 bytes} [Sat May 14 21:42:05 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:06.082292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4593e9f0-715d-46a4-a6a8-66d13cc6d48d tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:06.087890 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:06.087890 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:42:06.223736 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4593e9f0-715d-46a4-a6a8-66d13cc6d48d tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.149740 May 14 21:42:06.225332 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2723/5857] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:42:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:06.236904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-33c86314-769d-4d64-a4e2-6a3dee5cd125 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:06.238628 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:06.238628 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:42:06.240310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33c86314-769d-4d64-a4e2-6a3dee5cd125 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:06.241969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33c86314-769d-4d64-a4e2-6a3dee5cd125 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:06.243100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33c86314-769d-4d64-a4e2-6a3dee5cd125 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:06.243931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33c86314-769d-4d64-a4e2-6a3dee5cd125 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:06.278761 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-33c86314-769d-4d64-a4e2-6a3dee5cd125 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046612 May 14 21:42:06.280360 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2724/5858] 10.222.0.52 () {58 vars in 1175 bytes} [Sat May 14 21:42:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:42:06.292448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4b33c977-b591-49c6-8884-a416c06afea0 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:06.294285 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:06.294285 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:42:06.303641 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4b33c977-b591-49c6-8884-a416c06afea0 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016286 May 14 21:42:06.305479 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2725/5859] 10.222.0.52 () {58 vars in 1142 bytes} [Sat May 14 21:42:06 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:42:06.317136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8892d5c1-736f-41f4-a0cf-6451b1ea95e1 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:06.318885 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:06.318885 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:42:06.331415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8892d5c1-736f-41f4-a0cf-6451b1ea95e1 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:06.333087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8892d5c1-736f-41f4-a0cf-6451b1ea95e1 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:06.646489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:42:06.653876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:42:06.653876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:42:06.653876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:42:06.653876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:42:06.661896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:06.662357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:06.665235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:06.665893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:06.687041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Getting quotas for project 0166571316634a7185b9768add179654. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:42:06.693747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Getting quotas for user a3f0269a87fb4a8fa8dbc1b84c134fe7 and project 0166571316634a7185b9768add179654. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:42:06.723945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:42:06.731670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:42:06.836684 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8892d5c1-736f-41f4-a0cf-6451b1ea95e1 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.524584 May 14 21:42:06.837912 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2726/5860] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:42:06 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:06.842742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:06.843686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:06.851213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:06.851940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:06.852889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:06.853493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:06.887034 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f01e9a23-53bd-4c10-89a8-91fb4dd696b6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.063363 May 14 21:42:06.894075 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3135/5861] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:42:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:42:06.902840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cbf7c689-852f-4d56-ab16-390b6af8c962 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:06.904147 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:06.904147 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:42:06.917385 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cbf7c689-852f-4d56-ab16-390b6af8c962 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.019094 May 14 21:42:06.924553 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3136/5862] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:42:06 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:06.933231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b439a55d-1119-4625-b65c-bf0be2677fcd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:06.934218 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b439a55d-1119-4625-b65c-bf0be2677fcd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:07.094679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b439a55d-1119-4625-b65c-bf0be2677fcd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:07.108746 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b439a55d-1119-4625-b65c-bf0be2677fcd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1214 microversion: 2.1 time: 0.178821 May 14 21:42:07.118566 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3137/5863] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:06 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:07.125111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8eb9eaa-4554-4adb-9306-8ddde3031ce4 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-699682300", "availability_zone": "foo_zone"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:07.126831 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:07.126831 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:42:07.340828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:07.352543 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f99a77d-dd48-4477-94c2-8ddaf3831917 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1318 microversion: 2.1 time: 0.513386 May 14 21:42:07.353616 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2727/5864] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:06 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1318 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:07.358524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f0c98e26-fdbf-4485-96fe-0a6db7da5bb7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'create', calling method: .version_select at 0x7fb1a7015d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1779473625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDS03MjQaOUlXZ3pYQ1SrAQvNB6Vojjw79rckLGKLifm8gMMuxBBeC3DSZxjqir5/TfUrFBHeiPpn2xCuGY1B6qnF8EqzwmiIClnVAYaktiKTA92wciX40oRYk0smcGiXQ=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:07.367037 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8eb9eaa-4554-4adb-9306-8ddde3031ce4 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.246517 May 14 21:42:07.388021 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3138/5865] 10.222.0.52 () {60 vars in 1172 bytes} [Sat May 14 21:42:07 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:07.392651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f0c98e26-fdbf-4485-96fe-0a6db7da5bb7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:42:07.405895 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-15e46939-db3e-452b-9b74-1780e7e25ff5 req-f10c73e8-c629-47dd-aa72-3202c88de28f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ee751a8-3bfb-4b61-8117-6f8e05f6cd88", "tag": "f9e39b22-4401-4f1f-b347-524ae155a4ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:07.411738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f0c98e26-fdbf-4485-96fe-0a6db7da5bb7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for user cab5a299e003422286f01bd44fda92bc and project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:42:07.426174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-15e46939-db3e-452b-9b74-1780e7e25ff5 req-f10c73e8-c629-47dd-aa72-3202c88de28f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:07.427246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-15e46939-db3e-452b-9b74-1780e7e25ff5 req-f10c73e8-c629-47dd-aa72-3202c88de28f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:07.452667 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-15e46939-db3e-452b-9b74-1780e7e25ff5 req-f10c73e8-c629-47dd-aa72-3202c88de28f service nova] Creating event network-changed:f9e39b22-4401-4f1f-b347-524ae155a4ea for instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 on nch2-master-1 May 14 21:42:07.459198 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-15e46939-db3e-452b-9b74-1780e7e25ff5 req-f10c73e8-c629-47dd-aa72-3202c88de28f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069786 May 14 21:42:07.459991 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3139/5866] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:07.465806 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b8b33662-d125-4bb2-bf1b-3686fca288f1 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:07.467589 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:07.467589 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:42:07.518949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f0c98e26-fdbf-4485-96fe-0a6db7da5bb7 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.164063 May 14 21:42:07.519696 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2728/5867] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:42:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:07.593636 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b8b33662-d125-4bb2-bf1b-3686fca288f1 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.126723 May 14 21:42:07.593636 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3140/5868] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:42:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:07.599498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c9372ac-9df5-4764-a1d5-6a7608ba226e tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:07.601442 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:07.601442 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 21:42:07.622507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c9372ac-9df5-4764-a1d5-6a7608ba226e tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.024448 May 14 21:42:07.622507 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2729/5869] 10.222.0.52 () {58 vars in 1151 bytes} [Sat May 14 21:42:07 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:07.633602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-13dd27e3-52ac-4537-a5fc-654fd89e9e64 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:07.635014 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:07.635014 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:42:07.655148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13dd27e3-52ac-4537-a5fc-654fd89e9e64 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:07.655913 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-13dd27e3-52ac-4537-a5fc-654fd89e9e64 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:08.124453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fefd3464-ce4b-4461-beaa-0d5175bb7e2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:08.124975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fefd3464-ce4b-4461-beaa-0d5175bb7e2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:08.145659 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-13dd27e3-52ac-4537-a5fc-654fd89e9e64 tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.517133 May 14 21:42:08.150491 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3141/5870] 10.222.0.52 () {60 vars in 1193 bytes} [Sat May 14 21:42:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:08.163633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a8888745-d71a-4bc0-a103-9ccffc9d664b tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:08.169032 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:42:08.169032 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:42:08.254074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fefd3464-ce4b-4461-beaa-0d5175bb7e2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:08.279242 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fefd3464-ce4b-4461-beaa-0d5175bb7e2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1214 microversion: 2.1 time: 0.159858 May 14 21:42:08.290347 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2730/5871] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:08 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:08.369501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:08.370142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:08.373322 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a8888745-d71a-4bc0-a103-9ccffc9d664b tempest-TestAggregatesBasicOps-436216143 tempest-TestAggregatesBasicOps-436216143-project-admin] 10.222.0.52 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.215829 May 14 21:42:08.374110 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3142/5872] 10.222.0.52 () {58 vars in 1154 bytes} [Sat May 14 21:42:08 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 14 21:42:08.381356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:08.388161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:08.389085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:08.390261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:09.073279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:09.088679 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5ee1173c-b708-48c5-954e-2e9404676a91 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1314 microversion: 2.1 time: 0.723393 May 14 21:42:09.089297 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2731/5873] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:08 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:09.312602 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:09.316131 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:09.348433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:09.355880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:09.360211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:09.360211 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:09.504551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:09.521536 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9c3402e-8360-44ad-8bb2-622b8acd0cdb tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1266 microversion: 2.1 time: 0.216504 May 14 21:42:09.526967 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3143/5874] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:09 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:10.105461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:10.106841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:10.114530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:10.115365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:10.116479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:10.117212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:10.456704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:10.466845 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5e7ce60-7860-42ee-b4e7-db0dcef94697 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1314 microversion: 2.1 time: 0.365222 May 14 21:42:10.467447 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2732/5875] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:10 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:10.542961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:10.543896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:10.558489 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:10.565142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:10.566373 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:10.566982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:10.707739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:10.717934 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6d9ddfd6-6a5e-4951-8749-984241c937e6 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1272 microversion: 2.1 time: 0.181206 May 14 21:42:10.722704 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3144/5876] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:10 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:11.491010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:11.492374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:11.512358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:11.513136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:11.514255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:11.514860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:11.738852 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:11.740597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:11.754279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:11.755196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:11.756421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:11.759819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:11.947758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:11.956813 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c61f249-2917-43c8-bb81-27f8004ecaa4 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.224602 May 14 21:42:11.957844 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3145/5877] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:11 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:11.965982 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1266588735", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "02d52912-8e9f-4347-9eaa-055f507d398b"}], "key_name": "tempest-TestNetworkBasicOps-1779473625", "security_groups": [{"name": "tempest-secgroup-smoke-879167023"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:11.970228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:11.980087 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34e41cfc-edb3-4915-8a72-be9a8032f039 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1314 microversion: 2.1 time: 0.493174 May 14 21:42:11.981238 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2733/5878] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:11 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:12.114742 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] validate_networks() for [('02d52912-8e9f-4347-9eaa-055f507d398b', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:42:12.827693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:42:12.829026 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:42:12.830505 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:42:12.831387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:42:12.832451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:42:12.845651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:12.846342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:12.847537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:12.848142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:12.878931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:42:12.890312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Getting quotas for user cab5a299e003422286f01bd44fda92bc and project a5d1195cf21b4146ae0c49a9c95ab8fa. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:42:12.906086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:42:12.908905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:42:12.975057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:12.975570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:12.992090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:12.996455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:12.996455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:12.996455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:13.137902 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d14e90c7-bca7-4e24-85bc-4fe1cdea6ad8 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.177495 May 14 21:42:13.139579 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3146/5879] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:42:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:42:13.154594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:13.156609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:13.172005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:13.175375 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:13.182202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:13.183281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:13.418362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:13.426911 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3168de8b-4529-4251-b13a-ea7e7f49bf5e tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1314 microversion: 2.1 time: 0.285973 May 14 21:42:13.427519 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3147/5880] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:13 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:13.443867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dfed8be4-4396-457b-9f25-ff8fa3508e3a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:13.444562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dfed8be4-4396-457b-9f25-ff8fa3508e3a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:13.555934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dfed8be4-4396-457b-9f25-ff8fa3508e3a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:13.564507 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dfed8be4-4396-457b-9f25-ff8fa3508e3a tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1249 microversion: 2.1 time: 0.133190 May 14 21:42:13.567643 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3148/5881] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:13 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1249 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:13.780428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:13.790539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18deeb01-6d72-48a1-94d8-1a7a1586d105 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.820163 May 14 21:42:13.791144 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2734/5882] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:12 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:13.980612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-cf041c2e-bd90-49aa-b177-0301a2723603 req-a921d5e4-ca51-4eb3-bda7-11b87f337deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee751a8-3bfb-4b61-8117-6f8e05f6cd88", "name": "network-vif-plugged", "status": "completed", "tag": "f9e39b22-4401-4f1f-b347-524ae155a4ea"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:13.991779 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cf041c2e-bd90-49aa-b177-0301a2723603 req-a921d5e4-ca51-4eb3-bda7-11b87f337deb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:13.992237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-cf041c2e-bd90-49aa-b177-0301a2723603 req-a921d5e4-ca51-4eb3-bda7-11b87f337deb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:14.003159 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-cf041c2e-bd90-49aa-b177-0301a2723603 req-a921d5e4-ca51-4eb3-bda7-11b87f337deb service nova] Creating event network-vif-plugged:f9e39b22-4401-4f1f-b347-524ae155a4ea for instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 on nch2-master-1 May 14 21:42:14.008306 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-cf041c2e-bd90-49aa-b177-0301a2723603 req-a921d5e4-ca51-4eb3-bda7-11b87f337deb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031317 May 14 21:42:14.009217 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3149/5883] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:14.289159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-3cf383d0-96d0-46c0-8194-7ca6bc322447 req-0c6da470-33d4-4e9b-beb9-06035efb3479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787596fc-6501-43f7-9502-4ccc956edc28", "tag": "df9f28e4-be02-4fc7-94ef-9bfdd439d06d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:14.298599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3cf383d0-96d0-46c0-8194-7ca6bc322447 req-0c6da470-33d4-4e9b-beb9-06035efb3479 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:14.299067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3cf383d0-96d0-46c0-8194-7ca6bc322447 req-0c6da470-33d4-4e9b-beb9-06035efb3479 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:14.311092 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-3cf383d0-96d0-46c0-8194-7ca6bc322447 req-0c6da470-33d4-4e9b-beb9-06035efb3479 service nova] Creating event network-changed:df9f28e4-be02-4fc7-94ef-9bfdd439d06d for instance 787596fc-6501-43f7-9502-4ccc956edc28 on nch1-master-1 May 14 21:42:14.316080 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-3cf383d0-96d0-46c0-8194-7ca6bc322447 req-0c6da470-33d4-4e9b-beb9-06035efb3479 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030820 May 14 21:42:14.316884 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2735/5884] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:14.445976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:14.450319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:14.453620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:14.454344 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:14.456386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:14.457003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:14.582531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:14.583428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:14.591893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:14.592570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:14.593519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:14.594117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:14.648535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:14.656138 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e69aa693-e98b-44bf-a33f-70a29ebaf7c1 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1314 microversion: 2.1 time: 0.215302 May 14 21:42:14.656717 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3150/5885] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:14 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:14.785219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:14.794428 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e41944db-b5e4-4367-97e5-fa6bdc2ec4f6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1253 microversion: 2.1 time: 0.216039 May 14 21:42:14.795027 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2736/5886] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:14 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1253 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:14.810927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:14.811598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:14.818984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:14.820102 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:14.821596 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:14.822110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:15.248768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:15.264175 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd4025ad-4c1b-4c3d-ac56-ffeaf46e028f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.454742 May 14 21:42:15.264802 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3151/5887] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:14 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:15.680990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:15.681633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:15.693058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:15.693459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:15.694629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:15.695089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:15.811971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:15.812606 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:15.820670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:15.820670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:15.822273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:15.822723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:15.853618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:15.862013 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ee11965b-efa9-44d3-83f5-865d3e99bbda tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1499 microversion: 2.1 time: 0.187478 May 14 21:42:15.875006 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2737/5888] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:15 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1499 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:15.953523 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:15.982344 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4673ce3c-2531-46d4-9d50-5d9903f69c91 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1301 microversion: 2.1 time: 0.174016 May 14 21:42:15.982633 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3152/5889] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:15 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1301 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:16.282836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:16.283634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:16.290898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:16.292774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:16.293610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:16.294248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:16.548456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:16.558405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4ea30a0-56a2-44ba-8aed-8a083a971cec tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.280032 May 14 21:42:16.559014 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2738/5890] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:16 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:16.935202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:16.935661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:16.943441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:16.944328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:16.945059 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:16.945498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:16.978894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:42:17.003526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:17.006068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:17.020514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:17.021831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:17.026271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:17.026271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:17.129924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:17.140372 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5525bfe1-c52a-4b90-9cdd-17cf9fe86ecc tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1307 microversion: 2.1 time: 0.143178 May 14 21:42:17.150546 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2739/5891] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:16 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1307 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:17.294897 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8959fd43-cd4b-4f21-b2e8-7005bc73cde9 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 204 len: 0 microversion: 2.1 time: 0.364155 May 14 21:42:17.295529 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3153/5892] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:42:16 2022] DELETE /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:42:17.303850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:17.304950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:17.311547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:17.312220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:17.313168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:17.313819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:17.575191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:17.578359 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:17.579574 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:17.583643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2300db1f-8e86-4541-bf4b-f7eaeed377ec tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1505 microversion: 2.1 time: 0.283874 May 14 21:42:17.584297 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2740/5893] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:17 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:17.595970 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:17.596432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:17.597219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:17.597662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:17.806487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:17.814559 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a9263425-df62-40d2-94d0-5eafa602eefe tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.242760 May 14 21:42:17.815152 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3154/5894] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:17 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:18.158211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:18.158834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:18.167853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:18.168436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:18.169293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:18.169752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:18.445295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:18.453952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-89d4da16-905a-4487-9f04-dabe94383a24 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.299544 May 14 21:42:18.454943 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2741/5895] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:18 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:18.602458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:18.603097 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:18.613155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:18.613945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:18.616662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:18.617516 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:18.834387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:18.835876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:18.844603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:18.845506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:18.846272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:18.846845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:19.000311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:19.010151 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a48c762c-c4aa-48d4-8376-a72d137747c4 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1505 microversion: 2.1 time: 0.412420 May 14 21:42:19.011025 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3155/5896] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:18 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1505 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:19.327692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:19.342848 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8593a0e3-a7e6-4253-a56b-4bd4203922ca tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.514899 May 14 21:42:19.355001 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2742/5897] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:18 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:19.477593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:19.478968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:19.486867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:19.487500 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:19.494654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:19.494654 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:19.869154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-efd86fbf-b521-490f-8e1e-20e4e51613d3 req-f71213d4-84dc-4fb5-b4c3-0643d138c615 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ee751a8-3bfb-4b61-8117-6f8e05f6cd88", "name": "network-vif-deleted", "tag": "f9e39b22-4401-4f1f-b347-524ae155a4ea"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:19.889101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-efd86fbf-b521-490f-8e1e-20e4e51613d3 req-f71213d4-84dc-4fb5-b4c3-0643d138c615 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:19.889564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-efd86fbf-b521-490f-8e1e-20e4e51613d3 req-f71213d4-84dc-4fb5-b4c3-0643d138c615 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:19.906148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-efd86fbf-b521-490f-8e1e-20e4e51613d3 req-f71213d4-84dc-4fb5-b4c3-0643d138c615 service nova] Creating event network-vif-deleted:f9e39b22-4401-4f1f-b347-524ae155a4ea for instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 on nch2-master-1 May 14 21:42:19.912392 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-efd86fbf-b521-490f-8e1e-20e4e51613d3 req-f71213d4-84dc-4fb5-b4c3-0643d138c615 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047894 May 14 21:42:19.918068 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2743/5898] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:20.027882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:20.028836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:20.035280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:20.035990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:20.036994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:20.037789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:20.131947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b156d4dd0064d63b2809fa6327ed8aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02f7a491fa1c45c896f1af07217a303a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:20.141968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3d2d3ee-1395-45ba-8b50-e592cec257bf tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 200 len: 1299 microversion: 2.1 time: 0.118230 May 14 21:42:20.143203 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2744/5899] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:20 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:20.155532 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:20.167720 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-20da4d84-26cc-4aae-8eaa-b1dd6a775ece tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.697735 May 14 21:42:20.177398 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3156/5900] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:19 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:20.361981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:20.362693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:20.371343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:20.372154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:20.373364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:20.374092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:20.489179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-61acbab6-dea9-45bb-8dcd-84cc38b3eb70 req-c86ebac8-a3ea-477d-b6ae-e1e3a2f6c660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c548d30e-d00d-4158-a577-383be392e733", "tag": "a9fe4e9d-844f-4445-8996-495ffab498b8"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:20.509573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-61acbab6-dea9-45bb-8dcd-84cc38b3eb70 req-c86ebac8-a3ea-477d-b6ae-e1e3a2f6c660 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:20.512814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-61acbab6-dea9-45bb-8dcd-84cc38b3eb70 req-c86ebac8-a3ea-477d-b6ae-e1e3a2f6c660 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:20.552779 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-61acbab6-dea9-45bb-8dcd-84cc38b3eb70 req-c86ebac8-a3ea-477d-b6ae-e1e3a2f6c660 service nova] Creating event network-changed:a9fe4e9d-844f-4445-8996-495ffab498b8 for instance c548d30e-d00d-4158-a577-383be392e733 on nch2-master-1 May 14 21:42:20.573806 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-61acbab6-dea9-45bb-8dcd-84cc38b3eb70 req-c86ebac8-a3ea-477d-b6ae-e1e3a2f6c660 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089387 May 14 21:42:20.574579 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3157/5901] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:42:20.626267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:20.634770 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3920c65-e604-4395-8b65-152764827c2b tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.276792 May 14 21:42:20.639630 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2745/5902] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:20 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:21.162824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:21.163595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] [instance: 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:21.171233 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:21.171985 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:21.172839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:21.173281 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:21.184909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:21.185979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:21.191936 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] HTTP exception thrown: Instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 could not be found. May 14 21:42:21.192878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:21.193586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Request method failure captured: May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 HTTP/1.1 May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCIH0lPm714rqaKKCBkmRwtzp9n5-loVV1RcYN4pmKKxxAzmLo4z9PrmUNoGe3wC2kcpYQTzs4Rx0t1FTKhkFVQrPDi8cx_Z2RgH_WSRh3KNvshcjY2B109hlp9HbuGke9dIxjhTbezckTLpW-1xaIkqj-4Tc-gIE9E-h71l51YQVUc May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 02f7a491fa1c45c896f1af07217a303a May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesActionsTest-1847628510 May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02f7a491fa1c45c896f1af07217a303a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/02f7a491fa1c45c896f1af07217a303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/02f7a491fa1c45c896f1af07217a303a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_02f7a491fa1c45c896f1af07217a303a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesActionsTest-1847628510 May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 02f7a491fa1c45c896f1af07217a303a May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesActionsTest-1847628510 May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesActionsTest-1847628510-project May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 9b156d4dd0064d63b2809fa6327ed8aa May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesActionsTest-1847628510-project May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 could not be found. May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '3ee751a8-3bfb-4b61-8117-6f8e05f6cd88'} May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 could not be found. May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 could not be found. May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:42:21.194251 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 could not be found. May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] Returning 404 to user: Instance 3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:42:21.200280 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b893a628-88ac-43e1-b365-6af34ad40f22 tempest-VolumesActionsTest-1847628510 tempest-VolumesActionsTest-1847628510-project] 10.222.0.52 "GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88" status: 404 len: 111 microversion: 2.1 time: 0.038255 May 14 21:42:21.202718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:21.203398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:21.206956 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3158/5903] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:21 2022] GET /compute/v2.1/servers/3ee751a8-3bfb-4b61-8117-6f8e05f6cd88 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:42:21.422935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:21.433874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db07220b-76ab-4b77-b772-233d2b23ae30 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.252782 May 14 21:42:21.438380 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2746/5904] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:21 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:21.675009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:21.675009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:21.675768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:21.676401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:21.677341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:21.677926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:21.950141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:21.958472 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-97e3cf41-ac60-447f-ac38-00692f699d22 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.295616 May 14 21:42:21.964355 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3159/5905] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:21 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:22.434020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9abc1e3c-151a-43ae-81f4-b8eea6488de5 req-ff139b05-a091-4dc5-931a-955e1170e836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787596fc-6501-43f7-9502-4ccc956edc28", "name": "network-vif-plugged", "status": "completed", "tag": "df9f28e4-be02-4fc7-94ef-9bfdd439d06d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:22.452653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9abc1e3c-151a-43ae-81f4-b8eea6488de5 req-ff139b05-a091-4dc5-931a-955e1170e836 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:22.454738 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:22.455371 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:22.456973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9abc1e3c-151a-43ae-81f4-b8eea6488de5 req-ff139b05-a091-4dc5-931a-955e1170e836 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:22.463229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:22.463730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:22.464531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:22.465021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:22.496630 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9abc1e3c-151a-43ae-81f4-b8eea6488de5 req-ff139b05-a091-4dc5-931a-955e1170e836 service nova] Creating event network-vif-plugged:df9f28e4-be02-4fc7-94ef-9bfdd439d06d for instance 787596fc-6501-43f7-9502-4ccc956edc28 on nch1-master-1 May 14 21:42:22.509937 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9abc1e3c-151a-43ae-81f4-b8eea6488de5 req-ff139b05-a091-4dc5-931a-955e1170e836 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079679 May 14 21:42:22.511275 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2747/5906] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:22.869513 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:22.883676 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2a05d25-ede9-4de3-941e-bac588e6e15e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.427795 May 14 21:42:22.884608 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3160/5907] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:22 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:22.982537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:22.983598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:22.995690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:22.996460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:22.997266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:22.997718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:23.671610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:23.682169 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4862a8e2-f2b3-4842-b0dc-2065044675d1 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1314 microversion: 2.1 time: 0.704246 May 14 21:42:23.693550 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2748/5908] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:22 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:23.903227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:23.903909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:23.916710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:23.919077 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:23.921261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:23.923796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:24.329048 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:24.337541 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6861aebe-65e8-43b1-aa7c-5fd95b45f8d6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.439132 May 14 21:42:24.339628 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3161/5909] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:23 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:24.711272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:24.712143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:24.721214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:24.721984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:24.723410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:24.724157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:25.137554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:25.150309 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7ded6b5-bdbe-4813-8dbe-35f966f6464f tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1498 microversion: 2.1 time: 0.443821 May 14 21:42:25.157445 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2749/5910] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:24 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1498 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:25.354636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:25.355319 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:25.365989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:25.366597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:25.367406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:25.374148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:25.988610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:26.030305 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07d6db50-2907-49ec-8cfa-fe56c6f3223e tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.679754 May 14 21:42:26.035169 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3162/5911] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:25 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:27.051793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:27.052321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:27.059952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:27.060416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:27.063365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:27.063365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:27.464697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:27.477977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ccf56ab-9242-48ed-87a8-d684966d1ae0 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.430054 May 14 21:42:27.479313 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2750/5912] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:27 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:28.507075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:28.507953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:28.551143 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:28.551776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:28.552572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:28.557422 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:28.887203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:28.895864 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-60cc255d-1f63-4819-98a2-9028d3444276 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.404457 May 14 21:42:28.898871 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3163/5913] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:28 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:29.918722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:29.921414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:29.946926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:29.947389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:29.948222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:29.948668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:30.328133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:30.353712 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cf33d00e-df49-41c8-9903-6bf719c15e29 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.435470 May 14 21:42:30.363202 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2751/5914] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:29 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:30.380083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-d9bd241f-7fa9-40a3-a330-84c13ac4897a req-8d9abde1-7fdc-4d3a-b257-3b89ca381ebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c548d30e-d00d-4158-a577-383be392e733", "name": "network-vif-plugged", "status": "completed", "tag": "a9fe4e9d-844f-4445-8996-495ffab498b8"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:30.405338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d9bd241f-7fa9-40a3-a330-84c13ac4897a req-8d9abde1-7fdc-4d3a-b257-3b89ca381ebf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:30.405809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-d9bd241f-7fa9-40a3-a330-84c13ac4897a req-8d9abde1-7fdc-4d3a-b257-3b89ca381ebf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:30.441508 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-d9bd241f-7fa9-40a3-a330-84c13ac4897a req-8d9abde1-7fdc-4d3a-b257-3b89ca381ebf service nova] Creating event network-vif-plugged:a9fe4e9d-844f-4445-8996-495ffab498b8 for instance c548d30e-d00d-4158-a577-383be392e733 on nch2-master-1 May 14 21:42:30.455407 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-d9bd241f-7fa9-40a3-a330-84c13ac4897a req-8d9abde1-7fdc-4d3a-b257-3b89ca381ebf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080743 May 14 21:42:30.457090 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3164/5915] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:30.820414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:30.820858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:30.834461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:30.834893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:30.835743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:30.839781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:30.904306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:42:31.313369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c59a308-7617-49a2-a5b1-a4a36b1a4383 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "DELETE /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 204 len: 0 microversion: 2.1 time: 0.497905 May 14 21:42:31.317959 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2752/5916] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:42:30 2022] DELETE /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:42:31.324321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:31.325458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:31.331989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:31.332452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:31.333253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:31.333700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:31.378747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:31.379470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:31.386097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:31.386564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:31.387385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:31.387860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:31.499694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:31.507492 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-86f437b5-36f0-448b-813d-0e96bef47b80 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1504 microversion: 2.1 time: 0.188022 May 14 21:42:31.508088 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3165/5917] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:31 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:31.551790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:31.560130 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad354913-0c7e-45b4-a449-26745d380f14 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1374 microversion: 2.1 time: 0.185625 May 14 21:42:31.560808 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2753/5918] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:31 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:32.529701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:32.530921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:32.551285 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:32.555629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:32.556614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:32.559323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:32.577443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:32.581110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:32.589042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:32.589967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:32.591841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:32.592641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:32.902255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:32.917298 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7d803a7c-0329-4d49-9ebf-584afe6cf5af tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1504 microversion: 2.1 time: 0.391829 May 14 21:42:32.918051 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3166/5919] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:32 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1504 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:33.510227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:33.520765 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb752c64-4cd3-4745-b7b6-f237232ddc4c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1545 microversion: 2.1 time: 0.947921 May 14 21:42:33.538756 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2754/5920] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:32 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1545 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:33.541957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:33.543168 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:33.561088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:33.562010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:33.562843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:33.564093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:33.937449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:33.938833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:33.955027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:33.955773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:33.956800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:33.960195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:34.008965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:34.017329 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d6e20915-0576-4aae-8774-191d644eec7c tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1545 microversion: 2.1 time: 0.480381 May 14 21:42:34.020321 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3167/5921] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:33 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1545 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:34.697393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:34.705366 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72889abe-6d2c-4a5b-8b6b-1eeafea847dd tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1504 microversion: 2.1 time: 0.772993 May 14 21:42:34.720175 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2755/5922] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:33 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1504 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:35.729983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:35.731417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:35.766985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:35.782487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:35.785078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:35.788931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:36.070171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f0269a87fb4a8fa8dbc1b84c134fe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0166571316634a7185b9768add179654', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:36.081568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-369eb1c9-3b0d-43c3-88b0-39757fedd92d req-e804bb99-9351-4cb1-ae67-6a38d41c3d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787596fc-6501-43f7-9502-4ccc956edc28", "name": "network-vif-deleted", "tag": "df9f28e4-be02-4fc7-94ef-9bfdd439d06d"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:36.108435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb206fd9-efa7-4e96-8f06-3331aa5329e5 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 200 len: 1299 microversion: 2.1 time: 0.385263 May 14 21:42:36.109058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2756/5923] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:35 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 1299 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:36.115446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-369eb1c9-3b0d-43c3-88b0-39757fedd92d req-e804bb99-9351-4cb1-ae67-6a38d41c3d03 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:36.121338 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-369eb1c9-3b0d-43c3-88b0-39757fedd92d req-e804bb99-9351-4cb1-ae67-6a38d41c3d03 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:36.149601 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-369eb1c9-3b0d-43c3-88b0-39757fedd92d req-e804bb99-9351-4cb1-ae67-6a38d41c3d03 service nova] Creating event network-vif-deleted:df9f28e4-be02-4fc7-94ef-9bfdd439d06d for instance 787596fc-6501-43f7-9502-4ccc956edc28 on nch1-master-1 May 14 21:42:36.156494 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-369eb1c9-3b0d-43c3-88b0-39757fedd92d req-e804bb99-9351-4cb1-ae67-6a38d41c3d03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.603549 May 14 21:42:36.159245 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3168/5924] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:42:36.615213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-419111440", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "35b6e5a3-f1f1-4cd9-a826-fda89a2237dc"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:36.716244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] validate_networks() for [('35b6e5a3-f1f1-4cd9-a826-fda89a2237dc', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:42:37.125543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:37.127040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] [instance: 787596fc-6501-43f7-9502-4ccc956edc28] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:37.152599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:37.152599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:37.154055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:37.155743 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:37.196497 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] HTTP exception thrown: Instance 787596fc-6501-43f7-9502-4ccc956edc28 could not be found. May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Request method failure captured: May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 HTTP/1.1 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCImA9ThkFw-qGHBHlExI_Vf942nMSU-hurxEimJ-oHCLncbDYwDXVFr95uzeOTAmdgLqAJmfkF2rSMovW1G_ZTnvDtGe3dtX_kFd5y0S-feTAcGfT7qIeDe31SGDKkvux6NEtOIytgHonbeMiEHYS5jc4pcvu5OF1A0JkR6vIT3gao May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 0166571316634a7185b9768add179654 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-VolumesActionsTest-1932666048 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0166571316634a7185b9768add179654"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0166571316634a7185b9768add179654"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0166571316634a7185b9768add179654"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0166571316634a7185b9768add179654", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-VolumesActionsTest-1932666048 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 0166571316634a7185b9768add179654 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-VolumesActionsTest-1932666048 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-VolumesActionsTest-1932666048-project May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: a3f0269a87fb4a8fa8dbc1b84c134fe7 May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-VolumesActionsTest-1932666048-project May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 787596fc-6501-43f7-9502-4ccc956edc28 could not be found. May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '787596fc-6501-43f7-9502-4ccc956edc28'} May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787596fc-6501-43f7-9502-4ccc956edc28 could not be found. May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787596fc-6501-43f7-9502-4ccc956edc28 could not be found. May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:42:37.202615 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:37.206826 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:42:37.206826 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:42:37.206826 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:42:37.206826 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:42:37.206826 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:42:37.206826 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787596fc-6501-43f7-9502-4ccc956edc28 could not be found. May 14 21:42:37.206826 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:42:37.210671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] Returning 404 to user: Instance 787596fc-6501-43f7-9502-4ccc956edc28 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:42:37.213291 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0a31cafe-531b-45b4-b87e-9202dc45a4f2 tempest-VolumesActionsTest-1932666048 tempest-VolumesActionsTest-1932666048-project] 10.222.0.52 "GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28" status: 404 len: 111 microversion: 2.1 time: 0.091784 May 14 21:42:37.216931 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3169/5925] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:37 2022] GET /compute/v2.1/servers/787596fc-6501-43f7-9502-4ccc956edc28 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:42:38.035333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:42:38.035891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:42:38.036438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:42:38.037510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:42:38.037941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:42:38.049330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:38.050094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:38.050940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:38.051664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:38.077603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Getting quotas for project ab48666810d04a19acf601f7f0be7231. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:42:38.085268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Getting quotas for user 05c848f818574d218be610bd709f733f and project ab48666810d04a19acf601f7f0be7231. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:42:38.100637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:42:38.103556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:42:38.207456 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93fa30da-063b-496c-ac2d-57c0e7988a24 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.726939 May 14 21:42:38.208175 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2757/5926] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:42:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:42:38.219269 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f74d3fca-e0c2-4f2e-ab75-707c1c03f87e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:38.220079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f74d3fca-e0c2-4f2e-ab75-707c1c03f87e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:38.404584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f74d3fca-e0c2-4f2e-ab75-707c1c03f87e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:38.410171 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f74d3fca-e0c2-4f2e-ab75-707c1c03f87e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1214 microversion: 2.1 time: 0.195014 May 14 21:42:38.412546 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3170/5927] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:38 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:38.748920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-46198cd0-c351-4e94-80b0-13afceb72055 req-b5035ab7-16e4-4bbe-8929-a5c66508027c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c548d30e-d00d-4158-a577-383be392e733", "tag": "a9fe4e9d-844f-4445-8996-495ffab498b8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:38.764590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-46198cd0-c351-4e94-80b0-13afceb72055 req-b5035ab7-16e4-4bbe-8929-a5c66508027c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:38.765054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-46198cd0-c351-4e94-80b0-13afceb72055 req-b5035ab7-16e4-4bbe-8929-a5c66508027c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:38.793507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-46198cd0-c351-4e94-80b0-13afceb72055 req-b5035ab7-16e4-4bbe-8929-a5c66508027c service nova] Creating event network-changed:a9fe4e9d-844f-4445-8996-495ffab498b8 for instance c548d30e-d00d-4158-a577-383be392e733 on nch2-master-1 May 14 21:42:38.809397 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-46198cd0-c351-4e94-80b0-13afceb72055 req-b5035ab7-16e4-4bbe-8929-a5c66508027c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064586 May 14 21:42:38.810812 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2758/5928] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:39.429833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-56bb34d5-81f1-4cd2-baea-3e700174c0b1 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:39.430487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-56bb34d5-81f1-4cd2-baea-3e700174c0b1 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:39.712086 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-56bb34d5-81f1-4cd2-baea-3e700174c0b1 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:39.740760 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-56bb34d5-81f1-4cd2-baea-3e700174c0b1 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1214 microversion: 2.1 time: 0.315375 May 14 21:42:39.746441 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3171/5929] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:39 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1214 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:40.765105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:40.767042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:40.787454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:40.790934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:40.794721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:40.795826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:40.904879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:40.922830 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a4b9a77-eddc-46ab-a6fb-88c213b5e017 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1266 microversion: 2.1 time: 0.154871 May 14 21:42:40.924091 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2759/5930] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:40 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:41.942237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:41.942947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:41.959690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:41.960453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:41.962849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:41.963911 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:42.122485 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:42.133671 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7ee9bf6-511e-420e-9cf5-350d1de723ae tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1272 microversion: 2.1 time: 0.196638 May 14 21:42:42.147413 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3172/5931] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:41 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1272 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:43.154433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:43.155154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:43.174388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:43.175329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:43.176449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:43.177057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:43.621624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:43.632901 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d180d9a3-0c52-4e69-9847-2ce2e7954fef tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.482442 May 14 21:42:43.633836 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2760/5932] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:43 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:44.653524 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:44.655897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:44.747296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:44.747296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:44.747296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:44.747296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:45.024358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:45.037051 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c7e1b12a-e469-479a-ab38-66f3c52c7fcc tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.389578 May 14 21:42:45.038175 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3173/5933] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:44 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:45.265547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-77734977-de27-493a-bc9a-dd450d04c0b0 req-016fe10d-7b93-4e2e-a1f3-6da5b9564f56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93c737c2-8af5-41a8-8755-4dfa4fedc7ac", "tag": "6688abac-fe8d-4e06-b94b-bf703577bc7d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:45.281818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-77734977-de27-493a-bc9a-dd450d04c0b0 req-016fe10d-7b93-4e2e-a1f3-6da5b9564f56 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:45.284461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-77734977-de27-493a-bc9a-dd450d04c0b0 req-016fe10d-7b93-4e2e-a1f3-6da5b9564f56 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:45.324501 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-77734977-de27-493a-bc9a-dd450d04c0b0 req-016fe10d-7b93-4e2e-a1f3-6da5b9564f56 service nova] Creating event network-changed:6688abac-fe8d-4e06-b94b-bf703577bc7d for instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac on nch1-master-1 May 14 21:42:45.338624 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-77734977-de27-493a-bc9a-dd450d04c0b0 req-016fe10d-7b93-4e2e-a1f3-6da5b9564f56 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075303 May 14 21:42:45.345604 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2761/5934] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:46.080052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:46.080052 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:46.085718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:46.112256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:46.112256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:46.112256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:46.369328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:46.389078 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3616faa4-711c-4845-8f00-ed3a98e72108 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.323255 May 14 21:42:46.400622 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3174/5935] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:46 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:47.412069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:47.413693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:47.422075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:47.422619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:47.423690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:47.424194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:47.597728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:47.611153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2570d205-8365-4e02-b27d-715ab917f6d9 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.207870 May 14 21:42:47.612631 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2762/5936] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:47 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:48.629705 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:48.630415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:48.650308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:48.650810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:48.657768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:48.657768 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:49.316271 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:49.346853 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-48f3d157-1f3a-4add-bfeb-336b97b09f6a tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.719003 May 14 21:42:49.348785 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3175/5937] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:48 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:50.374531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:50.375150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:50.387877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:50.388573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:50.389636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:50.390014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:50.598337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:50.608332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e0b9f83-a0d9-4573-9b3e-604c1b40b77b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.246993 May 14 21:42:50.611550 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2763/5938] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:50 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:51.629190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:51.630901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:51.640647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:51.641954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:51.643880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:51.644957 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:51.817946 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:51.828520 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ac63b69e-4c99-4a26-81ff-9c61f8f18162 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.205475 May 14 21:42:51.829708 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3176/5939] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:51 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:52.384851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c868d3d6-c4d2-4e88-9caf-52b3f9b605ea req-86620102-7b14-402c-9256-743ef1e68595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c737c2-8af5-41a8-8755-4dfa4fedc7ac", "name": "network-vif-plugged", "status": "completed", "tag": "6688abac-fe8d-4e06-b94b-bf703577bc7d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:52.394251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c868d3d6-c4d2-4e88-9caf-52b3f9b605ea req-86620102-7b14-402c-9256-743ef1e68595 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:52.394780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c868d3d6-c4d2-4e88-9caf-52b3f9b605ea req-86620102-7b14-402c-9256-743ef1e68595 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:52.407048 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c868d3d6-c4d2-4e88-9caf-52b3f9b605ea req-86620102-7b14-402c-9256-743ef1e68595 service nova] Creating event network-vif-plugged:6688abac-fe8d-4e06-b94b-bf703577bc7d for instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac on nch1-master-1 May 14 21:42:52.412664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c868d3d6-c4d2-4e88-9caf-52b3f9b605ea req-86620102-7b14-402c-9256-743ef1e68595 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033351 May 14 21:42:52.413360 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2764/5940] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:42:52.850805 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:52.851639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:52.859335 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:52.859843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:52.863415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:52.863415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:53.041655 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:53.049119 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-feb6a20d-f18b-4142-a2ee-cf6a3a450112 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1314 microversion: 2.1 time: 0.202650 May 14 21:42:53.049638 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3177/5941] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:52 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:54.072366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:54.073152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:54.080580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.081043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.081955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.082515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.221403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:54.230029 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e21736a-d005-4108-a53d-43010d9127f2 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1501 microversion: 2.1 time: 0.167052 May 14 21:42:54.230616 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2765/5942] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:54 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:54.248463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:54.249197 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:54.256280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.256737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.257536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.257974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.392922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:54.401043 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65f0e05b-048f-47f7-a31b-8831d4ccb748 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1501 microversion: 2.1 time: 0.156439 May 14 21:42:54.406670 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3178/5943] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:54 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:54.418493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:54.419051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:54.425485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.425948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.426732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.427804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.451535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lazy-loading 'flavor' on Instance uuid 93c737c2-8af5-41a8-8755-4dfa4fedc7ac {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:42:54.683247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e41a9564-52d2-4d6b-aa7c-e793ffe22bbd tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action" status: 202 len: 0 microversion: 2.1 time: 0.268003 May 14 21:42:54.687639 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2766/5944] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:42:54 2022] POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:42:54.694598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:54.695370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:54.705796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.706240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.707367 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:54.708531 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:54.863615 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:54.874013 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-abda8a6f-e2ef-4399-8842-3eb1ce4c56ed tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1509 microversion: 2.1 time: 0.185430 May 14 21:42:54.875326 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3179/5945] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:54 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:42:55.454317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7e46061e-3bc9-46e4-afa0-1e0a9b4061e3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:55.455409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7e46061e-3bc9-46e4-afa0-1e0a9b4061e3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:55.461898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e46061e-3bc9-46e4-afa0-1e0a9b4061e3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:55.462309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e46061e-3bc9-46e4-afa0-1e0a9b4061e3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:55.463086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e46061e-3bc9-46e4-afa0-1e0a9b4061e3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:55.463617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7e46061e-3bc9-46e4-afa0-1e0a9b4061e3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:55.515360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7e46061e-3bc9-46e4-afa0-1e0a9b4061e3 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733/action" status: 200 len: 24577 microversion: 2.1 time: 0.066413 May 14 21:42:55.516343 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2767/5946] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:42:55 2022] POST /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733/action => generated 24577 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:42:55.892736 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:55.893959 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:55.901689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:55.902153 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:55.902993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:55.903453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:56.039290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:56.046867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-02341f4b-7d95-4816-8207-993541943a16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1492 microversion: 2.1 time: 0.158349 May 14 21:42:56.047498 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3180/5947] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:55 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1492 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:56.064929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3ef04ec4-a409-4c49-98f9-ad424e98c281 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:56.065567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3ef04ec4-a409-4c49-98f9-ad424e98c281 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:56.073730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ef04ec4-a409-4c49-98f9-ad424e98c281 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:56.074197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ef04ec4-a409-4c49-98f9-ad424e98c281 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:56.074978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ef04ec4-a409-4c49-98f9-ad424e98c281 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:56.075426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3ef04ec4-a409-4c49-98f9-ad424e98c281 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:56.263098 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3ef04ec4-a409-4c49-98f9-ad424e98c281 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action" status: 202 len: 0 microversion: 2.1 time: 0.202650 May 14 21:42:56.263776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2768/5948] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:42:56 2022] POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:42:56.272546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:56.273202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:56.279147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:56.279645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:56.280436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:56.280883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:56.419393 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:56.428529 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-11d592a1-7706-45ac-a1e4-dee224d6f937 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1498 microversion: 2.1 time: 0.160360 May 14 21:42:56.431569 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3181/5949] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:56 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:57.448508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:57.449255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:57.455598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:57.456173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:57.456943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:57.457391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:57.609904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:57.627420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a598448-9a0a-43bf-a781-3c9ccd40ff48 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1498 microversion: 2.1 time: 0.185088 May 14 21:42:57.636331 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2769/5950] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:57 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:58.646144 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:58.647147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:58.655809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:58.656278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:58.657071 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:58.657551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:58.801401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:58.809571 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-479bb77e-c8ce-4836-ba14-d75e92d6d74e tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1501 microversion: 2.1 time: 0.167343 May 14 21:42:58.810141 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3182/5951] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:58 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1501 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:42:58.827527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:42:58.828065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:58.835422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:58.835907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:58.836695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:58.837142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:58.860381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lazy-loading 'flavor' on Instance uuid 93c737c2-8af5-41a8-8755-4dfa4fedc7ac {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:42:59.228299 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27c80559-335c-438f-bca4-1af2f15c695b tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action" status: 202 len: 0 microversion: 2.1 time: 0.404496 May 14 21:42:59.229034 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2770/5952] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:42:58 2022] POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:42:59.237246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:42:59.238120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:42:59.244358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:59.244869 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:59.245651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:42:59.246096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:42:59.415196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:42:59.422877 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-89e5edea-9a96-43d4-9b19-9a63999a9407 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1509 microversion: 2.1 time: 0.189601 May 14 21:42:59.423399 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3183/5953] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:42:59 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:00.442617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:00.444123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:00.450596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:00.451058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:00.451996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:00.452448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:00.589318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:00.596966 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-08021b7a-02f0-45ad-b545-a91a72b9e767 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1492 microversion: 2.1 time: 0.159693 May 14 21:43:00.597548 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2771/5954] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:00 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1492 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:00.613481 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fcdd6a91-7a29-4831-be84-61ec873b3033 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:00.614019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fcdd6a91-7a29-4831-be84-61ec873b3033 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:00.621325 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcdd6a91-7a29-4831-be84-61ec873b3033 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:00.621776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcdd6a91-7a29-4831-be84-61ec873b3033 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:00.622545 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcdd6a91-7a29-4831-be84-61ec873b3033 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:00.622995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fcdd6a91-7a29-4831-be84-61ec873b3033 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:00.920606 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fcdd6a91-7a29-4831-be84-61ec873b3033 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action" status: 202 len: 0 microversion: 2.1 time: 0.310813 May 14 21:43:00.921424 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3184/5955] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:43:00 2022] POST /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:43:00.930892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:00.931554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:00.937744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:00.938187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:00.942921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:00.942921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:01.111652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:01.119307 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c96e4a2-b41e-4523-80d1-7f8bd6e00b16 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1498 microversion: 2.1 time: 0.193624 May 14 21:43:01.119923 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2772/5956] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:00 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:02.137714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:02.138494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:02.144754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:02.145224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:02.146544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:02.147231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:02.296406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:02.304647 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4306f498-5ab4-4fc2-bafc-0368567bfcaa tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1498 microversion: 2.1 time: 0.172149 May 14 21:43:02.305221 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3185/5957] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:02 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:03.322076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:03.322939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:03.330931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:03.331525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:03.332235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:03.332674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:03.473334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:03.481948 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-da5b670d-1cbd-4a7a-8850-ce42abd5c021 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1501 microversion: 2.1 time: 0.165254 May 14 21:43:03.482542 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2773/5958] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:03 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:03.499085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:03.499657 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:03.506883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:03.507350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:03.508396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:03.508845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:03.535321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:43:03.871182 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e7b28ae8-ff4f-47d4-8a81-ba222928aa58 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 204 len: 0 microversion: 2.1 time: 0.375622 May 14 21:43:03.871945 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3186/5959] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:43:03 2022] DELETE /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:43:03.886180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:03.886800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:03.892730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:03.893237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:03.893991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:03.894437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:04.046685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:04.055047 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d378a7bd-1626-4a76-b530-85f0de12ef66 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1507 microversion: 2.1 time: 0.172690 May 14 21:43:04.055693 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2774/5960] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:03 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:05.073853 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:05.074595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:05.081439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:05.081888 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:05.082661 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:05.083100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:05.222466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:05.230670 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b25f0972-02dd-4971-8733-c1ff416d0ca6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1507 microversion: 2.1 time: 0.161169 May 14 21:43:05.233278 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3187/5961] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:05 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:06.216517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-be96aa95-1ca4-4fa1-9b70-b866c38338b8 req-ccf37472-0c3d-4375-ad65-25568b1a99a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93c737c2-8af5-41a8-8755-4dfa4fedc7ac", "name": "network-vif-deleted", "tag": "6688abac-fe8d-4e06-b94b-bf703577bc7d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:06.224798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-be96aa95-1ca4-4fa1-9b70-b866c38338b8 req-ccf37472-0c3d-4375-ad65-25568b1a99a0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:06.225258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-be96aa95-1ca4-4fa1-9b70-b866c38338b8 req-ccf37472-0c3d-4375-ad65-25568b1a99a0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:06.237075 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-be96aa95-1ca4-4fa1-9b70-b866c38338b8 req-ccf37472-0c3d-4375-ad65-25568b1a99a0 service nova] Creating event network-vif-deleted:6688abac-fe8d-4e06-b94b-bf703577bc7d for instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac on nch1-master-1 May 14 21:43:06.242701 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-be96aa95-1ca4-4fa1-9b70-b866c38338b8 req-ccf37472-0c3d-4375-ad65-25568b1a99a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 May 14 21:43:06.248194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:06.248811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:06.254922 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2775/5962] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:06.256763 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:06.258053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:06.259186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:06.259809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:06.325558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05c848f818574d218be610bd709f733f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab48666810d04a19acf601f7f0be7231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:06.333960 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-186fddc4-02b6-4e13-801c-1a21af3cb18f tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 200 len: 1465 microversion: 2.1 time: 0.088941 May 14 21:43:06.335147 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3188/5963] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:06 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 1465 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:06.569678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-023c445a-44b8-44b0-812b-b302318c36d4 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:06.570856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-023c445a-44b8-44b0-812b-b302318c36d4 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:06.578599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023c445a-44b8-44b0-812b-b302318c36d4 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:06.579004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023c445a-44b8-44b0-812b-b302318c36d4 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:06.579896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023c445a-44b8-44b0-812b-b302318c36d4 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:06.580452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023c445a-44b8-44b0-812b-b302318c36d4 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:06.632122 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-023c445a-44b8-44b0-812b-b302318c36d4 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "POST /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733/action" status: 200 len: 32644 microversion: 2.1 time: 0.066276 May 14 21:43:06.632993 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2776/5964] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:43:06 2022] POST /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733/action => generated 32644 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:43:07.352873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:07.356099 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] [instance: 93c737c2-8af5-41a8-8755-4dfa4fedc7ac] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:07.362374 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:07.362901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:07.363774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:07.364288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:07.382958 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] HTTP exception thrown: Instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac could not be found. May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Request method failure captured: May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac HTTP/1.1 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCJHsybNg8sA5rWhT4w3oHyEbOYKOiLgMMoV-jmx6JIN1-7Oas0uNdGvLNP2R08vQeMPwhTzGf3CkB6flYEoOoXrmOh1PiYeo9_inU_SgQtN1rAwbQ-3T41wnJ_DRuW8eFtVr2XHCUnbTg6lMOFaSp_KzD1_yTC0sxa8sGymWDyl7xY May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: ab48666810d04a19acf601f7f0be7231 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestServerAdvancedOps-892963183 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab48666810d04a19acf601f7f0be7231"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/ab48666810d04a19acf601f7f0be7231"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/ab48666810d04a19acf601f7f0be7231"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_ab48666810d04a19acf601f7f0be7231", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestServerAdvancedOps-892963183 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: ab48666810d04a19acf601f7f0be7231 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestServerAdvancedOps-892963183 May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestServerAdvancedOps-892963183-project May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 05c848f818574d218be610bd709f733f May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestServerAdvancedOps-892963183-project May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac could not be found. May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '93c737c2-8af5-41a8-8755-4dfa4fedc7ac'} May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac could not be found. May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac could not be found. May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:43:07.384896 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac could not be found. May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] Returning 404 to user: Instance 93c737c2-8af5-41a8-8755-4dfa4fedc7ac could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-91dc1695-b1fb-4884-a90b-dada02d7dac6 tempest-TestServerAdvancedOps-892963183 tempest-TestServerAdvancedOps-892963183-project] 10.222.0.52 "GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac" status: 404 len: 111 microversion: 2.1 time: 0.038609 May 14 21:43:07.393446 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3189/5965] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:07 2022] GET /compute/v2.1/servers/93c737c2-8af5-41a8-8755-4dfa4fedc7ac => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:43:08.391734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-581552834", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:08.434442 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:08.435450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:08.451322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:08.452638 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:08.454415 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:08.455538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:08.470425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:43:08.523058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:43:08.725407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:43:08.726064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:43:08.726550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:43:08.726970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:43:08.727420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:43:08.736402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:08.736864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:08.737678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:08.738640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:08.756710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Getting quotas for project 8526cad5fef54772a988df44138c90fe. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:43:08.762301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Getting quotas for user 80f409708620474aa128bf8412fa54be and project 8526cad5fef54772a988df44138c90fe. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:43:08.775391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:43:08.777847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:43:08.943965 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18d3e523-7360-45be-acf3-d860298bc59f tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556520 May 14 21:43:08.944891 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2777/5966] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:43:08.956296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5499c1b9-d4c9-444f-acbb-4a697ee639e0 req-b12a695e-e640-4b33-bf33-f5d34e119f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c548d30e-d00d-4158-a577-383be392e733", "tag": "a9fe4e9d-844f-4445-8996-495ffab498b8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:08.972103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5499c1b9-d4c9-444f-acbb-4a697ee639e0 req-b12a695e-e640-4b33-bf33-f5d34e119f7b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:08.972744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5499c1b9-d4c9-444f-acbb-4a697ee639e0 req-b12a695e-e640-4b33-bf33-f5d34e119f7b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:08.985417 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5dcf5135-7eae-4f24-b3cc-e1a16f61dd0b tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 204 len: 0 microversion: 2.1 time: 0.556146 May 14 21:43:08.986110 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3190/5967] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:43:08 2022] DELETE /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:43:08.994735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8a6bfa56-a847-4b26-9793-9592ca22a6b0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:08.997603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8a6bfa56-a847-4b26-9793-9592ca22a6b0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:09.004401 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5499c1b9-d4c9-444f-acbb-4a697ee639e0 req-b12a695e-e640-4b33-bf33-f5d34e119f7b service nova] Creating event network-changed:a9fe4e9d-844f-4445-8996-495ffab498b8 for instance c548d30e-d00d-4158-a577-383be392e733 on nch2-master-1 May 14 21:43:09.012833 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5499c1b9-d4c9-444f-acbb-4a697ee639e0 req-b12a695e-e640-4b33-bf33-f5d34e119f7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066545 May 14 21:43:09.013671 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2778/5968] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:09.020865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:09.021593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:09.028303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:09.029042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:09.030012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:09.030474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:09.211943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:09.220095 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24259bcd-8413-4570-87bd-491a7acae89f tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1669 microversion: 2.1 time: 0.204988 May 14 21:43:09.221663 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2779/5969] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:09 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1669 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:09.446668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a6bfa56-a847-4b26-9793-9592ca22a6b0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:09.454700 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8a6bfa56-a847-4b26-9793-9592ca22a6b0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1213 microversion: 2.1 time: 0.467206 May 14 21:43:09.455353 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3191/5970] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:08 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1213 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:10.240210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:10.241463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:10.249299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:10.249769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:10.250558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:10.251006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:10.473645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:10.475732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:10.485368 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:10.487296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:10.488310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:10.489183 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:10.563860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:10.574755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4289a1e9-31aa-4db9-8694-3e1bab638dc6 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1669 microversion: 2.1 time: 0.338327 May 14 21:43:10.575663 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2780/5971] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:10 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1669 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:10.576621 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:10.593608 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-03879d5a-3bad-474c-b520-298013115d24 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1217 microversion: 2.1 time: 0.125317 May 14 21:43:10.604730 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3192/5972] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:10 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:11.030085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a9ac98d9-2249-4720-a288-30561b551178 req-cb964ff0-faa6-44e3-ab3d-e7180ee1b3c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c548d30e-d00d-4158-a577-383be392e733", "name": "network-vif-deleted", "tag": "a9fe4e9d-844f-4445-8996-495ffab498b8"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:11.038623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a9ac98d9-2249-4720-a288-30561b551178 req-cb964ff0-faa6-44e3-ab3d-e7180ee1b3c9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:11.039071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a9ac98d9-2249-4720-a288-30561b551178 req-cb964ff0-faa6-44e3-ab3d-e7180ee1b3c9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:11.050347 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a9ac98d9-2249-4720-a288-30561b551178 req-cb964ff0-faa6-44e3-ab3d-e7180ee1b3c9 service nova] Creating event network-vif-deleted:a9fe4e9d-844f-4445-8996-495ffab498b8 for instance c548d30e-d00d-4158-a577-383be392e733 on nch2-master-1 May 14 21:43:11.056576 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a9ac98d9-2249-4720-a288-30561b551178 req-cb964ff0-faa6-44e3-ab3d-e7180ee1b3c9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030619 May 14 21:43:11.057176 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2781/5973] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:11.592776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:11.593566 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:11.601874 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:11.603075 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:11.604167 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:11.604864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:11.613366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:11.614751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:11.628106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:11.629960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:11.631543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:11.632371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:11.652626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:11.653140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:11.653609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lazy-loading 'fault' on Instance uuid c548d30e-d00d-4158-a577-383be392e733 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:43:11.708135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:11.708353 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5a299e003422286f01bd44fda92bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5d1195cf21b4146ae0c49a9c95ab8fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:11.717898 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03f8e8ae-2d8b-49cb-a13b-e4201ed47fd0 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1283 microversion: 2.1 time: 0.111379 May 14 21:43:11.718947 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc223211-09c4-4f79-af7c-0f7f20d096de tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 200 len: 1339 microversion: 2.1 time: 0.130106 May 14 21:43:11.719951 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2782/5974] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:11 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:11.725677 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3193/5975] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:11 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 1339 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:12.741236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:12.741798 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:12.742188 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] [instance: c548d30e-d00d-4158-a577-383be392e733] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:12.742972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:12.749130 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:12.749841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:12.750842 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:12.751293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:12.758552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:12.759016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:12.759836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:12.760391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:12.767510 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] HTTP exception thrown: Instance c548d30e-d00d-4158-a577-383be392e733 could not be found. May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Request method failure captured: May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 HTTP/1.1 May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCGPzvzQx4M9urm-BS_8yUFO9mzxYPafHOFRPIXrXWiCEGDoVOaebEVpZqH4NmnDtdduA43Yl9oL6zh5XNm8Haf2ibTUkU-Ry-cW4QDO9T0b1ujXqQzTJOs04wWt94d39OfozxPYwr52RzjBh7B797VxBxyvuSGB9H-InYkGHMb-4oM May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: a5d1195cf21b4146ae0c49a9c95ab8fa May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestNetworkBasicOps-845713673 May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a5d1195cf21b4146ae0c49a9c95ab8fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a5d1195cf21b4146ae0c49a9c95ab8fa", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestNetworkBasicOps-845713673 May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: a5d1195cf21b4146ae0c49a9c95ab8fa May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestNetworkBasicOps-845713673 May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestNetworkBasicOps-845713673-project May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: cab5a299e003422286f01bd44fda92bc May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestNetworkBasicOps-845713673-project May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance c548d30e-d00d-4158-a577-383be392e733 could not be found. May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'c548d30e-d00d-4158-a577-383be392e733'} May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c548d30e-d00d-4158-a577-383be392e733 could not be found. May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c548d30e-d00d-4158-a577-383be392e733 could not be found. May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:43:12.770708 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c548d30e-d00d-4158-a577-383be392e733 could not be found. May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Returning 404 to user: Instance c548d30e-d00d-4158-a577-383be392e733 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8d99563e-124f-4ef0-9525-421f2975c672 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733" status: 404 len: 111 microversion: 2.1 time: 0.035663 May 14 21:43:12.782699 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3194/5976] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:12 2022] GET /compute/v2.1/servers/c548d30e-d00d-4158-a577-383be392e733 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:43:12.987497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:12.996146 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7da6c062-61d8-4c83-baf1-c1328f1a91fc tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.259341 May 14 21:43:12.996737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2783/5977] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:12 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:13.110624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2474041c-4f91-443c-87cf-ff2576766f04 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] Calling method '.version_select at 0x7fb1a6c60e50>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:13.232343 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2474041c-4f91-443c-87cf-ff2576766f04 tempest-TestNetworkBasicOps-845713673 tempest-TestNetworkBasicOps-845713673-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1779473625" status: 202 len: 0 microversion: 2.1 time: 0.125657 May 14 21:43:13.233039 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3195/5978] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 21:43:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1779473625 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:43:13.593357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f7c6391b-06b0-40ec-a716-bf521514c680 req-a322a11e-4f8f-4bdb-9bc8-b1e1b77da5bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5", "tag": "a2e00c97-6d45-43c9-993c-f7d6c4050513"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:13.602443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f7c6391b-06b0-40ec-a716-bf521514c680 req-a322a11e-4f8f-4bdb-9bc8-b1e1b77da5bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:13.602912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f7c6391b-06b0-40ec-a716-bf521514c680 req-a322a11e-4f8f-4bdb-9bc8-b1e1b77da5bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:13.614100 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f7c6391b-06b0-40ec-a716-bf521514c680 req-a322a11e-4f8f-4bdb-9bc8-b1e1b77da5bd service nova] Creating event network-changed:a2e00c97-6d45-43c9-993c-f7d6c4050513 for instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 on nch1-master-1 May 14 21:43:13.628744 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f7c6391b-06b0-40ec-a716-bf521514c680 req-a322a11e-4f8f-4bdb-9bc8-b1e1b77da5bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038799 May 14 21:43:13.629374 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2784/5979] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:14.013230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:14.014440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:14.022846 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:14.023573 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:14.024433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:14.025031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:14.247709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:14.256423 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7de216e7-8d02-476c-87fb-5b03e861d0be tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.246560 May 14 21:43:14.257113 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3196/5980] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:14 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:15.274988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:15.276016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:15.283502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:15.283966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:15.284748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:15.286016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:15.468660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:15.477951 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1236c0a4-906e-4e04-9f16-e8cda432f233 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.207818 May 14 21:43:15.478817 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2785/5981] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:15 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:16.494866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:16.495397 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:16.502950 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:16.508023 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:16.509237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:16.509796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:16.793587 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:16.803736 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d5f8553f-47c2-4dd1-a996-6dfcbf4744cf tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.311931 May 14 21:43:16.804354 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3197/5982] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:16 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:17.820981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:17.821633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:17.828725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:17.829142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:17.829926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:17.830379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:17.986708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:17.994876 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ec251f7-e125-44d0-9095-09d47d89e063 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.177945 May 14 21:43:17.995579 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2786/5983] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:17 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:19.012207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:19.012848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:19.020249 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:19.020714 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:19.022658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:19.023142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:19.159777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:19.168106 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3aa9d19-5b44-4054-9a23-bff2f41d96b1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.160188 May 14 21:43:19.168779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3198/5984] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:19 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:20.185251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:20.185873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:20.193051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:20.194436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:20.195468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:20.196176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:20.332127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:20.341438 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2fd13e6f-c535-4c17-804a-27768cad7a71 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.160197 May 14 21:43:20.342035 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2787/5985] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:20 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:20.451956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-b80c464c-63dc-4d14-9478-5ae94d125abf req-42ccd449-c3d3-423e-bdeb-b9b73d2c86f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5", "name": "network-vif-plugged", "status": "completed", "tag": "a2e00c97-6d45-43c9-993c-f7d6c4050513"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:20.461214 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b80c464c-63dc-4d14-9478-5ae94d125abf req-42ccd449-c3d3-423e-bdeb-b9b73d2c86f4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:20.461685 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b80c464c-63dc-4d14-9478-5ae94d125abf req-42ccd449-c3d3-423e-bdeb-b9b73d2c86f4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:20.472923 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-b80c464c-63dc-4d14-9478-5ae94d125abf req-42ccd449-c3d3-423e-bdeb-b9b73d2c86f4 service nova] Creating event network-vif-plugged:a2e00c97-6d45-43c9-993c-f7d6c4050513 for instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 on nch1-master-1 May 14 21:43:20.478549 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-b80c464c-63dc-4d14-9478-5ae94d125abf req-42ccd449-c3d3-423e-bdeb-b9b73d2c86f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030650 May 14 21:43:20.479139 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3199/5986] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:21.358530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:21.359835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:21.367542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:21.368169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:21.369029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:21.369580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:21.502208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:21.510361 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-829fe852-7f96-44ec-8c3c-2741026f1482 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1313 microversion: 2.1 time: 0.156008 May 14 21:43:21.510949 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2788/5987] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:21 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:21.547544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-eec17f39-cf6e-41d2-967c-cbd89cd115e0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Action: 'create', calling method: .version_select at 0x7fb1a6e88280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2009470981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/qMcx2TYte7Ftb0AKg3O54qrTJP3KfsJQ5VH5IuSi7bs01xiRIgsqJp8Z+yabumFvHvWK7XEyoufrG0wLNATwN77RGy197kwI6z3v/2Ug0j/jQKXiYXlEgTC/xeF992A=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:21.562305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-eec17f39-cf6e-41d2-967c-cbd89cd115e0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Getting quotas for project 72ef6fbeb65948a3b9cbd45229a26bec. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:43:21.567903 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-eec17f39-cf6e-41d2-967c-cbd89cd115e0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Getting quotas for user 139d42d8881949b3befd8e4412c64800 and project 72ef6fbeb65948a3b9cbd45229a26bec. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:43:21.689213 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-eec17f39-cf6e-41d2-967c-cbd89cd115e0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.309349 May 14 21:43:21.689836 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3200/5988] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:43:21 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:43:22.527612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:22.528289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:22.535015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:22.535486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:22.536288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:22.536763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:22.676701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:22.684444 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c7a406e3-f608-4be2-adb5-9a029b25107d tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1462 microversion: 2.1 time: 0.160953 May 14 21:43:22.685079 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2789/5989] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:22 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1462 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:22.702322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-975b0ec5-dd17-47dc-91c1-09e929eebd92 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2219050-2175-4ef5-b7e6-5497a584ba80", "device": "/dev/sdb"}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:22.703612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-975b0ec5-dd17-47dc-91c1-09e929eebd92 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:22.711057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975b0ec5-dd17-47dc-91c1-09e929eebd92 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:22.711558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975b0ec5-dd17-47dc-91c1-09e929eebd92 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:22.712333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975b0ec5-dd17-47dc-91c1-09e929eebd92 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:22.712774 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-975b0ec5-dd17-47dc-91c1-09e929eebd92 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:23.475736 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-975b0ec5-dd17-47dc-91c1-09e929eebd92 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "POST /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777479 May 14 21:43:23.476367 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3201/5990] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 21:43:22 2022] POST /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:30.221884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-630732614-access_point-1475147019", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "5b482ada-1091-4886-ac77-9909d7641353"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2009470981", "security_groups": [{"name": "tempest-secgroup_access--1594640582"}, {"name": "tempest-secgroup_general--1732503784"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:30.429447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] validate_networks() for [('5b482ada-1091-4886-ac77-9909d7641353', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:43:30.966476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:43:30.972161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:43:30.972161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:43:30.972161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:43:30.972161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:43:30.980192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:30.980733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:30.981736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:30.982242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:31.000472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Getting quotas for project 72ef6fbeb65948a3b9cbd45229a26bec. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:43:31.007238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Getting quotas for user 139d42d8881949b3befd8e4412c64800 and project 72ef6fbeb65948a3b9cbd45229a26bec. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:43:31.020116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:43:31.028951 ncdv-master-1 devstack@n-api.service[130637]: WARNING nova.utils [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-630732614-access_point-1475147019 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-630732614-acc May 14 21:43:31.028951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:43:31.125566 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b2922bd9-d29e-42c3-b1ac-2b2118dea1f1 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.911641 May 14 21:43:31.126458 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2790/5991] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:43:30 2022] POST /compute/v2.1/servers => generated 458 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:43:31.139401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5f12ecaf-9c4c-4180-949d-04825a58a818 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:31.140142 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5f12ecaf-9c4c-4180-949d-04825a58a818 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:31.201136 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5f12ecaf-9c4c-4180-949d-04825a58a818 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:31.210044 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5f12ecaf-9c4c-4180-949d-04825a58a818 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1294 microversion: 2.1 time: 0.075901 May 14 21:43:31.210637 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3202/5992] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:31 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1294 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:32.226396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:32.227471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:32.235016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:32.235494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:32.236297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:32.236750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:32.299150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:32.308104 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c55cc710-90f2-4fb6-8b4a-544563eb9b6b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1298 microversion: 2.1 time: 0.085780 May 14 21:43:32.309042 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2791/5993] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:32 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1298 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:33.328445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:33.328445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:33.335022 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:33.335731 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:33.336696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:33.337451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:33.411780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:33.419509 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43ea6f86-7784-4231-a6fe-2f5524ad4538 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1354 microversion: 2.1 time: 0.098014 May 14 21:43:33.420147 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3203/5994] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:33 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:34.458843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:34.460990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:34.476523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:34.477108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:34.478170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:34.479348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:34.731640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:34.741729 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d00687b-d9cf-42d1-8af8-66b580a3774b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.307485 May 14 21:43:34.746415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2792/5995] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:34 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:35.613182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-ba119abd-8514-4bfa-8738-6db936e5d87e req-b9cd2d8c-a39d-47b3-8731-b76051a021c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405b63c7-0cff-4fea-a9ae-abc1d0250bbc", "tag": "0217e206-fd26-4ebe-9052-2170cfdca84e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:35.622014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ba119abd-8514-4bfa-8738-6db936e5d87e req-b9cd2d8c-a39d-47b3-8731-b76051a021c7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:35.622718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-ba119abd-8514-4bfa-8738-6db936e5d87e req-b9cd2d8c-a39d-47b3-8731-b76051a021c7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:35.635221 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-ba119abd-8514-4bfa-8738-6db936e5d87e req-b9cd2d8c-a39d-47b3-8731-b76051a021c7 service nova] Creating event network-changed:0217e206-fd26-4ebe-9052-2170cfdca84e for instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc on nch2-master-1 May 14 21:43:35.640331 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-ba119abd-8514-4bfa-8738-6db936e5d87e req-b9cd2d8c-a39d-47b3-8731-b76051a021c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032578 May 14 21:43:35.640954 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3204/5996] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:35.763367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:35.764204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:35.771396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:35.772320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:35.773224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:35.773899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:36.010669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:36.019181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76df590b-ab98-4165-b431-d9274fa282a8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.260303 May 14 21:43:36.019916 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2793/5997] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:35 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:37.042334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:37.043900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:37.051656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:37.052800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:37.053790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:37.054424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:37.207908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:37.217039 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1d9d87f6-46d2-4ec3-bb6a-01df0c7c7e89 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.183858 May 14 21:43:37.221667 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3205/5998] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:37 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:38.234139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:38.234841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:38.241650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:38.242092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:38.242866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:38.243306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:38.395087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:38.405177 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-38e6f105-bfd2-40ce-bd2e-0c03ff1fe877 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.174955 May 14 21:43:38.407796 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2794/5999] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:38 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:39.422502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:39.423150 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:39.431906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:39.432358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:39.433473 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:39.433977 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:39.590161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:39.597567 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1f058022-e526-4ada-9da7-b6f9174ab13e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.179310 May 14 21:43:39.598139 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3206/6000] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:39 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:40.614344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:40.614906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:40.622552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:40.623024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:40.624390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:40.624865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:40.776025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:40.783390 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3bcea9c8-c628-4770-8bcc-ce83b18e1451 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.173120 May 14 21:43:40.784005 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2795/6001] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:40 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:41.801389 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:41.802042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:41.809673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:41.810129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:41.812939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:41.812939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:41.967607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:41.973435 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d84f5051-82eb-4881-b844-f96a9e25b5a0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.176018 May 14 21:43:41.980166 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3207/6002] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:41 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:42.318612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-242b82e6-f8ac-463c-980e-be2436c6db5d req-93dba771-c895-416e-a0a2-9a7a7cfabac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405b63c7-0cff-4fea-a9ae-abc1d0250bbc", "name": "network-vif-plugged", "status": "completed", "tag": "0217e206-fd26-4ebe-9052-2170cfdca84e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:42.328435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-242b82e6-f8ac-463c-980e-be2436c6db5d req-93dba771-c895-416e-a0a2-9a7a7cfabac8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:42.329104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-242b82e6-f8ac-463c-980e-be2436c6db5d req-93dba771-c895-416e-a0a2-9a7a7cfabac8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:42.344444 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-242b82e6-f8ac-463c-980e-be2436c6db5d req-93dba771-c895-416e-a0a2-9a7a7cfabac8 service nova] Creating event network-vif-plugged:0217e206-fd26-4ebe-9052-2170cfdca84e for instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc on nch2-master-1 May 14 21:43:42.349539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-242b82e6-f8ac-463c-980e-be2436c6db5d req-93dba771-c895-416e-a0a2-9a7a7cfabac8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035284 May 14 21:43:42.350145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2796/6003] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:42.991935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:42.992551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:42.999859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:43.000313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:43.001078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:43.001518 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:43.148540 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:43.157163 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53881a20-2dab-497f-bca2-2313e99b7353 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1472 microversion: 2.1 time: 0.169188 May 14 21:43:43.157746 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3208/6004] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:42 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1472 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:44.176373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:44.177079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:44.184187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:44.185184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:44.185543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:44.185996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:44.333358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:44.341230 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0a41172-11e4-4da9-9a5b-65534a721399 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1645 microversion: 2.1 time: 0.170039 May 14 21:43:44.345858 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2797/6005] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:44 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1645 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:44.357669 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:44.358284 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:44.364949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:44.365399 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:44.366159 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:44.366595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:44.522817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:44.533007 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-895e12d8-308a-4431-af97-9a40819dd6b8 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1645 microversion: 2.1 time: 0.178828 May 14 21:43:44.534071 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3209/6006] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:44 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1645 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:44.550335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aba3b980-8b5e-4d57-8da1-31eb7e5a2200 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:44.550962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aba3b980-8b5e-4d57-8da1-31eb7e5a2200 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:44.556896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba3b980-8b5e-4d57-8da1-31eb7e5a2200 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:44.557357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba3b980-8b5e-4d57-8da1-31eb7e5a2200 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:44.558136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba3b980-8b5e-4d57-8da1-31eb7e5a2200 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:44.558587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba3b980-8b5e-4d57-8da1-31eb7e5a2200 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:44.859368 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aba3b980-8b5e-4d57-8da1-31eb7e5a2200 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1796 microversion: 2.1 time: 0.312711 May 14 21:43:44.859991 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2798/6007] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:44 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1796 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:45.314002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:45.314506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:45.320372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:45.326526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:45.326526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:45.326526 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:45.408832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lazy-loading 'services' on Instance uuid 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:43:45.654346 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-00fbb041-169a-4b1a-8e72-b6c40bdb2ee1 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5/os-volume_attachments/f2219050-2175-4ef5-b7e6-5497a584ba80" status: 202 len: 0 microversion: 2.1 time: 0.344381 May 14 21:43:45.655051 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3210/6008] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 21:43:45 2022] DELETE /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5/os-volume_attachments/f2219050-2175-4ef5-b7e6-5497a584ba80 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:43:46.778848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:46.779411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:46.787091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:46.787878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:46.792505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:46.792505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:46.819011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:43:47.090266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-fc437379-9ad9-4f57-afd8-e2cc8639486b req-66753cd3-3958-48d9-8465-09688ccee008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405b63c7-0cff-4fea-a9ae-abc1d0250bbc", "tag": "0217e206-fd26-4ebe-9052-2170cfdca84e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:47.112873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fc437379-9ad9-4f57-afd8-e2cc8639486b req-66753cd3-3958-48d9-8465-09688ccee008 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:47.113336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-fc437379-9ad9-4f57-afd8-e2cc8639486b req-66753cd3-3958-48d9-8465-09688ccee008 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:47.128936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-782ead44-5404-42b3-bb27-641790f4c8d6 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "DELETE /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 204 len: 0 microversion: 2.1 time: 0.353415 May 14 21:43:47.131900 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2799/6009] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:43:46 2022] DELETE /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:43:47.141131 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-fc437379-9ad9-4f57-afd8-e2cc8639486b req-66753cd3-3958-48d9-8465-09688ccee008 service nova] Creating event network-changed:0217e206-fd26-4ebe-9052-2170cfdca84e for instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc on nch2-master-1 May 14 21:43:47.143292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:47.144215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:47.146161 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-fc437379-9ad9-4f57-afd8-e2cc8639486b req-66753cd3-3958-48d9-8465-09688ccee008 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060950 May 14 21:43:47.147716 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3211/6010] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:47.156033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:47.156862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:47.157928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:47.158529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:47.404157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:47.412292 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7058b9a-1e00-415d-871f-c64617e6cd19 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1468 microversion: 2.1 time: 0.274905 May 14 21:43:47.413630 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2800/6011] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:47 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:48.439929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:48.440749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:48.448033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:48.448503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:48.449287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:48.449732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:48.595452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:48.603647 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b79ac69d-e222-4ab3-8dc7-16807c6c2522 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1468 microversion: 2.1 time: 0.168832 May 14 21:43:48.604233 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3212/6012] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:48 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1468 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:49.221199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2f432fd7-6ec7-454c-bdb1-c57c950c4485 req-cc538e12-d71b-44f7-83dc-05013fae4a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5", "name": "network-vif-deleted", "tag": "a2e00c97-6d45-43c9-993c-f7d6c4050513"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:43:49.230727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2f432fd7-6ec7-454c-bdb1-c57c950c4485 req-cc538e12-d71b-44f7-83dc-05013fae4a3f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:49.231280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2f432fd7-6ec7-454c-bdb1-c57c950c4485 req-cc538e12-d71b-44f7-83dc-05013fae4a3f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:49.243888 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2f432fd7-6ec7-454c-bdb1-c57c950c4485 req-cc538e12-d71b-44f7-83dc-05013fae4a3f service nova] Creating event network-vif-deleted:a2e00c97-6d45-43c9-993c-f7d6c4050513 for instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 on nch1-master-1 May 14 21:43:49.248789 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2f432fd7-6ec7-454c-bdb1-c57c950c4485 req-cc538e12-d71b-44f7-83dc-05013fae4a3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 May 14 21:43:49.249540 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2801/6013] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:43:49.620889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:49.621598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:49.628707 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:49.629178 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:49.629967 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:49.630423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:49.663942 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:49.664395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:49.665386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lazy-loading 'fault' on Instance uuid 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:43:49.705943 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80f409708620474aa128bf8412fa54be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8526cad5fef54772a988df44138c90fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:43:49.714107 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-620aef5b-d7ab-4621-8d63-39ac42d09065 tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 200 len: 1303 microversion: 2.1 time: 0.097316 May 14 21:43:49.714629 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3213/6014] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:49 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:43:50.732341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:43:50.732991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] [instance: 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:43:50.745561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:50.746027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:50.746817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:43:50.747262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:43:50.761053 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] HTTP exception thrown: Instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 could not be found. May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Request method failure captured: May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 HTTP/1.1 May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCJpeTqf-w9H7I_3-5DybyacIg_eND5rEsjtBLO_LfS6ryeZbZm9QQ7pCyM8abnYaw0Jy232jkOPEsIvflzBZZHkeqy3B-wEKix9oeMfwieIIKGjlsyviB0T-deQtl6EoU3BxOu5vvJQJUM99Aqd9K6d1vGDPGdv43FlV8Qz5f3dG5s May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 8526cad5fef54772a988df44138c90fe May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-VolumesBackupsTest-1778047115 May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8526cad5fef54772a988df44138c90fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8526cad5fef54772a988df44138c90fe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8526cad5fef54772a988df44138c90fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8526cad5fef54772a988df44138c90fe", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-VolumesBackupsTest-1778047115 May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 8526cad5fef54772a988df44138c90fe May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-VolumesBackupsTest-1778047115 May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-VolumesBackupsTest-1778047115-project May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 80f409708620474aa128bf8412fa54be May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-VolumesBackupsTest-1778047115-project May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 could not be found. May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5'} May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 could not be found. May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 could not be found. May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:43:50.762730 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 could not be found. May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] Returning 404 to user: Instance 88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-781d9a16-88a6-4dda-a6b6-00cf8bf50fda tempest-VolumesBackupsTest-1778047115 tempest-VolumesBackupsTest-1778047115-project] 10.222.0.52 "GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5" status: 404 len: 111 microversion: 2.1 time: 0.037855 May 14 21:43:50.767543 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2802/6015] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:43:50 2022] GET /compute/v2.1/servers/88c52cbb-5c1d-48b7-aa24-cb6bd0f468d5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:44:28.509372 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-988430505", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "4f892917-f415-425c-a436-49df8fe81795"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2009470981", "security_groups": []}, "os:scheduler_hints": {"different_host": ["405b63c7-0cff-4fea-a9ae-abc1d0250bbc"]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:44:28.572706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] validate_networks() for [('4f892917-f415-425c-a436-49df8fe81795', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:44:29.093157 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:44:29.093696 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:44:29.094401 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:44:29.095096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:44:29.095658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:44:29.108651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:29.110764 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:29.112286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:29.112945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:29.141015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Getting quotas for project 72ef6fbeb65948a3b9cbd45229a26bec. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:44:29.148772 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Getting quotas for user 139d42d8881949b3befd8e4412c64800 and project 72ef6fbeb65948a3b9cbd45229a26bec. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:44:29.167538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:44:29.170880 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:44:29.314090 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-47eb00ae-841c-446b-94a2-37a02a5f480b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.810138 May 14 21:44:29.314757 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3214/6016] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:44:28 2022] POST /compute/v2.1/servers => generated 361 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:44:29.325383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6dca7d09-00d3-42a5-a1c6-6f20ed9e6864 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:29.326127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6dca7d09-00d3-42a5-a1c6-6f20ed9e6864 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:29.388705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6dca7d09-00d3-42a5-a1c6-6f20ed9e6864 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:29.398509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6dca7d09-00d3-42a5-a1c6-6f20ed9e6864 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1241 microversion: 2.1 time: 0.076732 May 14 21:44:29.408782 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2803/6017] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:29 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:30.417784 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:30.418426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:30.426248 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:30.426712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:30.427530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:30.427981 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:30.505926 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:30.514383 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c74d82c-8dad-4643-a002-71006263d7bf tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1245 microversion: 2.1 time: 0.101689 May 14 21:44:30.515151 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3215/6018] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:30 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:31.533421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:31.534065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:31.542768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:31.543194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:31.544017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:31.544468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:31.630964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:31.639696 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-33522fda-2a3e-4939-841a-b6edf1cac3cd tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1301 microversion: 2.1 time: 0.111416 May 14 21:44:31.640408 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2804/6019] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:31 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1301 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:32.657560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:32.658117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:32.664906 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:32.665250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:32.666032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:32.666480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:32.752551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:32.758152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-bf09c078-fc08-4a02-ba17-403f7faa66c7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1299 microversion: 2.1 time: 0.104704 May 14 21:44:32.758732 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3216/6020] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:32 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:33.157262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fb130258-d6fc-4626-a49e-3981bb4aafa3 req-308ca630-0ca7-4b59-9d72-22e6ec57040d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72996ac8-6e9f-48e9-8e2f-e2ffa8834074", "tag": "a44db1c0-84e4-4ad3-928b-c4e8c27a8541"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:44:33.174876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fb130258-d6fc-4626-a49e-3981bb4aafa3 req-308ca630-0ca7-4b59-9d72-22e6ec57040d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:33.175270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fb130258-d6fc-4626-a49e-3981bb4aafa3 req-308ca630-0ca7-4b59-9d72-22e6ec57040d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:33.189210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fb130258-d6fc-4626-a49e-3981bb4aafa3 req-308ca630-0ca7-4b59-9d72-22e6ec57040d service nova] Creating event network-changed:a44db1c0-84e4-4ad3-928b-c4e8c27a8541 for instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 on nch1-master-1 May 14 21:44:33.194470 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fb130258-d6fc-4626-a49e-3981bb4aafa3 req-308ca630-0ca7-4b59-9d72-22e6ec57040d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041267 May 14 21:44:33.195083 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2805/6021] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:44:33.777215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:33.777215 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:33.784794 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:33.785256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:33.786036 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:33.786557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:33.873314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:33.881794 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-44b46b0e-2493-40d1-9941-6881b7f7dfc0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1299 microversion: 2.1 time: 0.109435 May 14 21:44:33.882526 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3217/6022] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:33 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:34.907446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:34.908291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:34.914615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:34.915066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:34.915912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:34.916358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:35.005521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:35.013081 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ad7d1b0-2105-4f92-9396-c8b728f4212f tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1299 microversion: 2.1 time: 0.111068 May 14 21:44:35.013661 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2806/6023] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:34 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:36.030264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:36.035154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:36.037910 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:36.038502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:36.039266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:36.039737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:36.124156 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:36.132465 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-74100bde-db3e-4571-9515-04fd75e21287 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1299 microversion: 2.1 time: 0.106353 May 14 21:44:36.133045 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3218/6024] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:36 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1299 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:37.150358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:37.150897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:37.158469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:37.159031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:37.159867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:37.160319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:37.249000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:37.256964 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-719b7120-73e7-450c-8d1d-cd78d794d2fc tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1299 microversion: 2.1 time: 0.110955 May 14 21:44:37.261403 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2807/6025] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:37 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:38.277792 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:38.278436 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:38.288346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:38.288749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:38.289544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:38.290045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:38.382037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:38.390128 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ae4acbab-4d32-4eac-ad85-e5a21de0459a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1299 microversion: 2.1 time: 0.118573 May 14 21:44:38.390721 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3219/6026] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:38 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:39.027311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7001ba56-8754-457a-82d5-76b8be6541fb req-1bccb81c-2b4c-4dbf-9f6b-6be4280b72fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72996ac8-6e9f-48e9-8e2f-e2ffa8834074", "name": "network-vif-plugged", "status": "completed", "tag": "a44db1c0-84e4-4ad3-928b-c4e8c27a8541"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:44:39.036537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7001ba56-8754-457a-82d5-76b8be6541fb req-1bccb81c-2b4c-4dbf-9f6b-6be4280b72fe service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:39.036993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7001ba56-8754-457a-82d5-76b8be6541fb req-1bccb81c-2b4c-4dbf-9f6b-6be4280b72fe service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:39.048476 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7001ba56-8754-457a-82d5-76b8be6541fb req-1bccb81c-2b4c-4dbf-9f6b-6be4280b72fe service nova] Creating event network-vif-plugged:a44db1c0-84e4-4ad3-928b-c4e8c27a8541 for instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 on nch1-master-1 May 14 21:44:39.053651 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7001ba56-8754-457a-82d5-76b8be6541fb req-1bccb81c-2b4c-4dbf-9f6b-6be4280b72fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171026 May 14 21:44:39.054249 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2808/6027] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:44:39.409693 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:39.410267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:39.417190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:39.417651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:39.418428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:39.418872 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:39.509598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:39.517944 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8404e99-5ce4-4a91-a13f-131036ba253e tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1299 microversion: 2.1 time: 0.112798 May 14 21:44:39.518510 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3220/6028] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:39 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:40.536208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:40.536910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:40.543244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.543738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:40.544592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.545031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:40.631860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:40.639613 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c45efde4-4872-4edf-abb3-b13045e0af27 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1472 microversion: 2.1 time: 0.109084 May 14 21:44:40.640200 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2809/6029] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:40 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:40.656934 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:40.657709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:40.664980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.665432 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:40.666204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.666647 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:40.749932 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:40.758283 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8da70e83-4fcc-4f9d-91c5-f08aab373c14 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1472 microversion: 2.1 time: 0.105252 May 14 21:44:40.758866 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3221/6030] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:40 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1472 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:40.775089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d355284-b4f2-4c49-ab69-bb5a7d12baf2 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:40.775695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d355284-b4f2-4c49-ab69-bb5a7d12baf2 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:40.781700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d355284-b4f2-4c49-ab69-bb5a7d12baf2 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.782163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d355284-b4f2-4c49-ab69-bb5a7d12baf2 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:40.782942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d355284-b4f2-4c49-ab69-bb5a7d12baf2 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.783436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d355284-b4f2-4c49-ab69-bb5a7d12baf2 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:40.862647 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d355284-b4f2-4c49-ab69-bb5a7d12baf2 tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1623 microversion: 2.1 time: 0.091629 May 14 21:44:40.863272 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2810/6031] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:40 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:40.879635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a794f651-4795-451b-9846-ce3788d17d5a tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:40.880250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a794f651-4795-451b-9846-ce3788d17d5a tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:40.886194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a794f651-4795-451b-9846-ce3788d17d5a tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.886645 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a794f651-4795-451b-9846-ce3788d17d5a tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:40.889430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a794f651-4795-451b-9846-ce3788d17d5a tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:40.889430 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a794f651-4795-451b-9846-ce3788d17d5a tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:41.028306 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a794f651-4795-451b-9846-ce3788d17d5a tempest-TestSecurityGroupsBasicOps-1077811156 tempest-TestSecurityGroupsBasicOps-1077811156-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1915 microversion: 2.1 time: 0.152938 May 14 21:44:41.028812 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3222/6032] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:40 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1915 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:41.364322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:41.364912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:41.371356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:41.374586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:41.374586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:41.374586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:41.400804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:44:41.715525 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5172161-2bc5-44d0-b57a-16e8c71302f5 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "DELETE /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 204 len: 0 microversion: 2.1 time: 0.356053 May 14 21:44:41.716457 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2811/6033] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:44:41 2022] DELETE /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:44:41.725204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:41.725832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:41.732595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:41.733484 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:41.733823 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:41.734333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:41.816703 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:41.824251 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0ad19461-06d2-4b7e-b36a-2c241013d92b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1478 microversion: 2.1 time: 0.103565 May 14 21:44:41.824826 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3223/6034] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:41 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1478 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:42.842868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:42.843633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:42.856196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:42.856696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:42.857507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:42.857953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:42.944282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:42.953760 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec94aeae-ce91-4d60-8b7f-c39201041f20 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1478 microversion: 2.1 time: 0.115221 May 14 21:44:42.958236 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2812/6035] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:42 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1478 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:43.565421 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-374b25cc-0cfa-42b8-a8ae-50c6410a44e1 req-5382f323-b083-41f0-b9c3-a3ddca239ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72996ac8-6e9f-48e9-8e2f-e2ffa8834074", "name": "network-vif-deleted", "tag": "a44db1c0-84e4-4ad3-928b-c4e8c27a8541"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:44:43.574581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-374b25cc-0cfa-42b8-a8ae-50c6410a44e1 req-5382f323-b083-41f0-b9c3-a3ddca239ef1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:43.575034 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-374b25cc-0cfa-42b8-a8ae-50c6410a44e1 req-5382f323-b083-41f0-b9c3-a3ddca239ef1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:43.587555 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-374b25cc-0cfa-42b8-a8ae-50c6410a44e1 req-5382f323-b083-41f0-b9c3-a3ddca239ef1 service nova] Creating event network-vif-deleted:a44db1c0-84e4-4ad3-928b-c4e8c27a8541 for instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 on nch1-master-1 May 14 21:44:43.592803 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-374b25cc-0cfa-42b8-a8ae-50c6410a44e1 req-5382f323-b083-41f0-b9c3-a3ddca239ef1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 May 14 21:44:43.593417 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3224/6036] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:44:43.972098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:43.972719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:43.979731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:43.981205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:43.981205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:43.981423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:44.013411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:44.013974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:44.014440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lazy-loading 'fault' on Instance uuid 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:44:44.063963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:44.072920 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-38aaf2f8-200a-4335-a5f0-6d6a3fd0f4f6 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 200 len: 1331 microversion: 2.1 time: 0.105347 May 14 21:44:44.073518 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2813/6037] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:43 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:45.091984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:45.092642 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 72996ac8-6e9f-48e9-8e2f-e2ffa8834074] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:45.099735 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:45.100195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:45.100980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:45.101427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:45.115659 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] HTTP exception thrown: Instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 could not be found. May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Request method failure captured: May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 HTTP/1.1 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCJ3tAPKRSAQrrsUfN82zKjVcbFnlIb1mGfj4Obyizrx_mYKmhyyAK2Au51p47mGHsWdUW2HbtQYVs0256NzX_JDGWiqoau92Uo0OrOSJmMsiWmaJ58FX45p7Js_8RxMPIJHHqXR34z0jviXkFI8jSCp9DtwEFJjp9ONc_uKOmYfuPM May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 72ef6fbeb65948a3b9cbd45229a26bec May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-630732614 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/72ef6fbeb65948a3b9cbd45229a26bec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/72ef6fbeb65948a3b9cbd45229a26bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/72ef6fbeb65948a3b9cbd45229a26bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_72ef6fbeb65948a3b9cbd45229a26bec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestSecurityGroupsBasicOps-630732614 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 72ef6fbeb65948a3b9cbd45229a26bec May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-630732614 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestSecurityGroupsBasicOps-630732614-project May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 139d42d8881949b3befd8e4412c64800 May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestSecurityGroupsBasicOps-630732614-project May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 could not be found. May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '72996ac8-6e9f-48e9-8e2f-e2ffa8834074'} May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 could not be found. May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 could not be found. May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:44:45.117291 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 could not be found. May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Returning 404 to user: Instance 72996ac8-6e9f-48e9-8e2f-e2ffa8834074 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-082b8453-e5f8-41f7-b501-ed547b8650c0 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074" status: 404 len: 111 microversion: 2.1 time: 0.032392 May 14 21:44:45.122053 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3225/6038] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:45 2022] GET /compute/v2.1/servers/72996ac8-6e9f-48e9-8e2f-e2ffa8834074 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:44:50.698948 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c1e11dbb-80d3-4652-b24e-00f7f29aaff1 req-e7980ff2-f242-4366-9a4d-16d7d967c98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405b63c7-0cff-4fea-a9ae-abc1d0250bbc", "tag": "0217e206-fd26-4ebe-9052-2170cfdca84e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:44:50.702765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:50.704762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:50.722526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:50.723006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:50.723948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:50.724402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:50.728280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c1e11dbb-80d3-4652-b24e-00f7f29aaff1 req-e7980ff2-f242-4366-9a4d-16d7d967c98d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:50.728873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c1e11dbb-80d3-4652-b24e-00f7f29aaff1 req-e7980ff2-f242-4366-9a4d-16d7d967c98d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:50.754401 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c1e11dbb-80d3-4652-b24e-00f7f29aaff1 req-e7980ff2-f242-4366-9a4d-16d7d967c98d service nova] Creating event network-changed:0217e206-fd26-4ebe-9052-2170cfdca84e for instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc on nch2-master-1 May 14 21:44:50.762585 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c1e11dbb-80d3-4652-b24e-00f7f29aaff1 req-e7980ff2-f242-4366-9a4d-16d7d967c98d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069145 May 14 21:44:50.765218 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3226/6039] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:44:50.781790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:44:51.132658 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c3a37e0-6710-48e7-8528-3e10d12fb7b2 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "DELETE /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 204 len: 0 microversion: 2.1 time: 0.444187 May 14 21:44:51.133241 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2814/6040] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:44:50 2022] DELETE /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:44:51.144135 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:51.144837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:51.152226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:51.153316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:51.153424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:51.153856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:51.324309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:51.333205 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-00b24701-0fe6-4d8c-9b84-ee52480cab94 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1770 microversion: 2.1 time: 0.195246 May 14 21:44:51.333844 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3227/6041] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:51 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1770 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:52.354431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:52.355174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:52.362839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:52.363305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:52.364136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:52.364588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:52.631283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:52.635365 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e0a1775-5b44-4e62-a12d-1c86e74b6ac7 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1770 microversion: 2.1 time: 0.286362 May 14 21:44:52.636276 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2815/6042] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:52 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1770 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:44:53.182321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2aa98d1a-ec38-460b-b5f9-cc0dc5ec861d req-f589301b-7294-4b85-a593-2bc342238e82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405b63c7-0cff-4fea-a9ae-abc1d0250bbc", "name": "network-vif-deleted", "tag": "0217e206-fd26-4ebe-9052-2170cfdca84e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:44:53.192256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2aa98d1a-ec38-460b-b5f9-cc0dc5ec861d req-f589301b-7294-4b85-a593-2bc342238e82 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:53.204388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2aa98d1a-ec38-460b-b5f9-cc0dc5ec861d req-f589301b-7294-4b85-a593-2bc342238e82 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:53.205004 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2aa98d1a-ec38-460b-b5f9-cc0dc5ec861d req-f589301b-7294-4b85-a593-2bc342238e82 service nova] Creating event network-vif-deleted:0217e206-fd26-4ebe-9052-2170cfdca84e for instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc on nch2-master-1 May 14 21:44:53.210370 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2aa98d1a-ec38-460b-b5f9-cc0dc5ec861d req-f589301b-7294-4b85-a593-2bc342238e82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 May 14 21:44:53.211192 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3228/6043] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:44:53.654573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:53.658457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:53.663232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:53.666629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:53.666629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:53.666629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:53.699078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:53.699571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:53.700040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lazy-loading 'fault' on Instance uuid 405b63c7-0cff-4fea-a9ae-abc1d0250bbc {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:44:53.746262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '139d42d8881949b3befd8e4412c64800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72ef6fbeb65948a3b9cbd45229a26bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:44:53.755114 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9bb06859-ee35-414d-b975-2ccaea056583 tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 200 len: 1384 microversion: 2.1 time: 0.104449 May 14 21:44:53.755887 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2816/6044] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:53 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 1384 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:44:54.773712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:44:54.774709 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] [instance: 405b63c7-0cff-4fea-a9ae-abc1d0250bbc] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:44:54.784867 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:54.785572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:54.786453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:44:54.787133 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:44:54.806691 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] HTTP exception thrown: Instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc could not be found. May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Request method failure captured: May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc HTTP/1.1 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCJ3tAPKRSAQrrsUfN82zKjVcbFnlIb1mGfj4Obyizrx_mYKmhyyAK2Au51p47mGHsWdUW2HbtQYVs0256NzX_JDGWiqoau92Uo0OrOSJmMsiWmaJ58FX45p7Js_8RxMPIJHHqXR34z0jviXkFI8jSCp9DtwEFJjp9ONc_uKOmYfuPM May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 72ef6fbeb65948a3b9cbd45229a26bec May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-630732614 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/72ef6fbeb65948a3b9cbd45229a26bec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/72ef6fbeb65948a3b9cbd45229a26bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/72ef6fbeb65948a3b9cbd45229a26bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_72ef6fbeb65948a3b9cbd45229a26bec", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestSecurityGroupsBasicOps-630732614 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 72ef6fbeb65948a3b9cbd45229a26bec May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-630732614 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestSecurityGroupsBasicOps-630732614-project May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 139d42d8881949b3befd8e4412c64800 May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestSecurityGroupsBasicOps-630732614-project May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc could not be found. May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '405b63c7-0cff-4fea-a9ae-abc1d0250bbc'} May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc could not be found. May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc could not be found. May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:44:54.808833 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc could not be found. May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Returning 404 to user: Instance 405b63c7-0cff-4fea-a9ae-abc1d0250bbc could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4c392b83-6bc5-41ba-b770-28a0c42c7c8b tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc" status: 404 len: 111 microversion: 2.1 time: 0.042791 May 14 21:44:54.820029 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3229/6045] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:44:54 2022] GET /compute/v2.1/servers/405b63c7-0cff-4fea-a9ae-abc1d0250bbc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:44:59.070202 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 21:44:59.070848 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 21:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 21:44:59.988906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cf9f3099-01f7-450b-ae12-ad400899632a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] Calling method '.version_select at 0x7fb1a6d803a0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:45:00.150810 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cf9f3099-01f7-450b-ae12-ad400899632a tempest-TestSecurityGroupsBasicOps-630732614 tempest-TestSecurityGroupsBasicOps-630732614-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2009470981" status: 202 len: 0 microversion: 2.1 time: 0.166140 May 14 21:45:00.154728 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2817/6046] 10.222.0.52 () {58 vars in 1277 bytes} [Sat May 14 21:44:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2009470981 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:46:08.188469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8faf26af-3e05-437a-95d1-16df1aaebbe0 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Action: 'create', calling method: .version_select at 0x7fb1a6c5c4c0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1687937417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK88ZbfUiIvsE55zojckVyg7nFNx0uJH3Z24ujOSL9wVf3Ar8z6/7uVM4/h1VaSBf5KN+9U8lJVMnC0BMyGD7rxJPGiq7Wv0bo6pfgRVfb5okxP4Rz7Xd+hyHZAZerlymQ=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:08.209931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8faf26af-3e05-437a-95d1-16df1aaebbe0 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Getting quotas for project 233de55e2a38457bb1837da8374b7b54. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:46:08.216279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-8faf26af-3e05-437a-95d1-16df1aaebbe0 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Getting quotas for user 2c025653d74848899a26c661400279cf and project 233de55e2a38457bb1837da8374b7b54. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:46:08.232054 ncdv-master-1 devstack@n-api.service[130638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8faf26af-3e05-437a-95d1-16df1aaebbe0 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [a9d27b0e-f5bb-4194-90bb-d1d1731a0c7d] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 21:46:09.241906 ncdv-master-1 devstack@n-api.service[130638]: INFO oslo.messaging._drivers.impl_rabbit [None req-8faf26af-3e05-437a-95d1-16df1aaebbe0 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [a9d27b0e-f5bb-4194-90bb-d1d1731a0c7d] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 57980. May 14 21:46:09.332846 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8faf26af-3e05-437a-95d1-16df1aaebbe0 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.350604 May 14 21:46:09.333645 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3230/6047] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:46:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:12.000924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-116682544", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1687937417", "security_groups": [{"name": "tempest-secgroup-smoke-1213651436"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "e4a54a10-2ec2-4817-9874-4d5bc5dd6a8e"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:12.113750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] validate_networks() for [('e4a54a10-2ec2-4817-9874-4d5bc5dd6a8e', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:46:12.494518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Getting quotas for project 233de55e2a38457bb1837da8374b7b54. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:46:12.499982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Getting quotas for user 2c025653d74848899a26c661400279cf and project 233de55e2a38457bb1837da8374b7b54. Resources: dict_keys(['metadata_items']) {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:46:12.516486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:46:12.516938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:46:12.517424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:46:12.517836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:46:12.518257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:46:12.527872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:12.528336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:12.529150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:12.529599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:12.547042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Getting quotas for project 233de55e2a38457bb1837da8374b7b54. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:46:12.552339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Getting quotas for user 2c025653d74848899a26c661400279cf and project 233de55e2a38457bb1837da8374b7b54. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:46:12.566012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:46:12.568393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:46:12.668576 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [09734ecc-08e3-483c-a1fe-e05b8ab6055a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 21:46:13.676015 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [09734ecc-08e3-483c-a1fe-e05b8ab6055a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 58078. May 14 21:46:13.681297 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9100413f-d958-4cb2-b6cf-ce4ed1bd680c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.687232 May 14 21:46:13.681962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2818/6048] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:46:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:46:13.692016 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e0c401cb-72dc-4839-a9b8-3734e94dc600 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:13.701057 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e0c401cb-72dc-4839-a9b8-3734e94dc600 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:13.751739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e0c401cb-72dc-4839-a9b8-3734e94dc600 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:13.761202 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e0c401cb-72dc-4839-a9b8-3734e94dc600 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1302 microversion: 2.1 time: 0.073277 May 14 21:46:13.761779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3231/6049] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:13 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1302 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:14.779875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82557616-eabf-41be-8a74-62882d22c638 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:14.780496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82557616-eabf-41be-8a74-62882d22c638 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:14.843830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82557616-eabf-41be-8a74-62882d22c638 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:14.850690 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82557616-eabf-41be-8a74-62882d22c638 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1302 microversion: 2.1 time: 0.075587 May 14 21:46:14.852136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2819/6050] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:14 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1302 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:15.869147 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1539ad6b-8a3f-4be4-8369-829bd93b2853 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:15.869868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1539ad6b-8a3f-4be4-8369-829bd93b2853 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:15.925717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1539ad6b-8a3f-4be4-8369-829bd93b2853 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:15.933481 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1539ad6b-8a3f-4be4-8369-829bd93b2853 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1302 microversion: 2.1 time: 0.069150 May 14 21:46:15.934065 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3232/6051] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:15 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1302 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:16.950477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f345bb57-5117-4c96-a05b-1d48a181d686 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:16.955796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f345bb57-5117-4c96-a05b-1d48a181d686 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:17.007779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f345bb57-5117-4c96-a05b-1d48a181d686 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:17.014676 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f345bb57-5117-4c96-a05b-1d48a181d686 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1302 microversion: 2.1 time: 0.068174 May 14 21:46:17.015263 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2820/6052] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:16 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1302 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:18.032094 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:18.032786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:18.042925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:18.042925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:18.042925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:18.042925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:18.105820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:18.113416 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9c4d659-556b-4b69-ada2-afa82499698c tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1306 microversion: 2.1 time: 0.085284 May 14 21:46:18.113983 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3233/6053] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:18 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1306 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:19.130317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:19.131048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:19.139759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:19.148724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:19.148724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:19.148724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:19.203417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:19.211661 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fba978af-e6f4-402c-bba9-5a66c389e04d tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1306 microversion: 2.1 time: 0.085363 May 14 21:46:19.214033 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2821/6054] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:19 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1306 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:20.228084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:20.228683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:20.235322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:20.235814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:20.236593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:20.237205 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:20.307042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:20.314835 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f508d7de-9bba-40cd-83f8-ccd0f1c52c5a tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1372 microversion: 2.1 time: 0.090990 May 14 21:46:20.315402 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3234/6055] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:20 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:21.333948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:21.334610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:21.342531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:21.342918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:21.343824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:21.344265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:21.477212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:21.484813 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-625558eb-dbd5-4619-80ab-5df31da6b264 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1428 microversion: 2.1 time: 0.154840 May 14 21:46:21.485406 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2822/6056] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:21 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1428 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:22.189334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4f942f38-129c-4e96-8ba4-dc1027486dee req-cf85df53-6f2f-4836-9fa7-ab2394496ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda28b45-a644-4897-8a19-407348b6a354", "tag": "58fa393d-5dc7-49f6-a33f-24492ed4050f"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:22.198056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4f942f38-129c-4e96-8ba4-dc1027486dee req-cf85df53-6f2f-4836-9fa7-ab2394496ef1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:22.198503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4f942f38-129c-4e96-8ba4-dc1027486dee req-cf85df53-6f2f-4836-9fa7-ab2394496ef1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:22.211152 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4f942f38-129c-4e96-8ba4-dc1027486dee req-cf85df53-6f2f-4836-9fa7-ab2394496ef1 service nova] Creating event network-changed:58fa393d-5dc7-49f6-a33f-24492ed4050f for instance eda28b45-a644-4897-8a19-407348b6a354 on nch2-master-1 May 14 21:46:22.224769 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4f942f38-129c-4e96-8ba4-dc1027486dee req-cf85df53-6f2f-4836-9fa7-ab2394496ef1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124490 May 14 21:46:22.225543 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3235/6057] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:22.506390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:22.507076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:22.513462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:22.513917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:22.514693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:22.515133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:22.653658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:22.661705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0009278b-b555-4c26-8ad1-96c5ad2d48cc tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1428 microversion: 2.1 time: 0.159360 May 14 21:46:22.662288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2823/6058] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:22 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1428 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:23.680296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:23.681015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:23.687244 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:23.687750 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:23.689961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:23.689961 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:23.919582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:23.928255 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fef2a4b6-9fef-4463-aac0-c4a31af574a2 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1428 microversion: 2.1 time: 0.253754 May 14 21:46:23.929759 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3236/6059] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:23 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1428 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:24.946762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:24.947394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:24.954251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:24.954739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:24.955526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:24.955977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:25.091335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:25.098973 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-331cc287-60a2-4435-abf4-b8263e2157a5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1428 microversion: 2.1 time: 0.157108 May 14 21:46:25.099617 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2824/6060] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:24 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1428 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:26.116076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:26.117395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:26.124084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:26.124549 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:26.125334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:26.125780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:26.261695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:26.269310 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-18ad28c1-e8ab-4a06-b8d9-b68da03dd90f tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1428 microversion: 2.1 time: 0.157288 May 14 21:46:26.269891 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3237/6061] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:26 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1428 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:27.216207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5ee2f809-109c-4a22-85f5-65948fbf283d req-378c5d54-44d9-4fd9-ab37-91001a3eafd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda28b45-a644-4897-8a19-407348b6a354", "name": "network-vif-plugged", "status": "completed", "tag": "58fa393d-5dc7-49f6-a33f-24492ed4050f"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:27.225310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5ee2f809-109c-4a22-85f5-65948fbf283d req-378c5d54-44d9-4fd9-ab37-91001a3eafd5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:27.225874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5ee2f809-109c-4a22-85f5-65948fbf283d req-378c5d54-44d9-4fd9-ab37-91001a3eafd5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:27.236929 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5ee2f809-109c-4a22-85f5-65948fbf283d req-378c5d54-44d9-4fd9-ab37-91001a3eafd5 service nova] Creating event network-vif-plugged:58fa393d-5dc7-49f6-a33f-24492ed4050f for instance eda28b45-a644-4897-8a19-407348b6a354 on nch2-master-1 May 14 21:46:27.241942 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5ee2f809-109c-4a22-85f5-65948fbf283d req-378c5d54-44d9-4fd9-ab37-91001a3eafd5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029538 May 14 21:46:27.242601 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2825/6062] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:27.286848 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:27.287580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:27.294939 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:27.295403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:27.296220 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:27.296664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:27.480298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:27.487704 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-abc1faab-120d-4145-9a55-67acdab817e3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1428 microversion: 2.1 time: 0.204923 May 14 21:46:27.488288 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3238/6063] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:27 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1428 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:28.507806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:28.509099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:28.515731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:28.515978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:28.516900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:28.517374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:28.662587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:28.671453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d3e72e2-3b59-4e74-8bc7-c9348b042542 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1428 microversion: 2.1 time: 0.169366 May 14 21:46:28.672065 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2826/6064] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:28 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1428 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:29.689433 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:29.690091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:29.697966 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:29.698427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:29.699203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:29.699680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:29.837575 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:29.845944 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f20bcd8a-e5a5-493e-9799-03168fb4bd68 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1609 microversion: 2.1 time: 0.160426 May 14 21:46:29.851622 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3239/6065] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:29 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1609 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:29.862690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:29.863307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:29.870825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:29.877462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:29.877462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:29.877462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:30.014150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:30.022462 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a2cb547-bf2b-4e83-a337-ee947ea06964 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1609 microversion: 2.1 time: 0.163421 May 14 21:46:30.023047 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2827/6066] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:29 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1609 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:30.046918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:30.051117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:30.053800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:30.054262 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:30.055045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:30.055509 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:30.196904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:30.204693 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6778c927-5763-4436-8132-f7217c01e511 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1609 microversion: 2.1 time: 0.161700 May 14 21:46:30.205267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3240/6067] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:30 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1609 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:32.352177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b0753cc-4a50-49db-9d7d-8962e8ccae64 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: .version_select at 0x7fb1a6bcd280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1427122938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcjbaN/np44pHX11IogR6XkWuZp/LMq4gZ8o2Hy4kOhinY0ZN5H0gCz3nzMue8ptmdldDv+tIMprMyaa25OjsM+HsD8uRjVCpAUBVPmCY7iv3w+j1DJ3F8l5jMqmN6nLw=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:32.366875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7b0753cc-4a50-49db-9d7d-8962e8ccae64 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:46:32.372969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7b0753cc-4a50-49db-9d7d-8962e8ccae64 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:46:32.403462 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-42a9311d-7f7e-4f3d-8a67-9244b8ef7f59 req-5ee5f0a0-1f4b-409b-9525-c8d5ac08d58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eda28b45-a644-4897-8a19-407348b6a354", "tag": "58fa393d-5dc7-49f6-a33f-24492ed4050f"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:32.412123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-42a9311d-7f7e-4f3d-8a67-9244b8ef7f59 req-5ee5f0a0-1f4b-409b-9525-c8d5ac08d58d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:32.412790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-42a9311d-7f7e-4f3d-8a67-9244b8ef7f59 req-5ee5f0a0-1f4b-409b-9525-c8d5ac08d58d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:32.425394 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-42a9311d-7f7e-4f3d-8a67-9244b8ef7f59 req-5ee5f0a0-1f4b-409b-9525-c8d5ac08d58d service nova] Creating event network-changed:58fa393d-5dc7-49f6-a33f-24492ed4050f for instance eda28b45-a644-4897-8a19-407348b6a354 on nch2-master-1 May 14 21:46:32.430708 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-42a9311d-7f7e-4f3d-8a67-9244b8ef7f59 req-5ee5f0a0-1f4b-409b-9525-c8d5ac08d58d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032895 May 14 21:46:32.432615 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3241/6068] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:32.468703 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b0753cc-4a50-49db-9d7d-8962e8ccae64 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.306905 May 14 21:46:32.469500 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2828/6069] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:46:32 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:41.546472 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-267052116", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "292be6b3-941d-4930-9be9-2daaf47b7a25"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1427122938", "security_groups": [{"name": "tempest-secgroup-smoke-498119661"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:41.862831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] validate_networks() for [('292be6b3-941d-4930-9be9-2daaf47b7a25', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:46:42.414336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:46:42.414739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:46:42.415858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:46:42.416404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:46:42.416684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:46:42.427123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:42.427729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:42.428822 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:42.429552 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:42.450427 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:46:42.456830 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:46:42.472949 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:46:42.475612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:46:42.596006 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c428eca6-99f0-407b-b65e-a84671705bc1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.055998 May 14 21:46:42.601837 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3242/6070] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:46:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:46:42.608422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26f00059-02c0-476a-9919-4e8db463ce2b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:42.609067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26f00059-02c0-476a-9919-4e8db463ce2b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:42.752605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-26f00059-02c0-476a-9919-4e8db463ce2b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:42.762367 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26f00059-02c0-476a-9919-4e8db463ce2b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1266 microversion: 2.1 time: 0.158018 May 14 21:46:42.779689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2829/6071] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:42 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:43.780164 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d8382b6c-9282-4c59-836b-6922dfd9c18c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:43.780726 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d8382b6c-9282-4c59-836b-6922dfd9c18c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:43.838305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d8382b6c-9282-4c59-836b-6922dfd9c18c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:43.845153 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d8382b6c-9282-4c59-836b-6922dfd9c18c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1266 microversion: 2.1 time: 0.069058 May 14 21:46:43.845955 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3243/6072] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:43 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1266 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:44.864636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:44.865543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:44.876971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:44.877567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:44.878925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:44.879515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:44.955456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:44.964975 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-559333c4-fe42-4855-b63d-8be2d9f89377 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1318 microversion: 2.1 time: 0.105741 May 14 21:46:44.965871 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2830/6073] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:44 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1318 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:45.989227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:45.989953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:45.997827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:46.001989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:46.001989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:46.001989 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:46.138603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:46.146058 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8ada7665-5c88-4e65-ba7b-4002ffa1a3f3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.160752 May 14 21:46:46.146642 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3244/6074] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:45 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:46.762232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b363b2c1-eb2f-4363-bb76-dccf61299dbc req-816b90d7-6160-49d1-91af-4ca409a963a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:46.774161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b363b2c1-eb2f-4363-bb76-dccf61299dbc req-816b90d7-6160-49d1-91af-4ca409a963a0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:46.775195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b363b2c1-eb2f-4363-bb76-dccf61299dbc req-816b90d7-6160-49d1-91af-4ca409a963a0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:46.788479 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b363b2c1-eb2f-4363-bb76-dccf61299dbc req-816b90d7-6160-49d1-91af-4ca409a963a0 service nova] Creating event network-changed:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch1-master-1 May 14 21:46:46.794398 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b363b2c1-eb2f-4363-bb76-dccf61299dbc req-816b90d7-6160-49d1-91af-4ca409a963a0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036662 May 14 21:46:46.795165 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2831/6075] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:47.168824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:47.169417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:47.176550 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:47.177002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:47.177789 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:47.178228 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:47.356458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:47.364910 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-53ade8d2-644c-4c8e-a508-4aa7c8823e78 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.200627 May 14 21:46:47.365796 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3245/6076] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:47 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:48.386878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:48.387571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:48.394091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:48.394550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:48.395328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:48.395823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:48.565631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:48.573963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb0adadd-4389-40a9-bfd6-e487656aba55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.194880 May 14 21:46:48.575382 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2832/6077] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:48 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:49.591756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:49.592533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:49.601630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:49.602160 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:49.604429 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:49.604885 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:49.797533 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:49.805884 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c4e7f4b-2463-4a5f-8e45-47f0cee16275 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.219246 May 14 21:46:49.806485 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3246/6078] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:49 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:50.828020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:50.828666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:50.835365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:50.835860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:50.836627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:50.837064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:50.972042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:50.980083 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba8c2329-0548-4d88-a618-6b1527b995d7 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.156148 May 14 21:46:50.980666 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2833/6079] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:50 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:51.996908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:51.997559 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:52.004506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:52.004952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:52.005800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:52.006241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:52.155315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:52.163471 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-58f70ca7-7758-493c-9d74-b8fd0bac7296 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.170861 May 14 21:46:52.164060 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3247/6080] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:51 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:53.180683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:53.181295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:53.187748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:53.188210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:53.188985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:53.189457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:53.332685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:53.340968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27e3d653-d5ca-490a-a62b-ce9ec56cf780 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.164466 May 14 21:46:53.341668 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2834/6081] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:53 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:53.381711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-b7b4d2de-9b9c-4f41-89d3-05e2fa38c2ff req-08022630-8c9c-49c6-8b20-4bad34a85fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "name": "network-vif-plugged", "status": "completed", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:53.392166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b7b4d2de-9b9c-4f41-89d3-05e2fa38c2ff req-08022630-8c9c-49c6-8b20-4bad34a85fc6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:53.392620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-b7b4d2de-9b9c-4f41-89d3-05e2fa38c2ff req-08022630-8c9c-49c6-8b20-4bad34a85fc6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:53.408592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-b7b4d2de-9b9c-4f41-89d3-05e2fa38c2ff req-08022630-8c9c-49c6-8b20-4bad34a85fc6 service nova] Creating event network-vif-plugged:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch1-master-1 May 14 21:46:53.418703 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-b7b4d2de-9b9c-4f41-89d3-05e2fa38c2ff req-08022630-8c9c-49c6-8b20-4bad34a85fc6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040751 May 14 21:46:53.419353 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3248/6082] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:54.358027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:54.358677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:54.365581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:54.366039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:54.366815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:54.367290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:54.499779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:54.507422 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bde37cfb-ddf2-45c1-94e0-54526780fff6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1391 microversion: 2.1 time: 0.153355 May 14 21:46:54.508291 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2835/6083] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:54 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:55.527659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:55.528369 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:55.534660 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:55.535114 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:55.535908 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:55.536346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:55.678912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:55.687134 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-741c8bdf-13ae-4792-bbd7-1fb9975acbdc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1564 microversion: 2.1 time: 0.165863 May 14 21:46:55.687756 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3249/6084] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:55 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:55.705835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:55.706463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:55.713953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:55.714415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:55.715203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:55.715688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:55.850678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:55.858547 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9b14f78-17bb-40b3-a70f-23c7a78e8b1e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1564 microversion: 2.1 time: 0.156806 May 14 21:46:55.859437 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2836/6085] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:55 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:46:57.863204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:46:57.864528 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:46:57.865370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-44b87004-be40-4ed2-91a6-867a5fcf7239 req-77c3f25b-4fd0-44ae-824a-3501a252ef27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:46:57.872979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:57.873698 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:57.874954 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:57.875598 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:57.877274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-44b87004-be40-4ed2-91a6-867a5fcf7239 req-77c3f25b-4fd0-44ae-824a-3501a252ef27 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:46:57.877779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-44b87004-be40-4ed2-91a6-867a5fcf7239 req-77c3f25b-4fd0-44ae-824a-3501a252ef27 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:46:57.890936 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-44b87004-be40-4ed2-91a6-867a5fcf7239 req-77c3f25b-4fd0-44ae-824a-3501a252ef27 service nova] Creating event network-changed:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch1-master-1 May 14 21:46:57.898143 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-44b87004-be40-4ed2-91a6-867a5fcf7239 req-77c3f25b-4fd0-44ae-824a-3501a252ef27 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036436 May 14 21:46:57.899509 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2837/6086] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:46:58.033066 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:46:58.040523 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6c80dd4c-9769-40e9-a8c5-54f517fe6445 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1564 microversion: 2.1 time: 0.182631 May 14 21:46:58.041677 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3250/6087] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:46:57 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:07.747027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a253b5d2-664b-49c4-8629-77314ffa98e1 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:07.747691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a253b5d2-664b-49c4-8629-77314ffa98e1 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:07.754002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a253b5d2-664b-49c4-8629-77314ffa98e1 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:07.754460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a253b5d2-664b-49c4-8629-77314ffa98e1 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:07.756459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a253b5d2-664b-49c4-8629-77314ffa98e1 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:07.756459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a253b5d2-664b-49c4-8629-77314ffa98e1 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:07.783387 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a253b5d2-664b-49c4-8629-77314ffa98e1 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.042026 May 14 21:47:07.784017 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2838/6088] 10.222.0.52 () {58 vars in 1292 bytes} [Sat May 14 21:47:07 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354/os-server-password => generated 116 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:47:19.667411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0b4ccfb1-171b-49bd-823a-ba945ed43b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:47:19.668403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0b4ccfb1-171b-49bd-823a-ba945ed43b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:19.678776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b4ccfb1-171b-49bd-823a-ba945ed43b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:19.678776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b4ccfb1-171b-49bd-823a-ba945ed43b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:19.678776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b4ccfb1-171b-49bd-823a-ba945ed43b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:19.678776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0b4ccfb1-171b-49bd-823a-ba945ed43b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:19.733602 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0b4ccfb1-171b-49bd-823a-ba945ed43b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action" status: 200 len: 24573 microversion: 2.1 time: 0.069948 May 14 21:47:19.734254 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3251/6089] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:47:19 2022] POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action => generated 24573 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:47:26.127558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-676882f7-8f8b-45e1-ba03-73918af6711a tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:26.128176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-676882f7-8f8b-45e1-ba03-73918af6711a tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:26.134404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-676882f7-8f8b-45e1-ba03-73918af6711a tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.134863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-676882f7-8f8b-45e1-ba03-73918af6711a tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:26.135664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-676882f7-8f8b-45e1-ba03-73918af6711a tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.136109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-676882f7-8f8b-45e1-ba03-73918af6711a tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:26.435300 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-676882f7-8f8b-45e1-ba03-73918af6711a tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1832 microversion: 2.1 time: 0.312423 May 14 21:47:26.436071 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2839/6090] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:26 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1832 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:26.452995 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:26.453706 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:26.461628 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.462031 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:26.462843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.463288 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:26.598259 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:26.606554 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0e85686f-40b8-4ea2-b62a-04f576d4394d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1681 microversion: 2.1 time: 0.157640 May 14 21:47:26.607138 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3252/6091] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:26 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:26.704666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e283893-4681-40b9-9c62-93451ad8fc29 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:47:26.705610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e283893-4681-40b9-9c62-93451ad8fc29 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:26.711787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e283893-4681-40b9-9c62-93451ad8fc29 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.712207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e283893-4681-40b9-9c62-93451ad8fc29 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:26.712975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e283893-4681-40b9-9c62-93451ad8fc29 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.713471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e283893-4681-40b9-9c62-93451ad8fc29 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:26.765667 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e283893-4681-40b9-9c62-93451ad8fc29 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action" status: 200 len: 32645 microversion: 2.1 time: 0.064837 May 14 21:47:26.766334 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2840/6092] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:47:26 2022] POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action => generated 32645 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:47:26.969900 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:47:26.970527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:26.977722 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.978182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:26.978955 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:26.979396 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:27.021275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f2ffdc7ae79e469e9bf232ffb1d5ff3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d288bc5c1457bba2b72854fd2d328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:27.021875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] flavor_id is None. Assuming migration. {{(pid=130638) resize /opt/stack/nova/nova/compute/api.py:4142}} May 14 21:47:27.022317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130638) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 21:47:27.329113 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-21586972-f3d3-45aa-8497-c2d6c51f35f9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action" status: 202 len: 0 microversion: 2.1 time: 0.362974 May 14 21:47:27.329850 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3253/6093] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:47:26 2022] POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:47:27.338533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:27.339240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:27.348750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:27.349228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:27.349990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:27.350430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:27.490170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:27.498002 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9718b820-8022-41d7-822d-238a7de45994 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1690 microversion: 2.1 time: 0.163677 May 14 21:47:27.498976 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2841/6094] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:27 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:47:28.516165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:28.516818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:28.525024 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:28.525488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:28.526267 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:28.526757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:28.668877 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:28.676536 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-36afb651-5264-45b4-a6da-e6e9329f617f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1690 microversion: 2.1 time: 0.164922 May 14 21:47:28.682152 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3254/6095] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:28 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:29.693797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:29.694437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:29.704871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:29.705335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:29.706121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:29.706562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:29.903196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:29.912249 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-384e1806-dedd-4bbe-9e0c-d5b1cc8a1a76 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1690 microversion: 2.1 time: 0.222290 May 14 21:47:29.913170 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2842/6096] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:29 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:30.929730 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:30.930360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:30.937406 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:30.937916 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:30.938711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:30.939278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:31.072721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:31.080474 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8b5fb17a-3116-4ae5-b22c-0fc4a2adb3a6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.154686 May 14 21:47:31.081055 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3255/6097] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:30 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:32.100455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:32.101350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:32.115622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:32.115622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:32.115622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:32.115622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:32.243116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:32.251333 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc2510a0-8fa3-4d41-acc8-67236c8a6380 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.157082 May 14 21:47:32.252781 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2843/6098] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:32 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:33.268863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:33.269530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:33.276548 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:33.277027 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:33.277796 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:33.278236 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:33.417028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:33.425883 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b0a2634b-1f11-4ec4-bb05-1fb1cae604de tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.161397 May 14 21:47:33.426491 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3256/6099] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:33 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:34.443562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:34.444193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:34.451038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:34.451532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:34.452364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:34.452808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:34.588411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:34.596381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fdd187f2-36c2-4324-a515-d347af24e6ba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.156971 May 14 21:47:34.596972 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2844/6100] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:34 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:35.613639 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:35.614256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:35.621042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:35.621494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:35.622257 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:35.622694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:35.752894 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:35.760371 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e9d74ada-100e-40c7-a61c-43ba3b8e23ce tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.150637 May 14 21:47:35.760945 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3257/6101] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:35 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:36.778509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:36.779128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:36.786373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:36.790767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:36.790767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:36.790767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:36.921397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:36.929384 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3cf9b69-00ec-42f7-a444-1e3eb4c81b9b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.155108 May 14 21:47:36.929982 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2845/6102] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:36 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:37.947179 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:37.947839 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:37.954881 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:37.955380 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:37.956321 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:37.956831 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:38.094780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:38.102374 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7faf87a2-b477-4acc-948c-65e54f528ada tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.159219 May 14 21:47:38.102954 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3258/6103] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:37 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:39.120216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:39.120764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:39.128102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:39.128562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:39.129351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:39.129794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:39.265871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:39.273548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be8e49ad-bfe8-4747-8772-44efe5c1bd9d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.157501 May 14 21:47:39.276274 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2846/6104] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:39 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:40.291641 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:40.292487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:40.301469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:40.301922 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:40.302701 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:40.303138 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:40.445120 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:40.453657 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-534c9dc0-116a-4cf9-bd6a-234cec82d3df tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.165866 May 14 21:47:40.454257 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3259/6105] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:40 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:41.470720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:41.471377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:41.478168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:41.478626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:41.479409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:41.479957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:41.614460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:41.622471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-85a4fff7-19e4-47f2-8a64-a332de650c3d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1695 microversion: 2.1 time: 0.155818 May 14 21:47:41.623142 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2847/6106] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:41 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1695 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:42.641413 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:42.642041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:42.650902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:42.650902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:42.650902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:42.650902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:42.872938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:42.881293 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-febcb31e-0e7f-4feb-86fc-8608ebe62961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1694 microversion: 2.1 time: 0.243858 May 14 21:47:42.882083 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3260/6107] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:42 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:43.118613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-83f32e87-82a6-4bf2-a4fd-0356fbf8cb65 req-05e82d7f-f141-426a-9935-2ceb604a8c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "name": "network-vif-unplugged", "status": "completed", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:47:43.130126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-83f32e87-82a6-4bf2-a4fd-0356fbf8cb65 req-05e82d7f-f141-426a-9935-2ceb604a8c9f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:43.130586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-83f32e87-82a6-4bf2-a4fd-0356fbf8cb65 req-05e82d7f-f141-426a-9935-2ceb604a8c9f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:43.145290 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-83f32e87-82a6-4bf2-a4fd-0356fbf8cb65 req-05e82d7f-f141-426a-9935-2ceb604a8c9f service nova] Creating event network-vif-unplugged:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch2-master-1 May 14 21:47:43.150984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-83f32e87-82a6-4bf2-a4fd-0356fbf8cb65 req-05e82d7f-f141-426a-9935-2ceb604a8c9f service nova] Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:47:43.162369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-83f32e87-82a6-4bf2-a4fd-0356fbf8cb65 req-05e82d7f-f141-426a-9935-2ceb604a8c9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047816 May 14 21:47:43.162957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2848/6108] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:47:43.899254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:43.900330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:43.910451 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:43.911851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:43.919858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:43.919858 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:44.133240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:44.141489 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8a51d593-ef7a-4cf6-b7d2-59c3610f9a69 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1694 microversion: 2.1 time: 0.246770 May 14 21:47:44.142074 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3261/6109] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:43 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1694 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:45.160835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:45.161475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:45.175927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:45.175927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:45.175927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:45.175927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:45.177085 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-2a62c89e-2a6a-48ac-92dd-a233bc1fabd8 req-62a9bda5-b477-44cf-90a3-768d10ad15e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:47:45.186063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2a62c89e-2a6a-48ac-92dd-a233bc1fabd8 req-62a9bda5-b477-44cf-90a3-768d10ad15e6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:45.186447 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-2a62c89e-2a6a-48ac-92dd-a233bc1fabd8 req-62a9bda5-b477-44cf-90a3-768d10ad15e6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:45.198056 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-2a62c89e-2a6a-48ac-92dd-a233bc1fabd8 req-62a9bda5-b477-44cf-90a3-768d10ad15e6 service nova] Creating event network-changed:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch2-master-1 May 14 21:47:45.203931 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-2a62c89e-2a6a-48ac-92dd-a233bc1fabd8 req-62a9bda5-b477-44cf-90a3-768d10ad15e6 service nova] Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:47:45.214977 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-2a62c89e-2a6a-48ac-92dd-a233bc1fabd8 req-62a9bda5-b477-44cf-90a3-768d10ad15e6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041784 May 14 21:47:45.215721 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3262/6110] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:47:45.323992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:45.332758 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d5ce8cf-5406-45be-8a7b-b45d516a8fef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1692 microversion: 2.1 time: 0.176708 May 14 21:47:45.333426 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2849/6111] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:45 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:46.353173 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:46.354541 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:46.363902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:46.364377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:46.365171 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:46.365625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:46.507403 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:46.515042 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-087c0f26-ccb5-4664-811a-2e18289ebcb6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1689 microversion: 2.1 time: 0.168926 May 14 21:47:46.515653 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3263/6112] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:46 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:46.531769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4be05c8c-6b6c-432d-8447-e1c9f9da62da tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:47:46.532415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4be05c8c-6b6c-432d-8447-e1c9f9da62da tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:46.539507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4be05c8c-6b6c-432d-8447-e1c9f9da62da tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:46.539986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4be05c8c-6b6c-432d-8447-e1c9f9da62da tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:46.540769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4be05c8c-6b6c-432d-8447-e1c9f9da62da tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:46.541221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4be05c8c-6b6c-432d-8447-e1c9f9da62da tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:46.762913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4be05c8c-6b6c-432d-8447-e1c9f9da62da tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action" status: 204 len: 0 microversion: 2.1 time: 0.234985 May 14 21:47:46.763700 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2850/6113] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:47:46 2022] POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:47:46.773128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:46.773838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:46.781118 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:46.781584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:46.782360 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:46.782803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:46.919411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:46.929345 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7b14f635-dd37-4c00-80a5-26328b644ba4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1689 microversion: 2.1 time: 0.160365 May 14 21:47:46.932779 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3264/6114] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:46 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:47.948151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:47.948903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:47.956004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:47.956467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:47.958629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:47.958629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:48.093199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:48.097816 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3dec6228-c27a-4fd0-acd5-8bb71c27b558 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1689 microversion: 2.1 time: 0.154815 May 14 21:47:48.098399 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2851/6115] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:47 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:49.114636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:47:49.115290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:47:49.122683 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:49.123712 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:49.124492 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:49.124940 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:49.260313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:47:49.268652 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5877af20-eca0-425b-afde-3e9285317c60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1681 microversion: 2.1 time: 0.158131 May 14 21:47:49.269565 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3265/6116] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:47:49 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:47:49.434009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a7a4382c-de05-4e64-ba6c-e558fc43bd5b req-ffb92e30-0609-4c5f-ac23-f9e0e99c3594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "name": "network-vif-plugged", "status": "completed", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:47:49.443694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a7a4382c-de05-4e64-ba6c-e558fc43bd5b req-ffb92e30-0609-4c5f-ac23-f9e0e99c3594 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:47:49.452688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a7a4382c-de05-4e64-ba6c-e558fc43bd5b req-ffb92e30-0609-4c5f-ac23-f9e0e99c3594 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:47:49.456382 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a7a4382c-de05-4e64-ba6c-e558fc43bd5b req-ffb92e30-0609-4c5f-ac23-f9e0e99c3594 service nova] Creating event network-vif-plugged:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch2-master-1 May 14 21:47:49.463055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a7a4382c-de05-4e64-ba6c-e558fc43bd5b req-ffb92e30-0609-4c5f-ac23-f9e0e99c3594 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031944 May 14 21:47:49.463732 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2852/6117] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:48:11.447749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1931b8a3-4963-4ae9-9419-cec8c276b507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:11.449328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1931b8a3-4963-4ae9-9419-cec8c276b507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:11.455702 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1931b8a3-4963-4ae9-9419-cec8c276b507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:11.456312 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1931b8a3-4963-4ae9-9419-cec8c276b507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:11.457106 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1931b8a3-4963-4ae9-9419-cec8c276b507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:11.457665 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1931b8a3-4963-4ae9-9419-cec8c276b507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:11.523426 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1931b8a3-4963-4ae9-9419-cec8c276b507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action" status: 200 len: 24577 microversion: 2.1 time: 0.079360 May 14 21:48:11.531251 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3266/6118] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:48:11 2022] POST /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585/action => generated 24577 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:48:17.700405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26866fd0-b53e-4f76-a838-c1d8f4cb92d8 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:17.701156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26866fd0-b53e-4f76-a838-c1d8f4cb92d8 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:17.710094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26866fd0-b53e-4f76-a838-c1d8f4cb92d8 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:17.710947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26866fd0-b53e-4f76-a838-c1d8f4cb92d8 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:17.712158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26866fd0-b53e-4f76-a838-c1d8f4cb92d8 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:17.712650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26866fd0-b53e-4f76-a838-c1d8f4cb92d8 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:17.940743 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26866fd0-b53e-4f76-a838-c1d8f4cb92d8 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1832 microversion: 2.1 time: 0.243710 May 14 21:48:17.941640 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2853/6119] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:17 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1832 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:19.380406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-08940910-b0f3-44ba-8ada-b4d5b0b5f73c req-76b00807-03b4-411b-976e-5f8727117cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:19.388316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:19.389002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:19.389513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-08940910-b0f3-44ba-8ada-b4d5b0b5f73c req-76b00807-03b4-411b-976e-5f8727117cda service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:19.390314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-08940910-b0f3-44ba-8ada-b4d5b0b5f73c req-76b00807-03b4-411b-976e-5f8727117cda service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:19.398186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:19.398651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:19.399754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:19.400493 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:19.406083 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-08940910-b0f3-44ba-8ada-b4d5b0b5f73c req-76b00807-03b4-411b-976e-5f8727117cda service nova] Creating event network-changed:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch2-master-1 May 14 21:48:19.418867 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-08940910-b0f3-44ba-8ada-b4d5b0b5f73c req-76b00807-03b4-411b-976e-5f8727117cda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042744 May 14 21:48:19.419524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2854/6120] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:48:19.440899 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:48:19.811836 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4853d57c-84d2-4435-94d7-7c981dcb45d3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 204 len: 0 microversion: 2.1 time: 0.432424 May 14 21:48:19.811836 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3267/6121] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:48:19 2022] DELETE /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:48:19.822961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:19.824843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:19.843259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:19.851045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:19.853299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:19.856172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:20.093848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:20.108792 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-423203d4-57b3-4678-aadb-18f0683ca88a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1687 microversion: 2.1 time: 0.294154 May 14 21:48:20.110215 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2855/6122] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:19 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1687 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:21.152974 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:21.153785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:21.176826 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:21.177786 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:21.178864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:21.179584 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:21.558668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:21.582449 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ce377697-7880-4b58-b047-301e71d61079 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1687 microversion: 2.1 time: 0.436106 May 14 21:48:21.583118 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3268/6123] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:21 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1687 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:22.140445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-dc5ab453-022b-4b96-b9ad-5b1ec4e33c14 req-0ab30c5f-3601-4644-a4f3-9865e7bf840a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efe544-f2a2-4ea1-baa4-dfe8414bd585", "name": "network-vif-deleted", "tag": "f70f8f4d-36ed-4fff-8628-2ff7c9526efd"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:22.149689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-dc5ab453-022b-4b96-b9ad-5b1ec4e33c14 req-0ab30c5f-3601-4644-a4f3-9865e7bf840a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:22.150650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-dc5ab453-022b-4b96-b9ad-5b1ec4e33c14 req-0ab30c5f-3601-4644-a4f3-9865e7bf840a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:22.162975 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-dc5ab453-022b-4b96-b9ad-5b1ec4e33c14 req-0ab30c5f-3601-4644-a4f3-9865e7bf840a service nova] Creating event network-vif-deleted:f70f8f4d-36ed-4fff-8628-2ff7c9526efd for instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 on nch2-master-1 May 14 21:48:22.170038 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-dc5ab453-022b-4b96-b9ad-5b1ec4e33c14 req-0ab30c5f-3601-4644-a4f3-9865e7bf840a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237157 May 14 21:48:22.170677 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2856/6124] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:48:22.599875 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:22.602347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:22.610000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:22.610467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:22.611263 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:22.612404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:22.652987 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:22.653452 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:22.653979 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lazy-loading 'fault' on Instance uuid 77efe544-f2a2-4ea1-baa4-dfe8414bd585 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:48:22.698773 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:22.707205 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-87b076de-8d77-4d1c-b3b5-7ff952f550b2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 200 len: 1356 microversion: 2.1 time: 0.111938 May 14 21:48:22.707829 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3269/6125] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:22 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:23.730941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:23.734153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 77efe544-f2a2-4ea1-baa4-dfe8414bd585] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:23.742054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:23.742768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:23.743787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:23.744235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:23.758593 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] HTTP exception thrown: Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 could not be found. May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Request method failure captured: May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 HTTP/1.1 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCM3z8vMGjE3Khn4V0nlEkyzMD4gMlNtB_haMBg2QZyvExKimZQNDFtNzwnf7W5QpmJun_aMxnyPjSJvXTHJJpSxIrZdmdZOxt6-npK6Q3ANgmmJJV39-0JjN8BwmXyB2w81Esnzt1ZQcd61XAwfRfne5qpFFcIclz-YjQV4VtFBGjw May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d47cde4b8ee4dbc9ad64de4084690a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: e9982f39ae394932a2fb8c9e4d456d8d May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 could not be found. May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '77efe544-f2a2-4ea1-baa4-dfe8414bd585'} May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 could not be found. May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 could not be found. May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:48:23.760334 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 could not be found. May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Returning 404 to user: Instance 77efe544-f2a2-4ea1-baa4-dfe8414bd585 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f546e8f7-7105-4c09-ac42-ccbcbaee62b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585" status: 404 len: 111 microversion: 2.1 time: 0.040994 May 14 21:48:23.764733 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2857/6126] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:23 2022] GET /compute/v2.1/servers/77efe544-f2a2-4ea1-baa4-dfe8414bd585 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:48:29.670927 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6054bb37-611e-4ca8-b7af-50bbb9fed86e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '.version_select at 0x7fb1a78d7700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:29.746592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6054bb37-611e-4ca8-b7af-50bbb9fed86e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1427122938" status: 202 len: 0 microversion: 2.1 time: 0.085192 May 14 21:48:29.747196 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3270/6127] 10.222.0.52 () {58 vars in 1283 bytes} [Sat May 14 21:48:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1427122938 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:48:29.778046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dbe946f3-2e8c-4706-8d6b-bf3f43f224fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: .version_select at 0x7fb1a7b5f160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-662002036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMe9e2OPUu8x0vSqpWx6CTw+ZVrJ9Z3r3M41BNnwVGUaZW9JznRlhSvW3MoxrNYVtliwP987S5vhvqPqBBil89RTkoBtr2KIzvsTeTLLUd0Nqy1+ckMgOlh51orKdyLuCA=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:29.794229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-dbe946f3-2e8c-4706-8d6b-bf3f43f224fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:48:29.800720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-dbe946f3-2e8c-4706-8d6b-bf3f43f224fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:48:29.866910 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dbe946f3-2e8c-4706-8d6b-bf3f43f224fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.093283 May 14 21:48:29.867723 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2858/6128] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:48:29 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:48:38.932128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-847885937", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "7fbc828b-a320-43bb-b7d9-1e31801bb2a0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-662002036", "security_groups": [{"name": "tempest-secgroup-smoke-1312942904"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:39.092836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] validate_networks() for [('7fbc828b-a320-43bb-b7d9-1e31801bb2a0', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:48:39.501440 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:48:39.501873 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:48:39.502361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:48:39.502777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:48:39.503227 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:48:39.512221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:39.512623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:39.513426 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:39.513870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:39.532937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:48:39.539387 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:48:39.552352 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:48:39.554944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:48:39.730067 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15a1f9af-7be4-41fe-ac4c-0d6e5ed42738 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.807818 May 14 21:48:39.730737 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3271/6129] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:48:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:48:39.741250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-85da6325-09b1-4cc6-9bf4-1c4dbf1c3c2c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:39.742046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-85da6325-09b1-4cc6-9bf4-1c4dbf1c3c2c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:39.800557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-85da6325-09b1-4cc6-9bf4-1c4dbf1c3c2c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:39.807932 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-85da6325-09b1-4cc6-9bf4-1c4dbf1c3c2c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1265 microversion: 2.1 time: 0.070797 May 14 21:48:39.808877 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2859/6130] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:39 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1265 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:40.827207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:40.827935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:40.835732 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:40.836187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:40.837063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:40.837668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:40.921795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:40.936861 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3b635116-7485-4f88-948a-f427c6985c87 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1269 microversion: 2.1 time: 0.114566 May 14 21:48:40.940736 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3272/6131] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:40 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1269 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:41.957873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:41.959032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:41.966362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:41.966825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:41.967663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:41.968109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:42.043292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:42.051399 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4510161-785e-4e9d-984d-5ededf8199b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1325 microversion: 2.1 time: 0.097394 May 14 21:48:42.052015 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2860/6132] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:41 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1325 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:43.070818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:43.071467 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:43.078689 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:43.079330 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:43.081294 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:43.082347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:43.244033 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:43.253101 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-65ea04d7-efc7-4fc8-825f-fe1805a9696b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1391 microversion: 2.1 time: 0.187084 May 14 21:48:43.260694 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3273/6133] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:43 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1391 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:43.785674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6905eb23-3af9-459a-b194-1b7c051fe870 req-1b1d80b9-6a11-41ff-8f08-71279a90ea53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:43.801580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6905eb23-3af9-459a-b194-1b7c051fe870 req-1b1d80b9-6a11-41ff-8f08-71279a90ea53 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:43.801835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6905eb23-3af9-459a-b194-1b7c051fe870 req-1b1d80b9-6a11-41ff-8f08-71279a90ea53 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:43.814335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6905eb23-3af9-459a-b194-1b7c051fe870 req-1b1d80b9-6a11-41ff-8f08-71279a90ea53 service nova] Creating event network-changed:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:48:43.820221 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6905eb23-3af9-459a-b194-1b7c051fe870 req-1b1d80b9-6a11-41ff-8f08-71279a90ea53 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039527 May 14 21:48:43.821233 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2861/6134] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:48:44.270840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:44.271466 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:44.278557 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:44.279006 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:44.279849 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:44.280299 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:44.415658 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:44.426164 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c6b75804-843d-4923-9106-b098a1a93360 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1391 microversion: 2.1 time: 0.159585 May 14 21:48:44.438141 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3274/6135] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:44 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:45.447461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:45.450968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:45.455111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:45.455590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:45.456353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:45.456802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:45.591935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:45.600205 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b939f138-fc4c-48a4-b1f3-5423b4222106 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1391 microversion: 2.1 time: 0.158287 May 14 21:48:45.603766 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2862/6136] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:45 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:46.618626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:46.619256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:46.626207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:46.626668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:46.627444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:46.627930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:46.765152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:46.773411 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5e5f5e30-5182-4391-a39a-dea08c31a32a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1391 microversion: 2.1 time: 0.157998 May 14 21:48:46.774080 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3275/6137] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:46 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:47.791304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:47.792001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:47.799037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:47.799526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:47.800368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:47.800821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:47.940592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:47.948370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c60023dd-3141-42b9-855b-368eb6a01425 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1391 microversion: 2.1 time: 0.161759 May 14 21:48:47.952847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2863/6138] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:47 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:48.966040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:48.966656 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:48.974110 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:48.974350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:48.975117 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:48.975592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:49.113253 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:49.121831 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-6a32d3f0-ccb0-4c11-9070-7ca07821d9b1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1391 microversion: 2.1 time: 0.160551 May 14 21:48:49.122408 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3276/6139] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:48 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:50.002853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-352c322f-15d7-4ccc-8696-6af7b2b6795d req-aad28ba9-e4fa-4ae0-842d-de8ff4bbaf9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "name": "network-vif-plugged", "status": "completed", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:50.012432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-352c322f-15d7-4ccc-8696-6af7b2b6795d req-aad28ba9-e4fa-4ae0-842d-de8ff4bbaf9c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:50.012914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-352c322f-15d7-4ccc-8696-6af7b2b6795d req-aad28ba9-e4fa-4ae0-842d-de8ff4bbaf9c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:50.023736 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-352c322f-15d7-4ccc-8696-6af7b2b6795d req-aad28ba9-e4fa-4ae0-842d-de8ff4bbaf9c service nova] Creating event network-vif-plugged:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:48:50.029064 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-352c322f-15d7-4ccc-8696-6af7b2b6795d req-aad28ba9-e4fa-4ae0-842d-de8ff4bbaf9c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030009 May 14 21:48:50.029651 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2864/6140] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:48:50.139679 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:50.140320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:50.149009 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:50.150146 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:50.151317 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:50.151756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:50.291725 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:50.299140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cee1ed6a-fbf8-49c3-8045-6efc39319a34 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1391 microversion: 2.1 time: 0.163830 May 14 21:48:50.299755 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3277/6141] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:50 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:51.316995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:51.317710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:51.324358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:51.324826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:51.325606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:51.326053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:51.468463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:51.476317 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4e5ec375-e77e-4298-b738-337e2654bf33 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1562 microversion: 2.1 time: 0.164523 May 14 21:48:51.476911 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2865/6142] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:51 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:51.493050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:51.493803 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:51.501785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:51.502304 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:51.503666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:51.504324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:51.664754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:51.673353 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b6e26026-3a80-4fb2-8e7e-da6766b57538 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1562 microversion: 2.1 time: 0.184179 May 14 21:48:51.673936 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3278/6143] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:51 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1562 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:48:53.777585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:48:53.778303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:48:53.781407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8e568961-4831-4357-a5ae-a061e1f4b9d2 req-6ea1b603-5391-47d4-a2be-0979a439fdbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:48:53.794305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:53.794782 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:53.795607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:53.798006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8e568961-4831-4357-a5ae-a061e1f4b9d2 req-6ea1b603-5391-47d4-a2be-0979a439fdbe service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:48:53.802115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8e568961-4831-4357-a5ae-a061e1f4b9d2 req-6ea1b603-5391-47d4-a2be-0979a439fdbe service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:53.802829 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:48:53.815143 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8e568961-4831-4357-a5ae-a061e1f4b9d2 req-6ea1b603-5391-47d4-a2be-0979a439fdbe service nova] Creating event network-changed:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:48:53.820299 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8e568961-4831-4357-a5ae-a061e1f4b9d2 req-6ea1b603-5391-47d4-a2be-0979a439fdbe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050632 May 14 21:48:53.821295 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2866/6144] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:48:53.974260 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:48:53.982798 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-c551a413-cc8c-45b7-a670-68c9516be127 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1562 microversion: 2.1 time: 0.209468 May 14 21:48:53.983713 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3279/6145] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:48:53 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1562 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:15.293131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ed187b8-9385-4c22-87e5-f452b1d509fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:15.294073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ed187b8-9385-4c22-87e5-f452b1d509fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:15.300530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ed187b8-9385-4c22-87e5-f452b1d509fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:15.300993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ed187b8-9385-4c22-87e5-f452b1d509fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:15.301815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ed187b8-9385-4c22-87e5-f452b1d509fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:15.302277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ed187b8-9385-4c22-87e5-f452b1d509fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:15.351195 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ed187b8-9385-4c22-87e5-f452b1d509fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action" status: 200 len: 24568 microversion: 2.1 time: 0.063363 May 14 21:49:15.352036 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2867/6146] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:49:15 2022] POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action => generated 24568 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:49:26.467809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-627b0dc9-a10e-4381-80b1-b4c7bf2a67fc tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:26.468441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-627b0dc9-a10e-4381-80b1-b4c7bf2a67fc tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:26.474945 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-627b0dc9-a10e-4381-80b1-b4c7bf2a67fc tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:26.475407 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-627b0dc9-a10e-4381-80b1-b4c7bf2a67fc tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:26.476216 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-627b0dc9-a10e-4381-80b1-b4c7bf2a67fc tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:26.476671 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-627b0dc9-a10e-4381-80b1-b4c7bf2a67fc tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:26.610538 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-627b0dc9-a10e-4381-80b1-b4c7bf2a67fc tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1831 microversion: 2.1 time: 0.146550 May 14 21:49:26.611292 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3280/6147] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:26 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1831 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:26.628304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:26.629015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:26.637126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:26.638881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:26.638881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:26.638881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:26.771148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:26.779739 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ece3ee80-0645-44be-a56c-b637e4d186b8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1680 microversion: 2.1 time: 0.155587 May 14 21:49:26.780327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2868/6148] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:26 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:26.874410 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f7aa3393-7f3d-45ed-b3ca-dd50ef20593d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:26.875404 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f7aa3393-7f3d-45ed-b3ca-dd50ef20593d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:26.882111 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7aa3393-7f3d-45ed-b3ca-dd50ef20593d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:26.882561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7aa3393-7f3d-45ed-b3ca-dd50ef20593d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:26.883323 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7aa3393-7f3d-45ed-b3ca-dd50ef20593d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:26.883810 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7aa3393-7f3d-45ed-b3ca-dd50ef20593d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:26.933697 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f7aa3393-7f3d-45ed-b3ca-dd50ef20593d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action" status: 200 len: 32640 microversion: 2.1 time: 0.063180 May 14 21:49:26.937147 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3281/6149] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:49:26 2022] POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:49:27.099063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:27.100190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:27.110270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:27.110950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:27.112084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:27.112541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:27.213425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f2ffdc7ae79e469e9bf232ffb1d5ff3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c8d288bc5c1457bba2b72854fd2d328', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:27.220271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] flavor_id is None. Assuming migration. {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4142}} May 14 21:49:27.220271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 21:49:27.588718 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ac94e5b-50df-4108-853a-957f43da2333 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action" status: 202 len: 0 microversion: 2.1 time: 0.495278 May 14 21:49:27.589353 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2869/6150] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:49:27 2022] POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:49:27.598589 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:27.599637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:27.607154 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:27.607864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:27.608508 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:27.608960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:27.742011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:27.750224 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-49a5e421-57cc-47e0-989f-f26b196e16ee tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1689 microversion: 2.1 time: 0.156405 May 14 21:49:27.750792 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3282/6151] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:27 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:28.768300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:28.768877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:28.776669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:28.777157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:28.779297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:28.779297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:28.930471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:28.938108 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-97b8099c-4509-49a3-abdc-1637916f3f52 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1689 microversion: 2.1 time: 0.174666 May 14 21:49:28.938701 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2870/6152] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:28 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:29.955868 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:29.956490 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:29.965634 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:29.966101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:29.966925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:29.967366 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:30.474553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:30.482247 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-07a0dadd-7cb5-462f-a4d4-385a8c902213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1689 microversion: 2.1 time: 0.530443 May 14 21:49:30.482819 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3283/6153] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:29 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1689 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:31.499998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:31.500653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:31.508437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:31.508886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:31.509676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:31.510115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:31.647417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:31.655267 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78b889b2-3dbd-4623-9fcc-e5c5cb86eae1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.159203 May 14 21:49:31.655868 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2871/6154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:31 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:32.672787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:32.673443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:32.681247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:32.681704 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:32.682488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:32.682929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:32.812785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:32.821243 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-44951960-c58a-426f-8cec-0e138120444e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.152335 May 14 21:49:32.821821 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3284/6155] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:32 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:33.838647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:33.840037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:33.847095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:33.847592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:33.848496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:33.848948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:33.980019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:33.987573 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f23b3066-6a83-4930-8039-54be9804ee55 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.152987 May 14 21:49:33.988157 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2872/6156] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:33 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:35.005346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:35.005963 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:35.012975 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:35.013438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:35.014231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:35.014682 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:35.147092 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:35.154914 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd329440-de6f-4115-9813-e71a0558d948 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.153578 May 14 21:49:35.155502 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3285/6157] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:35 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:36.172989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:36.173607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:36.180445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:36.182572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:36.182572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:36.182572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:36.315947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:36.323528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-240b90ec-60c2-46a0-a832-49af7319e22c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.154536 May 14 21:49:36.324109 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2873/6158] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:36 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:37.341572 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:37.342192 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:37.348710 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:37.349748 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:37.350614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:37.351063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:37.492879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:37.500940 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ffa574e0-614e-416f-9a0f-9f681d1eeb08 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.163449 May 14 21:49:37.503587 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3286/6159] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:37 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:38.518559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:38.519204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:38.526012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:38.526473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:38.527246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:38.527717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:38.669071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:38.676594 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4e2db47-71eb-44e9-9c29-6545fdb468cb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.162013 May 14 21:49:38.677176 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2874/6160] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:38 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:39.694744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:39.695595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:39.702856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:39.703298 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:39.704096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:39.704537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:39.837019 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:39.844739 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-367cbebf-8cdf-4311-b409-4047d7948edb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.154390 May 14 21:49:39.845310 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3287/6161] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:39 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:40.862448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:40.863145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:40.871781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:40.872243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:40.873027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:40.873478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:41.006229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:41.014409 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-091f0d67-f817-4fc3-b158-ac2c083f73bd tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.155988 May 14 21:49:41.015045 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2875/6162] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:40 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:42.031788 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:42.032412 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:42.039286 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:42.040617 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:42.041580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:42.042037 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:42.180539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:42.194528 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2c3d6f6d-dc6b-4ef1-9e6a-0881687620e5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1694 microversion: 2.1 time: 0.160412 May 14 21:49:42.194528 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3288/6163] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:42 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1694 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:43.205853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:43.206451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:43.213747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:43.218940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:43.218940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:43.218940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:43.453955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:43.460590 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8e60b84-c06b-43e6-886a-9347cc9d7d94 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1693 microversion: 2.1 time: 0.258828 May 14 21:49:43.461149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2876/6164] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:43 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1693 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:44.136744 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-936d6e02-c4bd-433c-a2e5-e8cbe5a5c71c req-0a2e45ac-30fc-42ba-bed8-9a9ba3c10936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "name": "network-vif-unplugged", "status": "completed", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:44.145438 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-936d6e02-c4bd-433c-a2e5-e8cbe5a5c71c req-0a2e45ac-30fc-42ba-bed8-9a9ba3c10936 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:44.146055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-936d6e02-c4bd-433c-a2e5-e8cbe5a5c71c req-0a2e45ac-30fc-42ba-bed8-9a9ba3c10936 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:44.159162 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-936d6e02-c4bd-433c-a2e5-e8cbe5a5c71c req-0a2e45ac-30fc-42ba-bed8-9a9ba3c10936 service nova] Creating event network-vif-unplugged:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch2-master-1 May 14 21:49:44.164876 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-936d6e02-c4bd-433c-a2e5-e8cbe5a5c71c req-0a2e45ac-30fc-42ba-bed8-9a9ba3c10936 service nova] Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:49:44.183615 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-936d6e02-c4bd-433c-a2e5-e8cbe5a5c71c req-0a2e45ac-30fc-42ba-bed8-9a9ba3c10936 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050976 May 14 21:49:44.184239 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3289/6165] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:49:44.478511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:44.479824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:44.487348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:44.488057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:44.489171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:44.489616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:44.692426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:44.700229 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01404348-ad26-41b2-8716-853d98dca088 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1693 microversion: 2.1 time: 0.225816 May 14 21:49:44.700814 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2877/6166] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:44 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:45.718837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:45.719576 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:45.725866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:45.726324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:45.727176 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:45.727809 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:45.863292 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:45.871733 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a2381a76-a4c6-4133-b7b3-73524118ac41 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1691 microversion: 2.1 time: 0.158020 May 14 21:49:45.873179 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3290/6167] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:45 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:46.198895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-3cbb9930-be5d-438c-b7fd-923d88b25db6 req-f4fbb07c-47c4-4dd2-895c-1aec6171e221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:46.208102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3cbb9930-be5d-438c-b7fd-923d88b25db6 req-f4fbb07c-47c4-4dd2-895c-1aec6171e221 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:46.208558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3cbb9930-be5d-438c-b7fd-923d88b25db6 req-f4fbb07c-47c4-4dd2-895c-1aec6171e221 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:46.220996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-3cbb9930-be5d-438c-b7fd-923d88b25db6 req-f4fbb07c-47c4-4dd2-895c-1aec6171e221 service nova] Creating event network-changed:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch2-master-1 May 14 21:49:46.226465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-3cbb9930-be5d-438c-b7fd-923d88b25db6 req-f4fbb07c-47c4-4dd2-895c-1aec6171e221 service nova] Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:49:46.237195 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-3cbb9930-be5d-438c-b7fd-923d88b25db6 req-f4fbb07c-47c4-4dd2-895c-1aec6171e221 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043145 May 14 21:49:46.237804 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2878/6168] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:49:46.890625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:46.891343 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:46.898362 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:46.899119 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:46.900174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:46.900700 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:47.042728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:47.052892 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2886b4d3-6da7-4992-bc01-1db02f54651a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1691 microversion: 2.1 time: 0.164166 May 14 21:49:47.052892 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3291/6169] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:46 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:48.071371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:48.072752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:48.081035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:48.081502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:48.082665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:48.083148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:48.221156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:48.229963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0cdcb8d-c632-4501-89e6-6782a34b5d4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1688 microversion: 2.1 time: 0.164870 May 14 21:49:48.230558 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2879/6170] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:48 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:48.247127 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7098d4c7-12c3-4b01-9493-64a1503b40fb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:48.249261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7098d4c7-12c3-4b01-9493-64a1503b40fb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:48.254791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7098d4c7-12c3-4b01-9493-64a1503b40fb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:48.255331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7098d4c7-12c3-4b01-9493-64a1503b40fb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:48.256194 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7098d4c7-12c3-4b01-9493-64a1503b40fb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:48.256633 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7098d4c7-12c3-4b01-9493-64a1503b40fb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:48.680622 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7098d4c7-12c3-4b01-9493-64a1503b40fb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action" status: 202 len: 0 microversion: 2.1 time: 0.437987 May 14 21:49:48.681255 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3292/6171] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:49:48 2022] POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:49:48.689698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:48.690811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:48.698774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:48.698774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:48.701452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:48.705152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:48.846522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:48.854937 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f539c476-727a-41fe-8e29-d896b314d507 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1687 microversion: 2.1 time: 0.169071 May 14 21:49:48.855540 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2880/6172] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:48 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:49.872767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:49.873503 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:49.880629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:49.881091 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:49.881861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:49.882302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:50.166554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0f865fcd-26d1-4be7-ac4f-5742d4050b7f req-6eb5d89f-dc24-4633-892c-9facb29dbfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "name": "network-vif-plugged", "status": "completed", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:50.176082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0f865fcd-26d1-4be7-ac4f-5742d4050b7f req-6eb5d89f-dc24-4633-892c-9facb29dbfdf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:50.176636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0f865fcd-26d1-4be7-ac4f-5742d4050b7f req-6eb5d89f-dc24-4633-892c-9facb29dbfdf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:50.189836 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0f865fcd-26d1-4be7-ac4f-5742d4050b7f req-6eb5d89f-dc24-4633-892c-9facb29dbfdf service nova] Creating event network-vif-plugged:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch2-master-1 May 14 21:49:50.195539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-0f865fcd-26d1-4be7-ac4f-5742d4050b7f req-6eb5d89f-dc24-4633-892c-9facb29dbfdf service nova] Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:49:50.206970 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0f865fcd-26d1-4be7-ac4f-5742d4050b7f req-6eb5d89f-dc24-4633-892c-9facb29dbfdf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125367 May 14 21:49:50.207776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2881/6173] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:49:50.288185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:50.297288 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3d3dd2d-a08f-447e-931b-9a825e4b3302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1687 microversion: 2.1 time: 0.428667 May 14 21:49:50.297776 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3293/6174] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:49 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1687 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:51.315784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:51.316498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:51.322827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:51.323907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:51.324963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:51.325545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:51.481493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:51.489919 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bdd10fc4-8b44-4b9e-b6d8-e46531737ff2 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1687 microversion: 2.1 time: 0.179158 May 14 21:49:51.490525 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2882/6175] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:51 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:52.513264 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:52.514749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:52.521924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:52.522388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:52.523182 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:52.523663 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:52.612203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-260331e5-3581-4d02-9a28-db6d60af5b43 req-db0da395-6fca-4a8a-901d-4dab66967422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "name": "network-vif-unplugged", "status": "completed", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:52.621180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-260331e5-3581-4d02-9a28-db6d60af5b43 req-db0da395-6fca-4a8a-901d-4dab66967422 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:52.627841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-260331e5-3581-4d02-9a28-db6d60af5b43 req-db0da395-6fca-4a8a-901d-4dab66967422 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:52.634723 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-260331e5-3581-4d02-9a28-db6d60af5b43 req-db0da395-6fca-4a8a-901d-4dab66967422 service nova] Creating event network-vif-unplugged:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:49:52.640880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-260331e5-3581-4d02-9a28-db6d60af5b43 req-db0da395-6fca-4a8a-901d-4dab66967422 service nova] Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:49:52.653431 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-260331e5-3581-4d02-9a28-db6d60af5b43 req-db0da395-6fca-4a8a-901d-4dab66967422 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045193 May 14 21:49:52.654325 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2883/6176] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:49:52.675889 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:52.682641 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8f80bc8b-7b5d-44f6-8c16-1c23d966400c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1687 microversion: 2.1 time: 0.179347 May 14 21:49:52.683204 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3294/6177] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:52 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:53.700593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:53.701311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:53.708560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:53.709027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:53.709813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:53.710267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:53.869812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:53.878460 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-08aab6d4-b684-4e60-afac-9ee552f634d1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1687 microversion: 2.1 time: 0.182527 May 14 21:49:53.879074 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2884/6178] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:53 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:54.669175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-34b1bc6d-3360-47dd-a62e-35c08f22f832 req-73993a73-419d-47d6-933c-b0bc7b9278f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:54.677991 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-34b1bc6d-3360-47dd-a62e-35c08f22f832 req-73993a73-419d-47d6-933c-b0bc7b9278f7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:54.678448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-34b1bc6d-3360-47dd-a62e-35c08f22f832 req-73993a73-419d-47d6-933c-b0bc7b9278f7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:54.691140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-34b1bc6d-3360-47dd-a62e-35c08f22f832 req-73993a73-419d-47d6-933c-b0bc7b9278f7 service nova] Creating event network-changed:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:49:54.696800 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [req-34b1bc6d-3360-47dd-a62e-35c08f22f832 req-73993a73-419d-47d6-933c-b0bc7b9278f7 service nova] Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130638) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 21:49:54.713211 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-34b1bc6d-3360-47dd-a62e-35c08f22f832 req-73993a73-419d-47d6-933c-b0bc7b9278f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048361 May 14 21:49:54.713826 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3295/6179] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:49:54.895766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:54.897443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:54.904126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:54.904570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:54.905348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:54.905796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:55.519791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:55.530706 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b543d01-9eb7-44d9-b20d-b230b71deddf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1687 microversion: 2.1 time: 0.638525 May 14 21:49:55.531495 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2885/6180] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:54 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1687 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:56.551923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:49:56.552636 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:49:56.559884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:56.560348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:56.561134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:56.561585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:56.705474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:49:56.713086 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f3d083d9-befe-4fc8-9a6e-6cda21a0b54d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1680 microversion: 2.1 time: 0.166373 May 14 21:49:56.713674 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3296/6181] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:49:56 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:49:58.293376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-acfd588d-5d4a-4c73-b71b-4c954a8b1a8a req-86679397-dbd5-4a2f-8a36-8916d2ac779b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "name": "network-vif-plugged", "status": "completed", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:49:58.302743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-acfd588d-5d4a-4c73-b71b-4c954a8b1a8a req-86679397-dbd5-4a2f-8a36-8916d2ac779b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:49:58.303183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-acfd588d-5d4a-4c73-b71b-4c954a8b1a8a req-86679397-dbd5-4a2f-8a36-8916d2ac779b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:49:58.314806 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-acfd588d-5d4a-4c73-b71b-4c954a8b1a8a req-86679397-dbd5-4a2f-8a36-8916d2ac779b service nova] Creating event network-vif-plugged:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:49:58.320065 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-acfd588d-5d4a-4c73-b71b-4c954a8b1a8a req-86679397-dbd5-4a2f-8a36-8916d2ac779b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031395 May 14 21:49:58.320686 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2886/6182] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:04.396128 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ba18e44b-8a85-42fb-bdb1-f93034dfe14f tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Action: 'create', calling method: .version_select at 0x7fb1a6c5c5e0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1474254061", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHo8mFLh3Zz5sRpo7W6ePXwfrblaI/BIKXKXpF8F6F184uvd72bJMrPxFsl+NpeucjGxxIfW9N4+MyQ4pXZAUanlEBaJ2sHsWxRyUUKiuiO1KQoy6tFaXBOM3P8EnWKog=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:04.411753 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ba18e44b-8a85-42fb-bdb1-f93034dfe14f tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Getting quotas for project fbd6e36a563a4245acae34e00437ca87. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:50:04.422666 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-ba18e44b-8a85-42fb-bdb1-f93034dfe14f tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Getting quotas for user 1b51720c7970425abf4a26b2406893b7 and project fbd6e36a563a4245acae34e00437ca87. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:50:04.522590 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ba18e44b-8a85-42fb-bdb1-f93034dfe14f tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.130363 May 14 21:50:04.523127 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3297/6183] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:50:04 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:06.800720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1191514332", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "e466666d-dad2-4f32-a5b6-875fbf06b6c9", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1474254061", "security_groups": [{"name": "tempest-secgroup-smoke-1535702177"}], "networks": [{"uuid": "ab045a92-e325-4248-b39f-db14e2d2fe17"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:06.910649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] validate_networks() for [('ab045a92-e325-4248-b39f-db14e2d2fe17', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:50:07.269448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:50:07.269881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:50:07.270365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:50:07.270784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:50:07.271207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:50:07.280411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:07.280866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:07.281701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:07.282146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:07.299073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Getting quotas for project fbd6e36a563a4245acae34e00437ca87. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:50:07.304331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Getting quotas for user 1b51720c7970425abf4a26b2406893b7 and project fbd6e36a563a4245acae34e00437ca87. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:50:07.362070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:50:07.364314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e466666d-dad2-4f32-a5b6-875fbf06b6c9',volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:50:07.728716 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99037a80-f1c1-45df-bcd4-77a9b62f9100 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.933290 May 14 21:50:07.729393 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2887/6184] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:50:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:50:07.740651 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a0db6895-10df-4a20-b716-97023c84b102 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:07.741444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a0db6895-10df-4a20-b716-97023c84b102 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:07.796718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a0db6895-10df-4a20-b716-97023c84b102 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:07.803661 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a0db6895-10df-4a20-b716-97023c84b102 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1099 microversion: 2.1 time: 0.067995 May 14 21:50:07.804267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3298/6185] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:07 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1099 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:08.821752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:08.822278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:08.829699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:08.830160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:08.830923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:08.831361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:08.902308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:08.910950 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c051b877-61ea-4cf2-bf28-6638478f9f87 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1149 microversion: 2.1 time: 0.094306 May 14 21:50:08.911542 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2888/6186] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:08 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1149 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:09.929300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:09.929863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:09.937210 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:09.941273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:09.941273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:09.941273 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:10.008162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:10.015150 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0fb3d62e-e82d-432e-b123-2a500b9eeb57 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1205 microversion: 2.1 time: 0.090193 May 14 21:50:10.016226 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3299/6187] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:09 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1205 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:11.034500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:11.035127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:11.042549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:11.043015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:11.043832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:11.044280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:11.204831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:11.212486 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a6de336-9795-4898-a63c-eccb8dad4a81 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1283 microversion: 2.1 time: 0.182261 May 14 21:50:11.213061 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2889/6188] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:11 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:11.581878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-baa7bdfe-58a1-4ba6-b7e6-3dbc86b2c930 req-3ac84386-ef41-413c-868a-2a4311119fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba04a2d9-8864-4848-b937-425921786664", "tag": "fabc866e-ec56-434f-8b1d-167f054712e7"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:11.592791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-baa7bdfe-58a1-4ba6-b7e6-3dbc86b2c930 req-3ac84386-ef41-413c-868a-2a4311119fdf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:11.593424 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-baa7bdfe-58a1-4ba6-b7e6-3dbc86b2c930 req-3ac84386-ef41-413c-868a-2a4311119fdf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:11.610489 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-baa7bdfe-58a1-4ba6-b7e6-3dbc86b2c930 req-3ac84386-ef41-413c-868a-2a4311119fdf service nova] Creating event network-changed:fabc866e-ec56-434f-8b1d-167f054712e7 for instance ba04a2d9-8864-4848-b937-425921786664 on nch2-master-1 May 14 21:50:11.616231 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-baa7bdfe-58a1-4ba6-b7e6-3dbc86b2c930 req-3ac84386-ef41-413c-868a-2a4311119fdf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038787 May 14 21:50:11.617095 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3300/6189] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:12.229677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:12.230307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:12.237839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:12.238304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:12.239086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:12.239662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:12.383600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:12.392761 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0592e698-80c0-4a1b-8f69-734b53b75143 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1271 microversion: 2.1 time: 0.167068 May 14 21:50:12.393354 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2890/6190] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:12 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:13.411841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:13.412544 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:13.418729 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:13.419180 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:13.420226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:13.420614 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:13.553208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:13.561264 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5d30b665-250f-493a-b057-f53687ab4047 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1271 microversion: 2.1 time: 0.153972 May 14 21:50:13.561833 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3301/6191] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:13 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:14.578371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:14.579002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:14.585876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:14.586336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:14.587109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:14.587589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:14.725549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:14.733996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79ecde24-4a80-4f06-995e-14ba12a8f916 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1271 microversion: 2.1 time: 0.159949 May 14 21:50:14.734593 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2891/6192] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:14 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:15.751093 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:15.751757 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:15.758586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:15.759053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:15.759862 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:15.760308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:15.893240 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:15.901310 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e52a41ae-2a39-4d69-9213-6b34e8e8a83b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1271 microversion: 2.1 time: 0.154600 May 14 21:50:15.901888 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3302/6193] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:15 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:16.917477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:16.918099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:16.925794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:16.926365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:16.927029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:16.927561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:17.060953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:17.068461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d2bf453f-c174-4915-b781-20d56286e991 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1271 microversion: 2.1 time: 0.154893 May 14 21:50:17.069042 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2892/6194] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:16 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:18.085749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:18.086377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:18.094346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:18.094804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:18.095620 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:18.096063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:18.132049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-65b3061c-a64c-448e-b2b9-28d469309210 req-b5eaf668-406e-45da-b5d0-2f31b2ccf41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba04a2d9-8864-4848-b937-425921786664", "name": "network-vif-plugged", "status": "completed", "tag": "fabc866e-ec56-434f-8b1d-167f054712e7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:18.143400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-65b3061c-a64c-448e-b2b9-28d469309210 req-b5eaf668-406e-45da-b5d0-2f31b2ccf41b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:18.144139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-65b3061c-a64c-448e-b2b9-28d469309210 req-b5eaf668-406e-45da-b5d0-2f31b2ccf41b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:18.157117 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-65b3061c-a64c-448e-b2b9-28d469309210 req-b5eaf668-406e-45da-b5d0-2f31b2ccf41b service nova] Creating event network-vif-plugged:fabc866e-ec56-434f-8b1d-167f054712e7 for instance ba04a2d9-8864-4848-b937-425921786664 on nch2-master-1 May 14 21:50:18.161593 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-65b3061c-a64c-448e-b2b9-28d469309210 req-b5eaf668-406e-45da-b5d0-2f31b2ccf41b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033466 May 14 21:50:18.162404 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2893/6195] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:18.233670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:18.241611 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e935c8c4-d77e-44d9-993f-8dbccc1e3d0b tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1271 microversion: 2.1 time: 0.159971 May 14 21:50:18.243522 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3303/6196] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:18 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:19.260926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:19.261663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:19.269017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:19.269479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:19.270257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:19.270707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:19.410088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:19.417701 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-662e8659-1839-41cc-8253-74bba35fce6a tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1271 microversion: 2.1 time: 0.161974 May 14 21:50:19.418283 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2894/6197] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:19 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:20.434280 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:20.434909 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:20.442480 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:20.442944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:20.443749 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:20.444230 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:20.577229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:20.584754 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f9a79b9b-b60b-478e-a842-b3a4732b6d86 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1461 microversion: 2.1 time: 0.154442 May 14 21:50:20.585330 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3304/6198] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:20 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1461 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:20.600876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:20.601500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:20.608907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:20.609374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:20.610148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:20.610600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:20.741428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:20.749652 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eed6eeb9-ef76-48bc-b786-e314b1c798e8 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1461 microversion: 2.1 time: 0.151957 May 14 21:50:20.750219 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2895/6199] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:20 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1461 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:20.936385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-15a7657c-d3e9-40eb-90c0-a86b0910ebfa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:20.937322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-15a7657c-d3e9-40eb-90c0-a86b0910ebfa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:20.943568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a7657c-d3e9-40eb-90c0-a86b0910ebfa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:20.944013 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a7657c-d3e9-40eb-90c0-a86b0910ebfa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:20.944816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a7657c-d3e9-40eb-90c0-a86b0910ebfa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:20.945256 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-15a7657c-d3e9-40eb-90c0-a86b0910ebfa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:20.998468 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-15a7657c-d3e9-40eb-90c0-a86b0910ebfa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action" status: 200 len: 63186 microversion: 2.1 time: 0.065811 May 14 21:50:21.006080 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3305/6200] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:50:20 2022] POST /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2/action => generated 63186 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:50:22.734061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cbb9f4a2-f38d-40f6-b16d-ba862ee02972 req-4ae9898e-e873-4a2d-aace-2a630c25227b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba04a2d9-8864-4848-b937-425921786664", "tag": "fabc866e-ec56-434f-8b1d-167f054712e7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:22.742556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cbb9f4a2-f38d-40f6-b16d-ba862ee02972 req-4ae9898e-e873-4a2d-aace-2a630c25227b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:22.743265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cbb9f4a2-f38d-40f6-b16d-ba862ee02972 req-4ae9898e-e873-4a2d-aace-2a630c25227b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:22.755669 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cbb9f4a2-f38d-40f6-b16d-ba862ee02972 req-4ae9898e-e873-4a2d-aace-2a630c25227b service nova] Creating event network-changed:fabc866e-ec56-434f-8b1d-167f054712e7 for instance ba04a2d9-8864-4848-b937-425921786664 on nch2-master-1 May 14 21:50:22.761307 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cbb9f4a2-f38d-40f6-b16d-ba862ee02972 req-4ae9898e-e873-4a2d-aace-2a630c25227b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031358 May 14 21:50:22.762363 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2896/6201] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:24.433190 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-194c0462-a8ac-4ddb-8fc1-56ba81111c53 req-940e8d85-69c2-4e8b-99a9-e98717c54733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba04a2d9-8864-4848-b937-425921786664", "tag": "fabc866e-ec56-434f-8b1d-167f054712e7"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:24.443603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-194c0462-a8ac-4ddb-8fc1-56ba81111c53 req-940e8d85-69c2-4e8b-99a9-e98717c54733 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:24.444054 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-194c0462-a8ac-4ddb-8fc1-56ba81111c53 req-940e8d85-69c2-4e8b-99a9-e98717c54733 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:24.456780 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-194c0462-a8ac-4ddb-8fc1-56ba81111c53 req-940e8d85-69c2-4e8b-99a9-e98717c54733 service nova] Creating event network-changed:fabc866e-ec56-434f-8b1d-167f054712e7 for instance ba04a2d9-8864-4848-b937-425921786664 on nch2-master-1 May 14 21:50:24.461554 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-194c0462-a8ac-4ddb-8fc1-56ba81111c53 req-940e8d85-69c2-4e8b-99a9-e98717c54733 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032487 May 14 21:50:24.462145 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3306/6202] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:26.478437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5a13fbf8-02ee-4380-8fc4-991efed2b24b req-2c27abe1-f43a-406c-b07a-2fd6cd2c983d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba04a2d9-8864-4848-b937-425921786664", "tag": "fabc866e-ec56-434f-8b1d-167f054712e7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:26.487877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5a13fbf8-02ee-4380-8fc4-991efed2b24b req-2c27abe1-f43a-406c-b07a-2fd6cd2c983d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:26.488330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5a13fbf8-02ee-4380-8fc4-991efed2b24b req-2c27abe1-f43a-406c-b07a-2fd6cd2c983d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:26.499514 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5a13fbf8-02ee-4380-8fc4-991efed2b24b req-2c27abe1-f43a-406c-b07a-2fd6cd2c983d service nova] Creating event network-changed:fabc866e-ec56-434f-8b1d-167f054712e7 for instance ba04a2d9-8864-4848-b937-425921786664 on nch2-master-1 May 14 21:50:26.505124 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5a13fbf8-02ee-4380-8fc4-991efed2b24b req-2c27abe1-f43a-406c-b07a-2fd6cd2c983d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030750 May 14 21:50:26.505705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2897/6203] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:27.543501 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8cd1c2b0-5636-4a6c-b580-23e23588c4ce tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:27.544331 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8cd1c2b0-5636-4a6c-b580-23e23588c4ce tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:27.552832 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cd1c2b0-5636-4a6c-b580-23e23588c4ce tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:27.553385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cd1c2b0-5636-4a6c-b580-23e23588c4ce tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:27.554348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cd1c2b0-5636-4a6c-b580-23e23588c4ce tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:27.554921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8cd1c2b0-5636-4a6c-b580-23e23588c4ce tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:27.689780 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8cd1c2b0-5636-4a6c-b580-23e23588c4ce tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1831 microversion: 2.1 time: 0.151890 May 14 21:50:27.690351 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3307/6204] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:27 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1831 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:28.620336 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-c23f1231-b70b-41e3-827a-82682d1f9211 req-a6ffe3a6-eae2-4445-9349-d6a823c6d918 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:28.625731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:28.626337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:28.636284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:28.637030 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c23f1231-b70b-41e3-827a-82682d1f9211 req-a6ffe3a6-eae2-4445-9349-d6a823c6d918 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:28.637193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:28.637517 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-c23f1231-b70b-41e3-827a-82682d1f9211 req-a6ffe3a6-eae2-4445-9349-d6a823c6d918 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:28.637857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:28.638771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:28.649114 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-c23f1231-b70b-41e3-827a-82682d1f9211 req-a6ffe3a6-eae2-4445-9349-d6a823c6d918 service nova] Creating event network-changed:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:50:28.654732 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-c23f1231-b70b-41e3-827a-82682d1f9211 req-a6ffe3a6-eae2-4445-9349-d6a823c6d918 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037900 May 14 21:50:28.655676 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3308/6205] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:28.668732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:50:28.949766 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83b771d5-b044-48e2-8435-528e3a543cc6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 204 len: 0 microversion: 2.1 time: 0.337111 May 14 21:50:28.950702 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2898/6206] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:50:28 2022] DELETE /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:50:28.960231 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:28.960637 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:28.967347 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:28.967814 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:28.968597 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:28.969043 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:29.113673 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:29.121138 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8061659f-ec4c-4e54-8109-fc0a9f8a1911 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1686 microversion: 2.1 time: 0.165881 May 14 21:50:29.121721 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3309/6207] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:28 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:30.141976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:30.142708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:30.149130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:30.149587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:30.150642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:30.151083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:30.335209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:30.344839 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-18e5230c-ec53-4fd0-ae56-766602528058 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1568 microversion: 2.1 time: 0.209309 May 14 21:50:30.345828 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2899/6208] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:30 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:30.859324 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a4b39351-7015-433a-b170-d1e25b551bdd req-7899a332-f2ed-4d6a-903b-246bccb9abe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c74149a-e96c-4f13-a6a1-6d9e74fd85e2", "name": "network-vif-deleted", "tag": "43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:30.867915 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a4b39351-7015-433a-b170-d1e25b551bdd req-7899a332-f2ed-4d6a-903b-246bccb9abe4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:30.868420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a4b39351-7015-433a-b170-d1e25b551bdd req-7899a332-f2ed-4d6a-903b-246bccb9abe4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:30.880182 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a4b39351-7015-433a-b170-d1e25b551bdd req-7899a332-f2ed-4d6a-903b-246bccb9abe4 service nova] Creating event network-vif-deleted:43fe9ee4-5d99-46d5-b6c4-e77f68d05bb3 for instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 on nch1-master-1 May 14 21:50:30.885274 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a4b39351-7015-433a-b170-d1e25b551bdd req-7899a332-f2ed-4d6a-903b-246bccb9abe4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030768 May 14 21:50:30.885736 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3310/6209] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:31.364053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:31.364731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:31.372051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:31.372509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:31.373323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:31.374326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:31.412783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:31.413170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:31.413643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lazy-loading 'fault' on Instance uuid 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:50:31.456582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:31.464203 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4e12e5ad-8111-4827-8e83-cfafba92c89f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 200 len: 1355 microversion: 2.1 time: 0.104340 May 14 21:50:31.464792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2900/6210] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:31 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:32.487151 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:32.487886 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:32.494207 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:32.494644 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:32.495411 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:32.495884 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:32.509566 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] HTTP exception thrown: Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 could not be found. May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Request method failure captured: May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 HTTP/1.1 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCM3z8vMGjE3Khn4V0nlEkyzMD4gMlNtB_haMBg2QZyvExKimZQNDFtNzwnf7W5QpmJun_aMxnyPjSJvXTHJJpSxIrZdmdZOxt6-npK6Q3ANgmmJJV39-0JjN8BwmXyB2w81Esnzt1ZQcd61XAwfRfne5qpFFcIclz-YjQV4VtFBGjw May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d47cde4b8ee4dbc9ad64de4084690a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: e9982f39ae394932a2fb8c9e4d456d8d May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 could not be found. May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': '2c74149a-e96c-4f13-a6a1-6d9e74fd85e2'} May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 could not be found. May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 could not be found. May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:50:32.511195 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 could not be found. May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Returning 404 to user: Instance 2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-fb1fc22e-f685-4845-bc2b-75db5f3fb302 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2" status: 404 len: 111 microversion: 2.1 time: 0.031146 May 14 21:50:32.517008 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3311/6211] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:32 2022] GET /compute/v2.1/servers/2c74149a-e96c-4f13-a6a1-6d9e74fd85e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:50:36.366616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd6de94c-976a-4abf-bf4a-6758a808ded3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '.version_select at 0x7fb1a7e2dca0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:36.430626 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd6de94c-976a-4abf-bf4a-6758a808ded3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662002036" status: 202 len: 0 microversion: 2.1 time: 0.067864 May 14 21:50:36.431547 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2901/6212] 10.222.0.52 () {58 vars in 1280 bytes} [Sat May 14 21:50:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662002036 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:50:36.471222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-db62b202-e0a1-4cc9-84b0-609981409f38 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: .version_select at 0x7fb1a6724ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-497683938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHilINjFZBnmHrgRr3mzWnj7d7owo+kp6d+Wy8JuG9agQkbGxM5ukocU2kwmDO0n/lhuKBT8fBWBFKYFsxl2UgUbwa4YhIHBBrLCopqzSNJq1JXNX81tV3Q3f8gM/3V7A=="}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:36.486947 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-db62b202-e0a1-4cc9-84b0-609981409f38 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:50:36.492148 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-db62b202-e0a1-4cc9-84b0-609981409f38 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:50:36.590445 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-db62b202-e0a1-4cc9-84b0-609981409f38 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.123693 May 14 21:50:36.591051 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3312/6213] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:50:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:44.492417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-669879989", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "9663d433-3dce-4185-98aa-0d1d7affc206"}], "key_name": "tempest-TestNetworkAdvancedServerOps-497683938", "security_groups": [{"name": "tempest-secgroup-smoke-569735624"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:44.624173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] validate_networks() for [('9663d433-3dce-4185-98aa-0d1d7affc206', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:50:45.115599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:50:45.116089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:50:45.116580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:50:45.117006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:50:45.117433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:50:45.127656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:45.134282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:45.134282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:45.134282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:45.148336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:50:45.155825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:50:45.176070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:50:45.176070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:50:45.324750 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-08bab5cb-9890-4fe5-9293-f3bd05450b06 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.838876 May 14 21:50:45.337592 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d0f6c568-940e-47a9-92c6-969e58dddfa6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:45.338980 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d0f6c568-940e-47a9-92c6-969e58dddfa6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:45.343583 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2902/6214] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:50:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:50:45.409388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d0f6c568-940e-47a9-92c6-969e58dddfa6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:45.417141 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d0f6c568-940e-47a9-92c6-969e58dddfa6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1265 microversion: 2.1 time: 0.084053 May 14 21:50:45.419801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3313/6215] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:45 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:46.446039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:46.446039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:46.457542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:46.458008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:46.458870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:46.459492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:46.532860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:46.552509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f192571a-04ea-45a4-9489-1479505f1f4d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1269 microversion: 2.1 time: 0.120279 May 14 21:50:46.554211 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2903/6216] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:46 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:47.570737 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:47.571349 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:47.579390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:47.580969 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:47.582155 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:47.582850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:47.660434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:47.670448 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-47a77d04-9409-4bde-ba7e-cbd498939be1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1325 microversion: 2.1 time: 0.104048 May 14 21:50:47.676274 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3314/6217] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:47 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:48.688081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:48.688702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:48.696652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:48.697108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:48.697885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:48.698331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:48.904599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:48.914348 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-859ec792-49c0-457a-9078-9b87808cf975 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1390 microversion: 2.1 time: 0.230136 May 14 21:50:48.918645 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2904/6218] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:48 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1390 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:49.309902 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-79c22cae-da5f-463c-a9f7-df1d83e730fa req-0a3752a5-f03d-42bb-8d28-e923c2d7223f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:49.319538 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-79c22cae-da5f-463c-a9f7-df1d83e730fa req-0a3752a5-f03d-42bb-8d28-e923c2d7223f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:49.324152 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-79c22cae-da5f-463c-a9f7-df1d83e730fa req-0a3752a5-f03d-42bb-8d28-e923c2d7223f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:49.337751 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-79c22cae-da5f-463c-a9f7-df1d83e730fa req-0a3752a5-f03d-42bb-8d28-e923c2d7223f service nova] Creating event network-changed:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch1-master-1 May 14 21:50:49.343148 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-79c22cae-da5f-463c-a9f7-df1d83e730fa req-0a3752a5-f03d-42bb-8d28-e923c2d7223f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036991 May 14 21:50:49.344120 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3315/6219] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:49.932100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:49.932744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:49.940567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:49.941030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:49.941873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:49.942355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:50.102165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:50.110112 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53f749e3-2945-4139-b8a6-781aa73cb366 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1390 microversion: 2.1 time: 0.182468 May 14 21:50:50.110718 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2905/6220] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:49 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1390 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:51.128420 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:51.129122 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:51.136488 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:51.136944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:51.137745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:51.138186 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:51.271003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:51.279222 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33ecfdb7-4d92-40d8-ad58-9bda6f20e31e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1390 microversion: 2.1 time: 0.155078 May 14 21:50:51.279841 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3316/6221] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:51 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:52.295868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:52.296483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:52.303041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:52.303515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:52.304286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:52.304724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:52.450604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:52.458709 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ddaae1f-2bd4-48ad-9fa6-744d9fff6043 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1390 microversion: 2.1 time: 0.166877 May 14 21:50:52.459288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2906/6222] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:52 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:53.475905 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:53.476555 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:53.483341 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:53.483838 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:53.484613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:53.485055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:53.618865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:53.626338 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-1d0d1e0f-81da-455a-8f9d-3ca86b91ea05 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1390 microversion: 2.1 time: 0.155263 May 14 21:50:53.626931 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3317/6223] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:53 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:54.627564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a9c91d45-3785-4e77-85a7-62fe9cb4f81b req-44bfd7fa-3224-43b9-909c-9466c2845695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "name": "network-vif-plugged", "status": "completed", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:54.636934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a9c91d45-3785-4e77-85a7-62fe9cb4f81b req-44bfd7fa-3224-43b9-909c-9466c2845695 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:54.638817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a9c91d45-3785-4e77-85a7-62fe9cb4f81b req-44bfd7fa-3224-43b9-909c-9466c2845695 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:54.655833 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:54.656404 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a9c91d45-3785-4e77-85a7-62fe9cb4f81b req-44bfd7fa-3224-43b9-909c-9466c2845695 service nova] Creating event network-vif-plugged:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch1-master-1 May 14 21:50:54.656529 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:54.662033 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a9c91d45-3785-4e77-85a7-62fe9cb4f81b req-44bfd7fa-3224-43b9-909c-9466c2845695 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038671 May 14 21:50:54.662653 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2907/6224] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:54.666300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:54.666300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:54.666300 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:54.667051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:54.811079 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:54.818967 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-33d13e3f-b19a-4c9b-b388-a3ddf1ecdc10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1390 microversion: 2.1 time: 0.178488 May 14 21:50:54.819583 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3318/6225] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:54 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:55.838298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:55.838926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:55.846064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:55.851517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:55.851517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:55.851517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:55.988812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:55.996714 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e1a6ce2-cd68-4211-b0ae-5b2d78c0fdf9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1390 microversion: 2.1 time: 0.163672 May 14 21:50:55.997347 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2908/6226] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:55 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:50:57.014174 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:57.014801 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:57.022212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:57.022684 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:57.023465 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:57.023944 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:57.153965 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:57.161513 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-aee616f8-e296-4323-ad16-ad6c3e6942b3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1561 microversion: 2.1 time: 0.151319 May 14 21:50:57.162116 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3319/6227] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:57 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1561 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:50:57.178231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:57.178873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:57.185930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:57.186386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:57.187168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:57.187646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:57.323575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:57.331525 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dafdac20-7f50-4ff2-98a3-23def2fd5246 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1561 microversion: 2.1 time: 0.157343 May 14 21:50:57.332110 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2909/6228] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:57 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:50:59.688061 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:50:59.688759 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:50:59.691690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0bd778ac-3b0b-4157-bfc7-55bfde48c57c req-6bfa88f2-b94c-477b-9eb2-7018f7db095a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:50:59.697141 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:59.697611 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:59.698408 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:59.698859 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:59.702421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0bd778ac-3b0b-4157-bfc7-55bfde48c57c req-6bfa88f2-b94c-477b-9eb2-7018f7db095a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:50:59.702968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0bd778ac-3b0b-4157-bfc7-55bfde48c57c req-6bfa88f2-b94c-477b-9eb2-7018f7db095a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:50:59.716328 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0bd778ac-3b0b-4157-bfc7-55bfde48c57c req-6bfa88f2-b94c-477b-9eb2-7018f7db095a service nova] Creating event network-changed:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch1-master-1 May 14 21:50:59.721963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0bd778ac-3b0b-4157-bfc7-55bfde48c57c req-6bfa88f2-b94c-477b-9eb2-7018f7db095a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034930 May 14 21:50:59.725656 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2910/6229] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:50:59.851460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:50:59.861513 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-23f466c5-c36d-41d2-8839-e1325ab7dd8c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1561 microversion: 2.1 time: 0.177340 May 14 21:50:59.862307 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3320/6230] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:50:59 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:11.420556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:11.421160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:11.427405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:11.428438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:11.429209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:11.429654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:11.455695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:51:11.743815 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c31ddba-ab35-4501-a157-b4a66fd82bef tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 204 len: 0 microversion: 2.1 time: 0.431217 May 14 21:51:11.744433 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2911/6231] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:51:11 2022] DELETE /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:51:11.753089 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:11.753783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:11.760551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:11.761007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:11.761785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:11.762224 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:11.894999 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:11.903665 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c472c93-5263-479c-8a7b-7f7c41e6dcaf tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1734 microversion: 2.1 time: 0.154615 May 14 21:51:11.904251 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3321/6232] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:11 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:12.921193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:12.921939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:12.928833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:12.929287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:12.930066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:12.930547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:13.109116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:13.117064 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79a14e48-d041-4b7c-99c0-d716947ccdc5 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1734 microversion: 2.1 time: 0.200485 May 14 21:51:13.117668 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2912/6233] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:12 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1734 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:14.047078 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4ce9e778-0acc-4c8f-a223-316429f98df4 req-f85edf23-f014-485f-af4d-15075870ddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eda28b45-a644-4897-8a19-407348b6a354", "name": "network-vif-deleted", "tag": "58fa393d-5dc7-49f6-a33f-24492ed4050f"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:14.056718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4ce9e778-0acc-4c8f-a223-316429f98df4 req-f85edf23-f014-485f-af4d-15075870ddc7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:14.057580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4ce9e778-0acc-4c8f-a223-316429f98df4 req-f85edf23-f014-485f-af4d-15075870ddc7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:14.069184 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4ce9e778-0acc-4c8f-a223-316429f98df4 req-f85edf23-f014-485f-af4d-15075870ddc7 service nova] Creating event network-vif-deleted:58fa393d-5dc7-49f6-a33f-24492ed4050f for instance eda28b45-a644-4897-8a19-407348b6a354 on nch2-master-1 May 14 21:51:14.075236 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4ce9e778-0acc-4c8f-a223-316429f98df4 req-f85edf23-f014-485f-af4d-15075870ddc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031948 May 14 21:51:14.076471 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3322/6234] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:51:14.134839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:14.135771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:14.142868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:14.143427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:14.144319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:14.144845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:14.219865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c025653d74848899a26c661400279cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233de55e2a38457bb1837da8374b7b54', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:14.231160 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c2cc4d15-e437-4f6c-8e4f-f65278e87ed8 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 200 len: 1666 microversion: 2.1 time: 0.100191 May 14 21:51:14.233939 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2913/6235] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:14 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 1666 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:15.250676 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:15.251392 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:15.259050 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:15.259609 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:15.260390 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:15.260836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:15.274018 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] HTTP exception thrown: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Request method failure captured: May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 HTTP/1.1 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCMZcYkLMVH5OOTRvOdQyrcC6dheop3QQHI_9BIZ7R2NFE66FOrNlwjQS3KkyWHNdhKPT38TQ5lSJO-RcXQIKK-t-MYHQdJ6GU1NxyJX1i9o-exhTrvUwpUoRTRRv_nmrN7kakLeRaBqWy9SFhlwkLivGbADpGz29Agg44AZC9fAYps May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 233de55e2a38457bb1837da8374b7b54 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestServerBasicOps-236296520 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_233de55e2a38457bb1837da8374b7b54", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestServerBasicOps-236296520 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 233de55e2a38457bb1837da8374b7b54 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestServerBasicOps-236296520 May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestServerBasicOps-236296520-project May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 2c025653d74848899a26c661400279cf May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestServerBasicOps-236296520-project May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'eda28b45-a644-4897-8a19-407348b6a354'} May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:15.275956 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Returning 404 to user: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-5b28e082-889a-4384-89d7-f1866831b982 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 404 len: 111 microversion: 2.1 time: 0.030989 May 14 21:51:15.284334 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3323/6236] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:15 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:51:15.807361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:15.807937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:15.814768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:15.815225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:15.816047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:15.816489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:15.830227 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] HTTP exception thrown: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Request method failure captured: May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 HTTP/1.1 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCMZcYkLMVH5OOTRvOdQyrcC6dheop3QQHI_9BIZ7R2NFE66FOrNlwjQS3KkyWHNdhKPT38TQ5lSJO-RcXQIKK-t-MYHQdJ6GU1NxyJX1i9o-exhTrvUwpUoRTRRv_nmrN7kakLeRaBqWy9SFhlwkLivGbADpGz29Agg44AZC9fAYps May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 233de55e2a38457bb1837da8374b7b54 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestServerBasicOps-236296520 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_233de55e2a38457bb1837da8374b7b54", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestServerBasicOps-236296520 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 233de55e2a38457bb1837da8374b7b54 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestServerBasicOps-236296520 May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestServerBasicOps-236296520-project May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2c025653d74848899a26c661400279cf May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestServerBasicOps-236296520-project May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'eda28b45-a644-4897-8a19-407348b6a354'} May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:51:15.831931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Returning 404 to user: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be757bcc-f68e-40f2-848c-fd45216c73a3 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "DELETE /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 404 len: 111 microversion: 2.1 time: 0.031587 May 14 21:51:15.837357 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2914/6237] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:51:15 2022] DELETE /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:51:15.842530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:15.843206 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] [instance: eda28b45-a644-4897-8a19-407348b6a354] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:15.849226 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:15.849675 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:15.850437 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:15.850878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:15.867453 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] HTTP exception thrown: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Request method failure captured: May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 HTTP/1.1 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCMZcYkLMVH5OOTRvOdQyrcC6dheop3QQHI_9BIZ7R2NFE66FOrNlwjQS3KkyWHNdhKPT38TQ5lSJO-RcXQIKK-t-MYHQdJ6GU1NxyJX1i9o-exhTrvUwpUoRTRRv_nmrN7kakLeRaBqWy9SFhlwkLivGbADpGz29Agg44AZC9fAYps May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 233de55e2a38457bb1837da8374b7b54 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestServerBasicOps-236296520 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/233de55e2a38457bb1837da8374b7b54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_233de55e2a38457bb1837da8374b7b54", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestServerBasicOps-236296520 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 233de55e2a38457bb1837da8374b7b54 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestServerBasicOps-236296520 May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestServerBasicOps-236296520-project May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: 2c025653d74848899a26c661400279cf May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestServerBasicOps-236296520-project May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'eda28b45-a644-4897-8a19-407348b6a354'} May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:15.869817 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Returning 404 to user: Instance eda28b45-a644-4897-8a19-407348b6a354 could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7dcef519-e353-4e00-bcdf-b16df7129ab4 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354" status: 404 len: 111 microversion: 2.1 time: 0.032609 May 14 21:51:15.886293 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3324/6238] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:15 2022] GET /compute/v2.1/servers/eda28b45-a644-4897-8a19-407348b6a354 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:51:16.119344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a06fb9f8-fa77-4a27-a61d-3c8bc626ef36 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] Calling method '.version_select at 0x7fb1a768f5e0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:16.219102 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a06fb9f8-fa77-4a27-a61d-3c8bc626ef36 tempest-TestServerBasicOps-236296520 tempest-TestServerBasicOps-236296520-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1687937417" status: 202 len: 0 microversion: 2.1 time: 0.103884 May 14 21:51:16.219667 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2915/6239] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 21:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1687937417 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:51:19.436081 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-42df5cf9-a725-4782-8ced-7d3263e2d632 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:19.439287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-42df5cf9-a725-4782-8ced-7d3263e2d632 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:19.447032 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42df5cf9-a725-4782-8ced-7d3263e2d632 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:19.447512 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42df5cf9-a725-4782-8ced-7d3263e2d632 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:19.448309 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42df5cf9-a725-4782-8ced-7d3263e2d632 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:19.448754 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-42df5cf9-a725-4782-8ced-7d3263e2d632 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:19.518140 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-42df5cf9-a725-4782-8ced-7d3263e2d632 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action" status: 200 len: 24574 microversion: 2.1 time: 0.095965 May 14 21:51:19.519094 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3325/6240] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:51:19 2022] POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action => generated 24574 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:51:30.570788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:30.571410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:30.579528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:30.579987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:30.580781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:30.581261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:30.714192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:30.722664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1bce5489-e6a0-4d74-b920-c6b44b14515c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1679 microversion: 2.1 time: 0.156014 May 14 21:51:30.723263 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2916/6241] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:30 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:30.815355 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8a471dea-6386-41d1-b369-0c0fe62eca95 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:30.820734 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8a471dea-6386-41d1-b369-0c0fe62eca95 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:30.823924 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a471dea-6386-41d1-b369-0c0fe62eca95 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:30.824334 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a471dea-6386-41d1-b369-0c0fe62eca95 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:30.825165 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a471dea-6386-41d1-b369-0c0fe62eca95 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:30.825612 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8a471dea-6386-41d1-b369-0c0fe62eca95 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:30.874389 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8a471dea-6386-41d1-b369-0c0fe62eca95 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action" status: 200 len: 32649 microversion: 2.1 time: 0.063168 May 14 21:51:30.875044 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3326/6242] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:51:30 2022] POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action => generated 32649 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:51:31.043408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-549fb42c-a952-48c0-bb0f-2774d338a0c9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:31.044065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-549fb42c-a952-48c0-bb0f-2774d338a0c9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:31.050277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549fb42c-a952-48c0-bb0f-2774d338a0c9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:31.050737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549fb42c-a952-48c0-bb0f-2774d338a0c9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:31.051548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549fb42c-a952-48c0-bb0f-2774d338a0c9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:31.052003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549fb42c-a952-48c0-bb0f-2774d338a0c9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:31.186130 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-549fb42c-a952-48c0-bb0f-2774d338a0c9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1830 microversion: 2.1 time: 0.146843 May 14 21:51:31.190818 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2917/6243] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:31 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1830 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:31.203568 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:31.204804 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:31.211918 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:31.213767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:31.213767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:31.213767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:31.238530 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lazy-loading 'flavor' on Instance uuid 4352d2e8-3b5f-4531-ab77-8c712dcefc79 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:51:31.252014 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Going to try to live migrate instance to another host {{(pid=130638) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 14 21:51:31.577060 ncdv-master-1 devstack@n-api.service[130638]: ERROR oslo.messaging._drivers.impl_rabbit [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [4354ceac-0c7c-4460-9d05-9d748e53a7d0] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 21:51:32.584686 ncdv-master-1 devstack@n-api.service[130638]: INFO oslo.messaging._drivers.impl_rabbit [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [4354ceac-0c7c-4460-9d05-9d748e53a7d0] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 60964. May 14 21:51:35.076259 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-39f0b82a-0201-457c-a663-ac43add48ba0 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action" status: 202 len: 0 microversion: 2.1 time: 3.876747 May 14 21:51:35.076938 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3327/6244] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:51:31 2022] POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action => generated 0 bytes in 3879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:51:35.212504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:35.213259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:35.219568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:35.220051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:35.220831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:35.221254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:35.358557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:35.363504 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf39ecfc-53dd-49b5-a157-d7d63379d256 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.282116 May 14 21:51:35.364201 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2918/6245] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:35 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:36.382289 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:36.383025 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:36.391364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:36.391864 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:36.392659 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:36.393108 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:36.423543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6178821d-b561-4a09-bfca-9fcce53ce68d req-139fef02-536d-4286-bdc8-87f9bdc37dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "name": "network-vif-unplugged", "status": "completed", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:36.433222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6178821d-b561-4a09-bfca-9fcce53ce68d req-139fef02-536d-4286-bdc8-87f9bdc37dff service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:36.433834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6178821d-b561-4a09-bfca-9fcce53ce68d req-139fef02-536d-4286-bdc8-87f9bdc37dff service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:36.445283 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6178821d-b561-4a09-bfca-9fcce53ce68d req-139fef02-536d-4286-bdc8-87f9bdc37dff service nova] Creating event network-vif-unplugged:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch1-master-1 May 14 21:51:36.451053 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6178821d-b561-4a09-bfca-9fcce53ce68d req-139fef02-536d-4286-bdc8-87f9bdc37dff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032357 May 14 21:51:36.451713 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2919/6246] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:51:36.537045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:36.545360 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-40d6e5c7-f901-4e06-99e9-dfb0acabdefa tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.166942 May 14 21:51:36.546267 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3328/6247] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:36 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:37.563571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:37.564343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:37.570727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:37.573343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:37.573343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:37.573343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:37.708450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:37.716447 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-391b7678-3be0-45ac-986f-a0f9d33f4747 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.157993 May 14 21:51:37.717032 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2920/6248] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:37 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:51:38.475896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4366a50d-7cf4-4117-8b48-43d3079f7615 req-3628aef0-f353-46ff-ad5c-4b08db3df55f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:38.486624 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4366a50d-7cf4-4117-8b48-43d3079f7615 req-3628aef0-f353-46ff-ad5c-4b08db3df55f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:38.490818 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4366a50d-7cf4-4117-8b48-43d3079f7615 req-3628aef0-f353-46ff-ad5c-4b08db3df55f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:38.499087 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4366a50d-7cf4-4117-8b48-43d3079f7615 req-3628aef0-f353-46ff-ad5c-4b08db3df55f service nova] Creating event network-changed:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch1-master-1 May 14 21:51:38.505005 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4366a50d-7cf4-4117-8b48-43d3079f7615 req-3628aef0-f353-46ff-ad5c-4b08db3df55f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032773 May 14 21:51:38.508082 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3329/6249] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:51:38.735105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:38.735685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:38.742187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:38.742649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:38.743433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:38.743904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:38.968431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:38.971863 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-464509e5-37ac-43af-9b7d-16ddfe5f87d5 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.241392 May 14 21:51:38.972466 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2921/6250] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:38 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:39.991527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:39.992245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:39.998623 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:39.999083 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:39.999901 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:40.000350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:40.134333 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:40.142519 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-77b22d0b-dc01-4f89-bc4a-83994ca970bc tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.156142 May 14 21:51:40.143111 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3330/6251] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:39 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:41.159892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:41.160515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:41.167891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:41.168351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:41.169128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:41.169573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:41.303371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:41.311647 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6b6aaedb-91d3-4c24-a991-da0244616fda tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.155623 May 14 21:51:41.312235 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2922/6252] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:41 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:42.170441 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-a4fccab9-bb63-4963-8547-d2f2b7ced4bb req-cd7f3eae-15cc-4c90-a7b5-fb7e02f02e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "name": "network-vif-unplugged", "status": "completed", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:42.173860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a4fccab9-bb63-4963-8547-d2f2b7ced4bb req-cd7f3eae-15cc-4c90-a7b5-fb7e02f02e88 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:42.174261 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-a4fccab9-bb63-4963-8547-d2f2b7ced4bb req-cd7f3eae-15cc-4c90-a7b5-fb7e02f02e88 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:42.185909 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-a4fccab9-bb63-4963-8547-d2f2b7ced4bb req-cd7f3eae-15cc-4c90-a7b5-fb7e02f02e88 service nova] Creating event network-vif-unplugged:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch1-master-1 May 14 21:51:42.190907 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-a4fccab9-bb63-4963-8547-d2f2b7ced4bb req-cd7f3eae-15cc-4c90-a7b5-fb7e02f02e88 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030267 May 14 21:51:42.191531 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3331/6253] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:51:42.329824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:42.330441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:42.337223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:42.337672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:42.338437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:42.338899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:42.877593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:42.885471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-304d040e-af97-4aef-9680-2f3eab673019 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.559629 May 14 21:51:42.886666 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2923/6254] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:42 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:43.904935 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:43.905653 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:43.911866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:43.920222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:43.920222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:43.920222 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:44.162962 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:44.171187 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a7a61661-92b3-44b5-a4cb-c76a93e73169 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1689 microversion: 2.1 time: 0.272232 May 14 21:51:44.171797 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3332/6255] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:43 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1689 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:45.189309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:45.190036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:45.196903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:45.200134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:45.200134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:45.200134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:45.392534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:45.400091 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bcdf0e83-7d75-43ad-8876-6206cdf6971b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1679 microversion: 2.1 time: 0.214912 May 14 21:51:45.400664 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2924/6256] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:45 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:45.422203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca3db9b6-910a-4d89-8616-d90e24efdcb9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:45.422856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ca3db9b6-910a-4d89-8616-d90e24efdcb9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:45.429694 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca3db9b6-910a-4d89-8616-d90e24efdcb9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:45.431239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca3db9b6-910a-4d89-8616-d90e24efdcb9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:45.431239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca3db9b6-910a-4d89-8616-d90e24efdcb9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:45.431499 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca3db9b6-910a-4d89-8616-d90e24efdcb9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:45.559921 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca3db9b6-910a-4d89-8616-d90e24efdcb9 tempest-TestNetworkAdvancedServerOps-94644676 tempest-TestNetworkAdvancedServerOps-94644676-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1830 microversion: 2.1 time: 0.141412 May 14 21:51:45.560518 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3333/6257] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:45 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1830 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:45.576361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:45.577472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:45.583007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:45.583529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:45.584302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:45.584747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:45.715998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:45.723609 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe3e5f58-b6bc-47be-af01-266eab90f213 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1679 microversion: 2.1 time: 0.151355 May 14 21:51:45.724183 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2925/6258] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:45 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:47.828821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-491791ca-c63f-4773-817d-e15aacfa48c1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:47.829816 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-491791ca-c63f-4773-817d-e15aacfa48c1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:47.836668 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-491791ca-c63f-4773-817d-e15aacfa48c1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:47.837132 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-491791ca-c63f-4773-817d-e15aacfa48c1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:47.837904 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-491791ca-c63f-4773-817d-e15aacfa48c1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:47.838350 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-491791ca-c63f-4773-817d-e15aacfa48c1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:47.888063 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-491791ca-c63f-4773-817d-e15aacfa48c1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action" status: 200 len: 38617 microversion: 2.1 time: 0.063659 May 14 21:51:47.888691 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3334/6259] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:51:47 2022] POST /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79/action => generated 38617 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:51:48.985801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:48.986347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:48.994900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:48.995365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:48.996769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:48.997216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:49.029017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:51:49.066543 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-763cc15c-2cdb-482f-b01d-2d1083ef97d3 req-d39aaf29-bfc0-4546-b46f-0164c0b788c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:49.075604 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-763cc15c-2cdb-482f-b01d-2d1083ef97d3 req-d39aaf29-bfc0-4546-b46f-0164c0b788c0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:49.076063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-763cc15c-2cdb-482f-b01d-2d1083ef97d3 req-d39aaf29-bfc0-4546-b46f-0164c0b788c0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:49.087188 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-763cc15c-2cdb-482f-b01d-2d1083ef97d3 req-d39aaf29-bfc0-4546-b46f-0164c0b788c0 service nova] Creating event network-changed:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch2-master-1 May 14 21:51:49.092871 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-763cc15c-2cdb-482f-b01d-2d1083ef97d3 req-d39aaf29-bfc0-4546-b46f-0164c0b788c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108149 May 14 21:51:49.093477 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3335/6260] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:51:49.331747 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c9125915-8024-4927-af0e-a28d4fdfd49e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 204 len: 0 microversion: 2.1 time: 0.349633 May 14 21:51:49.335771 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2926/6261] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:51:48 2022] DELETE /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:51:49.342603 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:49.343364 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:49.349670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:49.350134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:49.351181 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:49.351819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:49.493998 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:49.502779 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e641b970-5fd1-4769-bf0a-cdb77dc0602c tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1685 microversion: 2.1 time: 0.165628 May 14 21:51:49.503361 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3336/6262] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:49 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:50.323617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-175faa28-7a88-4b75-9ec2-c10e162c2abc req-a2a273db-e8ad-4a21-9929-008e97646cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4352d2e8-3b5f-4531-ab77-8c712dcefc79", "name": "network-vif-deleted", "tag": "9eb246db-4507-425a-8cfb-69a595958b9a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:50.332645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-175faa28-7a88-4b75-9ec2-c10e162c2abc req-a2a273db-e8ad-4a21-9929-008e97646cf6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:50.333095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-175faa28-7a88-4b75-9ec2-c10e162c2abc req-a2a273db-e8ad-4a21-9929-008e97646cf6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:50.344274 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-175faa28-7a88-4b75-9ec2-c10e162c2abc req-a2a273db-e8ad-4a21-9929-008e97646cf6 service nova] Creating event network-vif-deleted:9eb246db-4507-425a-8cfb-69a595958b9a for instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 on nch2-master-1 May 14 21:51:50.349293 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-175faa28-7a88-4b75-9ec2-c10e162c2abc req-a2a273db-e8ad-4a21-9929-008e97646cf6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029661 May 14 21:51:50.349908 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2927/6263] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:51:50.520625 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:50.521266 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:50.528896 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:50.529322 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:50.530100 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:50.530546 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:50.594586 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:51:50.602572 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-d3331bbf-9e1b-47e0-b0bb-15dda86312a0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 200 len: 1350 microversion: 2.1 time: 0.085927 May 14 21:51:50.603325 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3337/6264] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:50 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:51:51.621791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:51.622483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: 4352d2e8-3b5f-4531-ab77-8c712dcefc79] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:51:51.628965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:51.629414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:51.630181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:51:51.630608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:51:51.644259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] HTTP exception thrown: Instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 could not be found. May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Request method failure captured: May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 HTTP/1.1 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCM3z8vMGjE3Khn4V0nlEkyzMD4gMlNtB_haMBg2QZyvExKimZQNDFtNzwnf7W5QpmJun_aMxnyPjSJvXTHJJpSxIrZdmdZOxt6-npK6Q3ANgmmJJV39-0JjN8BwmXyB2w81Esnzt1ZQcd61XAwfRfne5qpFFcIclz-YjQV4VtFBGjw May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d47cde4b8ee4dbc9ad64de4084690a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: e9982f39ae394932a2fb8c9e4d456d8d May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 could not be found. May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '4352d2e8-3b5f-4531-ab77-8c712dcefc79'} May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 could not be found. May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 could not be found. May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:51:51.645866 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 could not be found. May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Returning 404 to user: Instance 4352d2e8-3b5f-4531-ab77-8c712dcefc79 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28a02571-f7b6-4391-9551-9cdf0091cff9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79" status: 404 len: 111 microversion: 2.1 time: 0.030691 May 14 21:51:51.651702 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2928/6265] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:51:51 2022] GET /compute/v2.1/servers/4352d2e8-3b5f-4531-ab77-8c712dcefc79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:51:55.673960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-609bd8ec-527f-42b5-b109-67a9947f0781 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '.version_select at 0x7fb1b97db700>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:51:55.766746 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-609bd8ec-527f-42b5-b109-67a9947f0781 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-497683938" status: 202 len: 0 microversion: 2.1 time: 0.096955 May 14 21:51:55.767280 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3338/6266] 10.222.0.52 () {58 vars in 1280 bytes} [Sat May 14 21:51:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-497683938 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:51:55.797604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-277eaea2-ddcc-4b42-a619-cfeb17392bc8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: .version_select at 0x7fb1a767d310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-523417973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLz/tlSBVXHXzSZ9cFAzuU8W0+m2oqldXiWgRy9PhNoH2qkDl3AxLaLkXzoTZ3SrkTRjUpk7FtBg/p5k4+pzCOLXJNssIA+niTqZwqenlxY8dDublWoW8viZRrUYGA0d8Q=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:51:55.813342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-277eaea2-ddcc-4b42-a619-cfeb17392bc8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:51:55.819199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-277eaea2-ddcc-4b42-a619-cfeb17392bc8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:51:55.921719 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-277eaea2-ddcc-4b42-a619-cfeb17392bc8 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.128029 May 14 21:51:55.922327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2929/6267] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:51:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:52:04.307445 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2119490635", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "86ba39e7-c7ca-46ed-9f66-25113b3ad9aa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-523417973", "security_groups": [{"name": "tempest-secgroup-smoke-8204655"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:52:04.424007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] validate_networks() for [('86ba39e7-c7ca-46ed-9f66-25113b3ad9aa', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:52:04.864377 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:52:04.864941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:52:04.865610 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:52:04.866021 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:52:04.866515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:52:04.876840 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:04.877302 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:04.878113 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:04.878560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:04.896195 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:52:04.901860 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Getting quotas for user e9982f39ae394932a2fb8c9e4d456d8d and project 9d47cde4b8ee4dbc9ad64de4084690a9. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:52:04.914747 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:52:04.917245 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:52:05.028767 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7add3f93-c862-4e52-bfc7-72ea0ad287e1 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.726083 May 14 21:52:05.036057 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3339/6268] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:52:04 2022] POST /compute/v2.1/servers => generated 403 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:52:05.041010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4bbfc0a0-7ca8-4cbb-a288-411983b4e0cf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:05.050399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4bbfc0a0-7ca8-4cbb-a288-411983b4e0cf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:05.110709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4bbfc0a0-7ca8-4cbb-a288-411983b4e0cf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:05.118663 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4bbfc0a0-7ca8-4cbb-a288-411983b4e0cf tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1266 microversion: 2.1 time: 0.081402 May 14 21:52:05.119136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2930/6269] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:05 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:06.136914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:06.138320 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:06.145204 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:06.150358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:06.150358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:06.150358 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:06.215577 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:06.224592 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e44feccd-17d8-4a60-99e1-742000bf56fe tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1270 microversion: 2.1 time: 0.092527 May 14 21:52:06.225287 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3340/6270] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:06 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:52:07.241405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:07.243027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:07.251277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:07.251985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:07.253486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:07.254164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:07.356123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:07.364611 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b9b88be7-83f8-459b-87c5-8b5e288ac5c0 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1336 microversion: 2.1 time: 0.126918 May 14 21:52:07.365314 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2931/6271] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:07 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1336 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:08.382560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:08.383161 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:08.391129 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:08.391984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:08.392783 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:08.393241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:08.536137 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:08.544048 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-94558beb-cd5a-427c-bbee-0a91c62c0af9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1389 microversion: 2.1 time: 0.165637 May 14 21:52:08.544634 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3341/6272] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:08 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:09.119347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-178d9fb8-9d77-42a3-aaa0-de57fd029873 req-0cdc4111-7e5f-430e-bace-578f8e6af399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2670155-2961-4fcc-8832-88738fe0b60c", "tag": "8aff54b0-db61-466d-994a-b32ac85a7a2e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:52:09.134232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-178d9fb8-9d77-42a3-aaa0-de57fd029873 req-0cdc4111-7e5f-430e-bace-578f8e6af399 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:09.134232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-178d9fb8-9d77-42a3-aaa0-de57fd029873 req-0cdc4111-7e5f-430e-bace-578f8e6af399 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:09.147117 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-178d9fb8-9d77-42a3-aaa0-de57fd029873 req-0cdc4111-7e5f-430e-bace-578f8e6af399 service nova] Creating event network-changed:8aff54b0-db61-466d-994a-b32ac85a7a2e for instance a2670155-2961-4fcc-8832-88738fe0b60c on nch1-master-1 May 14 21:52:09.153310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-178d9fb8-9d77-42a3-aaa0-de57fd029873 req-0cdc4111-7e5f-430e-bace-578f8e6af399 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037588 May 14 21:52:09.154985 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2932/6273] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:52:09.560777 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:09.561581 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:09.568423 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:09.568883 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:09.573502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:09.573502 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:09.712328 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:09.720537 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-177c7b8c-e559-449b-8a1a-2497179d7355 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1389 microversion: 2.1 time: 0.163887 May 14 21:52:09.721122 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3342/6274] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:09 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:10.738686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:10.739400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:10.746481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:10.747233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:10.748047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:10.748500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:10.880795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:10.888765 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cbc6869c-9201-4d0b-a4fd-b9a9c7198d0a tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1389 microversion: 2.1 time: 0.154286 May 14 21:52:10.895397 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2933/6275] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:10 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:52:11.906680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:11.907308 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:11.914282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:11.914745 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:11.915585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:11.916101 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:12.049469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:12.057014 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-febf3741-bce3-4d57-8594-ee89fefd3001 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1389 microversion: 2.1 time: 0.155156 May 14 21:52:12.057619 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3343/6276] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:11 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:13.075272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:13.075869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:13.082569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:13.088135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:13.088135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:13.088135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:13.222370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:13.230189 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b2d1ee9-ca65-434b-a5f5-47f0b37a442f tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1389 microversion: 2.1 time: 0.159526 May 14 21:52:13.231509 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2934/6277] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:13 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:14.247952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:14.248607 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:14.255570 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:14.256041 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:14.256821 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:14.257272 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:14.394345 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:14.402108 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-8c96ebc1-e382-4f11-96f8-01141c708711 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1389 microversion: 2.1 time: 0.158301 May 14 21:52:14.403130 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3344/6278] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:14 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:14.933274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-26d15ab1-6ebf-49ba-8044-17c6f7818c8e req-05fd6f98-9391-467e-8181-c4154561c191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2670155-2961-4fcc-8832-88738fe0b60c", "name": "network-vif-plugged", "status": "completed", "tag": "8aff54b0-db61-466d-994a-b32ac85a7a2e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:52:14.943993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-26d15ab1-6ebf-49ba-8044-17c6f7818c8e req-05fd6f98-9391-467e-8181-c4154561c191 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:14.943993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-26d15ab1-6ebf-49ba-8044-17c6f7818c8e req-05fd6f98-9391-467e-8181-c4154561c191 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:14.957709 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-26d15ab1-6ebf-49ba-8044-17c6f7818c8e req-05fd6f98-9391-467e-8181-c4154561c191 service nova] Creating event network-vif-plugged:8aff54b0-db61-466d-994a-b32ac85a7a2e for instance a2670155-2961-4fcc-8832-88738fe0b60c on nch1-master-1 May 14 21:52:14.962654 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-26d15ab1-6ebf-49ba-8044-17c6f7818c8e req-05fd6f98-9391-467e-8181-c4154561c191 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 May 14 21:52:14.966288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2935/6279] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:52:15.420339 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:15.420897 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:15.427819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:15.428275 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:15.429096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:15.429536 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:15.565246 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:15.573413 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-abfa0a45-ffa3-4368-9203-2346aeec8e10 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1389 microversion: 2.1 time: 0.157970 May 14 21:52:15.574801 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3345/6280] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:15 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:16.593024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:16.593911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:16.600230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:16.600684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:16.601451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:16.601891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:16.738397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:16.746197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d252bb0-a6e7-4089-a75e-a3fe0bb4cf27 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1562 microversion: 2.1 time: 0.158933 May 14 21:52:16.746772 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2936/6281] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:16 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:16.762843 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:16.763469 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:16.770305 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:16.770760 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:16.771561 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:16.772007 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:16.909856 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:16.917664 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ddc1421f-a157-416e-84f4-b47020667a62 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1562 microversion: 2.1 time: 0.158662 May 14 21:52:16.918302 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3346/6282] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:16 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:18.930640 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-4ce4419c-5895-4de6-8525-de533436f7c2 req-35d14635-1fad-4485-af55-6432ebdc5a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2670155-2961-4fcc-8832-88738fe0b60c", "tag": "8aff54b0-db61-466d-994a-b32ac85a7a2e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:52:18.933509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:18.934310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:18.942068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:18.943115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:18.944243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:18.945293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:18.948386 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4ce4419c-5895-4de6-8525-de533436f7c2 req-35d14635-1fad-4485-af55-6432ebdc5a99 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:18.948878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-4ce4419c-5895-4de6-8525-de533436f7c2 req-35d14635-1fad-4485-af55-6432ebdc5a99 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:18.960647 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-4ce4419c-5895-4de6-8525-de533436f7c2 req-35d14635-1fad-4485-af55-6432ebdc5a99 service nova] Creating event network-changed:8aff54b0-db61-466d-994a-b32ac85a7a2e for instance a2670155-2961-4fcc-8832-88738fe0b60c on nch1-master-1 May 14 21:52:18.966688 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-4ce4419c-5895-4de6-8525-de533436f7c2 req-35d14635-1fad-4485-af55-6432ebdc5a99 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039668 May 14 21:52:18.972786 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3347/6283] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:52:19.175339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:19.183128 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b05f4eed-ed20-41ec-82c3-8be1998252ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1562 microversion: 2.1 time: 0.262141 May 14 21:52:19.195056 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2937/6284] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:18 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:40.432776 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e1613fc0-6fa3-40e8-8729-61cca57f50f9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:52:40.433785 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e1613fc0-6fa3-40e8-8729-61cca57f50f9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:40.440212 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1613fc0-6fa3-40e8-8729-61cca57f50f9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:40.445237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1613fc0-6fa3-40e8-8729-61cca57f50f9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:40.445237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1613fc0-6fa3-40e8-8729-61cca57f50f9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:40.445237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e1613fc0-6fa3-40e8-8729-61cca57f50f9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:40.493336 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e1613fc0-6fa3-40e8-8729-61cca57f50f9 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c/action" status: 200 len: 24565 microversion: 2.1 time: 0.065787 May 14 21:52:40.493952 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3348/6285] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:52:40 2022] POST /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c/action => generated 24565 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:52:51.517515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:52:51.518997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:51.525282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:51.525742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:51.526776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:51.527220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:51.603635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:52:51.604073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:52:51.604565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:52:51.604986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:52:51.605410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:52:51.828555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:51.834618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:51.835133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:51.835971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:51.836422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:51.864338 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-704b6a39-672f-4af5-8966-b428dfe3f017 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c/action" status: 202 len: 1138 microversion: 2.1 time: 0.351029 May 14 21:52:51.864992 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2938/6286] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:52:51 2022] POST /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c/action => generated 1138 bytes in 352 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 14 21:52:51.879767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:51.881084 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:51.888004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:51.888461 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:51.889235 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:51.889686 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:52.025229 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:52.033414 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ca49615e-b0f1-4adc-96e0-18bfeafe4480 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.158165 May 14 21:52:52.033996 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3349/6287] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:51 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:53.050816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:53.051436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:53.058439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:53.058900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:53.059709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:53.060158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:53.194649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:53.202373 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54c38eba-ede5-4562-90f7-6249a15cfb93 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.156177 May 14 21:52:53.202954 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2939/6288] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:53 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:54.219595 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:54.220925 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:54.228662 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:54.231239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:54.231239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:54.231239 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:54.365011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:54.372717 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-efeeaf59-8ed1-4a72-a731-5a52180cfb54 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.157169 May 14 21:52:54.373296 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3350/6289] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:54 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:55.395773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:55.396325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:55.403586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:55.404043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:55.404849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:55.405300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:55.556059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:55.563735 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-087ea487-3d9a-4d47-9ed6-292f7c132120 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.172034 May 14 21:52:55.564314 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2940/6290] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:55 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:56.581453 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:56.582162 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:56.588972 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:56.589431 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:56.590241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:56.590758 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:56.722464 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:56.730095 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-04011cf3-b64b-4e73-b933-860fc00604d4 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.153249 May 14 21:52:56.734255 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3351/6291] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:56 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:57.747151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:57.747784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:57.755354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:57.758199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:57.758199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:57.758199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:57.893508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:57.901166 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6b593073-4ba2-41f4-af0a-dbe64643b5ed tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.158014 May 14 21:52:57.903515 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2941/6292] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:57 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:52:58.918690 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:52:58.919313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:52:58.927279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:58.927765 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:58.928554 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:52:58.929002 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:52:59.069938 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:52:59.077546 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9ef02b66-6d93-4f74-9840-b694dde1049e tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.162887 May 14 21:52:59.078138 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3352/6293] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:52:58 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:00.094438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:00.095822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:00.102990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:00.103503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:00.106426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:00.106426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:00.236774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:00.244373 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2e61d14-c573-47f8-a5bc-755d6ef18d7b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.153857 May 14 21:53:00.244954 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2942/6294] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:00 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:01.261767 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:01.262476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:01.270599 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:01.271056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:01.271976 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:01.272417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:01.414921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:01.422668 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2fe91309-0bbd-4abd-a9e1-1b9b86791e1b tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.164834 May 14 21:53:01.423235 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3353/6295] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:01 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:02.441643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:02.442355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:02.449175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:02.449624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:02.450382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:02.450817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:02.586416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:02.594085 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b75241e7-ae20-48db-bb1c-59a1d2eefceb tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.156488 May 14 21:53:02.595498 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2943/6296] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:02 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:03.612790 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:03.613370 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:03.620219 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:03.620680 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:03.621482 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:03.621928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:03.751960 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:03.759439 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7920ed75-1fce-48b9-9392-d2f9e6e5df83 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.151241 May 14 21:53:03.760034 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3354/6297] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:03 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:04.776476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:04.777361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:04.784561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:04.785042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:04.785837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:04.786286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:04.920733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:04.929710 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb2d42c8-1c09-44e1-824c-6d622902180d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.157140 May 14 21:53:04.933708 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2944/6298] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:04 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:05.946797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:05.947428 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:05.954000 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:05.954463 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:05.955241 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:05.955828 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:06.094055 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:06.102242 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dd6b0516-5bab-4af0-bd0c-2b6afbeb1b2d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.159496 May 14 21:53:06.102839 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3355/6299] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:05 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:07.119805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:07.120449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:07.128303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:07.128501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:07.129243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:07.129687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:07.258354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:07.265825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c6ba65d-f133-4139-b9e1-b970f297b1b6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.149946 May 14 21:53:07.266405 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2945/6300] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:07 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:08.282795 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:08.283385 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:08.291443 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:08.291928 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:08.292719 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:08.293196 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:08.428388 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:08.435858 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7c428bfe-e773-4e6c-8a05-c7295179c0e3 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1689 microversion: 2.1 time: 0.157118 May 14 21:53:08.436438 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3356/6301] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:08 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:09.452934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:09.454431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:09.460918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:09.461374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:09.462148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:09.462594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:09.599628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:09.607224 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd734972-95f9-47fb-9a48-4e0f049f2d13 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1695 microversion: 2.1 time: 0.158434 May 14 21:53:09.607862 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2946/6302] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:09 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:10.625836 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:10.626556 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:10.634017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:10.634506 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:10.635315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:10.635845 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:10.771040 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:10.778986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7482667f-6029-401a-be6e-9eb455f63961 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1695 microversion: 2.1 time: 0.157098 May 14 21:53:10.779583 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3357/6303] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:10 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1695 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:11.162005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fdbc5594-ca1f-4f11-95d1-32c0dcd5705e req-f1bbacc9-096a-4b3f-a314-f5dbae962b64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2670155-2961-4fcc-8832-88738fe0b60c", "name": "network-vif-unplugged", "status": "completed", "tag": "8aff54b0-db61-466d-994a-b32ac85a7a2e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:53:11.171402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fdbc5594-ca1f-4f11-95d1-32c0dcd5705e req-f1bbacc9-096a-4b3f-a314-f5dbae962b64 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:11.175839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fdbc5594-ca1f-4f11-95d1-32c0dcd5705e req-f1bbacc9-096a-4b3f-a314-f5dbae962b64 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:11.183865 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fdbc5594-ca1f-4f11-95d1-32c0dcd5705e req-f1bbacc9-096a-4b3f-a314-f5dbae962b64 service nova] Creating event network-vif-unplugged:8aff54b0-db61-466d-994a-b32ac85a7a2e for instance a2670155-2961-4fcc-8832-88738fe0b60c on nch1-master-1 May 14 21:53:11.189125 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fdbc5594-ca1f-4f11-95d1-32c0dcd5705e req-f1bbacc9-096a-4b3f-a314-f5dbae962b64 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031764 May 14 21:53:11.189861 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2947/6304] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:53:11.796376 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:11.797056 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:11.804594 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:11.805053 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:11.805863 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:11.806315 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:11.944384 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:11.951983 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2dac146c-0292-41fb-88ee-b6037168796d tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1680 microversion: 2.1 time: 0.159602 May 14 21:53:11.952572 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3358/6305] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:11 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:13.206725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-59ab6a06-579e-493c-a09a-7c1c6b04b343 req-656e693b-121a-4bfc-a8e6-d8436f777821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2670155-2961-4fcc-8832-88738fe0b60c", "name": "network-vif-plugged", "status": "completed", "tag": "8aff54b0-db61-466d-994a-b32ac85a7a2e"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:53:13.215157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-59ab6a06-579e-493c-a09a-7c1c6b04b343 req-656e693b-121a-4bfc-a8e6-d8436f777821 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:13.215703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-59ab6a06-579e-493c-a09a-7c1c6b04b343 req-656e693b-121a-4bfc-a8e6-d8436f777821 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:13.227948 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-59ab6a06-579e-493c-a09a-7c1c6b04b343 req-656e693b-121a-4bfc-a8e6-d8436f777821 service nova] Creating event network-vif-plugged:8aff54b0-db61-466d-994a-b32ac85a7a2e for instance a2670155-2961-4fcc-8832-88738fe0b60c on nch1-master-1 May 14 21:53:13.232921 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-59ab6a06-579e-493c-a09a-7c1c6b04b343 req-656e693b-121a-4bfc-a8e6-d8436f777821 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031868 May 14 21:53:13.233588 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2948/6306] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:53:36.147391 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-4a9e3345-f076-4fc6-9c0a-11f9c194d5d6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:53:36.149017 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-4a9e3345-f076-4fc6-9c0a-11f9c194d5d6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:36.155861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a9e3345-f076-4fc6-9c0a-11f9c194d5d6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:36.160297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a9e3345-f076-4fc6-9c0a-11f9c194d5d6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:36.160297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a9e3345-f076-4fc6-9c0a-11f9c194d5d6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:36.160297 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-4a9e3345-f076-4fc6-9c0a-11f9c194d5d6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:36.209788 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-4a9e3345-f076-4fc6-9c0a-11f9c194d5d6 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "POST /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c/action" status: 200 len: 24572 microversion: 2.1 time: 0.066042 May 14 21:53:36.210371 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3359/6307] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:53:36 2022] POST /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 14 21:53:43.857317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:43.862361 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-89602768-ac74-478e-a019-b943e01a7c5f req-465c8a79-e163-4511-987c-1c9a1ebca67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2670155-2961-4fcc-8832-88738fe0b60c", "tag": "8aff54b0-db61-466d-994a-b32ac85a7a2e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:53:43.862854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:43.869629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-89602768-ac74-478e-a019-b943e01a7c5f req-465c8a79-e163-4511-987c-1c9a1ebca67d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:43.870251 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-89602768-ac74-478e-a019-b943e01a7c5f req-465c8a79-e163-4511-987c-1c9a1ebca67d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:43.871465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:43.871956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:43.873107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:43.873572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:43.886324 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-89602768-ac74-478e-a019-b943e01a7c5f req-465c8a79-e163-4511-987c-1c9a1ebca67d service nova] Creating event network-changed:8aff54b0-db61-466d-994a-b32ac85a7a2e for instance a2670155-2961-4fcc-8832-88738fe0b60c on nch1-master-1 May 14 21:53:43.891986 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-89602768-ac74-478e-a019-b943e01a7c5f req-465c8a79-e163-4511-987c-1c9a1ebca67d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037519 May 14 21:53:43.893166 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3360/6308] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:53:43.909826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:53:44.279069 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a0aacec-a461-43c1-9c0c-09c1ea8cddba tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 204 len: 0 microversion: 2.1 time: 0.427212 May 14 21:53:44.279926 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2949/6309] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:53:43 2022] DELETE /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:53:44.289865 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:44.290921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:44.299739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:44.300535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:44.301567 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:44.302811 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:44.445993 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:44.453724 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-37a58c67-64af-4615-acb9-ef47114e5f81 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1686 microversion: 2.1 time: 0.169312 May 14 21:53:44.454308 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3361/6310] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:44 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:45.473411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:45.474304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:45.481216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:45.481679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:45.482464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:45.483032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:45.622713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:45.630577 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5200262-2935-42b1-b9f4-a79884a3fa60 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1568 microversion: 2.1 time: 0.161453 May 14 21:53:45.632111 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2950/6311] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:45 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:46.328504 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-61655506-ef76-4860-a7a7-8d9e92275c1a req-adce57d9-9eb2-4574-8d4e-b447c48c1273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2670155-2961-4fcc-8832-88738fe0b60c", "name": "network-vif-deleted", "tag": "8aff54b0-db61-466d-994a-b32ac85a7a2e"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:53:46.337879 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-61655506-ef76-4860-a7a7-8d9e92275c1a req-adce57d9-9eb2-4574-8d4e-b447c48c1273 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:46.338327 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-61655506-ef76-4860-a7a7-8d9e92275c1a req-adce57d9-9eb2-4574-8d4e-b447c48c1273 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:46.351096 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-61655506-ef76-4860-a7a7-8d9e92275c1a req-adce57d9-9eb2-4574-8d4e-b447c48c1273 service nova] Creating event network-vif-deleted:8aff54b0-db61-466d-994a-b32ac85a7a2e for instance a2670155-2961-4fcc-8832-88738fe0b60c on nch1-master-1 May 14 21:53:46.356011 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-61655506-ef76-4860-a7a7-8d9e92275c1a req-adce57d9-9eb2-4574-8d4e-b447c48c1273 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117819 May 14 21:53:46.356619 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3362/6312] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:53:46.648243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:46.652351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:46.656653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:46.657192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:46.658061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:46.658590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:46.694012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:46.694476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:46.694932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lazy-loading 'fault' on Instance uuid a2670155-2961-4fcc-8832-88738fe0b60c {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:53:46.741183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9982f39ae394932a2fb8c9e4d456d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d47cde4b8ee4dbc9ad64de4084690a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:53:46.748622 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8fc8f0fa-90a5-4144-81d8-24eed7145574 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 200 len: 1356 microversion: 2.1 time: 0.105003 May 14 21:53:46.749213 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2951/6313] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:46 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:53:47.766498 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:47.767255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] [instance: a2670155-2961-4fcc-8832-88738fe0b60c] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:53:47.773787 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:47.774185 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:47.774968 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:53:47.775417 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:53:47.789567 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.wsgi [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] HTTP exception thrown: Instance a2670155-2961-4fcc-8832-88738fe0b60c could not be found. May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Request method failure captured: May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: request: GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c HTTP/1.1 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: Accept: application/json May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: Accept-Encoding: identity May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: Connection: close May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: Content-Length: 0 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: Content-Type: application/json May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: Host: 10.222.0.52 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: Openstack-System-Scope: None May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: User-Agent: python-urllib3/1.26.9 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Auth-Token: gAAAAABigCM3z8vMGjE3Khn4V0nlEkyzMD4gMlNtB_haMBg2QZyvExKimZQNDFtNzwnf7W5QpmJun_aMxnyPjSJvXTHJJpSxIrZdmdZOxt6-npK6Q3ANgmmJJV39-0JjN8BwmXyB2w81Esnzt1ZQcd61XAwfRfne5qpFFcIclz-YjQV4VtFBGjw May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Id: None May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Domain-Name: None May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Identity-Status: Confirmed May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Is-Admin-Project: True May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Id: default May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Domain-Name: Default May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Role: reader,member May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Roles: reader,member May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9d47cde4b8ee4dbc9ad64de4084690a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9d47cde4b8ee4dbc9ad64de4084690a9", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Id: 9d47cde4b8ee4dbc9ad64de4084690a9 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2511691 May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-User: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Id: default May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-User-Domain-Name: Default May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-User-Id: e9982f39ae394932a2fb8c9e4d456d8d May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2511691-project May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: method: > May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: exception: Instance a2670155-2961-4fcc-8832-88738fe0b60c could not be found. May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: action_args: {'id': 'a2670155-2961-4fcc-8832-88738fe0b60c'} May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2670155-2961-4fcc-8832-88738fe0b60c could not be found. May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2670155-2961-4fcc-8832-88738fe0b60c could not be found. May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:53:47.791221 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2670155-2961-4fcc-8832-88738fe0b60c could not be found. May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: ERROR nova.api.openstack.wsgi May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Returning 404 to user: Instance a2670155-2961-4fcc-8832-88738fe0b60c could not be found. {{(pid=130638) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-be901cbc-b3d0-4246-908a-a14e2808a9ef tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c" status: 404 len: 111 microversion: 2.1 time: 0.031417 May 14 21:53:47.798005 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3363/6314] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:53:47 2022] GET /compute/v2.1/servers/a2670155-2961-4fcc-8832-88738fe0b60c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:53:51.655244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f73323a1-d60e-4bb3-98cc-69468946c703 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] Calling method '.version_select at 0x7fb1a7f0e670>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:53:51.753865 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f73323a1-d60e-4bb3-98cc-69468946c703 tempest-TestNetworkAdvancedServerOps-2511691 tempest-TestNetworkAdvancedServerOps-2511691-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-523417973" status: 202 len: 0 microversion: 2.1 time: 0.102586 May 14 21:53:51.754476 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2952/6315] 10.222.0.52 () {58 vars in 1280 bytes} [Sat May 14 21:53:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-523417973 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:54:07.259282 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-3c9e7741-4823-4705-bd03-cba71a0474e2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:07.259876 ncdv-master-1 devstack@n-api.service[130638]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 21:54:07.259876 ncdv-master-1 devstack@n-api.service[130638]: warnings.warn(msg) May 14 21:54:07.260535 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c9e7741-4823-4705-bd03-cba71a0474e2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:07.260990 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c9e7741-4823-4705-bd03-cba71a0474e2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:07.261893 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c9e7741-4823-4705-bd03-cba71a0474e2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:07.262527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-3c9e7741-4823-4705-bd03-cba71a0474e2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:07.288589 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-3c9e7741-4823-4705-bd03-cba71a0474e2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.194277 May 14 21:54:07.289178 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3364/6316] 10.222.0.52 () {58 vars in 1184 bytes} [Sat May 14 21:54:07 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:54:07.393658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-503407264", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "7c940309-5d6f-4dc6-acde-ac5250df915c"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:07.459629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] validate_networks() for [('7c940309-5d6f-4dc6-acde-ac5250df915c', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:54:07.887136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:54:07.887695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:54:07.888255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:54:07.888872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:54:07.889381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:54:07.899970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:07.900508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:07.901394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:07.901911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:07.923184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Getting quotas for project 83be614a11e44c29b6444b41ce0a20d8. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:54:07.932080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Getting quotas for user 562a60622af84fd383158e44f8b51ad9 and project 83be614a11e44c29b6444b41ce0a20d8. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:54:07.946903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:54:07.950373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:54:08.087137 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23bb7df0-585a-4fc1-95c2-c7a68d3df050 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698976 May 14 21:54:08.088911 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2953/6317] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:54:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:54:08.099290 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-79bf54bd-567d-4403-acca-e3d4fa56b34c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:08.103780 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-79bf54bd-567d-4403-acca-e3d4fa56b34c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:08.163533 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-79bf54bd-567d-4403-acca-e3d4fa56b34c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1328 microversion: 2.1 time: 0.068321 May 14 21:54:08.172954 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3365/6318] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:08 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1328 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:09.182526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66315a9c-01da-4e8c-8f1a-9d237ac90271 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:09.185368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-66315a9c-01da-4e8c-8f1a-9d237ac90271 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:09.246981 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-66315a9c-01da-4e8c-8f1a-9d237ac90271 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1328 microversion: 2.1 time: 0.069155 May 14 21:54:09.247595 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2954/6319] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:09 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1328 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:10.263458 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-383003c1-a0b5-49b6-bd23-0347ca68e7d9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:10.264134 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-383003c1-a0b5-49b6-bd23-0347ca68e7d9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:10.271941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-383003c1-a0b5-49b6-bd23-0347ca68e7d9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:10.272439 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-383003c1-a0b5-49b6-bd23-0347ca68e7d9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:10.273247 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-383003c1-a0b5-49b6-bd23-0347ca68e7d9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:10.273697 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-383003c1-a0b5-49b6-bd23-0347ca68e7d9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:10.345499 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-383003c1-a0b5-49b6-bd23-0347ca68e7d9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1415 microversion: 2.1 time: 0.085738 May 14 21:54:10.346084 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3366/6320] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:10 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1415 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:11.369483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6fc49d56-0ebd-4ba3-b4c5-d0c12a650b51 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:11.370201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6fc49d56-0ebd-4ba3-b4c5-d0c12a650b51 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:11.378025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fc49d56-0ebd-4ba3-b4c5-d0c12a650b51 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:11.384467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fc49d56-0ebd-4ba3-b4c5-d0c12a650b51 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:11.384467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fc49d56-0ebd-4ba3-b4c5-d0c12a650b51 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:11.384467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fc49d56-0ebd-4ba3-b4c5-d0c12a650b51 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:11.607819 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6fc49d56-0ebd-4ba3-b4c5-d0c12a650b51 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.244734 May 14 21:54:11.608408 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2955/6321] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:11 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:12.616187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-8218383f-0ac3-4315-95ff-1a431ca36bb7 req-4e602a92-905c-4394-8009-b2d6fcf6b394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd17c282-fb51-4153-82fa-b13423f56a41", "tag": "236594fd-8b9c-4079-91bb-3e96c0beae45"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:12.627399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b60e9462-02b5-4c60-b581-86fee48bdb7d tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:12.630830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b60e9462-02b5-4c60-b581-86fee48bdb7d tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:12.642426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b60e9462-02b5-4c60-b581-86fee48bdb7d tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:12.644913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b60e9462-02b5-4c60-b581-86fee48bdb7d tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:12.644913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b60e9462-02b5-4c60-b581-86fee48bdb7d tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:12.644913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b60e9462-02b5-4c60-b581-86fee48bdb7d tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:12.650635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8218383f-0ac3-4315-95ff-1a431ca36bb7 req-4e602a92-905c-4394-8009-b2d6fcf6b394 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:12.651096 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-8218383f-0ac3-4315-95ff-1a431ca36bb7 req-4e602a92-905c-4394-8009-b2d6fcf6b394 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:12.677139 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-8218383f-0ac3-4315-95ff-1a431ca36bb7 req-4e602a92-905c-4394-8009-b2d6fcf6b394 service nova] Creating event network-changed:236594fd-8b9c-4079-91bb-3e96c0beae45 for instance dd17c282-fb51-4153-82fa-b13423f56a41 on nch2-master-1 May 14 21:54:12.697867 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-8218383f-0ac3-4315-95ff-1a431ca36bb7 req-4e602a92-905c-4394-8009-b2d6fcf6b394 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082018 May 14 21:54:12.697867 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3367/6322] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:54:12.936548 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b60e9462-02b5-4c60-b581-86fee48bdb7d tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.314122 May 14 21:54:12.937351 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2956/6323] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:12 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:54:13.954629 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-24e03b23-0e09-4bb4-9dd6-ee08511b3315 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:13.955496 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-24e03b23-0e09-4bb4-9dd6-ee08511b3315 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:13.962952 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e03b23-0e09-4bb4-9dd6-ee08511b3315 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:13.963460 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e03b23-0e09-4bb4-9dd6-ee08511b3315 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:13.964250 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e03b23-0e09-4bb4-9dd6-ee08511b3315 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:13.964695 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-24e03b23-0e09-4bb4-9dd6-ee08511b3315 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:14.098755 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-24e03b23-0e09-4bb4-9dd6-ee08511b3315 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.148216 May 14 21:54:14.099935 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3368/6324] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:13 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:15.116805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f5bde197-0ff3-4f43-a566-1da8e43d6d5a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:15.117419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f5bde197-0ff3-4f43-a566-1da8e43d6d5a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:15.124352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5bde197-0ff3-4f43-a566-1da8e43d6d5a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:15.124801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5bde197-0ff3-4f43-a566-1da8e43d6d5a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:15.125563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5bde197-0ff3-4f43-a566-1da8e43d6d5a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:15.126007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5bde197-0ff3-4f43-a566-1da8e43d6d5a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:15.256187 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f5bde197-0ff3-4f43-a566-1da8e43d6d5a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.143835 May 14 21:54:15.256771 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2957/6325] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:15 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:16.272670 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a49a8574-825a-4961-a623-0b848f8e002e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:16.273238 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a49a8574-825a-4961-a623-0b848f8e002e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:16.280237 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a49a8574-825a-4961-a623-0b848f8e002e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:16.280688 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a49a8574-825a-4961-a623-0b848f8e002e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:16.281476 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a49a8574-825a-4961-a623-0b848f8e002e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:16.281914 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a49a8574-825a-4961-a623-0b848f8e002e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:16.409494 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a49a8574-825a-4961-a623-0b848f8e002e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.140602 May 14 21:54:16.410077 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3369/6326] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:16 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:17.426673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f60bed5-b9c3-4dc1-8a83-c46af98556f5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:17.427292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f60bed5-b9c3-4dc1-8a83-c46af98556f5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:17.434443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f60bed5-b9c3-4dc1-8a83-c46af98556f5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:17.434904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f60bed5-b9c3-4dc1-8a83-c46af98556f5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:17.435732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f60bed5-b9c3-4dc1-8a83-c46af98556f5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:17.436179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f60bed5-b9c3-4dc1-8a83-c46af98556f5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:17.563085 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f60bed5-b9c3-4dc1-8a83-c46af98556f5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.140294 May 14 21:54:17.563737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2958/6327] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:17 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:18.580063 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dfe23200-84f0-4b68-9fc0-2b2f8d50a03a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:18.580718 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dfe23200-84f0-4b68-9fc0-2b2f8d50a03a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:18.588474 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfe23200-84f0-4b68-9fc0-2b2f8d50a03a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:18.588937 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfe23200-84f0-4b68-9fc0-2b2f8d50a03a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:18.589861 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfe23200-84f0-4b68-9fc0-2b2f8d50a03a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:18.590314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dfe23200-84f0-4b68-9fc0-2b2f8d50a03a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:18.717246 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dfe23200-84f0-4b68-9fc0-2b2f8d50a03a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.140966 May 14 21:54:18.717826 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3370/6328] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:18 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:19.245825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9394cee5-6c54-4f85-b054-45dfdab596de req-890110dd-080d-4ab6-bdda-6134c1c54e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd17c282-fb51-4153-82fa-b13423f56a41", "name": "network-vif-plugged", "status": "completed", "tag": "236594fd-8b9c-4079-91bb-3e96c0beae45"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:19.254808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9394cee5-6c54-4f85-b054-45dfdab596de req-890110dd-080d-4ab6-bdda-6134c1c54e03 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:19.256385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9394cee5-6c54-4f85-b054-45dfdab596de req-890110dd-080d-4ab6-bdda-6134c1c54e03 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:19.267331 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9394cee5-6c54-4f85-b054-45dfdab596de req-890110dd-080d-4ab6-bdda-6134c1c54e03 service nova] Creating event network-vif-plugged:236594fd-8b9c-4079-91bb-3e96c0beae45 for instance dd17c282-fb51-4153-82fa-b13423f56a41 on nch2-master-1 May 14 21:54:19.274043 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9394cee5-6c54-4f85-b054-45dfdab596de req-890110dd-080d-4ab6-bdda-6134c1c54e03 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031706 May 14 21:54:19.274658 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2959/6329] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:54:19.734166 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e094527c-5d71-481c-8705-bdeecb4c7234 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:19.734791 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e094527c-5d71-481c-8705-bdeecb4c7234 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:19.741820 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e094527c-5d71-481c-8705-bdeecb4c7234 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:19.742278 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e094527c-5d71-481c-8705-bdeecb4c7234 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:19.751434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e094527c-5d71-481c-8705-bdeecb4c7234 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:19.751434 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e094527c-5d71-481c-8705-bdeecb4c7234 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:19.868841 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e094527c-5d71-481c-8705-bdeecb4c7234 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1463 microversion: 2.1 time: 0.138329 May 14 21:54:19.869425 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3371/6330] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:19 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:54:20.886270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ecd68e9-a5ad-489a-84c5-ca87a8a4c4ce tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:20.886987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ecd68e9-a5ad-489a-84c5-ca87a8a4c4ce tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:20.896045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecd68e9-a5ad-489a-84c5-ca87a8a4c4ce tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:20.896847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecd68e9-a5ad-489a-84c5-ca87a8a4c4ce tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:20.898377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecd68e9-a5ad-489a-84c5-ca87a8a4c4ce tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:20.899029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ecd68e9-a5ad-489a-84c5-ca87a8a4c4ce tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:21.031601 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ecd68e9-a5ad-489a-84c5-ca87a8a4c4ce tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1648 microversion: 2.1 time: 0.149430 May 14 21:54:21.032180 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2960/6331] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:20 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1648 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:21.048203 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-e8a15d86-65cf-4832-8de6-3421deab628c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:21.048827 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-e8a15d86-65cf-4832-8de6-3421deab628c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:21.056069 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8a15d86-65cf-4832-8de6-3421deab628c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:21.056515 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8a15d86-65cf-4832-8de6-3421deab628c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:21.057279 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8a15d86-65cf-4832-8de6-3421deab628c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:21.057721 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-e8a15d86-65cf-4832-8de6-3421deab628c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:21.186547 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-e8a15d86-65cf-4832-8de6-3421deab628c tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1648 microversion: 2.1 time: 0.142074 May 14 21:54:21.187126 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3372/6332] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:21 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1648 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:21.202494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a4c992a-30a7-4a65-8cbc-ec3b5f44f169 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:21.203108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2a4c992a-30a7-4a65-8cbc-ec3b5f44f169 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:21.209055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4c992a-30a7-4a65-8cbc-ec3b5f44f169 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:21.209677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4c992a-30a7-4a65-8cbc-ec3b5f44f169 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:21.210628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4c992a-30a7-4a65-8cbc-ec3b5f44f169 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:21.211068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a4c992a-30a7-4a65-8cbc-ec3b5f44f169 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:21.340392 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a4c992a-30a7-4a65-8cbc-ec3b5f44f169 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1648 microversion: 2.1 time: 0.141500 May 14 21:54:21.340984 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2961/6333] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:21 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1648 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:21.394580 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2110890362", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "7c940309-5d6f-4dc6-acde-ac5250df915c"}]}} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:21.453202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.network.neutron [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] validate_networks() for [('7c940309-5d6f-4dc6-acde-ac5250df915c', None, None, None, None, None)] {{(pid=130638) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:54:21.821992 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Flavor limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:54:21.822448 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Image limits 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:54:21.822930 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Flavor pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:54:21.823346 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Image pref 0:0:0 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:54:21.823850 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.virt.hardware [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130638) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:54:21.832728 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:21.833456 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:21.834270 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:21.835049 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:21.852857 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Getting quotas for project 83be614a11e44c29b6444b41ce0a20d8. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:54:21.858265 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.quota [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Getting quotas for user 562a60622af84fd383158e44f8b51ad9 and project 83be614a11e44c29b6444b41ce0a20d8. Resources: {'cores', 'ram', 'instances'} {{(pid=130638) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:54:21.871187 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Going to run 1 instances... {{(pid=130638) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:54:21.873601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130638) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:54:22.034999 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-48a27918-30e5-40f7-aa39-6b67ce5efb2e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644000 May 14 21:54:22.035609 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3373/6334] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:54:22.046201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bbc5cc10-4203-4fd5-9dde-fa1049cb1761 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:22.046827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bbc5cc10-4203-4fd5-9dde-fa1049cb1761 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:22.110718 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bbc5cc10-4203-4fd5-9dde-fa1049cb1761 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1329 microversion: 2.1 time: 0.068274 May 14 21:54:22.111864 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2962/6335] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:22 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1329 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:23.129015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-0d226882-960b-41d0-a24d-9b3e136737f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:23.129652 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-0d226882-960b-41d0-a24d-9b3e136737f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:23.190817 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-0d226882-960b-41d0-a24d-9b3e136737f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1329 microversion: 2.1 time: 0.065480 May 14 21:54:23.191702 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3374/6336] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:23 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1329 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:24.208510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72611aae-b7c1-4f28-99bd-f41c58120905 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:24.209088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-72611aae-b7c1-4f28-99bd-f41c58120905 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:24.269374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72611aae-b7c1-4f28-99bd-f41c58120905 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1329 microversion: 2.1 time: 0.064657 May 14 21:54:24.270056 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2963/6337] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:24 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1329 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:25.286303 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-dc083ec5-03bf-4610-b358-b4302eda1498 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:25.286923 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-dc083ec5-03bf-4610-b358-b4302eda1498 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:25.294878 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc083ec5-03bf-4610-b358-b4302eda1498 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:25.295348 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc083ec5-03bf-4610-b358-b4302eda1498 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:25.296342 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc083ec5-03bf-4610-b358-b4302eda1498 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:25.296781 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-dc083ec5-03bf-4610-b358-b4302eda1498 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:25.370837 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-dc083ec5-03bf-4610-b358-b4302eda1498 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1338 microversion: 2.1 time: 0.088411 May 14 21:54:25.371445 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3375/6338] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:25 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1338 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:26.391875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9b9c081b-8da6-410a-899c-f29eb5809009 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:26.392501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9b9c081b-8da6-410a-899c-f29eb5809009 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:26.399589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b9c081b-8da6-410a-899c-f29eb5809009 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:26.400052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b9c081b-8da6-410a-899c-f29eb5809009 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:26.400907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b9c081b-8da6-410a-899c-f29eb5809009 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:26.401347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9b9c081b-8da6-410a-899c-f29eb5809009 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:26.608367 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9b9c081b-8da6-410a-899c-f29eb5809009 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.220225 May 14 21:54:26.608980 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2964/6339] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:26 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:27.513756 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [req-40e7b10e-e888-4cca-8006-4e6c88137e9d req-d8715cfc-f436-435b-88fb-e2a2c9e1f04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "928875e8-99e9-4bad-bcd6-4960f4911eda", "tag": "e16cdfe5-530d-4d5d-bc15-b4494013715b"}]} {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:27.524723 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-40e7b10e-e888-4cca-8006-4e6c88137e9d req-d8715cfc-f436-435b-88fb-e2a2c9e1f04f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:27.526562 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [req-40e7b10e-e888-4cca-8006-4e6c88137e9d req-d8715cfc-f436-435b-88fb-e2a2c9e1f04f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:27.545807 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.compute.server_external_events [req-40e7b10e-e888-4cca-8006-4e6c88137e9d req-d8715cfc-f436-435b-88fb-e2a2c9e1f04f service nova] Creating event network-changed:e16cdfe5-530d-4d5d-bc15-b4494013715b for instance 928875e8-99e9-4bad-bcd6-4960f4911eda on nch1-master-1 May 14 21:54:27.550651 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [req-40e7b10e-e888-4cca-8006-4e6c88137e9d req-d8715cfc-f436-435b-88fb-e2a2c9e1f04f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041527 May 14 21:54:27.551586 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3376/6340] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:54:27.631715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b04c30bb-b65c-4a61-b8f3-a5cfe5ccbb66 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:27.631715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b04c30bb-b65c-4a61-b8f3-a5cfe5ccbb66 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:27.639572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b04c30bb-b65c-4a61-b8f3-a5cfe5ccbb66 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:27.640371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b04c30bb-b65c-4a61-b8f3-a5cfe5ccbb66 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:27.641544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b04c30bb-b65c-4a61-b8f3-a5cfe5ccbb66 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:27.642313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b04c30bb-b65c-4a61-b8f3-a5cfe5ccbb66 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:27.857693 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b04c30bb-b65c-4a61-b8f3-a5cfe5ccbb66 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.233379 May 14 21:54:27.860927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2965/6341] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:27 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:28.875887 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-7bce2405-0f66-43b1-8be4-d9a0aab2e5f2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:28.876664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-7bce2405-0f66-43b1-8be4-d9a0aab2e5f2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:28.884126 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bce2405-0f66-43b1-8be4-d9a0aab2e5f2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:28.884585 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bce2405-0f66-43b1-8be4-d9a0aab2e5f2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:28.885381 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bce2405-0f66-43b1-8be4-d9a0aab2e5f2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:28.885819 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-7bce2405-0f66-43b1-8be4-d9a0aab2e5f2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:29.015649 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-7bce2405-0f66-43b1-8be4-d9a0aab2e5f2 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.144640 May 14 21:54:29.016246 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3377/6342] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:28 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:30.033848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-238e33b0-c0d8-4746-bc3c-041d32172ea6 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:30.034497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-238e33b0-c0d8-4746-bc3c-041d32172ea6 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:30.041430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-238e33b0-c0d8-4746-bc3c-041d32172ea6 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:30.041881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-238e33b0-c0d8-4746-bc3c-041d32172ea6 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:30.042644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-238e33b0-c0d8-4746-bc3c-041d32172ea6 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:30.043085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-238e33b0-c0d8-4746-bc3c-041d32172ea6 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:30.172120 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-238e33b0-c0d8-4746-bc3c-041d32172ea6 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.141943 May 14 21:54:30.172738 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2966/6343] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:30 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:31.190004 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2e37039f-b7d7-411a-8d78-af0388132ed5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:31.190551 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2e37039f-b7d7-411a-8d78-af0388132ed5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:31.197593 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e37039f-b7d7-411a-8d78-af0388132ed5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:31.198058 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e37039f-b7d7-411a-8d78-af0388132ed5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:31.198841 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e37039f-b7d7-411a-8d78-af0388132ed5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:31.199287 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2e37039f-b7d7-411a-8d78-af0388132ed5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:31.334785 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2e37039f-b7d7-411a-8d78-af0388132ed5 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.148734 May 14 21:54:31.335547 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3378/6344] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:31 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:32.351169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac6114f8-a5bc-41a6-8a7c-5858e55d71a9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:32.351837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac6114f8-a5bc-41a6-8a7c-5858e55d71a9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:32.358687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6114f8-a5bc-41a6-8a7c-5858e55d71a9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:32.359149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6114f8-a5bc-41a6-8a7c-5858e55d71a9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:32.360080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6114f8-a5bc-41a6-8a7c-5858e55d71a9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:32.360526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac6114f8-a5bc-41a6-8a7c-5858e55d71a9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:32.484788 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac6114f8-a5bc-41a6-8a7c-5858e55d71a9 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.137343 May 14 21:54:32.485363 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2967/6345] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:32 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:33.502202 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72a143d3-4ffa-45da-8a9c-747b4892ba52 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:33.502824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-72a143d3-4ffa-45da-8a9c-747b4892ba52 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:33.510579 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72a143d3-4ffa-45da-8a9c-747b4892ba52 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:33.515635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72a143d3-4ffa-45da-8a9c-747b4892ba52 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:33.515635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72a143d3-4ffa-45da-8a9c-747b4892ba52 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:33.515635 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72a143d3-4ffa-45da-8a9c-747b4892ba52 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:33.651839 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72a143d3-4ffa-45da-8a9c-747b4892ba52 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.153403 May 14 21:54:33.652953 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3379/6346] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:33 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:33.749425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c4a403db-7fc0-4a72-a1f4-e9d635f2f10d req-fb152468-1e86-4fce-a398-5ffbfeb11ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928875e8-99e9-4bad-bcd6-4960f4911eda", "name": "network-vif-plugged", "status": "completed", "tag": "e16cdfe5-530d-4d5d-bc15-b4494013715b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:33.758893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c4a403db-7fc0-4a72-a1f4-e9d635f2f10d req-fb152468-1e86-4fce-a398-5ffbfeb11ef7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:33.759346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c4a403db-7fc0-4a72-a1f4-e9d635f2f10d req-fb152468-1e86-4fce-a398-5ffbfeb11ef7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:33.770253 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c4a403db-7fc0-4a72-a1f4-e9d635f2f10d req-fb152468-1e86-4fce-a398-5ffbfeb11ef7 service nova] Creating event network-vif-plugged:e16cdfe5-530d-4d5d-bc15-b4494013715b for instance 928875e8-99e9-4bad-bcd6-4960f4911eda on nch1-master-1 May 14 21:54:33.776034 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c4a403db-7fc0-4a72-a1f4-e9d635f2f10d req-fb152468-1e86-4fce-a398-5ffbfeb11ef7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030486 May 14 21:54:33.779815 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2968/6347] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:54:34.669051 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-72e97d2a-3cd6-45f1-98c6-fd28edba04cc tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:34.669681 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-72e97d2a-3cd6-45f1-98c6-fd28edba04cc tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:34.676626 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72e97d2a-3cd6-45f1-98c6-fd28edba04cc tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:34.677088 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72e97d2a-3cd6-45f1-98c6-fd28edba04cc tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:34.677866 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72e97d2a-3cd6-45f1-98c6-fd28edba04cc tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:34.678314 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-72e97d2a-3cd6-45f1-98c6-fd28edba04cc tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:34.803075 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-72e97d2a-3cd6-45f1-98c6-fd28edba04cc tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1464 microversion: 2.1 time: 0.137645 May 14 21:54:34.804334 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3380/6348] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:34 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1464 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:35.821797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5c88e9c-93cf-4da7-b841-5e8a5b9a02c8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:35.822507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5c88e9c-93cf-4da7-b841-5e8a5b9a02c8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:35.828810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5c88e9c-93cf-4da7-b841-5e8a5b9a02c8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:35.829271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5c88e9c-93cf-4da7-b841-5e8a5b9a02c8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:35.830044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5c88e9c-93cf-4da7-b841-5e8a5b9a02c8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:35.830493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5c88e9c-93cf-4da7-b841-5e8a5b9a02c8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:35.972617 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5c88e9c-93cf-4da7-b841-5e8a5b9a02c8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1648 microversion: 2.1 time: 0.155825 May 14 21:54:35.973212 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2969/6349] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:35 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1648 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:35.988582 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-55c94ef0-7aa4-4c93-9ec8-5fd683137df8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:35.989208 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-55c94ef0-7aa4-4c93-9ec8-5fd683137df8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:35.996553 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55c94ef0-7aa4-4c93-9ec8-5fd683137df8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:35.997015 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55c94ef0-7aa4-4c93-9ec8-5fd683137df8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:35.997824 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55c94ef0-7aa4-4c93-9ec8-5fd683137df8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:35.998277 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-55c94ef0-7aa4-4c93-9ec8-5fd683137df8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:36.131249 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-55c94ef0-7aa4-4c93-9ec8-5fd683137df8 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1648 microversion: 2.1 time: 0.146549 May 14 21:54:36.132626 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3381/6350] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:35 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1648 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:54:36.147855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b80146dc-b56e-4194-bba3-7ef923da6e94 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:36.149040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b80146dc-b56e-4194-bba3-7ef923da6e94 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:36.154777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b80146dc-b56e-4194-bba3-7ef923da6e94 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:36.155318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b80146dc-b56e-4194-bba3-7ef923da6e94 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:36.156131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b80146dc-b56e-4194-bba3-7ef923da6e94 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:36.156575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b80146dc-b56e-4194-bba3-7ef923da6e94 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:36.282335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b80146dc-b56e-4194-bba3-7ef923da6e94 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1648 microversion: 2.1 time: 0.138398 May 14 21:54:36.286574 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2970/6351] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:36 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1648 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:36.300028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:36.300539 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:36.307313 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:36.309601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:36.309601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:36.309601 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:36.338311 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:54:36.623460 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-94ad48af-da36-4266-8a25-f72deab8a881 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 204 len: 0 microversion: 2.1 time: 0.326792 May 14 21:54:36.624030 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3382/6352] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:54:36 2022] DELETE /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:54:36.633321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e33e9bd2-f98d-4f73-8b1c-485f64f8d798 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:36.633948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e33e9bd2-f98d-4f73-8b1c-485f64f8d798 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:36.640016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e33e9bd2-f98d-4f73-8b1c-485f64f8d798 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:36.640482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e33e9bd2-f98d-4f73-8b1c-485f64f8d798 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:36.641267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e33e9bd2-f98d-4f73-8b1c-485f64f8d798 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:36.641829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e33e9bd2-f98d-4f73-8b1c-485f64f8d798 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:36.769161 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e33e9bd2-f98d-4f73-8b1c-485f64f8d798 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1654 microversion: 2.1 time: 0.140648 May 14 21:54:36.769747 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2971/6353] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:36 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1654 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:37.787076 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f97b6299-3b30-4f1e-bebc-aaf275afcdff tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:37.788310 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f97b6299-3b30-4f1e-bebc-aaf275afcdff tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:37.795941 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f97b6299-3b30-4f1e-bebc-aaf275afcdff tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:37.796395 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f97b6299-3b30-4f1e-bebc-aaf275afcdff tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:37.797175 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f97b6299-3b30-4f1e-bebc-aaf275afcdff tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:37.797613 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f97b6299-3b30-4f1e-bebc-aaf275afcdff tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:37.933060 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f97b6299-3b30-4f1e-bebc-aaf275afcdff tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1654 microversion: 2.1 time: 0.150336 May 14 21:54:37.933676 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3383/6354] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:37 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:38.379736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9feaa1c5-5fd1-40de-9768-390fe8dd75fc req-40cc651d-6fd2-4f19-8812-bf9946f6f402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "928875e8-99e9-4bad-bcd6-4960f4911eda", "name": "network-vif-deleted", "tag": "e16cdfe5-530d-4d5d-bc15-b4494013715b"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:38.389344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9feaa1c5-5fd1-40de-9768-390fe8dd75fc req-40cc651d-6fd2-4f19-8812-bf9946f6f402 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:38.392756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9feaa1c5-5fd1-40de-9768-390fe8dd75fc req-40cc651d-6fd2-4f19-8812-bf9946f6f402 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:38.403274 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9feaa1c5-5fd1-40de-9768-390fe8dd75fc req-40cc651d-6fd2-4f19-8812-bf9946f6f402 service nova] Creating event network-vif-deleted:e16cdfe5-530d-4d5d-bc15-b4494013715b for instance 928875e8-99e9-4bad-bcd6-4960f4911eda on nch1-master-1 May 14 21:54:38.409442 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9feaa1c5-5fd1-40de-9768-390fe8dd75fc req-40cc651d-6fd2-4f19-8812-bf9946f6f402 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 May 14 21:54:38.411264 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2972/6355] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:54:38.950953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:38.951677 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:38.958870 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:38.959354 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:38.960527 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:38.960983 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:38.992921 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:38.993378 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:38.993837 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lazy-loading 'fault' on Instance uuid 928875e8-99e9-4bad-bcd6-4960f4911eda {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:54:39.041707 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-ee3b781a-b0e6-4252-8913-ea53cdabc4b0 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 200 len: 1454 microversion: 2.1 time: 0.094747 May 14 21:54:39.046883 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3384/6356] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:38 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:40.058378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:40.059086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: 928875e8-99e9-4bad-bcd6-4960f4911eda] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:40.066289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:40.066727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:40.067562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:40.068003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:40.082903 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] HTTP exception thrown: Instance 928875e8-99e9-4bad-bcd6-4960f4911eda could not be found. May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Request method failure captured: May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda HTTP/1.1 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCT_skXijKkEORXY6ubHZZZEtYSsvk8mT_k_piTymfgj1qvPnYTR5Up94dGQZ8aOYqzdJVwKh8P1mtQbGec0RubKPKSoq5aeyGC8-LNwRD0kj8HxQBIRWraIayBeO4dVfE84_xeTnwiPKgIVfHk_5GB9MCi2mgIIjuDfL1m4tYMcLdA May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 83be614a11e44c29b6444b41ce0a20d8 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestServerMultinode-1715906425 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83be614a11e44c29b6444b41ce0a20d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83be614a11e44c29b6444b41ce0a20d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83be614a11e44c29b6444b41ce0a20d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83be614a11e44c29b6444b41ce0a20d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestServerMultinode-1715906425 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 83be614a11e44c29b6444b41ce0a20d8 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestServerMultinode-1715906425 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestServerMultinode-1715906425-project-admin May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 562a60622af84fd383158e44f8b51ad9 May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestServerMultinode-1715906425-project-admin May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 928875e8-99e9-4bad-bcd6-4960f4911eda could not be found. May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '928875e8-99e9-4bad-bcd6-4960f4911eda'} May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 928875e8-99e9-4bad-bcd6-4960f4911eda could not be found. May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 928875e8-99e9-4bad-bcd6-4960f4911eda could not be found. May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:54:40.084652 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 928875e8-99e9-4bad-bcd6-4960f4911eda could not be found. May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Returning 404 to user: Instance 928875e8-99e9-4bad-bcd6-4960f4911eda could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-af923232-be29-450e-9dff-33236b1ca59a tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda" status: 404 len: 111 microversion: 2.1 time: 0.032707 May 14 21:54:40.094913 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2973/6357] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:40 2022] GET /compute/v2.1/servers/928875e8-99e9-4bad-bcd6-4960f4911eda => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:54:40.096664 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:40.097193 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:40.104255 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:40.104711 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:40.105487 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:40.105929 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:40.132971 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:54:40.461548 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-9a271017-d6a3-42aa-be4c-0a2e34cc1efd tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "DELETE /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 204 len: 0 microversion: 2.1 time: 0.368419 May 14 21:54:40.462159 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3385/6358] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:54:40 2022] DELETE /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:54:40.470046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-520c76b0-7a6a-43d7-b5c9-68d91721de39 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:40.470679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-520c76b0-7a6a-43d7-b5c9-68d91721de39 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:40.477631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-520c76b0-7a6a-43d7-b5c9-68d91721de39 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:40.478027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-520c76b0-7a6a-43d7-b5c9-68d91721de39 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:40.478799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-520c76b0-7a6a-43d7-b5c9-68d91721de39 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:40.479248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-520c76b0-7a6a-43d7-b5c9-68d91721de39 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:40.609621 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-520c76b0-7a6a-43d7-b5c9-68d91721de39 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1654 microversion: 2.1 time: 0.143159 May 14 21:54:40.610190 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2974/6359] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:40 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1654 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:41.627296 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-a7019160-b28e-4faa-8482-e661bd53f6f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:41.628045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-a7019160-b28e-4faa-8482-e661bd53f6f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:41.635616 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7019160-b28e-4faa-8482-e661bd53f6f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:41.635984 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7019160-b28e-4faa-8482-e661bd53f6f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:41.636762 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7019160-b28e-4faa-8482-e661bd53f6f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:41.637200 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-a7019160-b28e-4faa-8482-e661bd53f6f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:41.769735 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-a7019160-b28e-4faa-8482-e661bd53f6f7 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1654 microversion: 2.1 time: 0.146700 May 14 21:54:41.770681 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3386/6360] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:41 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1654 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:42.239181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7eccd424-8e18-4d05-9471-2dd1addc22bc req-3f81a782-908f-4497-9d88-1d39385694c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd17c282-fb51-4153-82fa-b13423f56a41", "name": "network-vif-deleted", "tag": "236594fd-8b9c-4079-91bb-3e96c0beae45"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:54:42.249680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7eccd424-8e18-4d05-9471-2dd1addc22bc req-3f81a782-908f-4497-9d88-1d39385694c7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:42.250130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7eccd424-8e18-4d05-9471-2dd1addc22bc req-3f81a782-908f-4497-9d88-1d39385694c7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:42.264341 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7eccd424-8e18-4d05-9471-2dd1addc22bc req-3f81a782-908f-4497-9d88-1d39385694c7 service nova] Creating event network-vif-deleted:236594fd-8b9c-4079-91bb-3e96c0beae45 for instance dd17c282-fb51-4153-82fa-b13423f56a41 on nch2-master-1 May 14 21:54:42.269705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7eccd424-8e18-4d05-9471-2dd1addc22bc req-3f81a782-908f-4497-9d88-1d39385694c7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035048 May 14 21:54:42.270907 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2975/6361] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:54:42.787121 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:42.787797 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:42.795064 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:42.795630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:42.796444 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:42.796912 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:42.831494 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:42.831953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:42.832416 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lazy-loading 'fault' on Instance uuid dd17c282-fb51-4153-82fa-b13423f56a41 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:54:42.885371 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-2228900c-6d7e-463a-b988-6c43b34c6f4e tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 200 len: 1453 microversion: 2.1 time: 0.102180 May 14 21:54:42.885957 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3387/6362] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:42 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:54:43.904384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:54:43.905090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] [instance: dd17c282-fb51-4153-82fa-b13423f56a41] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:54:43.911376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:43.911858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:43.912698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:54:43.913232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:54:43.927963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] HTTP exception thrown: Instance dd17c282-fb51-4153-82fa-b13423f56a41 could not be found. May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Request method failure captured: May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 HTTP/1.1 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCT_skXijKkEORXY6ubHZZZEtYSsvk8mT_k_piTymfgj1qvPnYTR5Up94dGQZ8aOYqzdJVwKh8P1mtQbGec0RubKPKSoq5aeyGC8-LNwRD0kj8HxQBIRWraIayBeO4dVfE84_xeTnwiPKgIVfHk_5GB9MCi2mgIIjuDfL1m4tYMcLdA May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 83be614a11e44c29b6444b41ce0a20d8 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestServerMultinode-1715906425 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83be614a11e44c29b6444b41ce0a20d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/83be614a11e44c29b6444b41ce0a20d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/83be614a11e44c29b6444b41ce0a20d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_83be614a11e44c29b6444b41ce0a20d8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestServerMultinode-1715906425 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 83be614a11e44c29b6444b41ce0a20d8 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestServerMultinode-1715906425 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestServerMultinode-1715906425-project-admin May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 562a60622af84fd383158e44f8b51ad9 May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestServerMultinode-1715906425-project-admin May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance dd17c282-fb51-4153-82fa-b13423f56a41 could not be found. May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'dd17c282-fb51-4153-82fa-b13423f56a41'} May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd17c282-fb51-4153-82fa-b13423f56a41 could not be found. May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd17c282-fb51-4153-82fa-b13423f56a41 could not be found. May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:54:43.929848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd17c282-fb51-4153-82fa-b13423f56a41 could not be found. May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] Returning 404 to user: Instance dd17c282-fb51-4153-82fa-b13423f56a41 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9b8921c-a8ed-4218-ae10-91e1e123cb67 tempest-TestServerMultinode-1715906425 tempest-TestServerMultinode-1715906425-project-admin] 10.222.0.52 "GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41" status: 404 len: 111 microversion: 2.1 time: 0.033940 May 14 21:54:43.934975 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2976/6363] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:54:43 2022] GET /compute/v2.1/servers/dd17c282-fb51-4153-82fa-b13423f56a41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:55:00.150872 ncdv-master-1 devstack@n-api.service[130638]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 21:55:00.151514 ncdv-master-1 devstack@n-api.service[130638]: Sat May 14 21:55:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 21:55:42.228495 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:55:42.229140 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:55:42.235890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2d5b4ab5-88ec-495b-8d37-a77149eb0eb1 req-613c5139-e043-47a2-a5ff-4087dd10d323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba04a2d9-8864-4848-b937-425921786664", "tag": "fabc866e-ec56-434f-8b1d-167f054712e7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:55:42.236450 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:42.236739 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:42.237511 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:42.237953 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:42.245691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2d5b4ab5-88ec-495b-8d37-a77149eb0eb1 req-613c5139-e043-47a2-a5ff-4087dd10d323 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:42.246292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2d5b4ab5-88ec-495b-8d37-a77149eb0eb1 req-613c5139-e043-47a2-a5ff-4087dd10d323 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:42.258888 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2d5b4ab5-88ec-495b-8d37-a77149eb0eb1 req-613c5139-e043-47a2-a5ff-4087dd10d323 service nova] Creating event network-changed:fabc866e-ec56-434f-8b1d-167f054712e7 for instance ba04a2d9-8864-4848-b937-425921786664 on nch2-master-1 May 14 21:55:42.265217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2d5b4ab5-88ec-495b-8d37-a77149eb0eb1 req-613c5139-e043-47a2-a5ff-4087dd10d323 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033633 May 14 21:55:42.266064 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2977/6364] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:55:42.268045 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Going to try to terminate instance {{(pid=130638) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:55:42.620305 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-cf66932d-eecc-4ba3-8b50-1dc1351b6afc tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 204 len: 0 microversion: 2.1 time: 0.395707 May 14 21:55:42.621057 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3388/6365] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:55:42 2022] DELETE /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:55:42.630874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:55:42.632074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:55:42.640573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:42.641160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:42.642249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:42.642785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:42.839532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:55:42.851177 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-078bbf5e-7745-4124-a03c-13d5b96356f7 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1585 microversion: 2.1 time: 0.225106 May 14 21:55:42.852402 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2978/6366] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:55:42 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1585 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:55:43.870537 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:55:43.871365 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:55:43.878583 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:43.879123 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:43.880011 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:43.880560 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:44.022630 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:55:44.030737 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-b58ceba3-9ba8-4e1d-b99a-be508da8e065 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1467 microversion: 2.1 time: 0.164672 May 14 21:55:44.031307 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3389/6367] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:55:43 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1467 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:55:44.137305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1c3aa603-fb3f-486e-a390-0fe246aef325 req-62f59906-be2e-4533-b8e6-bd039a996fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba04a2d9-8864-4848-b937-425921786664", "name": "network-vif-deleted", "tag": "fabc866e-ec56-434f-8b1d-167f054712e7"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:55:44.147971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1c3aa603-fb3f-486e-a390-0fe246aef325 req-62f59906-be2e-4533-b8e6-bd039a996fb1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:44.148421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1c3aa603-fb3f-486e-a390-0fe246aef325 req-62f59906-be2e-4533-b8e6-bd039a996fb1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:44.162237 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1c3aa603-fb3f-486e-a390-0fe246aef325 req-62f59906-be2e-4533-b8e6-bd039a996fb1 service nova] Creating event network-vif-deleted:fabc866e-ec56-434f-8b1d-167f054712e7 for instance ba04a2d9-8864-4848-b937-425921786664 on nch2-master-1 May 14 21:55:44.167629 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1c3aa603-fb3f-486e-a390-0fe246aef325 req-62f59906-be2e-4533-b8e6-bd039a996fb1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034294 May 14 21:55:44.168589 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2979/6368] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:55:45.048254 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:55:45.049010 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:55:45.056028 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:45.056558 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:45.057547 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:45.058003 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:45.089357 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:45.089851 ncdv-master-1 devstack@n-api.service[130638]: DEBUG oslo_concurrency.lockutils [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130638) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:45.090306 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.objects.instance [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lazy-loading 'fault' on Instance uuid ba04a2d9-8864-4848-b937-425921786664 {{(pid=130638) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:55:45.134042 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b51720c7970425abf4a26b2406893b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbd6e36a563a4245acae34e00437ca87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:55:45.142144 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f7889935-c139-4e2f-85e0-6b65ec4925e3 tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 200 len: 1235 microversion: 2.1 time: 0.098269 May 14 21:55:45.142742 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3390/6369] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:55:45 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 1235 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:55:46.164445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:55:46.165160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] [instance: ba04a2d9-8864-4848-b937-425921786664] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:55:46.173000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:46.177422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:46.177422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:55:46.177422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:55:46.188034 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] HTTP exception thrown: Instance ba04a2d9-8864-4848-b937-425921786664 could not be found. May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Request method failure captured: May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 HTTP/1.1 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCOiVaTXg6hHsYUv7EBcu9RoE3bNMoed9D1pDcKvrXCzmYyVFKqok7229qFJWTFyJimkOiC2G5B2H9uv5hIgfgRwjo1U-6uvw0w_81DCjXfeJYVfj4cZhPZ0ThqvLjJTv70IrT_Pe7l7DKN6D9Me_aG0P0-XVm2ueiwshUBPcMPdD1A May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fbd6e36a563a4245acae34e00437ca87 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBackupRestore-1478043453 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fbd6e36a563a4245acae34e00437ca87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fbd6e36a563a4245acae34e00437ca87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fbd6e36a563a4245acae34e00437ca87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fbd6e36a563a4245acae34e00437ca87", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBackupRestore-1478043453 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fbd6e36a563a4245acae34e00437ca87 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1478043453 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBackupRestore-1478043453-project May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 1b51720c7970425abf4a26b2406893b7 May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBackupRestore-1478043453-project May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance ba04a2d9-8864-4848-b937-425921786664 could not be found. May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'ba04a2d9-8864-4848-b937-425921786664'} May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba04a2d9-8864-4848-b937-425921786664 could not be found. May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba04a2d9-8864-4848-b937-425921786664 could not be found. May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:55:46.189606 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba04a2d9-8864-4848-b937-425921786664 could not be found. May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Returning 404 to user: Instance ba04a2d9-8864-4848-b937-425921786664 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76f13d73-4ad7-4f89-8937-5d657a46554e tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664" status: 404 len: 111 microversion: 2.1 time: 0.030865 May 14 21:55:46.194752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2980/6370] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:55:46 2022] GET /compute/v2.1/servers/ba04a2d9-8864-4848-b937-425921786664 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:55:46.413717 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-f2f2186e-738f-4bfb-a6f9-fd9f7b070d8d tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] Calling method '.version_select at 0x7fb1a6e88310>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:55:46.500433 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-f2f2186e-738f-4bfb-a6f9-fd9f7b070d8d tempest-TestVolumeBackupRestore-1478043453 tempest-TestVolumeBackupRestore-1478043453-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1474254061" status: 202 len: 0 microversion: 2.1 time: 0.091096 May 14 21:55:46.501029 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3391/6371] 10.222.0.52 () {58 vars in 1268 bytes} [Sat May 14 21:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1474254061 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 21:56:36.694888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2133611982", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7cb873fb-cfc0-428f-9688-278942d461c2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f86b7d55-3575-4193-a313-056d6af1cf6b"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:56:36.778807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] validate_networks() for [('f86b7d55-3575-4193-a313-056d6af1cf6b', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:56:37.555651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:56:37.556093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:56:37.556576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:56:37.556990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:56:37.557408 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:56:37.566913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:56:37.567367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:56:37.568213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:56:37.568657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:56:37.585282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:56:37.590465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for user 47332c347cf04b58b5857052c6468e6d and project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:56:37.603309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:56:37.605501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='7cb873fb-cfc0-428f-9688-278942d461c2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:56:37.793129 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [09734ecc-08e3-483c-a1fe-e05b8ab6055a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 21:56:38.801269 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [09734ecc-08e3-483c-a1fe-e05b8ab6055a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 33774. May 14 21:56:38.805232 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14b3fb10-545d-4836-a6bf-68a1245bf40e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.114596 May 14 21:56:38.805891 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2981/6372] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:56:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 21:56:38.817600 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.api.openstack.wsgi [None req-43363c16-5faa-4a1c-b7a2-be80b149df75 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130638) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:56:38.818316 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.compute.api [None req-43363c16-5faa-4a1c-b7a2-be80b149df75 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130638) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:56:38.870646 ncdv-master-1 devstack@n-api.service[130638]: DEBUG nova.policy [None req-43363c16-5faa-4a1c-b7a2-be80b149df75 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130638) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:56:38.878688 ncdv-master-1 devstack@n-api.service[130638]: INFO nova.api.openstack.requestlog [None req-43363c16-5faa-4a1c-b7a2-be80b149df75 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1057 microversion: 2.1 time: 0.066718 May 14 21:56:38.879774 ncdv-master-1 devstack@n-api.service[130638]: [pid: 130638|app: 0|req: 3392/6373] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:56:38 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1057 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:56:39.089562 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 21:56:39.089729 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 21:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 21:56:39.897596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9a103818-12a4-47b2-927b-852d24ffbe69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:56:39.898313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9a103818-12a4-47b2-927b-852d24ffbe69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:56:39.953723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9a103818-12a4-47b2-927b-852d24ffbe69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:56:39.960994 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9a103818-12a4-47b2-927b-852d24ffbe69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1057 microversion: 2.1 time: 0.068196 May 14 21:56:39.961733 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2982/6374] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:56:39 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1057 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:56:40.987838 ncdv-master-1 devstack@n-api.service[130638]: Traceback (most recent call last): May 14 21:56:40.988409 ncdv-master-1 devstack@n-api.service[130638]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 14 21:56:40.988409 ncdv-master-1 devstack@n-api.service[130638]: timer() May 14 21:56:40.988409 ncdv-master-1 devstack@n-api.service[130638]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 14 21:56:40.988409 ncdv-master-1 devstack@n-api.service[130638]: cb(*args, **kw) May 14 21:56:40.988409 ncdv-master-1 devstack@n-api.service[130638]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire May 14 21:56:40.988409 ncdv-master-1 devstack@n-api.service[130638]: waiter.switch() May 14 21:56:40.988409 ncdv-master-1 devstack@n-api.service[130638]: greenlet.error: cannot switch to a different thread May 14 21:56:44.757045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-82714f40-570d-4860-855e-e82d9b4fa877 req-eb2522e4-a68c-4911-8ea7-0b92b8eec737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3", "tag": "854a79f8-8519-44d0-bd6b-fc1b5285ff94"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:56:44.766503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-82714f40-570d-4860-855e-e82d9b4fa877 req-eb2522e4-a68c-4911-8ea7-0b92b8eec737 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:56:44.766949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-82714f40-570d-4860-855e-e82d9b4fa877 req-eb2522e4-a68c-4911-8ea7-0b92b8eec737 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:56:44.780619 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-82714f40-570d-4860-855e-e82d9b4fa877 req-eb2522e4-a68c-4911-8ea7-0b92b8eec737 service nova] Creating event network-changed:854a79f8-8519-44d0-bd6b-fc1b5285ff94 for instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 on nch2-master-1 May 14 21:56:44.786879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-82714f40-570d-4860-855e-e82d9b4fa877 req-eb2522e4-a68c-4911-8ea7-0b92b8eec737 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035111 May 14 21:56:44.787928 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2983/6375] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:56:55.921995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-140306ac-9792-4c44-ad83-51798b1823bd req-a11432d8-36bb-4b5e-931c-009dd5b4b865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3", "name": "network-vif-plugged", "status": "completed", "tag": "854a79f8-8519-44d0-bd6b-fc1b5285ff94"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:56:55.932560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-140306ac-9792-4c44-ad83-51798b1823bd req-a11432d8-36bb-4b5e-931c-009dd5b4b865 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:56:55.932560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-140306ac-9792-4c44-ad83-51798b1823bd req-a11432d8-36bb-4b5e-931c-009dd5b4b865 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:56:55.942830 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-140306ac-9792-4c44-ad83-51798b1823bd req-a11432d8-36bb-4b5e-931c-009dd5b4b865 service nova] Creating event network-vif-plugged:854a79f8-8519-44d0-bd6b-fc1b5285ff94 for instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 on nch2-master-1 May 14 21:56:55.947731 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-140306ac-9792-4c44-ad83-51798b1823bd req-a11432d8-36bb-4b5e-931c-009dd5b4b865 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159964 May 14 21:56:55.948338 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2984/6376] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:57:41.040200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:41.040985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:41.047780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.048247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.049028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.049484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.247684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:57:41.255290 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-552bccf2-3a83-4158-91e6-c16cc59118ac tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1390 microversion: 2.1 time: 0.220648 May 14 21:57:41.255892 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2985/6377] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:41 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1390 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:57:41.271119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:41.274556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:41.277406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.278458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.279536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.279983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.407844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:57:41.415287 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-62c351e8-2a04-4b4c-a147-d6531eab9981 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1390 microversion: 2.1 time: 0.147749 May 14 21:57:41.415889 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2986/6378] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:41 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1390 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:57:41.430843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:41.431453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:41.437892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.438344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.439115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.439585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.571989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:57:41.579540 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2fdb05e1-8af2-4af6-8f79-e627313b17dd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1390 microversion: 2.1 time: 0.152194 May 14 21:57:41.581673 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2987/6379] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:41 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:57:41.647358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:41.647900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:41.654721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.655183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.656004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.656581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.681314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:57:41.961173 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd7f8440-27cd-456a-aa13-056360215bbc tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 204 len: 0 microversion: 2.1 time: 0.317407 May 14 21:57:41.961834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2988/6380] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:57:41 2022] DELETE /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:57:41.970957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:41.971705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:41.977772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.978230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:41.979011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:41.979456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:42.113088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:57:42.120852 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c3dbf276-43da-452d-8706-f18a4424fb24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1396 microversion: 2.1 time: 0.153880 May 14 21:57:42.121458 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2989/6381] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:41 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:57:43.138381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:43.139110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:43.146601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:43.147061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:43.147888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:43.148336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:43.279024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:57:43.286527 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-074a6215-db58-41cd-bb3e-1e1fbb368a8a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1396 microversion: 2.1 time: 0.152478 May 14 21:57:43.287093 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2990/6382] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:43 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1396 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:57:44.182747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-97ffb6d3-dee7-487c-a4c9-4ba2e2ca0a36 req-6c66addf-2283-457c-b619-f4cdf70d618f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3", "name": "network-vif-deleted", "tag": "854a79f8-8519-44d0-bd6b-fc1b5285ff94"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:57:44.192401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-97ffb6d3-dee7-487c-a4c9-4ba2e2ca0a36 req-6c66addf-2283-457c-b619-f4cdf70d618f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:44.192854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-97ffb6d3-dee7-487c-a4c9-4ba2e2ca0a36 req-6c66addf-2283-457c-b619-f4cdf70d618f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:44.205158 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-97ffb6d3-dee7-487c-a4c9-4ba2e2ca0a36 req-6c66addf-2283-457c-b619-f4cdf70d618f service nova] Creating event network-vif-deleted:854a79f8-8519-44d0-bd6b-fc1b5285ff94 for instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 on nch2-master-1 May 14 21:57:44.210400 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-97ffb6d3-dee7-487c-a4c9-4ba2e2ca0a36 req-6c66addf-2283-457c-b619-f4cdf70d618f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031441 May 14 21:57:44.211324 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2991/6383] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:57:44.304486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:44.305471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:44.312564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:44.313021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:44.313795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:44.314236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:44.380005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:57:44.388149 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aebf4a5b-6b4d-467d-960a-ee8a2c7fe2ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1354 microversion: 2.1 time: 0.087720 May 14 21:57:44.388937 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2992/6384] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:44 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:57:45.406661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:45.407346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:45.414129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:45.414590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:45.415369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:45.415848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:45.450887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:45.451348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:45.451855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lazy-loading 'fault' on Instance uuid d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:57:45.498248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:57:45.505895 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae380c61-545c-4c0f-999e-db42f8cdbd65 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 200 len: 1193 microversion: 2.1 time: 0.104059 May 14 21:57:45.506476 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2993/6385] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:45 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 1193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:57:46.522966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:46.523673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:46.531201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:46.531683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:46.532460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:46.532897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:46.547217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 HTTP/1.1 May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3'} May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:57:46.548930 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-314288ba-3131-498d-9b3c-9118d33233c9 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 404 len: 111 microversion: 2.1 time: 0.031237 May 14 21:57:46.554153 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2994/6386] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:46 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:57:49.726473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:49.727095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:49.734602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:49.735061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:49.735888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:49.736335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:49.753762 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 HTTP/1.1 May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3'} May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:57:49.756300 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5186dc26-acea-46e4-92a5-0d4a97a014c7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 404 len: 111 microversion: 2.1 time: 0.035230 May 14 21:57:49.761552 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2995/6387] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:57:49 2022] DELETE /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:57:49.766021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:57:49.767783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:57:49.772686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:49.773151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:49.773926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:57:49.774374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:57:49.788831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 HTTP/1.1 May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3'} May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:57:49.790351 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4dd6551c-d3c7-4014-8798-83b62dcf81f2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3" status: 404 len: 111 microversion: 2.1 time: 0.029376 May 14 21:57:49.796881 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2996/6388] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:57:49 2022] GET /compute/v2.1/servers/d03c1ab3-fc8a-464f-b1f3-e11fdd4f80e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 21:58:05.543117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2057462059", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8eb810f7-e5ef-40f5-9a22-95d2637dd9d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "f86b7d55-3575-4193-a313-056d6af1cf6b"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:05.606383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] validate_networks() for [('f86b7d55-3575-4193-a313-056d6af1cf6b', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:58:05.961525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:58:05.961525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:58:05.961525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:58:05.961525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:58:05.962040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:58:05.970874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:05.971336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:05.972213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:05.972659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:05.989400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:58:05.994716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for user 47332c347cf04b58b5857052c6468e6d and project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:58:06.053521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:58:06.055651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8eb810f7-e5ef-40f5-9a22-95d2637dd9d7',volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:58:06.432385 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5db897ea-25ce-4271-8baf-d0f2a8dad28f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893183 May 14 21:58:06.433246 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2997/6389] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:58:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:58:06.443177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c73aa394-1556-4595-8ef9-57760d81d441 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:06.444124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c73aa394-1556-4595-8ef9-57760d81d441 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:06.497837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c73aa394-1556-4595-8ef9-57760d81d441 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:06.506227 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c73aa394-1556-4595-8ef9-57760d81d441 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1071 microversion: 2.1 time: 0.066760 May 14 21:58:06.507145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2998/6390] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:06 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1071 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:07.524144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:07.524826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:07.532525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:07.532984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:07.533853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:07.534320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:07.597579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:07.604785 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-40d61301-f4e0-457e-b519-0cd79550a9ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1121 microversion: 2.1 time: 0.084677 May 14 21:58:07.605673 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 2999/6391] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:07 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1121 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:08.622589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:08.623334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:08.630226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:08.630911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:08.631733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:08.632176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:08.727369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:08.735924 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d5c6e3f-ea08-43ab-9077-8b054b5c2e48 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1187 microversion: 2.1 time: 0.117377 May 14 21:58:08.745431 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3000/6392] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:08 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1187 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:09.754314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:09.755918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:09.764705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:09.765972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:09.767004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:09.767673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:09.922967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:09.931242 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-022d0e80-4780-403e-bc6a-6dd5ab0b58ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1229 microversion: 2.1 time: 0.181335 May 14 21:58:09.931875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3001/6393] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:09 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1229 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:10.028000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c42806ec-91d8-40f7-9ca0-c0c32936cc55 req-b30283dd-a71f-41d8-84f2-3ce8a0090e77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f1df010-e31a-44d9-b4fe-8777424612d0", "tag": "e6385634-71bd-4d95-831d-df8d13227361"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:10.043740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c42806ec-91d8-40f7-9ca0-c0c32936cc55 req-b30283dd-a71f-41d8-84f2-3ce8a0090e77 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:10.044201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c42806ec-91d8-40f7-9ca0-c0c32936cc55 req-b30283dd-a71f-41d8-84f2-3ce8a0090e77 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:10.060720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c42806ec-91d8-40f7-9ca0-c0c32936cc55 req-b30283dd-a71f-41d8-84f2-3ce8a0090e77 service nova] Creating event network-changed:e6385634-71bd-4d95-831d-df8d13227361 for instance 0f1df010-e31a-44d9-b4fe-8777424612d0 on nch2-master-1 May 14 21:58:10.067337 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c42806ec-91d8-40f7-9ca0-c0c32936cc55 req-b30283dd-a71f-41d8-84f2-3ce8a0090e77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042907 May 14 21:58:10.068054 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3002/6394] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:58:10.948948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:10.949670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:10.956849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:10.957318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:10.958116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:10.958544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:11.089883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:11.097998 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-84cdc78c-9c2d-4ebf-bfae-d75c4221435f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1217 microversion: 2.1 time: 0.153339 May 14 21:58:11.098575 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3003/6395] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:10 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:12.115205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:12.116095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:12.124278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:12.124771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:12.125555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:12.125996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:12.257399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:12.264950 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3b9a02f-6cf9-4638-81e4-9a588ac29524 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1217 microversion: 2.1 time: 0.153643 May 14 21:58:12.265520 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3004/6396] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:12 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:13.282163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:13.282869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:13.289662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:13.290118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:13.290891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:13.291331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:13.418787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:13.427278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53eece28-2d00-4198-aa90-bd95e7c10721 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1217 microversion: 2.1 time: 0.149538 May 14 21:58:13.427901 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3005/6397] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:13 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:14.444888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:14.445591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:14.452291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:14.452768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:14.454094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:14.454536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:14.581962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:14.589427 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5d2ad96-b9db-42b6-9ede-c2019e02408d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1217 microversion: 2.1 time: 0.148544 May 14 21:58:14.590045 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3006/6398] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:14 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:15.605886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:15.606561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:15.613406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:15.613869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:15.614645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:15.615089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:15.747115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:15.755868 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79583317-c805-4b30-af85-1c7ac91dc82f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1217 microversion: 2.1 time: 0.153806 May 14 21:58:15.756457 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3007/6399] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:15 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:16.083824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ee2ab91f-f93e-4955-ba10-9af7eb21de7c req-f7c4c7fa-fec2-4aa5-9b5c-1ca891e4b904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1df010-e31a-44d9-b4fe-8777424612d0", "name": "network-vif-plugged", "status": "completed", "tag": "e6385634-71bd-4d95-831d-df8d13227361"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:16.092363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee2ab91f-f93e-4955-ba10-9af7eb21de7c req-f7c4c7fa-fec2-4aa5-9b5c-1ca891e4b904 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:16.092814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee2ab91f-f93e-4955-ba10-9af7eb21de7c req-f7c4c7fa-fec2-4aa5-9b5c-1ca891e4b904 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:16.104733 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ee2ab91f-f93e-4955-ba10-9af7eb21de7c req-f7c4c7fa-fec2-4aa5-9b5c-1ca891e4b904 service nova] Creating event network-vif-plugged:e6385634-71bd-4d95-831d-df8d13227361 for instance 0f1df010-e31a-44d9-b4fe-8777424612d0 on nch2-master-1 May 14 21:58:16.112840 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ee2ab91f-f93e-4955-ba10-9af7eb21de7c req-f7c4c7fa-fec2-4aa5-9b5c-1ca891e4b904 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030654 May 14 21:58:16.112840 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3008/6400] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:58:16.774609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:16.775383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:16.789448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:16.789448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:16.789448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:16.789448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:16.914677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:16.922734 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bdf45c85-bc78-4b68-a93b-8160c98037ec tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1217 microversion: 2.1 time: 0.152526 May 14 21:58:16.923348 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3009/6401] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:16 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:17.940072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:17.940700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:17.947583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:17.948047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:17.948828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:17.949277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:18.077024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:18.085503 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a6eeecfa-a0ff-4258-9923-2b1f762fc77d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1405 microversion: 2.1 time: 0.150105 May 14 21:58:18.086075 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3010/6402] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:17 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:18.101722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:18.102341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:18.108192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:18.108645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:18.110131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:18.110576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:18.242403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:18.250430 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f90bc671-28db-4854-bb52-d276b6f2d30a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1405 microversion: 2.1 time: 0.152440 May 14 21:58:18.251002 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3011/6403] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:18 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:18.266026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1560875953"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:18.267044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:18.272787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:18.273239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:18.273999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:18.274437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:18.363362 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Attempting to quiesce instance before volume snapshot. May 14 21:58:18.423992 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 14 21:58:18.666376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Creating snapshot from volume 8eb810f7-e5ef-40f5-9a22-95d2637dd9d7. {{(pid=130637) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 14 21:58:20.201671 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-26ab8d53-9766-453c-9939-48fcf8662c09 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "POST /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0/action" status: 202 len: 0 microversion: 2.1 time: 1.939162 May 14 21:58:20.202327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3012/6404] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 21:58:18 2022] POST /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0/action => generated 0 bytes in 1940 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 14 21:58:21.347087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-864165852", "imageRef": "70282a3f-7393-43f0-a414-9d20c4e00343", "flavorRef": "452", "networks": [{"uuid": "f86b7d55-3575-4193-a313-056d6af1cf6b"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:21.398677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] validate_networks() for [('f86b7d55-3575-4193-a313-056d6af1cf6b', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:58:21.757996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:58:21.758448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:58:21.758947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:58:21.759383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:58:21.759846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:58:21.768766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:21.769241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:21.770066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:21.770524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:21.787896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:58:21.793201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for user 47332c347cf04b58b5857052c6468e6d and project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:58:21.806406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:58:21.809075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b9d7842a-919c-4b43-b206-f44b760eb6d7',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:58:21.953181 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-16a2739d-6b74-4ca2-be0c-b318eb0bb6ea tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611553 May 14 21:58:21.953841 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3013/6405] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:58:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:58:21.963756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffac270b-8dfb-466b-8d05-6cef12cd98d2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:21.965804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffac270b-8dfb-466b-8d05-6cef12cd98d2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:22.018240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ffac270b-8dfb-466b-8d05-6cef12cd98d2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:22.024914 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffac270b-8dfb-466b-8d05-6cef12cd98d2 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1229 microversion: 2.1 time: 0.065065 May 14 21:58:22.025495 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3014/6406] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:21 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1229 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:23.042172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:23.042861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:23.051286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:23.051788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:23.055944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:23.055944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:23.443733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:23.455879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa9ae0f3-d15e-46fc-b004-dd3cb98f6118 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1233 microversion: 2.1 time: 0.417527 May 14 21:58:23.456461 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3015/6407] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:23 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1233 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:24.473438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:24.474115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:24.480757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:24.481223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:24.481995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:24.482448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:24.731781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:24.739849 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d976e3fa-deff-4847-8255-fea8c471112b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1341 microversion: 2.1 time: 0.270295 May 14 21:58:24.741073 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3016/6408] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:24 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1341 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:25.706740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-312c0dbc-881a-4dc8-bb6e-0a0a4ef2e564 req-8aa79d3d-23b0-460a-8885-62d5060d9fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e123e75-bdec-4884-822f-9fa70f864661", "tag": "b52eb653-a8cf-4903-aab8-51c10fc8b9e3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:25.717067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-312c0dbc-881a-4dc8-bb6e-0a0a4ef2e564 req-8aa79d3d-23b0-460a-8885-62d5060d9fca service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:25.719570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-312c0dbc-881a-4dc8-bb6e-0a0a4ef2e564 req-8aa79d3d-23b0-460a-8885-62d5060d9fca service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:25.729507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-312c0dbc-881a-4dc8-bb6e-0a0a4ef2e564 req-8aa79d3d-23b0-460a-8885-62d5060d9fca service nova] Creating event network-changed:b52eb653-a8cf-4903-aab8-51c10fc8b9e3 for instance 3e123e75-bdec-4884-822f-9fa70f864661 on nch1-master-1 May 14 21:58:25.742288 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-312c0dbc-881a-4dc8-bb6e-0a0a4ef2e564 req-8aa79d3d-23b0-460a-8885-62d5060d9fca service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040209 May 14 21:58:25.743258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3017/6409] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:58:25.758404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:25.759417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:25.769334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:25.769954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:25.771597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:25.772170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:26.008061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:26.015892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2863ac55-1add-4514-b1f9-73db995a1b47 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1341 microversion: 2.1 time: 0.262272 May 14 21:58:26.016604 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3018/6410] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:25 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1341 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:27.034075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:27.034736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:27.041748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:27.042244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:27.043033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:27.043516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:27.181383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:27.188948 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a6162abe-1725-4602-a093-a5de7dea72ae tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1341 microversion: 2.1 time: 0.159766 May 14 21:58:27.189533 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3019/6411] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:27 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:28.205928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:28.206567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:28.213590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:28.214066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:28.214952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:28.215856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:28.352263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:28.359971 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cf798c8f-bf9e-4ce6-b2bb-cb1217bdf91a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1341 microversion: 2.1 time: 0.158629 May 14 21:58:28.361335 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3020/6412] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:28 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:29.377755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:29.378501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:29.385467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:29.388069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:29.388069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:29.388069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:29.519564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:29.527315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ed7ff114-283a-4e94-8e70-d71d2d07a591 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1387 microversion: 2.1 time: 0.153610 May 14 21:58:29.528135 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3021/6413] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:29 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1387 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:30.545497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:30.546196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:30.553126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:30.553593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:30.554368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:30.554819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:30.688661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:30.697267 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a46eecec-0e0d-45e0-a06b-8931e5384e19 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1375 microversion: 2.1 time: 0.155689 May 14 21:58:30.697859 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3022/6414] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:30 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:31.715248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:31.715995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:31.723582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:31.724054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:31.724841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:31.725299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:31.859836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:31.867387 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f67f085f-fa7f-47b0-aa06-c6e76c008f6b tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1375 microversion: 2.1 time: 0.156063 May 14 21:58:31.867999 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3023/6415] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:31 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:32.884438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:32.885207 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:32.891983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:32.892460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:32.894013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:32.894473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:33.030718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:33.038297 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23900bc6-ffeb-4951-9dba-cb9971e4dbe6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1375 microversion: 2.1 time: 0.157771 May 14 21:58:33.038889 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3024/6416] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:32 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:34.055902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:34.056647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:34.063317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:34.063815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:34.064590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:34.065791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:34.197406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:34.204964 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1cd80690-1dbf-43ec-8c4d-a5f674fd75cd tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1375 microversion: 2.1 time: 0.153012 May 14 21:58:34.206296 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3025/6417] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:34 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:35.222532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:35.223184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:35.230017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:35.230493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:35.231289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:35.231775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:35.386773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:35.394433 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-da3b8918-3685-46b0-8985-eac8f0fb6a7f tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1375 microversion: 2.1 time: 0.175953 May 14 21:58:35.395019 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3026/6418] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:35 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:36.411822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:36.412553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:36.419665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:36.420136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:36.420948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:36.421427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:36.564196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:36.572055 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2ae223c-d3fc-4f8a-b64b-2ddb829bcb5e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1375 microversion: 2.1 time: 0.164322 May 14 21:58:36.572656 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3027/6419] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:36 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:36.603244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a78ccfde-4311-4522-8e84-656609dd0917 req-4d976d2e-4315-4823-a0fa-ccf8df386bdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e123e75-bdec-4884-822f-9fa70f864661", "name": "network-vif-plugged", "status": "completed", "tag": "b52eb653-a8cf-4903-aab8-51c10fc8b9e3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:36.611129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a78ccfde-4311-4522-8e84-656609dd0917 req-4d976d2e-4315-4823-a0fa-ccf8df386bdf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:36.612406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a78ccfde-4311-4522-8e84-656609dd0917 req-4d976d2e-4315-4823-a0fa-ccf8df386bdf service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:36.623702 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a78ccfde-4311-4522-8e84-656609dd0917 req-4d976d2e-4315-4823-a0fa-ccf8df386bdf service nova] Creating event network-vif-plugged:b52eb653-a8cf-4903-aab8-51c10fc8b9e3 for instance 3e123e75-bdec-4884-822f-9fa70f864661 on nch1-master-1 May 14 21:58:36.629081 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a78ccfde-4311-4522-8e84-656609dd0917 req-4d976d2e-4315-4823-a0fa-ccf8df386bdf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029487 May 14 21:58:36.629685 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3028/6420] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:58:37.589430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:37.590175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:37.597337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:37.597802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:37.598580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:37.599033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:37.743361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:37.750833 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0fbfbd3-31b0-4d1c-af43-610e32b683a1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1375 microversion: 2.1 time: 0.165684 May 14 21:58:37.751457 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3029/6421] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:37 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:38.769669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:38.770391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:38.776853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:38.777761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:38.778306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:38.778762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:38.911372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:38.919355 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff00e5ef-e773-413f-896f-9813bce47a00 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1563 microversion: 2.1 time: 0.154315 May 14 21:58:38.920098 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3030/6422] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:38 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:38.937519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:38.938328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:38.944605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:38.945081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:38.945870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:38.946351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:39.079565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:39.087783 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03439185-555e-4968-a541-e6c7fe527d24 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1563 microversion: 2.1 time: 0.154163 May 14 21:58:39.088361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3031/6423] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:38 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:39.156062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:39.159024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:39.163199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:39.163710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:39.164495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:39.164954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:39.190378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:58:39.481740 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24bed171-e1e1-4c80-b883-df0f022f0a1d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 204 len: 0 microversion: 2.1 time: 0.329520 May 14 21:58:39.482346 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3032/6424] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:58:39 2022] DELETE /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 21:58:39.490612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:39.491404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:39.497456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:39.497931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:39.498727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:39.499191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:39.628738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:39.636505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-604b6424-7a15-40c2-8eba-db1548a6f0c6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1569 microversion: 2.1 time: 0.149944 May 14 21:58:39.638656 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3033/6425] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:39 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:40.654234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:40.655140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:40.662791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:40.663260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:40.664070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:40.664526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:40.794790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:40.802482 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be907d9e-bd71-4c65-b053-b1f19f2eacb7 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1569 microversion: 2.1 time: 0.152233 May 14 21:58:40.803058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3034/6426] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:40 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:41.529136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-12836435-98d6-4e4b-b933-d0f6d03764a0 req-4c67b685-0a5e-48f7-97ae-4683bbb4b3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e123e75-bdec-4884-822f-9fa70f864661", "name": "network-vif-deleted", "tag": "b52eb653-a8cf-4903-aab8-51c10fc8b9e3"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:58:41.529136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-12836435-98d6-4e4b-b933-d0f6d03764a0 req-4c67b685-0a5e-48f7-97ae-4683bbb4b3a2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:41.529136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-12836435-98d6-4e4b-b933-d0f6d03764a0 req-4c67b685-0a5e-48f7-97ae-4683bbb4b3a2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:41.540489 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-12836435-98d6-4e4b-b933-d0f6d03764a0 req-4c67b685-0a5e-48f7-97ae-4683bbb4b3a2 service nova] Creating event network-vif-deleted:b52eb653-a8cf-4903-aab8-51c10fc8b9e3 for instance 3e123e75-bdec-4884-822f-9fa70f864661 on nch1-master-1 May 14 21:58:41.545698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-12836435-98d6-4e4b-b933-d0f6d03764a0 req-4c67b685-0a5e-48f7-97ae-4683bbb4b3a2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032897 May 14 21:58:41.546787 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3035/6427] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:58:41.821425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:41.822149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:41.828367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:41.828841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:41.829630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:41.830090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:41.894066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:41.902925 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8fd7ad1e-d43a-4a8c-830b-eb0e8b818595 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1360 microversion: 2.1 time: 0.086681 May 14 21:58:41.903689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3036/6428] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:41 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1360 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:42.920970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:42.921673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:42.929132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:42.929904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:42.930709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:42.931371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:42.966628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:42.967024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:42.967534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lazy-loading 'fault' on Instance uuid 3e123e75-bdec-4884-822f-9fa70f864661 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:58:43.012027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:58:43.020099 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19e868a0-efc7-4f80-b9b4-52b950d88d04 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 200 len: 1365 microversion: 2.1 time: 0.103007 May 14 21:58:43.020677 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3037/6429] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:42 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:58:44.037844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:58:44.038504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:58:44.045291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:44.045755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:44.046528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:58:44.046980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:58:44.061054 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 HTTP/1.1 May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3e123e75-bdec-4884-822f-9fa70f864661'} May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:58:44.062732 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b81ea28d-e576-4651-aa10-ab2358564af4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 404 len: 111 microversion: 2.1 time: 0.031008 May 14 21:58:44.068427 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3038/6430] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:58:44 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:59:22.392579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:22.393244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:22.399750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:22.404904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:22.404904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:22.404904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:22.426503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 21:59:22.730613 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cdf5426e-c311-4780-80f8-1df305665da1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 204 len: 0 microversion: 2.1 time: 0.341923 May 14 21:59:22.731218 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3039/6431] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:59:22 2022] DELETE /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 21:59:22.739735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:22.740460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:22.747442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:22.747952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:22.748741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:22.749200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:22.878322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:22.886231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bd1c80c-6301-4d7c-8573-c5a1e9890e45 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1411 microversion: 2.1 time: 0.150628 May 14 21:59:22.887748 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3040/6432] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:22 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1411 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:23.903711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:23.904356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:23.911691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:23.912169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:23.912955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:23.914096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:24.044650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:24.052507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afd942fb-cd8d-49bd-ad15-00957340bdb0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1411 microversion: 2.1 time: 0.152851 May 14 21:59:24.053079 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3041/6433] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:23 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1411 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:25.069674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:25.070539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:25.077279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:25.077742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:25.078543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:25.078994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:25.149270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:25.161860 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5706925-c855-4d26-bba7-736800654640 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1369 microversion: 2.1 time: 0.092694 May 14 21:59:25.161860 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3042/6434] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:25 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:59:25.229778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f7d9eb24-f481-4cdd-bf34-6682af0e0e77 req-69595397-06f2-4402-96b9-d44ac84065b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f1df010-e31a-44d9-b4fe-8777424612d0", "name": "network-vif-deleted", "tag": "e6385634-71bd-4d95-831d-df8d13227361"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:59:25.238957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f7d9eb24-f481-4cdd-bf34-6682af0e0e77 req-69595397-06f2-4402-96b9-d44ac84065b9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:25.238957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f7d9eb24-f481-4cdd-bf34-6682af0e0e77 req-69595397-06f2-4402-96b9-d44ac84065b9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:25.249584 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f7d9eb24-f481-4cdd-bf34-6682af0e0e77 req-69595397-06f2-4402-96b9-d44ac84065b9 service nova] Creating event network-vif-deleted:e6385634-71bd-4d95-831d-df8d13227361 for instance 0f1df010-e31a-44d9-b4fe-8777424612d0 on nch2-master-1 May 14 21:59:25.254313 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f7d9eb24-f481-4cdd-bf34-6682af0e0e77 req-69595397-06f2-4402-96b9-d44ac84065b9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094228 May 14 21:59:25.255163 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3043/6435] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:59:26.177403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:26.178211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:26.185765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:26.186164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:26.187026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:26.187512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:26.221303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:26.221792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:26.222265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lazy-loading 'fault' on Instance uuid 0f1df010-e31a-44d9-b4fe-8777424612d0 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 21:59:26.264134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:26.272096 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b86e6f57-96ee-48f7-b9d4-e6e7ee0c9465 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 200 len: 1207 microversion: 2.1 time: 0.099826 May 14 21:59:26.272702 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3044/6436] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:26 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 1207 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:27.290936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:27.291600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:27.298286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:27.298757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:27.299554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:27.300008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:27.314566 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 HTTP/1.1 May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0f1df010-e31a-44d9-b4fe-8777424612d0'} May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:27.316262 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71fef610-8b0a-4934-a0bf-c04a7e695ac4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 404 len: 111 microversion: 2.1 time: 0.030949 May 14 21:59:27.322591 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3045/6437] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:27 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:59:32.595520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:32.596104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:32.603849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:32.604321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:32.605105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:32.605583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:32.619787 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 HTTP/1.1 May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3e123e75-bdec-4884-822f-9fa70f864661'} May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:59:32.621381 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8e2c79bb-520a-4a67-bf5b-a2627f49a9d3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 404 len: 111 microversion: 2.1 time: 0.031161 May 14 21:59:32.626911 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3046/6438] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:59:32 2022] DELETE /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:59:32.630936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:32.631583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 3e123e75-bdec-4884-822f-9fa70f864661] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:32.637661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:32.638125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:32.638898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:32.639347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:32.653628 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 HTTP/1.1 May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3e123e75-bdec-4884-822f-9fa70f864661'} May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:32.655406 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance 3e123e75-bdec-4884-822f-9fa70f864661 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-206b78f8-e709-4d24-b8d0-48027972cfc8 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661" status: 404 len: 111 microversion: 2.1 time: 0.029408 May 14 21:59:32.660847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3047/6439] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:32 2022] GET /compute/v2.1/servers/3e123e75-bdec-4884-822f-9fa70f864661 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:59:33.387032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:33.387654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:33.393615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:33.394082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:33.394862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:33.395318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:33.409686 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 HTTP/1.1 May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0f1df010-e31a-44d9-b4fe-8777424612d0'} May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:59:33.411232 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27fff162-6eaf-4e71-93c2-fe743df0528a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 404 len: 111 microversion: 2.1 time: 0.029335 May 14 21:59:33.419503 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3048/6440] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 21:59:33 2022] DELETE /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:59:33.421587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:33.422247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: 0f1df010-e31a-44d9-b4fe-8777424612d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:33.428196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:33.428707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:33.429501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:33.429962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:33.443360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 HTTP/1.1 May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0f1df010-e31a-44d9-b4fe-8777424612d0'} May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 21:59:33.445098 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance 0f1df010-e31a-44d9-b4fe-8777424612d0 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ca905fd-07c7-4d57-b5e0-cb5543e172ab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0" status: 404 len: 111 microversion: 2.1 time: 0.028674 May 14 21:59:33.450389 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3049/6441] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:33 2022] GET /compute/v2.1/servers/0f1df010-e31a-44d9-b4fe-8777424612d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 21:59:33.518209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96e4982b-cafb-4245-9d07-b28955198211 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Action: 'create', calling method: .version_select at 0x7fb1a7684430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1749942396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtm18BsRWJYhwVgAEuo+JDcp2c96b5Ee3m5WE7P764M64jiKVvisrk/9YldqAywVZWpK1nbqV6EQKURtl28QfylCxN5T1UsT7V6sqAak58gkNoMLD6fKlbL03lfqEhRKQ=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:59:33.532832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-96e4982b-cafb-4245-9d07-b28955198211 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:59:33.537983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-96e4982b-cafb-4245-9d07-b28955198211 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for user 47332c347cf04b58b5857052c6468e6d and project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:59:33.636834 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96e4982b-cafb-4245-9d07-b28955198211 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.122350 May 14 21:59:33.637491 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3050/6442] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 21:59:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:59:40.877822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2016016196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1749942396", "security_groups": [{"name": "tempest-secgroup-smoke-1748110835"}], "block_device_mapping_v2": [{"uuid": "b001bcfd-7605-45a8-bc29-58aed9008929", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f86b7d55-3575-4193-a313-056d6af1cf6b"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:59:40.985944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] validate_networks() for [('f86b7d55-3575-4193-a313-056d6af1cf6b', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 21:59:41.341573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 21:59:41.341952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 21:59:41.342443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 21:59:41.342981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 21:59:41.343415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 21:59:41.353410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:41.353877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:41.356998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:41.356998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:41.372915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 21:59:41.378135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Getting quotas for user 47332c347cf04b58b5857052c6468e6d and project 9f801df18eb74b818c7ef4d2e10c576f. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 21:59:41.436538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 21:59:41.438638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b001bcfd-7605-45a8-bc29-58aed9008929',volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 21:59:41.834085 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6d5a57ed-8095-45d7-bf0f-298284a55edf tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.961886 May 14 21:59:41.835287 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3051/6443] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 21:59:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 21:59:41.845365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-30cb43d6-4699-49b1-ba77-3aab9b886935 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:41.846006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-30cb43d6-4699-49b1-ba77-3aab9b886935 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:41.905612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-30cb43d6-4699-49b1-ba77-3aab9b886935 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:41.914051 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-30cb43d6-4699-49b1-ba77-3aab9b886935 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1095 microversion: 2.1 time: 0.072302 May 14 21:59:41.914632 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3052/6444] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:41 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:42.931525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:42.932163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:42.939299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:42.939828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:42.940610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:42.941063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:43.006041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:43.014299 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1e77935-a2ad-4b0b-8147-e5720e01697d tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1145 microversion: 2.1 time: 0.087479 May 14 21:59:43.014906 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3053/6445] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:42 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:44.033987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:44.034671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:44.047953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:44.048611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:44.049409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:44.049935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:44.129746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:44.138890 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-36b1795b-a55d-4a37-8f0f-37b442711255 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1211 microversion: 2.1 time: 0.109205 May 14 21:59:44.143982 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3054/6446] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:44 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1211 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:59:45.157260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:45.158111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:45.167152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:45.167835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:45.168993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:45.169778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:45.371006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:45.379388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1939d414-f5fd-4447-a36e-e267dcf77ab6 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1279 microversion: 2.1 time: 0.226405 May 14 21:59:45.385938 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3055/6447] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:45 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:45.618186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b2b9e392-423e-47a7-a7ab-0e53b46bf873 req-ec0e9089-24f9-4701-8536-23638edfa583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb96cb82-7091-4382-a910-92d33372a34b", "tag": "af5ac3e8-507c-41b9-b38e-adc49c46585c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:59:45.627662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b2b9e392-423e-47a7-a7ab-0e53b46bf873 req-ec0e9089-24f9-4701-8536-23638edfa583 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:45.628138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b2b9e392-423e-47a7-a7ab-0e53b46bf873 req-ec0e9089-24f9-4701-8536-23638edfa583 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:45.640907 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b2b9e392-423e-47a7-a7ab-0e53b46bf873 req-ec0e9089-24f9-4701-8536-23638edfa583 service nova] Creating event network-changed:af5ac3e8-507c-41b9-b38e-adc49c46585c for instance cb96cb82-7091-4382-a910-92d33372a34b on nch1-master-1 May 14 21:59:45.645913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b2b9e392-423e-47a7-a7ab-0e53b46bf873 req-ec0e9089-24f9-4701-8536-23638edfa583 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032841 May 14 21:59:45.648131 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3056/6448] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 21:59:46.398292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:46.398997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:46.405907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:46.406374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:46.407179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:46.407667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:46.731342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:46.738904 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c771a4c4-1da2-4b0b-adac-008066672cd0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1267 microversion: 2.1 time: 0.346185 May 14 21:59:46.747613 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3057/6449] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:46 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1267 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:47.756571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:47.757267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:47.764127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:47.764603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:47.765393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:47.765850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:47.895789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:47.903900 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-88de71d4-3420-4220-8b98-76d8bcd9af82 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1267 microversion: 2.1 time: 0.151228 May 14 21:59:47.904486 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3058/6450] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:47 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:48.921756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:48.922410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:48.930138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:48.930599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:48.931772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:48.931883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:49.062063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:49.069525 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-914a895f-167a-4892-8239-6cc297981088 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1267 microversion: 2.1 time: 0.151672 May 14 21:59:49.070098 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3059/6451] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:48 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:50.086503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:50.087186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:50.093986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:50.094457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:50.095242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:50.095731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:50.226289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:50.233712 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac915c20-992c-40d3-9bbb-bb7ecbfe294c tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1267 microversion: 2.1 time: 0.151249 May 14 21:59:50.234290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3060/6452] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:50 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:51.250797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:51.251467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:51.258493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:51.258964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:51.259774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:51.260234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:51.392723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:51.401115 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-84905fde-1dc1-42c3-b97d-930a20c78cab tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1267 microversion: 2.1 time: 0.154259 May 14 21:59:51.401694 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3061/6453] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:51 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:52.418811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:52.419536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:52.426003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:52.426477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:52.427252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:52.427739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:52.566726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:52.574642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-75afb030-0517-4676-ae8d-e2ddeb29dd6a tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1267 microversion: 2.1 time: 0.159811 May 14 21:59:52.575222 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3062/6454] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:52 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:52.778384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d5d5e8ef-9cd4-44cc-92ee-783f921e5961 req-920febc5-9b25-41cb-80e4-63374d41db54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb96cb82-7091-4382-a910-92d33372a34b", "name": "network-vif-plugged", "status": "completed", "tag": "af5ac3e8-507c-41b9-b38e-adc49c46585c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:59:52.786838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d5d5e8ef-9cd4-44cc-92ee-783f921e5961 req-920febc5-9b25-41cb-80e4-63374d41db54 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:52.789598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d5d5e8ef-9cd4-44cc-92ee-783f921e5961 req-920febc5-9b25-41cb-80e4-63374d41db54 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:52.798856 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d5d5e8ef-9cd4-44cc-92ee-783f921e5961 req-920febc5-9b25-41cb-80e4-63374d41db54 service nova] Creating event network-vif-plugged:af5ac3e8-507c-41b9-b38e-adc49c46585c for instance cb96cb82-7091-4382-a910-92d33372a34b on nch1-master-1 May 14 21:59:52.804062 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d5d5e8ef-9cd4-44cc-92ee-783f921e5961 req-920febc5-9b25-41cb-80e4-63374d41db54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029364 May 14 21:59:52.804671 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3063/6455] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 21:59:53.593007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:53.593779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:53.600895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:53.601373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:53.602170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:53.602637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:53.736450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:53.743886 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-81eb0c29-3df6-489d-b217-690d1d24bb63 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1267 microversion: 2.1 time: 0.156000 May 14 21:59:53.744471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3064/6456] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:53 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:54.760693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:54.761387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:54.768418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:54.768931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:54.769761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:54.770226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:54.898847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:54.906971 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09145c49-52bd-46f1-9a3e-013ad6c766d1 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1454 microversion: 2.1 time: 0.150265 May 14 21:59:54.909216 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3065/6457] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:54 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 21:59:54.923889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 21:59:54.924525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 21:59:54.931433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:54.931950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:54.932782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:54.933191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:55.062455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 21:59:55.070550 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-599d0d3d-6f7d-4b11-8304-115ea95a97c0 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1454 microversion: 2.1 time: 0.150498 May 14 21:59:55.071125 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3066/6458] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 21:59:54 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 21:59:57.388955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-3539d1b1-e638-4516-80a2-98f1cb3b77ca req-ff827b18-02ca-4734-93e8-33d948d8fe5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb96cb82-7091-4382-a910-92d33372a34b", "tag": "af5ac3e8-507c-41b9-b38e-adc49c46585c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 21:59:57.397684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3539d1b1-e638-4516-80a2-98f1cb3b77ca req-ff827b18-02ca-4734-93e8-33d948d8fe5b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 21:59:57.398147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-3539d1b1-e638-4516-80a2-98f1cb3b77ca req-ff827b18-02ca-4734-93e8-33d948d8fe5b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 21:59:57.409718 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-3539d1b1-e638-4516-80a2-98f1cb3b77ca req-ff827b18-02ca-4734-93e8-33d948d8fe5b service nova] Creating event network-changed:af5ac3e8-507c-41b9-b38e-adc49c46585c for instance cb96cb82-7091-4382-a910-92d33372a34b on nch1-master-1 May 14 21:59:57.414969 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-3539d1b1-e638-4516-80a2-98f1cb3b77ca req-ff827b18-02ca-4734-93e8-33d948d8fe5b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029748 May 14 21:59:57.415596 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3067/6459] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 21:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:01:39.114098 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:01:39.114864 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:01:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:03:15.136570 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 22:03:15.137460 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c695e059-b959-4273-91a2-45f2e7e76964] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 22:03:15.237974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cdba31c-93c7-48b0-93d6-b21056e2a8a4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:03:15.238989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cdba31c-93c7-48b0-93d6-b21056e2a8a4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:15.245832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cdba31c-93c7-48b0-93d6-b21056e2a8a4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:15.246302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cdba31c-93c7-48b0-93d6-b21056e2a8a4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:15.247078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cdba31c-93c7-48b0-93d6-b21056e2a8a4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:15.248193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cdba31c-93c7-48b0-93d6-b21056e2a8a4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:16.148882 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] [c695e059-b959-4273-91a2-45f2e7e76964] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 34902. May 14 22:03:16.149555 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 34900. May 14 22:03:16.153737 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cdba31c-93c7-48b0-93d6-b21056e2a8a4 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "POST /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b/action" status: 200 len: 24572 microversion: 2.1 time: 1.018807 May 14 22:03:16.154418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3068/6460] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:03:15 2022] POST /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b/action => generated 24572 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:03:17.132969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:17.133665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:17.140937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:17.141488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:17.142290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:17.142751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:17.168516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:03:17.403070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-029e2608-ccee-49ef-a60b-835d6a70e54e tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 204 len: 0 microversion: 2.1 time: 0.274521 May 14 22:03:17.403717 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3069/6461] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:03:17 2022] DELETE /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 22:03:17.522291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-da668f10-0f5b-45cf-9b79-965cfeecf25b req-492df100-5631-4763-a386-09a7daf95547 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb96cb82-7091-4382-a910-92d33372a34b", "tag": "af5ac3e8-507c-41b9-b38e-adc49c46585c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:03:17.532904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-da668f10-0f5b-45cf-9b79-965cfeecf25b req-492df100-5631-4763-a386-09a7daf95547 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:17.533366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-da668f10-0f5b-45cf-9b79-965cfeecf25b req-492df100-5631-4763-a386-09a7daf95547 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:17.544269 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-da668f10-0f5b-45cf-9b79-965cfeecf25b req-492df100-5631-4763-a386-09a7daf95547 service nova] Creating event network-changed:af5ac3e8-507c-41b9-b38e-adc49c46585c for instance cb96cb82-7091-4382-a910-92d33372a34b on nch1-master-1 May 14 22:03:17.549814 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-da668f10-0f5b-45cf-9b79-965cfeecf25b req-492df100-5631-4763-a386-09a7daf95547 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144035 May 14 22:03:17.550530 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3070/6462] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:03:17.555855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:17.556581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:17.563718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:17.567447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:17.567447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:17.567447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:17.755345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:17.763101 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6d596b90-56da-4e41-a9f2-5d9ccca4bea3 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1578 microversion: 2.1 time: 0.211379 May 14 22:03:17.764325 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3071/6463] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:17 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:03:18.781975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:18.782759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:18.789567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:18.790036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:18.790826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:18.791285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:19.003556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:19.011111 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-624e6107-6e20-448b-913e-bdaf2882e1bb tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1578 microversion: 2.1 time: 0.233996 May 14 22:03:19.011736 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3072/6464] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:18 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:19.625752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6d839161-6588-4203-aa7e-29f454f37553 req-5a686cb0-6ab4-4860-8ac0-5bedf87d3309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb96cb82-7091-4382-a910-92d33372a34b", "name": "network-vif-deleted", "tag": "af5ac3e8-507c-41b9-b38e-adc49c46585c"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:03:19.633912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6d839161-6588-4203-aa7e-29f454f37553 req-5a686cb0-6ab4-4860-8ac0-5bedf87d3309 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:19.634322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6d839161-6588-4203-aa7e-29f454f37553 req-5a686cb0-6ab4-4860-8ac0-5bedf87d3309 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:19.645489 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6d839161-6588-4203-aa7e-29f454f37553 req-5a686cb0-6ab4-4860-8ac0-5bedf87d3309 service nova] Creating event network-vif-deleted:af5ac3e8-507c-41b9-b38e-adc49c46585c for instance cb96cb82-7091-4382-a910-92d33372a34b on nch1-master-1 May 14 22:03:19.650270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6d839161-6588-4203-aa7e-29f454f37553 req-5a686cb0-6ab4-4860-8ac0-5bedf87d3309 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028908 May 14 22:03:19.650843 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3073/6465] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:03:20.032068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:20.033498 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:20.044955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:20.045421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:20.047224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:20.047730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:20.081745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:20.082139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:20.082612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lazy-loading 'fault' on Instance uuid cb96cb82-7091-4382-a910-92d33372a34b {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:03:20.128422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47332c347cf04b58b5857052c6468e6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f801df18eb74b818c7ef4d2e10c576f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:20.136016 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c4d27c2b-32cb-4ac4-908d-eccb4a2b1771 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 200 len: 1231 microversion: 2.1 time: 0.110782 May 14 22:03:20.136583 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3074/6466] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:20 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:21.160349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:21.161047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] [instance: cb96cb82-7091-4382-a910-92d33372a34b] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:21.167852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:21.168316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:21.169090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:21.169539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:21.187098 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] HTTP exception thrown: Instance cb96cb82-7091-4382-a910-92d33372a34b could not be found. May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Request method failure captured: May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b HTTP/1.1 May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCWEH4kWlqKxx1mlZgUtF5c1tDka1fdzB9kBfrG4oQBmvdwBfOj46Nvmo9kLD1pN62WFzHSdNpEV0XEfDG1NZX1WupsplfbxQIlk1ERvL7Z5P3OOEtgYP7vtUUS4XRyeNeX8Yx0L7VmqjJFo6zypX_UqBOOEMk1jYOuk5ZFA7JYrVwk May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestVolumeBootPattern-1752998452 May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9f801df18eb74b818c7ef4d2e10c576f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9f801df18eb74b818c7ef4d2e10c576f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestVolumeBootPattern-1752998452 May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9f801df18eb74b818c7ef4d2e10c576f May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestVolumeBootPattern-1752998452 May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestVolumeBootPattern-1752998452-project May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 47332c347cf04b58b5857052c6468e6d May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestVolumeBootPattern-1752998452-project May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance cb96cb82-7091-4382-a910-92d33372a34b could not be found. May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'cb96cb82-7091-4382-a910-92d33372a34b'} May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb96cb82-7091-4382-a910-92d33372a34b could not be found. May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb96cb82-7091-4382-a910-92d33372a34b could not be found. May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:03:21.188980 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb96cb82-7091-4382-a910-92d33372a34b could not be found. May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Returning 404 to user: Instance cb96cb82-7091-4382-a910-92d33372a34b could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8dfbf242-97c6-4464-8f78-08d9e194bf69 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b" status: 404 len: 111 microversion: 2.1 time: 0.034287 May 14 22:03:21.194566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3075/6467] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:21 2022] GET /compute/v2.1/servers/cb96cb82-7091-4382-a910-92d33372a34b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:03:29.053206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09a49299-a388-4d4e-8052-7ce35e3411b5 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] Calling method '.version_select at 0x7fb1a4753790>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:29.226526 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09a49299-a388-4d4e-8052-7ce35e3411b5 tempest-TestVolumeBootPattern-1752998452 tempest-TestVolumeBootPattern-1752998452-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1749942396" status: 202 len: 0 microversion: 2.1 time: 0.178088 May 14 22:03:29.227113 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3076/6468] 10.222.0.52 () {58 vars in 1262 bytes} [Sat May 14 22:03:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1749942396 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:03:50.396400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-725329468", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:03:50.449994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] validate_networks() for None {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:03:50.716565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:03:50.717005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:03:50.717494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:03:50.717916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:03:50.718348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:03:50.728640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:50.729112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:50.729919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:50.730373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:50.747030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Getting quotas for project fda412b109db40e2b861ef03652db7f4. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:03:50.752532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Getting quotas for user 82caa36fc4a3474caea54e96899d0193 and project fda412b109db40e2b861ef03652db7f4. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:03:50.764518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:03:50.766816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:03:50.888306 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-023184c0-9f4b-41ca-8cea-842215a90c68 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622836 May 14 22:03:50.889210 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3077/6469] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:03:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:03:50.900879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71844441-7761-407a-93b8-d030ae11e4c1 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:50.901522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71844441-7761-407a-93b8-d030ae11e4c1 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:50.959442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71844441-7761-407a-93b8-d030ae11e4c1 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:50.967022 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71844441-7761-407a-93b8-d030ae11e4c1 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1221 microversion: 2.1 time: 0.070920 May 14 22:03:50.967616 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3078/6470] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:50 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:51.984699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:51.985348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:51.992179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:51.997009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:51.997009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:51.997009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:52.055617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:52.063047 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-591b306a-0231-4dda-aa52-08636615c394 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1225 microversion: 2.1 time: 0.082350 May 14 22:03:52.063629 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3079/6471] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:51 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:53.081587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:53.082308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:53.090064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:53.090537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:53.091336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:53.091826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:53.188620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:53.197246 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0cd99dd-c1d5-4745-9c90-3bd60bb720fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1281 microversion: 2.1 time: 0.120270 May 14 22:03:53.203990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3080/6472] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:53 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1281 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:54.215221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:54.216148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:54.224295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:54.224885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:54.226067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:54.226612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:54.466637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:54.474670 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-befa20e4-8963-40bd-8fed-8f0842b64416 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1321 microversion: 2.1 time: 0.263529 May 14 22:03:54.475257 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3081/6473] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:54 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:55.118433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-898838d9-ad51-46c7-b09a-f04336544e81 req-a1bd46bb-d33d-42ca-843b-aac9daef4e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9eb884d2-76ba-45d8-9903-aad66a0b03f1", "tag": "06262602-07d6-4faa-8231-d226de9a16d9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:03:55.128123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-898838d9-ad51-46c7-b09a-f04336544e81 req-a1bd46bb-d33d-42ca-843b-aac9daef4e3c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:55.128592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-898838d9-ad51-46c7-b09a-f04336544e81 req-a1bd46bb-d33d-42ca-843b-aac9daef4e3c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:55.140242 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-898838d9-ad51-46c7-b09a-f04336544e81 req-a1bd46bb-d33d-42ca-843b-aac9daef4e3c service nova] Creating event network-changed:06262602-07d6-4faa-8231-d226de9a16d9 for instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 on nch2-master-1 May 14 22:03:55.145878 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-898838d9-ad51-46c7-b09a-f04336544e81 req-a1bd46bb-d33d-42ca-843b-aac9daef4e3c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033179 May 14 22:03:55.146495 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3082/6474] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:03:55.493184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:55.493921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:55.500470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:55.500945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:55.501741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:55.502201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:55.713927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:55.718238 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f23c216c-f06f-421d-aad4-1b9cddbeced0 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1321 microversion: 2.1 time: 0.230282 May 14 22:03:55.718817 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3083/6475] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:55 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:56.735205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:56.735945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:56.743695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:56.744199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:56.744995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:56.745453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:56.896462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:56.904213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-206131fd-37b9-4040-a22a-303d87db8333 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1321 microversion: 2.1 time: 0.173079 May 14 22:03:56.904806 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3084/6476] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:56 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:57.922124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:57.922812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:57.930153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:57.930600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:57.931383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:57.931863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:58.066837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:58.074476 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-855fe12f-aa04-4820-af6c-3d4eae26426d tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1321 microversion: 2.1 time: 0.156552 May 14 22:03:58.075063 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3085/6477] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:57 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:59.092060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:03:59.092754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:03:59.100356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:59.100831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:59.101621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:59.102077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:59.232056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:03:59.239627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f70c883f-edef-48a7-a9fd-b1569066e1fe tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1321 microversion: 2.1 time: 0.151387 May 14 22:03:59.244118 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3086/6478] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:03:59 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:03:59.850316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-91e70981-128d-4635-ba5e-e0f569583549 req-812e0524-2506-46c2-9e6b-4de0509391b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb884d2-76ba-45d8-9903-aad66a0b03f1", "name": "network-vif-plugged", "status": "completed", "tag": "06262602-07d6-4faa-8231-d226de9a16d9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:03:59.859321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-91e70981-128d-4635-ba5e-e0f569583549 req-812e0524-2506-46c2-9e6b-4de0509391b5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:03:59.859815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-91e70981-128d-4635-ba5e-e0f569583549 req-812e0524-2506-46c2-9e6b-4de0509391b5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:03:59.872360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-91e70981-128d-4635-ba5e-e0f569583549 req-812e0524-2506-46c2-9e6b-4de0509391b5 service nova] Creating event network-vif-plugged:06262602-07d6-4faa-8231-d226de9a16d9 for instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 on nch2-master-1 May 14 22:03:59.877311 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-91e70981-128d-4635-ba5e-e0f569583549 req-812e0524-2506-46c2-9e6b-4de0509391b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103979 May 14 22:03:59.878618 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3087/6479] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:00.257590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:00.258300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:00.264606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:00.265075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:00.265865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:00.266323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:00.395195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:00.402696 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c0f67b02-e338-42b6-bfe2-00c2f9977510 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1321 microversion: 2.1 time: 0.150248 May 14 22:04:00.403269 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3088/6480] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:00 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:04:01.420167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:01.420853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:01.428375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:01.428852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:01.429653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:01.430119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:01.558528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:01.566046 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-92625112-f8f4-4a62-90e6-a517c6ef72ab tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1471 microversion: 2.1 time: 0.149752 May 14 22:04:01.567290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3089/6481] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:01 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:01.634202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50ae809c-0c9c-4d25-9955-d84b157dd017 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Calling method '.version_select at 0x7fb1a67fb430>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:01.698565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-50ae809c-0c9c-4d25-9955-d84b157dd017 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/9bf3acbbe0574df19e22452dabf68f0f" status: 200 len: 371 microversion: 2.1 time: 0.117584 May 14 22:04:01.699149 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3090/6482] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 22:04:01 2022] GET /compute/v2.1/os-quota-sets/9bf3acbbe0574df19e22452dabf68f0f => generated 371 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:01.709129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2ada25a4-c246-463f-8d7a-7bc7a55ff103 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1078253165", "id": 752033309, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:01.710747 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 22:04:01.710747 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 22:04:01.784017 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2ada25a4-c246-463f-8d7a-7bc7a55ff103 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.078389 May 14 22:04:01.784602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3091/6483] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:04:01 2022] POST /compute/v2.1/flavors => generated 435 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:01.795097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "752033309"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:01.796120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:01.802935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:01.803407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:01.804378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:01.804834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:01.942650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3dcfc0c990cf43ca92bf65d12775c757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf3acbbe0574df19e22452dabf68f0f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:01.949280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1078253165 {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:04:01.955762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:01.956235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:01.957217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:01.957915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:01.979946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Getting quotas for project fda412b109db40e2b861ef03652db7f4. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:04:01.985013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Getting quotas for user 82caa36fc4a3474caea54e96899d0193 and project fda412b109db40e2b861ef03652db7f4. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:04:01.999507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] ram quota exceeded for 9bf3acbbe0574df19e22452dabf68f0f, tried to resize instance. May 14 22:04:02.000069 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Request method failure captured: May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1/action HTTP/1.1 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 38 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCdGqb0Lplirz9xC1je2JFddX-kTkpYJUzql84lcJky-juKaDfWZimIBR--5OygMvJo4js6eBQ7pdy2miz2poUjfuUWWRSVPecPscy8-ne9x4fSi1rlbFeM-bMcFzvz1JgO-FlZILXRbMNJ4yKVQ4KBzfuzQez4KubdDBuK4JCScVqY May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9bf3acbbe0574df19e22452dabf68f0f May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1012860469 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9bf3acbbe0574df19e22452dabf68f0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9bf3acbbe0574df19e22452dabf68f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9bf3acbbe0574df19e22452dabf68f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9bf3acbbe0574df19e22452dabf68f0f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1012860469 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9bf3acbbe0574df19e22452dabf68f0f May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1012860469 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersAdminNegativeTestJSON-1012860469-project-admin May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 3dcfc0c990cf43ca92bf65d12775c757 May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1012860469-project-admin May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: {"resize": {"flavorRef": "752033309"}} May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '9eb884d2-76ba-45d8-9903-aad66a0b03f1', 'body': {'resize': {'flavorRef': '752033309'}}} May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:04:02.006800 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-262dba7e-8437-4903-8b2c-d02ed766c765 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1/action" status: 403 len: 118 microversion: 2.1 time: 0.216733 May 14 22:04:02.012588 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3092/6484] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:04:01 2022] POST /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1/action => generated 118 bytes in 218 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 14 22:04:02.016735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e78f7cff-97a3-486f-b35c-01cad5080f73 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:02.017526 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 22:04:02.017526 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 22:04:02.075624 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e78f7cff-97a3-486f-b35c-01cad5080f73 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/752033309" status: 202 len: 0 microversion: 2.1 time: 0.062140 May 14 22:04:02.076220 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3093/6485] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 22:04:02 2022] DELETE /compute/v2.1/flavors/752033309 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 22:04:02.083757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-463ccb28-50c2-44f2-84f4-48b75168439b tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:02.101918 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-463ccb28-50c2-44f2-84f4-48b75168439b tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021561 May 14 22:04:02.102484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3094/6486] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 22:04:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:02.118784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83b9d183-4d00-4942-a627-4f8b601f9463 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Calling method '.version_select at 0x7fb1b96dd9d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:02.185982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83b9d183-4d00-4942-a627-4f8b601f9463 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "GET /compute/v2.1/os-quota-sets/9bf3acbbe0574df19e22452dabf68f0f" status: 200 len: 371 microversion: 2.1 time: 0.070612 May 14 22:04:02.186570 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3095/6487] 10.222.0.52 () {58 vars in 1241 bytes} [Sat May 14 22:04:02 2022] GET /compute/v2.1/os-quota-sets/9bf3acbbe0574df19e22452dabf68f0f => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:02.197152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-178dd062-b53e-4ff7-b95b-6140b9897f69 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-519737923", "id": 596754529, "os-flavor-access:is_public": "True"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:02.198645 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 22:04:02.198645 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 22:04:02.258507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-178dd062-b53e-4ff7-b95b-6140b9897f69 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.065633 May 14 22:04:02.259091 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3096/6488] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:04:02 2022] POST /compute/v2.1/flavors => generated 433 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:02.269886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "596754529"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:02.270855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:02.276736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.277268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.278057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.278516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.307132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3dcfc0c990cf43ca92bf65d12775c757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf3acbbe0574df19e22452dabf68f0f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:02.313191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-519737923 {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:04:02.319642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.320120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.320951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.321412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.341783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Getting quotas for project fda412b109db40e2b861ef03652db7f4. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:04:02.346776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Getting quotas for user 82caa36fc4a3474caea54e96899d0193 and project fda412b109db40e2b861ef03652db7f4. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:04:02.359363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] cores quota exceeded for 9bf3acbbe0574df19e22452dabf68f0f, tried to resize instance. May 14 22:04:02.359951 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Request method failure captured: May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1/action HTTP/1.1 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 38 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCdGqb0Lplirz9xC1je2JFddX-kTkpYJUzql84lcJky-juKaDfWZimIBR--5OygMvJo4js6eBQ7pdy2miz2poUjfuUWWRSVPecPscy8-ne9x4fSi1rlbFeM-bMcFzvz1JgO-FlZILXRbMNJ4yKVQ4KBzfuzQez4KubdDBuK4JCScVqY May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9bf3acbbe0574df19e22452dabf68f0f May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1012860469 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,admin,member May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,admin,member May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9bf3acbbe0574df19e22452dabf68f0f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9bf3acbbe0574df19e22452dabf68f0f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9bf3acbbe0574df19e22452dabf68f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9bf3acbbe0574df19e22452dabf68f0f", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1012860469 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9bf3acbbe0574df19e22452dabf68f0f May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1012860469 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersAdminNegativeTestJSON-1012860469-project-admin May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 3dcfc0c990cf43ca92bf65d12775c757 May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1012860469-project-admin May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: {"resize": {"flavorRef": "596754529"}} May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '9eb884d2-76ba-45d8-9903-aad66a0b03f1', 'body': {'resize': {'flavorRef': '596754529'}}} May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:04:02.361920 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9e554424-55a0-45f9-8429-1e7c16bada44 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "POST /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1/action" status: 403 len: 113 microversion: 2.1 time: 0.097496 May 14 22:04:02.366862 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3097/6489] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:04:02 2022] POST /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1/action => generated 113 bytes in 99 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 14 22:04:02.373846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-461a1ac8-5cd8-4a5e-a5f7-1c81385e5456 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:02.373846 ncdv-master-1 devstack@n-api.service[130637]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 14 22:04:02.373846 ncdv-master-1 devstack@n-api.service[130637]: warnings.warn(msg) May 14 22:04:02.424684 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-461a1ac8-5cd8-4a5e-a5f7-1c81385e5456 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "DELETE /compute/v2.1/flavors/596754529" status: 202 len: 0 microversion: 2.1 time: 0.056186 May 14 22:04:02.425408 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3098/6490] 10.222.0.52 () {58 vars in 1157 bytes} [Sat May 14 22:04:02 2022] DELETE /compute/v2.1/flavors/596754529 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:04:02.432801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-720ec5a9-1a59-4817-88f7-b16e20391b38 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:02.452366 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-720ec5a9-1a59-4817-88f7-b16e20391b38 tempest-ServersAdminNegativeTestJSON-1012860469 tempest-ServersAdminNegativeTestJSON-1012860469-project-admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022946 May 14 22:04:02.452937 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3099/6491] 10.222.0.52 () {58 vars in 1145 bytes} [Sat May 14 22:04:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:02.469611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:02.470129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:02.476160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.476635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.477426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.477889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.501809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:04:02.721600 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b92f5b84-cc85-40a0-b1e4-0280aa09d16c tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 204 len: 0 microversion: 2.1 time: 0.255238 May 14 22:04:02.722215 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3100/6492] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:04:02 2022] DELETE /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:04:02.730851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:02.731653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:02.737637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.738119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.739623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:02.740084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:02.871444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:02.879623 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8fe66e3e-b5d4-4aa7-b32d-0a9c885a958a tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1477 microversion: 2.1 time: 0.152146 May 14 22:04:02.880209 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3101/6493] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:02 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:03.896385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:03.897048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:03.903960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:03.904434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:03.905222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:03.905678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:04.073293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:04.080887 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5887a35-ed7e-4144-8498-1f829987fe10 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1477 microversion: 2.1 time: 0.188506 May 14 22:04:04.081670 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3102/6494] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:03 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1477 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:04.527066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f6c47924-9a4e-4b8a-85c0-d41dc5992097 req-8f1c0de3-7c88-4aab-9802-4713147dcf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9eb884d2-76ba-45d8-9903-aad66a0b03f1", "name": "network-vif-deleted", "tag": "06262602-07d6-4faa-8231-d226de9a16d9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:04.536185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f6c47924-9a4e-4b8a-85c0-d41dc5992097 req-8f1c0de3-7c88-4aab-9802-4713147dcf55 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:04.536582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f6c47924-9a4e-4b8a-85c0-d41dc5992097 req-8f1c0de3-7c88-4aab-9802-4713147dcf55 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:04.548100 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f6c47924-9a4e-4b8a-85c0-d41dc5992097 req-8f1c0de3-7c88-4aab-9802-4713147dcf55 service nova] Creating event network-vif-deleted:06262602-07d6-4faa-8231-d226de9a16d9 for instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 on nch2-master-1 May 14 22:04:04.553228 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f6c47924-9a4e-4b8a-85c0-d41dc5992097 req-8f1c0de3-7c88-4aab-9802-4713147dcf55 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030194 May 14 22:04:04.553785 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3103/6495] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:05.100531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:05.101512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:05.107816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:05.108280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:05.109057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:05.109506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:05.140803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:05.141270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:05.141738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lazy-loading 'fault' on Instance uuid 9eb884d2-76ba-45d8-9903-aad66a0b03f1 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:04:05.185290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82caa36fc4a3474caea54e96899d0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fda412b109db40e2b861ef03652db7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:05.190333 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a5e22c1-2bac-47c7-9f1d-84f2a07eeb79 tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 200 len: 1311 microversion: 2.1 time: 0.095718 May 14 22:04:05.190897 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3104/6496] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:05 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:04:06.208996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:06.209661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] [instance: 9eb884d2-76ba-45d8-9903-aad66a0b03f1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:06.216441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:06.216907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:06.217686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:06.218135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:06.232514 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] HTTP exception thrown: Instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 could not be found. May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Request method failure captured: May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 HTTP/1.1 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCdFoAaVkkMbiYe5Bu8UwRAPN8M72ClD0epf86Y1R8R0W3Lxj_XKQ-JLJA9qJpIiUD_QipejPocOai9q5LVyvcrOc5O4OiNkQ4T63qgD2LZnJEGxMJY45b1JlleUWUfrqhcUxHZ9gc6vqqbCRTBe6S3hiEcoqP8ASHYdMQHAmqKoXHc May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: fda412b109db40e2b861ef03652db7f4 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1313495445 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fda412b109db40e2b861ef03652db7f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/fda412b109db40e2b861ef03652db7f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/fda412b109db40e2b861ef03652db7f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_fda412b109db40e2b861ef03652db7f4", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1313495445 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: fda412b109db40e2b861ef03652db7f4 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1313495445 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersAdminNegativeTestJSON-1313495445-project May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 82caa36fc4a3474caea54e96899d0193 May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1313495445-project May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 could not be found. May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '9eb884d2-76ba-45d8-9903-aad66a0b03f1'} May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 could not be found. May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 could not be found. May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:06.234152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 could not be found. May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] Returning 404 to user: Instance 9eb884d2-76ba-45d8-9903-aad66a0b03f1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-622e3ff7-f1e2-4825-bcac-568cf50be6fb tempest-ServersAdminNegativeTestJSON-1313495445 tempest-ServersAdminNegativeTestJSON-1313495445-project] 10.222.0.52 "GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1" status: 404 len: 111 microversion: 2.1 time: 0.031344 May 14 22:04:06.240637 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3105/6497] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:06 2022] GET /compute/v2.1/servers/9eb884d2-76ba-45d8-9903-aad66a0b03f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:04:10.956630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-968679926", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "b6225137-5e54-45bd-8827-d22bb1135ebe"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:11.007170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] validate_networks() for [('b6225137-5e54-45bd-8827-d22bb1135ebe', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:04:11.354149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:04:11.354589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:04:11.355080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:04:11.355563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:04:11.355989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:04:11.365274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:11.365737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:11.366549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:11.367001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:11.383354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Getting quotas for project 3c99987d1aff4bdab1f5c51729d01452. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:04:11.388487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Getting quotas for user 920f7adb7bf84781928e6fcfe82dad0c and project 3c99987d1aff4bdab1f5c51729d01452. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:04:11.400550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:04:11.402817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:04:11.523271 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec5a7594-149d-46f8-96f0-15bf99e544c3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682324 May 14 22:04:11.524057 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3106/6498] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:04:11.534405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19d23663-e3c8-4c12-a429-f1bc7ed196bb tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:11.536259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-19d23663-e3c8-4c12-a429-f1bc7ed196bb tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:11.590110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-19d23663-e3c8-4c12-a429-f1bc7ed196bb tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:11.596697 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19d23663-e3c8-4c12-a429-f1bc7ed196bb tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1214 microversion: 2.1 time: 0.066509 May 14 22:04:11.597270 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3107/6499] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:11 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:12.614812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:12.615519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:12.622260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:12.622730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:12.623540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:12.624018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:12.684645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:12.692928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23bd58f9-928e-4af8-889d-3ea55cc056d4 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1218 microversion: 2.1 time: 0.082503 May 14 22:04:12.693542 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3108/6500] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:12 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:13.711209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:13.713177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:13.720470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:13.720938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:13.721721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:13.722321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:13.816743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:13.826776 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ac921ce-fd46-42d3-a70f-a265d288cd5f tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1284 microversion: 2.1 time: 0.121099 May 14 22:04:13.828032 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3109/6501] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:13 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:14.845131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:14.845872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:14.853306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:14.853780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:14.854584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:14.855044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:15.042528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:15.050278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8693b079-e1be-4287-9df6-160623488cae tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1314 microversion: 2.1 time: 0.208998 May 14 22:04:15.050856 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3110/6502] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:14 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:15.149256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8645268b-a08e-4646-b94f-a8b62b07870a req-fadcc066-ae1b-4499-bbe8-2288cf32158f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ccdbb1f-e059-48d2-b52e-2b13a6984c07", "tag": "caea385d-35cf-470b-89ad-f48a5ed8c163"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:15.158535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8645268b-a08e-4646-b94f-a8b62b07870a req-fadcc066-ae1b-4499-bbe8-2288cf32158f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:15.159911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8645268b-a08e-4646-b94f-a8b62b07870a req-fadcc066-ae1b-4499-bbe8-2288cf32158f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:15.173185 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8645268b-a08e-4646-b94f-a8b62b07870a req-fadcc066-ae1b-4499-bbe8-2288cf32158f service nova] Creating event network-changed:caea385d-35cf-470b-89ad-f48a5ed8c163 for instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 on nch2-master-1 May 14 22:04:15.182798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8645268b-a08e-4646-b94f-a8b62b07870a req-fadcc066-ae1b-4499-bbe8-2288cf32158f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037751 May 14 22:04:15.183947 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3111/6503] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:04:16.069665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:16.070360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:16.076791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:16.077263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:16.078051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:16.078512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:16.213905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:16.221450 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-741bbbcb-6435-4c8e-ade8-1dd021ed0fac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1314 microversion: 2.1 time: 0.157718 May 14 22:04:16.222028 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3112/6504] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:16 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:04:17.238209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:17.239375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:17.246444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:17.246915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:17.247736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:17.248193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:17.377214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:17.384698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc57716c-2661-4820-a6fc-4e487f77969a tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1314 microversion: 2.1 time: 0.150459 May 14 22:04:17.385278 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3113/6505] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:17 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:18.402176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:18.402865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:18.409875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:18.410340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:18.411189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:18.411671 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:18.542423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:18.550278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c5e6240-2cb0-43d2-a2ef-f8b9def8cfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1314 microversion: 2.1 time: 0.152139 May 14 22:04:18.550859 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3114/6506] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:18 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:19.568312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:19.568971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:19.575852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:19.576331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:19.577148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:19.577599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:19.706266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:19.714332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d4061484-fef9-499c-a6da-fc89ccef3cd1 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1314 microversion: 2.1 time: 0.150057 May 14 22:04:19.714927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3115/6507] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:19 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:19.831317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e09164a9-f69f-429d-ba83-216e7dfb3565 req-8e1716bf-8b28-4353-854d-13fb7376e93b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ccdbb1f-e059-48d2-b52e-2b13a6984c07", "name": "network-vif-plugged", "status": "completed", "tag": "caea385d-35cf-470b-89ad-f48a5ed8c163"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:19.840567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e09164a9-f69f-429d-ba83-216e7dfb3565 req-8e1716bf-8b28-4353-854d-13fb7376e93b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:19.841032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e09164a9-f69f-429d-ba83-216e7dfb3565 req-8e1716bf-8b28-4353-854d-13fb7376e93b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:19.852194 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e09164a9-f69f-429d-ba83-216e7dfb3565 req-8e1716bf-8b28-4353-854d-13fb7376e93b service nova] Creating event network-vif-plugged:caea385d-35cf-470b-89ad-f48a5ed8c163 for instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 on nch2-master-1 May 14 22:04:19.857035 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e09164a9-f69f-429d-ba83-216e7dfb3565 req-8e1716bf-8b28-4353-854d-13fb7376e93b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029534 May 14 22:04:19.857631 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3116/6508] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:20.732647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:20.733372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:20.740406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:20.740884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:20.741667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:20.742126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:20.878047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:20.886171 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9cdbc214-588e-4dbd-a0a8-d37465192d38 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1314 microversion: 2.1 time: 0.158631 May 14 22:04:20.886759 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3117/6509] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:20 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:21.903637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:21.904334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:21.911406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:21.912486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:21.913276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:21.913736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:22.039718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:22.047139 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a801c7be-ad16-4827-b1e5-ea19784471d2 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1500 microversion: 2.1 time: 0.147492 May 14 22:04:22.047746 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3118/6510] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:21 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1500 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:22.063869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:22.064875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:22.071174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:22.071686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:22.072519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:22.074261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:22.153369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:22.159740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:04:22.166696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:04:22.167135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:04:22.167665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:04:22.171962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:04:22.171962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:04:22.370732 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b1140442-34c0-41e8-9818-e42b2b451d66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "POST /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07/action" status: 202 len: 0 microversion: 2.1 time: 0.310531 May 14 22:04:22.371692 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3119/6511] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:04:22 2022] POST /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:04:22.380315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:22.381467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:22.391328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:22.393598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:22.393598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:22.393922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:22.534397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:22.543097 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8c8fa1d-892f-4a38-8dd2-63b6672c72c8 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1509 microversion: 2.1 time: 0.166824 May 14 22:04:22.543718 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3120/6512] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:22 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:23.560132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:23.560803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:23.567681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:23.568681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:23.570074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:23.570822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:23.704699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:23.712691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f924967-9be3-40e0-ba50-39373eb132fe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1509 microversion: 2.1 time: 0.156430 May 14 22:04:23.715966 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3121/6513] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:23 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:24.731042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:24.731750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:24.738497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:24.738962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:24.739771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:24.740221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:24.962851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:24.970832 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a1dce77a-8271-4b31-b2ea-4cac422c1242 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1509 microversion: 2.1 time: 0.243632 May 14 22:04:24.971559 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3122/6514] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:24 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1509 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:04:25.988762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:25.989410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:25.997603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:25.998065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:25.998835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:25.999285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:26.128608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:26.137425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6bb0e9db-84dd-4b79-909f-228ea89ce2d9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.152548 May 14 22:04:26.138004 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3123/6515] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:25 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:27.155728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:27.156445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:27.164083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:27.164556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:27.165349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:27.165809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:27.297016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:27.305035 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dbede0a5-82b7-4038-a633-8a452dfd7b55 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.153220 May 14 22:04:27.305605 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3124/6516] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:27 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:28.322096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:28.322750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:28.329417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:28.329887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:28.330667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:28.331122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:28.462534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:28.469899 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de21b99b-9873-4b28-8cfe-e32b12d6febe tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.151875 May 14 22:04:28.470471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3125/6517] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:28 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:29.487645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:29.488310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:29.496891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:29.497360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:29.498180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:29.498639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:29.910242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:29.918491 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a73c159e-5544-4f20-b4a2-aa04301ed908 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.434731 May 14 22:04:29.919081 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3126/6518] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:29 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:30.935596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:30.936229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:30.942950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:30.943737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:30.944552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:30.945006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:31.076314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:31.084241 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f61f824-e8f8-46e7-a2ae-1a6011193c5e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.152316 May 14 22:04:31.084838 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3127/6519] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:30 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:32.101482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:32.102160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:32.108918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:32.109392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:32.110184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:32.110648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:32.240727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:32.248347 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a3ce79e-6743-4e08-be7f-b7eef0945d57 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.151068 May 14 22:04:32.248920 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3128/6520] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:32 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:33.265324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:33.265989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:33.273590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:33.274067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:33.274858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:33.275318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:33.406254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:33.414367 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f8636821-ff54-45ee-83a8-bc6b041bb35e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.153027 May 14 22:04:33.414945 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3129/6521] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:33 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:34.432278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:34.432946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:34.439777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:34.440260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:34.441054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:34.441515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:34.581799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:34.589400 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-308c9643-655e-4dcc-b4a0-8c19a6e42918 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.161871 May 14 22:04:34.589973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3130/6522] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:34 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:35.606310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:35.606991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:35.613660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:35.614132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:35.614948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:35.615453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:35.751268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:35.759535 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-efc5172b-72f9-42f1-9207-324782ba3115 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.157277 May 14 22:04:35.760122 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3131/6523] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:35 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:36.776552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:36.777266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:36.784340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:36.784820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:36.785614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:36.786076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:36.918758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:36.926420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ecd07da5-5584-440d-80c0-45706787cb77 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.153805 May 14 22:04:36.927006 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3132/6524] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:36 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:37.943599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:37.944248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:37.951132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:37.951652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:37.952445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:37.952909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:38.080878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:38.089121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bc9d44b-7384-4428-8f83-ef1fb4346c66 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.149511 May 14 22:04:38.089734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3133/6525] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:37 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:39.106472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:39.107169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:39.114013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:39.114485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:39.116061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:39.116446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:39.247564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:39.254272 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6894341c-0933-439c-9eff-a8ff1872a16c tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.151724 May 14 22:04:39.254847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3134/6526] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:39 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:40.271113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:40.272216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:40.278976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:40.279444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:40.280258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:40.280711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:40.409823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:40.417374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03067567-f8a6-4f6d-ae74-04ed9b915f07 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.150336 May 14 22:04:40.417947 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3135/6527] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:40 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:41.433996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:41.434656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:41.441578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:41.445492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:41.445492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:41.445492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:41.575252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:41.582930 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0f80ded-0b52-4a8b-a5b5-5795bccbf350 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.152865 May 14 22:04:41.583534 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3136/6528] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:41 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:42.600608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:42.601260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:42.608177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:42.608654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:42.609449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:42.609909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:42.741655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:42.749103 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ce75a34-795b-4b79-b736-792e5698dfc3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.152568 May 14 22:04:42.749684 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3137/6529] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:42 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:43.767752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:43.768478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:43.776561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:43.777038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:43.777835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:43.778325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:43.906540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:43.914534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-460885ee-ef7f-4c22-b2e1-22d8051de8f9 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.150700 May 14 22:04:43.915412 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3138/6530] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:43 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:44.932455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:44.933093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:44.940213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:44.940722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:44.941514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:44.942004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:45.073513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:45.081700 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fcaa95a8-cb51-4b29-989b-976828c263ac tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.153148 May 14 22:04:45.082306 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3139/6531] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:44 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:46.100268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:46.100268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:46.107057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:46.107559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:46.108345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:46.108802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:46.242695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:46.244721 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1b2ff5c4-52cf-475d-902d-633d04d01b7b tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.149174 May 14 22:04:46.245309 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3140/6532] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:46 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:47.262056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:47.262753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:47.269540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:47.270010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:47.271317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:47.271867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:47.405070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:47.412912 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4eabde02-7a6f-41ca-b83b-e47882c16517 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.154838 May 14 22:04:47.413492 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3141/6533] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:47 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:48.430616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:48.431290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:48.438160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:48.438631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:48.439425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:48.439909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:48.570622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:48.578453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-923f0dff-7d40-4f64-8998-f8089700ec52 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.152190 May 14 22:04:48.579050 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3142/6534] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:48 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:49.595636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:49.596278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:49.604058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:49.604532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:49.605334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:49.605788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:49.738783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:49.748154 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aaf1a34f-0fbf-425f-8260-6be402faa8aa tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.156253 May 14 22:04:49.749005 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3143/6535] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:49 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:50.765791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:50.766489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:50.773713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:50.774183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:50.774986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:50.775500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:50.906539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:50.914481 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b50cbffa-e103-44ac-b7dd-a7b00250a6e3 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.152661 May 14 22:04:50.915066 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3144/6536] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:50 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:51.932184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:51.932828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:51.939615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:51.940085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:51.940861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:51.941313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:52.072506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:52.080164 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f045e98c-5693-4092-83ab-defdc5d0aeb0 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1514 microversion: 2.1 time: 0.152610 May 14 22:04:52.080763 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3145/6537] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:51 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:04:53.081966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fece4074-7d7a-4182-9e09-b63eed8321d0 req-71cdd323-c7b6-4911-b8f8-b660c5b62d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ccdbb1f-e059-48d2-b52e-2b13a6984c07", "name": "network-vif-unplugged", "status": "completed", "tag": "caea385d-35cf-470b-89ad-f48a5ed8c163"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:53.090390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fece4074-7d7a-4182-9e09-b63eed8321d0 req-71cdd323-c7b6-4911-b8f8-b660c5b62d2d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:53.090857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fece4074-7d7a-4182-9e09-b63eed8321d0 req-71cdd323-c7b6-4911-b8f8-b660c5b62d2d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:53.104240 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fece4074-7d7a-4182-9e09-b63eed8321d0 req-71cdd323-c7b6-4911-b8f8-b660c5b62d2d service nova] Creating event network-vif-unplugged:caea385d-35cf-470b-89ad-f48a5ed8c163 for instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 on nch1-master-1 May 14 22:04:53.109925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-fece4074-7d7a-4182-9e09-b63eed8321d0 req-71cdd323-c7b6-4911-b8f8-b660c5b62d2d service nova] Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:04:53.122192 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fece4074-7d7a-4182-9e09-b63eed8321d0 req-71cdd323-c7b6-4911-b8f8-b660c5b62d2d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108219 May 14 22:04:53.122811 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3146/6538] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:53.133880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:53.133880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:53.136105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:53.136931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:53.137376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:53.137831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:53.354722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:53.362144 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0eb054c-8338-46e1-85f9-2bd3f1703287 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1513 microversion: 2.1 time: 0.238199 May 14 22:04:53.362735 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3147/6539] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:53 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:04:54.380374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:54.381024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:54.388570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:54.389049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:54.389865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:54.390333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:54.522456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:54.530024 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4b38121a-e076-44bd-8e84-c070ad46d674 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1511 microversion: 2.1 time: 0.153611 May 14 22:04:54.530602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3148/6540] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:54 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:55.139982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2da9a126-74c4-4e6e-95ca-5c708d7e8a16 req-32f21ee0-40f9-4d1c-b163-5750394bb416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ccdbb1f-e059-48d2-b52e-2b13a6984c07", "tag": "caea385d-35cf-470b-89ad-f48a5ed8c163"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:04:55.148663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2da9a126-74c4-4e6e-95ca-5c708d7e8a16 req-32f21ee0-40f9-4d1c-b163-5750394bb416 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:55.149121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2da9a126-74c4-4e6e-95ca-5c708d7e8a16 req-32f21ee0-40f9-4d1c-b163-5750394bb416 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:55.160619 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2da9a126-74c4-4e6e-95ca-5c708d7e8a16 req-32f21ee0-40f9-4d1c-b163-5750394bb416 service nova] Creating event network-changed:caea385d-35cf-470b-89ad-f48a5ed8c163 for instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 on nch1-master-1 May 14 22:04:55.166608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-2da9a126-74c4-4e6e-95ca-5c708d7e8a16 req-32f21ee0-40f9-4d1c-b163-5750394bb416 service nova] Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:04:55.177062 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2da9a126-74c4-4e6e-95ca-5c708d7e8a16 req-32f21ee0-40f9-4d1c-b163-5750394bb416 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040800 May 14 22:04:55.177640 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3149/6541] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:04:55.549299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:55.549952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:55.556633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:55.557127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:55.557966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:55.558430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:56.065119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:56.073521 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-035a4f24-be9b-4cca-8675-bb991b69ff39 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1511 microversion: 2.1 time: 0.529620 May 14 22:04:56.074381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3150/6542] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:55 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1511 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:57.092102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:57.092731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:57.099402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:57.099987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:57.100837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:57.101297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:57.236167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:57.243808 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afb154c0-e5b0-4613-a27e-31b795dcce2e tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1508 microversion: 2.1 time: 0.155735 May 14 22:04:57.255671 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3151/6543] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:57 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:04:57.260027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:57.260539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:57.266194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:57.266743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:57.267569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:57.268028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:57.294685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:04:57.380744 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Found an unconfirmed migration during delete, id: 16, status: finished May 14 22:04:59.367495 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5887abe9-3f19-4b83-a65f-17d023bacf89 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 204 len: 0 microversion: 2.1 time: 2.111417 May 14 22:04:59.368138 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3152/6544] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:04:57 2022] DELETE /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 0 bytes in 2113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:04:59.376691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:04:59.377422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:04:59.384072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:59.384551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:59.385349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:04:59.385813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:04:59.515055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:04:59.522774 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc3dbdfc-bad1-4e4c-9977-d524117aba58 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1500 microversion: 2.1 time: 0.150130 May 14 22:04:59.523361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3153/6545] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:04:59 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1500 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:00.297345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ec451a3b-992e-4ba4-b1b8-ba6ab9d1b4f0 req-528b4cfc-c3e0-4c5c-a6ef-d36326b78ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ccdbb1f-e059-48d2-b52e-2b13a6984c07", "name": "network-vif-plugged", "status": "completed", "tag": "caea385d-35cf-470b-89ad-f48a5ed8c163"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:00.306082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ec451a3b-992e-4ba4-b1b8-ba6ab9d1b4f0 req-528b4cfc-c3e0-4c5c-a6ef-d36326b78ca4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:00.306553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ec451a3b-992e-4ba4-b1b8-ba6ab9d1b4f0 req-528b4cfc-c3e0-4c5c-a6ef-d36326b78ca4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:00.318050 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ec451a3b-992e-4ba4-b1b8-ba6ab9d1b4f0 req-528b4cfc-c3e0-4c5c-a6ef-d36326b78ca4 service nova] Creating event network-vif-plugged:caea385d-35cf-470b-89ad-f48a5ed8c163 for instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 on nch1-master-1 May 14 22:05:00.325421 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ec451a3b-992e-4ba4-b1b8-ba6ab9d1b4f0 req-528b4cfc-c3e0-4c5c-a6ef-d36326b78ca4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 May 14 22:05:00.326021 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3154/6546] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:05:00.541427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:00.542264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:00.549011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:00.549762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:00.550576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:00.551035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:00.751384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:00.759929 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5a583ade-47fd-4da5-be85-4970c3373cb7 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1500 microversion: 2.1 time: 0.223651 May 14 22:05:00.760530 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3155/6547] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:00 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1500 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:01.213682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-92a3f7ec-54f3-405f-8e32-8223f2ebbe48 req-3a74d849-7868-447d-9551-78251a6b1b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ccdbb1f-e059-48d2-b52e-2b13a6984c07", "name": "network-vif-deleted", "tag": "caea385d-35cf-470b-89ad-f48a5ed8c163"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:01.222904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-92a3f7ec-54f3-405f-8e32-8223f2ebbe48 req-3a74d849-7868-447d-9551-78251a6b1b92 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:01.223367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-92a3f7ec-54f3-405f-8e32-8223f2ebbe48 req-3a74d849-7868-447d-9551-78251a6b1b92 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:01.235425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-92a3f7ec-54f3-405f-8e32-8223f2ebbe48 req-3a74d849-7868-447d-9551-78251a6b1b92 service nova] Creating event network-vif-deleted:caea385d-35cf-470b-89ad-f48a5ed8c163 for instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 on nch1-master-1 May 14 22:05:01.242170 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-92a3f7ec-54f3-405f-8e32-8223f2ebbe48 req-3a74d849-7868-447d-9551-78251a6b1b92 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 May 14 22:05:01.242635 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3156/6548] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:05:01.778424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:01.779237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:01.786316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:01.786844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:01.787658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:01.788429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:01.823598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:01.824072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:01.824543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lazy-loading 'fault' on Instance uuid 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:05:01.867904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '920f7adb7bf84781928e6fcfe82dad0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c99987d1aff4bdab1f5c51729d01452', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:01.875419 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c034d974-5124-40ac-8527-8dc412816dbf tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 200 len: 1304 microversion: 2.1 time: 0.101403 May 14 22:05:01.876062 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3157/6549] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:01 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:02.893790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:02.894507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:02.902172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:02.902644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:02.903425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:02.903910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:02.918736 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] HTTP exception thrown: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Request method failure captured: May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 HTTP/1.1 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCdaTUD-RZzpuKNSIGSdcclDvDcpafhyKTsHzgBgOXWvjiFWS7ARmX2OPv0PZviJqL_FM-WLLmnN6zMxSrdEndkFeS3tMw-JiMo-uvikrBXdHptsOZZ-3qWhVksLw0rPvdeJ0SF18bCUixygClDybB0U4ltEM57vd9QVz0cas3o7liI May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 3c99987d1aff4bdab1f5c51729d01452 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3c99987d1aff4bdab1f5c51729d01452", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 3c99987d1aff4bdab1f5c51729d01452 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-668284347-project May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 920f7adb7bf84781928e6fcfe82dad0c May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-668284347-project May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0ccdbb1f-e059-48d2-b52e-2b13a6984c07'} May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:05:02.920449 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Returning 404 to user: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-177788ed-1851-49ce-aaa6-69a1589d9de6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 404 len: 111 microversion: 2.1 time: 0.032025 May 14 22:05:02.925821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3158/6550] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:02 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:05:02.934791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:02.935316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:02.941364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:02.941840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:02.942627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:02.943087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:02.956715 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] HTTP exception thrown: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Request method failure captured: May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 HTTP/1.1 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCdaTUD-RZzpuKNSIGSdcclDvDcpafhyKTsHzgBgOXWvjiFWS7ARmX2OPv0PZviJqL_FM-WLLmnN6zMxSrdEndkFeS3tMw-JiMo-uvikrBXdHptsOZZ-3qWhVksLw0rPvdeJ0SF18bCUixygClDybB0U4ltEM57vd9QVz0cas3o7liI May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 3c99987d1aff4bdab1f5c51729d01452 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3c99987d1aff4bdab1f5c51729d01452", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 3c99987d1aff4bdab1f5c51729d01452 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-668284347-project May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 920f7adb7bf84781928e6fcfe82dad0c May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-668284347-project May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0ccdbb1f-e059-48d2-b52e-2b13a6984c07'} May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:05:02.958272 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Returning 404 to user: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-098e6844-1d92-483f-82cb-6737994e7208 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 404 len: 111 microversion: 2.1 time: 0.028734 May 14 22:05:02.963973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3159/6551] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:05:02 2022] DELETE /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:05:02.968211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:02.968840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] [instance: 0ccdbb1f-e059-48d2-b52e-2b13a6984c07] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:02.974567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:02.975730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:02.976597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:02.977065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:02.990178 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] HTTP exception thrown: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Request method failure captured: May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 HTTP/1.1 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCdaTUD-RZzpuKNSIGSdcclDvDcpafhyKTsHzgBgOXWvjiFWS7ARmX2OPv0PZviJqL_FM-WLLmnN6zMxSrdEndkFeS3tMw-JiMo-uvikrBXdHptsOZZ-3qWhVksLw0rPvdeJ0SF18bCUixygClDybB0U4ltEM57vd9QVz0cas3o7liI May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 3c99987d1aff4bdab1f5c51729d01452 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3c99987d1aff4bdab1f5c51729d01452"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3c99987d1aff4bdab1f5c51729d01452", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 3c99987d1aff4bdab1f5c51729d01452 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-DeleteServersTestJSON-668284347 May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-DeleteServersTestJSON-668284347-project May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 920f7adb7bf84781928e6fcfe82dad0c May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-DeleteServersTestJSON-668284347-project May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '0ccdbb1f-e059-48d2-b52e-2b13a6984c07'} May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:05:02.991826 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] Returning 404 to user: Instance 0ccdbb1f-e059-48d2-b52e-2b13a6984c07 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3e6679a2-10df-4e9b-9f4b-859d7bfd30b6 tempest-DeleteServersTestJSON-668284347 tempest-DeleteServersTestJSON-668284347-project] 10.222.0.52 "GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07" status: 404 len: 111 microversion: 2.1 time: 0.028498 May 14 22:05:02.997474 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3160/6552] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:02 2022] GET /compute/v2.1/servers/0ccdbb1f-e059-48d2-b52e-2b13a6984c07 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:05:06.449803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1872706779", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a502bee7-d2a4-4aa4-a6c4-34a7c7b0a2c1"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:06.500630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] validate_networks() for [('a502bee7-d2a4-4aa4-a6c4-34a7c7b0a2c1', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:05:06.838016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:05:06.838455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:05:06.838953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:05:06.839383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:05:06.839839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:05:06.848515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:06.848980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:06.849799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:06.850253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:06.867055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Getting quotas for project 9092d803ae1249baa50f6717607e8621. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:05:06.872358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Getting quotas for user ae4941f6dd4844a1b441ff43114b3f3e and project 9092d803ae1249baa50f6717607e8621. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:05:06.888330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:05:06.891234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:05:07.053762 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5ad8575f-1c3f-48da-a9eb-aec7e59329b5 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720202 May 14 22:05:07.054933 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3161/6553] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:05:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:05:07.065441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c6c93a4-6cde-4569-bdb4-2f0a97f17517 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:07.066205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c6c93a4-6cde-4569-bdb4-2f0a97f17517 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:07.128638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c6c93a4-6cde-4569-bdb4-2f0a97f17517 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:07.136072 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c6c93a4-6cde-4569-bdb4-2f0a97f17517 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1218 microversion: 2.1 time: 0.074842 May 14 22:05:07.136748 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3162/6554] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:07 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:08.153405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3814019-29ad-4d64-a760-f9df0affde54 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:08.154081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3814019-29ad-4d64-a760-f9df0affde54 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:08.207348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3814019-29ad-4d64-a760-f9df0affde54 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:08.216024 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3814019-29ad-4d64-a760-f9df0affde54 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1218 microversion: 2.1 time: 0.066557 May 14 22:05:08.216618 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3163/6555] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:08 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:09.243610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:09.243610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:09.247575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:09.248057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:09.248887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:09.249396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:09.315231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:09.323635 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e440d6b-a1af-46bd-93fa-d80e5a080eca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1270 microversion: 2.1 time: 0.089415 May 14 22:05:09.324221 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3164/6556] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:09 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:10.343455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:10.344215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:10.351622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:10.352008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:10.352800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:10.353266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:10.552942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:10.561253 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3461eede-97aa-47c6-9154-f57285acccbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1318 microversion: 2.1 time: 0.221860 May 14 22:05:10.562524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3165/6557] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:10 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:11.406970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a26f65a4-4782-4f39-9659-f34d65093bb1 req-7cf37b73-2617-451a-8649-f9bdb7f5294e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff", "tag": "3b0a4e40-6cbf-4cba-86aa-d5f493cf75de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:11.417305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a26f65a4-4782-4f39-9659-f34d65093bb1 req-7cf37b73-2617-451a-8649-f9bdb7f5294e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:11.417843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a26f65a4-4782-4f39-9659-f34d65093bb1 req-7cf37b73-2617-451a-8649-f9bdb7f5294e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:11.429882 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a26f65a4-4782-4f39-9659-f34d65093bb1 req-7cf37b73-2617-451a-8649-f9bdb7f5294e service nova] Creating event network-changed:3b0a4e40-6cbf-4cba-86aa-d5f493cf75de for instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff on nch1-master-1 May 14 22:05:11.434917 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a26f65a4-4782-4f39-9659-f34d65093bb1 req-7cf37b73-2617-451a-8649-f9bdb7f5294e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032014 May 14 22:05:11.435555 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3166/6558] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:05:11.578943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:11.579729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:11.586122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:11.586603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:11.587406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:11.587901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:11.780830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:11.789809 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc226528-fc6a-4c1c-b1a0-ff2d5d033978 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1318 microversion: 2.1 time: 0.214299 May 14 22:05:11.790436 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3167/6559] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:11 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:12.810478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:12.811147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:12.818148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:12.832456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:12.832456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:12.832456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:12.955937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:12.963629 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a399567-9d00-452f-8e3a-e61c9e2147eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1318 microversion: 2.1 time: 0.157006 May 14 22:05:12.964219 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3168/6560] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:12 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:13.980551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:13.981944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:13.988120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:13.988597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:13.989417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:13.989880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:14.118710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:14.126216 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d166527e-ccca-450f-ba6f-b26c7a0b8156 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1318 microversion: 2.1 time: 0.149831 May 14 22:05:14.126819 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3169/6561] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:13 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:15.142276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:15.142927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:15.149952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:15.150424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:15.151216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:15.151716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:15.283163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:15.291268 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8ac3b41-c7b4-4b26-8b99-7fde5570b8b4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1318 microversion: 2.1 time: 0.153036 May 14 22:05:15.291879 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3170/6562] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:15 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:16.308748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:16.309443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:16.317974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:16.318818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:16.319982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:16.320618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:16.451711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:16.459287 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-17f5806f-288f-42c8-aeb9-0b27bd69b3a2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1318 microversion: 2.1 time: 0.155055 May 14 22:05:16.459893 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3171/6563] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:16 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:16.465988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-82740167-638c-401b-a979-878d69b84f7a req-f252b4f8-4ff4-4030-8d14-b81695c3ce26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff", "name": "network-vif-plugged", "status": "completed", "tag": "3b0a4e40-6cbf-4cba-86aa-d5f493cf75de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:16.473958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-82740167-638c-401b-a979-878d69b84f7a req-f252b4f8-4ff4-4030-8d14-b81695c3ce26 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:16.474427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-82740167-638c-401b-a979-878d69b84f7a req-f252b4f8-4ff4-4030-8d14-b81695c3ce26 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:16.487241 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-82740167-638c-401b-a979-878d69b84f7a req-f252b4f8-4ff4-4030-8d14-b81695c3ce26 service nova] Creating event network-vif-plugged:3b0a4e40-6cbf-4cba-86aa-d5f493cf75de for instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff on nch1-master-1 May 14 22:05:16.493000 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-82740167-638c-401b-a979-878d69b84f7a req-f252b4f8-4ff4-4030-8d14-b81695c3ce26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030639 May 14 22:05:16.493618 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3172/6564] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:05:17.478353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:17.479088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:17.485499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:17.485973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:17.486767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:17.487230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:17.622364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:17.630145 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-20a8c074-4538-4e3d-bc98-b57d0764453d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1318 microversion: 2.1 time: 0.157027 May 14 22:05:17.630734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3173/6565] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:17 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:18.648240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:18.649012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:18.656397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:18.656871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:18.657946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:18.658407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:18.791193 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:18.800583 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82957741-284b-4cbb-a8b6-d108cf641df0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1508 microversion: 2.1 time: 0.156986 May 14 22:05:18.804864 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3174/6566] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:18 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:18.817029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:18.817755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:18.823720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:18.824204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:18.825009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:18.825476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:18.956009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:18.963437 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c78704a-7c5b-4bba-af12-47e0241a485f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1508 microversion: 2.1 time: 0.150022 May 14 22:05:18.964033 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3175/6567] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:18 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:18.979314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4e4a5b9-e92a-4c1b-ad54-9d4813a5e9b1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:18.980456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a4e4a5b9-e92a-4c1b-ad54-9d4813a5e9b1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:18.986159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e4a5b9-e92a-4c1b-ad54-9d4813a5e9b1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:18.986627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e4a5b9-e92a-4c1b-ad54-9d4813a5e9b1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:18.987400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e4a5b9-e92a-4c1b-ad54-9d4813a5e9b1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:18.987876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4e4a5b9-e92a-4c1b-ad54-9d4813a5e9b1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.102291 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4e4a5b9-e92a-4c1b-ad54-9d4813a5e9b1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "PUT /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1080 microversion: 2.1 time: 0.127157 May 14 22:05:19.102938 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3176/6568] 10.222.0.52 () {60 vars in 1255 bytes} [Sat May 14 22:05:18 2022] PUT /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1080 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:19.116188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:19.117794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:19.123857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.129660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.129660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.129660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.253673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:19.262086 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fcaa4fda-fc77-42a7-97dd-25819d0e18a4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1506 microversion: 2.1 time: 0.149557 May 14 22:05:19.262658 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3177/6569] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:19 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:05:19.278471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:19.279099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:19.285202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.285673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.286457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.286912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.414151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:19.421683 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8915e925-922b-43ea-86e8-e397e37a0404 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1506 microversion: 2.1 time: 0.146833 May 14 22:05:19.422251 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3178/6570] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:19 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:19.437255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:19.438247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:19.444101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.444762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.445693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.446152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.474054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:19.480305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:05:19.486595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:05:19.487032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:05:19.487548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:05:19.487974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:05:19.488400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:05:19.672425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a1cf7708-350b-428a-9311-b7a6851a4ca4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "POST /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff/action" status: 202 len: 0 microversion: 2.1 time: 0.238511 May 14 22:05:19.673153 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3179/6571] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:05:19 2022] POST /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:05:19.681224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:19.681890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:19.688099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.688568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.689439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:19.689901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:19.826546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:19.834476 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad391d9a-f4ee-401b-b5b4-e99408797609 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1517 microversion: 2.1 time: 0.157273 May 14 22:05:19.835862 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3180/6572] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:19 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:05:20.853882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:20.854587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:20.861765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:20.862259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:20.863032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:20.863509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:20.997895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:21.005497 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7971133-055b-434a-ab52-c139ad379547 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1517 microversion: 2.1 time: 0.156485 May 14 22:05:21.006074 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3181/6573] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:20 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:22.023577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:22.024454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:22.031232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:22.031745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:22.032550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:22.033279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:22.569132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:22.577004 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9bf22152-e322-46e6-a13c-5850b6c9a499 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1517 microversion: 2.1 time: 0.557370 May 14 22:05:22.577597 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3182/6574] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:22 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1517 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:23.594419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:23.595121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:23.601844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:23.602398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:23.603178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:23.603667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:23.732243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:23.739634 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22698b33-f094-401c-9a7b-fe944e63b896 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.149273 May 14 22:05:23.740222 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3183/6575] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:23 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:24.756575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:24.757285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:24.765026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:24.765495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:24.766278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:24.766734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:24.899864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:24.907365 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c80ddebe-f062-486f-a247-53cb5354951d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.154800 May 14 22:05:24.908227 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3184/6576] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:24 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:25.924863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:25.925542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:25.932871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:25.933345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:25.934130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:25.934585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:26.061617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:26.069084 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-66991386-809f-43ab-b7ce-471c80acd8dc tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.148190 May 14 22:05:26.069690 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3185/6577] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:25 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:27.087242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:27.087904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:27.094805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:27.095275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:27.096080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:27.096538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:27.227705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:27.235174 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86821daf-a0c7-4431-a849-14c1e36e5296 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.152976 May 14 22:05:27.235795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3186/6578] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:27 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:28.252811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:28.253470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:28.260967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:28.261438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:28.262222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:28.262677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:28.394369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:28.402402 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dfaaa14e-a860-4f88-b4af-c672c41af0b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.153666 May 14 22:05:28.403170 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3187/6579] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:28 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:29.419852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:29.420493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:29.427339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:29.427849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:29.428641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:29.429102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:29.557543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:29.565184 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0576d0bb-5759-42fe-8481-01f998a58d57 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.149261 May 14 22:05:29.565771 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3188/6580] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:29 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:30.582654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:30.583313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:30.590658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:30.591138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:30.591981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:30.592443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:30.728361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:30.735909 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e7c6c4b-3c26-426d-b3bd-021e1278f686 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.157484 May 14 22:05:30.736533 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3189/6581] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:30 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:31.752919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:31.753574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:31.761442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:31.761910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:31.762695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:31.763152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:31.892365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:31.900119 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f0a0ca2-ac0a-44a1-9cae-c380289b94b0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.151158 May 14 22:05:31.900959 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3190/6582] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:31 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:32.917376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:32.918149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:32.924945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:32.925421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:32.926221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:32.926690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:33.058308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:33.065782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-30c38ef7-b6e3-417f-bad1-8e4f9c8069e2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.152979 May 14 22:05:33.066360 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3191/6583] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:32 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:34.082959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:34.083742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:34.091156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:34.091740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:34.092533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:34.092991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:34.221907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:34.229970 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dffa730a-9483-4e0d-a10d-0ee784ed8dc6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.150915 May 14 22:05:34.230560 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3192/6584] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:34 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:05:35.247653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:35.247653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:35.254006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:35.254517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:35.255327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:35.255803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:35.385020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:35.392534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0c7e5744-c8b7-4b91-abb0-47017d34be0f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.150176 May 14 22:05:35.393125 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3193/6585] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:35 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:36.412262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:36.412922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:36.419800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:36.420269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:36.421053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:36.421505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:36.552378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:36.560320 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-535d581c-a3ab-4db9-b827-d44412e41d74 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.152331 May 14 22:05:36.560910 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3194/6586] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:36 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:37.577832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:37.578504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:37.585276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:37.585746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:37.586528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:37.586980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:37.716422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:37.724119 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-421ee500-48f2-4ec2-a8d3-e4b45a7c2f27 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.150191 May 14 22:05:37.724743 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3195/6587] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:37 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:38.741392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:38.742072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:38.748954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:38.749431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:38.750224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:38.750692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:38.894228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:38.904701 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fbf6ce3f-2988-4b51-b061-3b6c2d66ad5d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1522 microversion: 2.1 time: 0.167309 May 14 22:05:38.907303 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3196/6588] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:38 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:39.929233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:39.929925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:39.937574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:39.938702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:39.938856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:39.939261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:40.145748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:40.154693 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3521554-46ac-46a2-8faf-78f846466868 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1521 microversion: 2.1 time: 0.229414 May 14 22:05:40.155296 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3197/6589] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:39 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:40.469605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-4c5ec1de-d0e3-4ee3-9a3b-bcd6b1817339 req-3f415863-8070-4254-b69a-10d5c7c95e52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff", "name": "network-vif-unplugged", "status": "completed", "tag": "3b0a4e40-6cbf-4cba-86aa-d5f493cf75de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:40.476735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4c5ec1de-d0e3-4ee3-9a3b-bcd6b1817339 req-3f415863-8070-4254-b69a-10d5c7c95e52 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:40.477246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4c5ec1de-d0e3-4ee3-9a3b-bcd6b1817339 req-3f415863-8070-4254-b69a-10d5c7c95e52 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:40.489151 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-4c5ec1de-d0e3-4ee3-9a3b-bcd6b1817339 req-3f415863-8070-4254-b69a-10d5c7c95e52 service nova] Creating event network-vif-unplugged:3b0a4e40-6cbf-4cba-86aa-d5f493cf75de for instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff on nch2-master-1 May 14 22:05:40.494434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-4c5ec1de-d0e3-4ee3-9a3b-bcd6b1817339 req-3f415863-8070-4254-b69a-10d5c7c95e52 service nova] Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:05:40.505414 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-4c5ec1de-d0e3-4ee3-9a3b-bcd6b1817339 req-3f415863-8070-4254-b69a-10d5c7c95e52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040493 May 14 22:05:40.506254 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3198/6590] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:05:41.174359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:41.175226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:41.181983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:41.182529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:41.183332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:41.183820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:41.366824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:41.375420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a674f3b1-63fb-4339-9acd-b16b90089fa3 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1521 microversion: 2.1 time: 0.206306 May 14 22:05:41.376820 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3199/6591] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:41 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:42.393366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:42.394003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:42.400856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:42.401324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:42.402135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:42.402590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:42.541046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:42.548746 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1068bdb1-4d5e-4615-8ab4-93e14d03d4eb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1519 microversion: 2.1 time: 0.159391 May 14 22:05:42.549328 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3200/6592] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:42 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:42.553746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0a84f5c7-2098-4e2f-8c99-c93cbb6c61e2 req-9c8c7b4d-51d3-4f44-8257-f542949b8e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff", "tag": "3b0a4e40-6cbf-4cba-86aa-d5f493cf75de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:42.562281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0a84f5c7-2098-4e2f-8c99-c93cbb6c61e2 req-9c8c7b4d-51d3-4f44-8257-f542949b8e2f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:42.562756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0a84f5c7-2098-4e2f-8c99-c93cbb6c61e2 req-9c8c7b4d-51d3-4f44-8257-f542949b8e2f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:42.575310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0a84f5c7-2098-4e2f-8c99-c93cbb6c61e2 req-9c8c7b4d-51d3-4f44-8257-f542949b8e2f service nova] Creating event network-changed:3b0a4e40-6cbf-4cba-86aa-d5f493cf75de for instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff on nch2-master-1 May 14 22:05:42.580649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-0a84f5c7-2098-4e2f-8c99-c93cbb6c61e2 req-9c8c7b4d-51d3-4f44-8257-f542949b8e2f service nova] Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:05:42.591213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0a84f5c7-2098-4e2f-8c99-c93cbb6c61e2 req-9c8c7b4d-51d3-4f44-8257-f542949b8e2f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040749 May 14 22:05:42.591844 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3201/6593] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:05:43.567851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:43.568669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:43.575781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:43.576253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:43.577038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:43.577495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:43.708655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:43.715668 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d56f2bf7-4054-4d10-9243-8ca9681878c7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1516 microversion: 2.1 time: 0.152889 May 14 22:05:43.716258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3202/6594] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:43 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:43.732476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-091e8e4a-e8de-4279-9f07-8f8439187fb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:43.733030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-091e8e4a-e8de-4279-9f07-8f8439187fb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:43.738951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091e8e4a-e8de-4279-9f07-8f8439187fb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:43.739535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091e8e4a-e8de-4279-9f07-8f8439187fb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:43.740321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091e8e4a-e8de-4279-9f07-8f8439187fb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:43.740777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091e8e4a-e8de-4279-9f07-8f8439187fb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:43.878782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-091e8e4a-e8de-4279-9f07-8f8439187fb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "POST /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff/action" status: 204 len: 0 microversion: 2.1 time: 0.150351 May 14 22:05:43.879372 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3203/6595] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:05:43 2022] POST /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff/action => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:05:43.888472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:43.889210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:43.895454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:43.895970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:43.896772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:43.897242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:44.085696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:44.096215 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9807dcfc-f259-4098-bc01-3d8f46f787ca tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1516 microversion: 2.1 time: 0.212414 May 14 22:05:44.097330 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3204/6596] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:43 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1516 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:45.114495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:45.115140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:45.122450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:45.122927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:45.123752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:45.124224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:45.256495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:45.265216 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4cd72f40-9814-4d0b-8e18-58969e84bff0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1516 microversion: 2.1 time: 0.154794 May 14 22:05:45.266023 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3205/6597] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:45 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:46.173914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f8edc610-45e9-4d5e-9292-a5b37dbef5e5 req-cc4d7c7a-ce14-4f05-b313-539e31088c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff", "name": "network-vif-plugged", "status": "completed", "tag": "3b0a4e40-6cbf-4cba-86aa-d5f493cf75de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:46.181858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f8edc610-45e9-4d5e-9292-a5b37dbef5e5 req-cc4d7c7a-ce14-4f05-b313-539e31088c51 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.182324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f8edc610-45e9-4d5e-9292-a5b37dbef5e5 req-cc4d7c7a-ce14-4f05-b313-539e31088c51 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.194360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f8edc610-45e9-4d5e-9292-a5b37dbef5e5 req-cc4d7c7a-ce14-4f05-b313-539e31088c51 service nova] Creating event network-vif-plugged:3b0a4e40-6cbf-4cba-86aa-d5f493cf75de for instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff on nch2-master-1 May 14 22:05:46.200571 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f8edc610-45e9-4d5e-9292-a5b37dbef5e5 req-cc4d7c7a-ce14-4f05-b313-539e31088c51 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 May 14 22:05:46.201178 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3206/6598] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:05:46.283807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:46.284457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:46.293827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.293827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.294534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.294997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.428394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:46.436183 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b3773dc-b9be-49a1-acc6-1220c888ce04 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1508 microversion: 2.1 time: 0.157147 May 14 22:05:46.436774 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3207/6599] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:46 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:05:46.452262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:46.452897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:46.458584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.459055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.459866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.460329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.589471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:46.602215 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba662f0a-d93d-4401-8337-869c45b4ee86 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1508 microversion: 2.1 time: 0.154030 May 14 22:05:46.602793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3208/6600] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:46 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:46.619144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:46.619828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:46.626768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.627240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.628059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.628515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.760071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:46.767857 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2ca1d572-676f-43b9-8506-ee22678a51f4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 200 len: 1508 microversion: 2.1 time: 0.152765 May 14 22:05:46.768433 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3209/6601] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:46 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:46.783912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:46.784427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:46.790198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.790667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.791447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:46.791979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:46.817500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:05:47.034226 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76839533-d245-48ba-8482-b623f0f59d44 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 204 len: 0 microversion: 2.1 time: 0.253840 May 14 22:05:47.034833 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3210/6602] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:05:46 2022] DELETE /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:05:47.089007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1650749808", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a502bee7-d2a4-4aa4-a6c4-34a7c7b0a2c1"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:47.140656 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] validate_networks() for [('a502bee7-d2a4-4aa4-a6c4-34a7c7b0a2c1', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:05:47.496250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:05:47.496822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:05:47.497184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:05:47.497623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:05:47.498060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:05:47.506918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:47.507416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:47.508459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:47.508923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:47.525703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Getting quotas for project 9092d803ae1249baa50f6717607e8621. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:05:47.531566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Getting quotas for user ae4941f6dd4844a1b441ff43114b3f3e and project 9092d803ae1249baa50f6717607e8621. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:05:47.544784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:05:47.547176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:05:47.646984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9417da1d-142d-4713-987a-7a2bb2bf218e tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562124 May 14 22:05:47.647760 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3211/6603] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:05:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:05:47.657654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9c7a107f-e61c-4bc0-9620-7c47bcb8bc28 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:47.658560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9c7a107f-e61c-4bc0-9620-7c47bcb8bc28 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:47.718659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9c7a107f-e61c-4bc0-9620-7c47bcb8bc28 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:47.726938 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9c7a107f-e61c-4bc0-9620-7c47bcb8bc28 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1218 microversion: 2.1 time: 0.071788 May 14 22:05:47.726938 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3212/6604] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:47 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:48.744020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:48.744655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:48.752730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:48.753204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:48.754002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:48.754463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:48.848778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:48.857960 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db6f9af2-9136-4d73-8ffc-d3553421081b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1222 microversion: 2.1 time: 0.117932 May 14 22:05:48.858755 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3213/6605] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:48 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:48.910138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-fb007b0a-a7fc-44a1-9a4c-998f24eaf8a0 req-173838a1-1ce3-4030-be92-fe31a22d91fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff", "name": "network-vif-deleted", "tag": "3b0a4e40-6cbf-4cba-86aa-d5f493cf75de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:48.920141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fb007b0a-a7fc-44a1-9a4c-998f24eaf8a0 req-173838a1-1ce3-4030-be92-fe31a22d91fc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:48.920751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-fb007b0a-a7fc-44a1-9a4c-998f24eaf8a0 req-173838a1-1ce3-4030-be92-fe31a22d91fc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:48.935767 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-fb007b0a-a7fc-44a1-9a4c-998f24eaf8a0 req-173838a1-1ce3-4030-be92-fe31a22d91fc service nova] Creating event network-vif-deleted:3b0a4e40-6cbf-4cba-86aa-d5f493cf75de for instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff on nch2-master-1 May 14 22:05:48.940879 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-fb007b0a-a7fc-44a1-9a4c-998f24eaf8a0 req-173838a1-1ce3-4030-be92-fe31a22d91fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034830 May 14 22:05:48.941591 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3214/6606] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:05:49.876920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:49.878423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:49.884669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:49.885428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:49.886282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:49.886746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:49.960928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:49.968564 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f0875452-287e-41af-a16f-8af9989360a7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1276 microversion: 2.1 time: 0.096975 May 14 22:05:49.969131 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3215/6607] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:49 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:05:50.956524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-76588002-3776-4060-b203-01610d387196 req-4d4a6d23-ee50-4375-8351-50009b07f259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf3c714-c8a8-4449-b147-f06904bebbf6", "tag": "bdd722e5-72e5-4897-95c7-913d01d9c066"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:50.966706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-76588002-3776-4060-b203-01610d387196 req-4d4a6d23-ee50-4375-8351-50009b07f259 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:50.967200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-76588002-3776-4060-b203-01610d387196 req-4d4a6d23-ee50-4375-8351-50009b07f259 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:50.978630 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-76588002-3776-4060-b203-01610d387196 req-4d4a6d23-ee50-4375-8351-50009b07f259 service nova] Creating event network-changed:bdd722e5-72e5-4897-95c7-913d01d9c066 for instance dbf3c714-c8a8-4449-b147-f06904bebbf6 on nch2-master-1 May 14 22:05:50.984454 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-76588002-3776-4060-b203-01610d387196 req-4d4a6d23-ee50-4375-8351-50009b07f259 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031719 May 14 22:05:50.985049 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3216/6608] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:05:50.990112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:50.990833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:50.997879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:50.998362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:50.999174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:50.999668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:51.200899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:51.208395 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2db6bba-262a-4ac0-89f9-f14cc0f0dabd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1318 microversion: 2.1 time: 0.222220 May 14 22:05:51.209019 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3217/6609] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:50 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:05:52.226103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:52.226715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:52.234878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:52.235350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:52.236292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:52.236748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:52.364157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:52.371677 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64dee076-ba70-44f6-9a6c-e8d5f8eba7d7 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1318 microversion: 2.1 time: 0.149550 May 14 22:05:52.372258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3218/6610] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:52 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:53.389084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:53.389712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:53.396537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:53.397009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:53.397801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:53.398257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:53.532751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:53.540576 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86b585e8-cd1b-4ad8-b995-973287580d42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1318 microversion: 2.1 time: 0.156068 May 14 22:05:53.541161 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3219/6611] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:53 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:54.557803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:54.558411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:54.565670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:54.566141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:54.566929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:54.567386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:54.695757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:54.704004 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c1bd2c23-07dc-4a8f-8559-914dab1ae326 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1318 microversion: 2.1 time: 0.150017 May 14 22:05:54.704581 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3220/6612] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:54 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:55.720949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:55.721594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:55.728818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:55.729295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:55.730103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:55.730848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:55.858111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:55.865896 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59374297-f8c9-4391-abcd-774fcc3908bf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1318 microversion: 2.1 time: 0.148981 May 14 22:05:55.866476 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3221/6613] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:55 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:56.159705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6f2bdb10-31c3-465e-850d-0aa8764adea1 req-1aaa8c9e-aa49-4f0a-93d6-5cacdfd8db36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf3c714-c8a8-4449-b147-f06904bebbf6", "name": "network-vif-plugged", "status": "completed", "tag": "bdd722e5-72e5-4897-95c7-913d01d9c066"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:56.167635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6f2bdb10-31c3-465e-850d-0aa8764adea1 req-1aaa8c9e-aa49-4f0a-93d6-5cacdfd8db36 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:56.168684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6f2bdb10-31c3-465e-850d-0aa8764adea1 req-1aaa8c9e-aa49-4f0a-93d6-5cacdfd8db36 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:56.179627 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6f2bdb10-31c3-465e-850d-0aa8764adea1 req-1aaa8c9e-aa49-4f0a-93d6-5cacdfd8db36 service nova] Creating event network-vif-plugged:bdd722e5-72e5-4897-95c7-913d01d9c066 for instance dbf3c714-c8a8-4449-b147-f06904bebbf6 on nch2-master-1 May 14 22:05:56.185356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6f2bdb10-31c3-465e-850d-0aa8764adea1 req-1aaa8c9e-aa49-4f0a-93d6-5cacdfd8db36 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029690 May 14 22:05:56.185941 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3222/6614] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:05:56.891208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:56.892048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:56.898333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:56.898812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:56.899642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:56.900106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:57.029163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:57.036949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4b2b5dcc-534e-4534-a2b5-d0c29f9c0431 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1318 microversion: 2.1 time: 0.156591 May 14 22:05:57.037527 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3223/6615] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:56 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:05:58.054169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:58.054806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:58.062490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.062971 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.063814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.064283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.197319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:58.205455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14997ce5-c3f9-498b-bceb-57da37439ff9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1509 microversion: 2.1 time: 0.155216 May 14 22:05:58.206050 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3224/6616] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:58 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:58.221105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:58.221756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:58.227604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.228080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.228875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.229343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.358279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:58.366069 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bfaf6bbe-2a80-43fd-b759-a75e47f08f53 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1509 microversion: 2.1 time: 0.148585 May 14 22:05:58.366653 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3225/6617] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:58 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:58.382242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:05:58.383248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:58.389232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.389713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.390506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.390965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.419902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:58.425960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:05:58.432421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:05:58.432868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:05:58.433366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:05:58.434885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:05:58.435326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:05:58.643172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ca4ee50b-cf18-4f42-81f2-106e15896f40 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "POST /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6/action" status: 202 len: 0 microversion: 2.1 time: 0.264284 May 14 22:05:58.643765 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3226/6618] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:05:58 2022] POST /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:05:58.651820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:58.652461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:58.661040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.661514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.662321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:58.662774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:58.797176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:58.804838 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1699968-268e-4cd5-9cb4-6abb61358a7f tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1516 microversion: 2.1 time: 0.156885 May 14 22:05:58.805427 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3227/6619] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:58 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:05:59.822296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:05:59.822924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:05:59.831177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:59.831688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:59.832475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:05:59.832934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:05:59.966240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:05:59.976575 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e5894e9f-f549-4ed6-9ff8-e9d761c8fbc4 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1516 microversion: 2.1 time: 0.158297 May 14 22:05:59.977271 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3228/6620] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:05:59 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:00.994194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:00.994847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:01.002628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:01.003106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:01.004017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:01.004496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:01.257412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:01.265940 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5f3af311-8a13-457a-9157-c429cb730235 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1516 microversion: 2.1 time: 0.275671 May 14 22:06:01.266534 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3229/6621] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:00 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:02.284787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:02.285400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:02.292388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:02.292864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:02.293652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:02.294130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:02.427454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:02.434945 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-68079a5c-06cd-4f24-b0a9-5d040d4803c2 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.155229 May 14 22:06:02.436748 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3230/6622] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:02 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:03.454104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:03.454848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:03.462040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:03.467463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:03.467463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:03.467463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:03.594223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:03.601737 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-51994478-5856-46ab-a859-626d7f43a100 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.152329 May 14 22:06:03.602325 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3231/6623] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:03 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:04.618940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:04.619611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:04.627218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:04.627729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:04.628528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:04.628997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:04.762199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:04.770144 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-06bee475-1292-40e3-ba57-ee6132079dbf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.155122 May 14 22:06:04.770731 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3232/6624] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:04 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:05.788308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:05.788955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:05.796770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:05.797254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:05.798089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:05.798552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:05.930266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:05.938278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1eb280ac-d9b4-4864-bb5c-08625d15d472 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.153923 May 14 22:06:05.938859 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3233/6625] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:05 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:06.954428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:06.955105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:06.962070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:06.962550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:06.963349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:06.963845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:07.097377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:07.105146 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-759b33ac-b185-415c-9ada-a28ff0183c42 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.154862 May 14 22:06:07.105731 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3234/6626] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:06 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:08.122802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:08.123508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:08.130360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:08.130838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:08.131674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:08.132143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:08.260736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:08.268955 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d93c722-90d0-439a-b2b2-7861849ebffd tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.150235 May 14 22:06:08.269553 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3235/6627] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:08 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:09.286533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:09.287132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:09.294151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:09.294622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:09.295412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:09.295982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:09.427468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:09.435866 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2dd5ec4-94da-4bf3-a816-f4881a08fdb6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.152934 May 14 22:06:09.436454 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3236/6628] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:09 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:10.453546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:10.454142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:10.461542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:10.462037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:10.462849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:10.463319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:10.598857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:10.606772 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24abcd35-53d1-4f12-94de-778f3bb75a79 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.157816 May 14 22:06:10.607361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3237/6629] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:10 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:11.623940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:11.624584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:11.631370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:11.631882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:11.632672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:11.633136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:11.763655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:11.771400 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d00604a9-43f9-4865-8f4d-8579285f7149 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.152033 May 14 22:06:11.772009 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3238/6630] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:11 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:12.788928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:12.789575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:12.796497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:12.796977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:12.797806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:12.798302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:12.940234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:12.947711 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9be96188-c7b4-4302-8ae6-7452a68a636a tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.162794 May 14 22:06:12.948292 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3239/6631] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:12 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:13.965853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:13.966569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:13.973715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:13.974223 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:13.975016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:13.975501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:14.104181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:14.112368 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ce1fe41-13f4-484a-be58-f205cfe7e355 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.150584 May 14 22:06:14.112980 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3240/6632] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:13 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:15.129094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:15.129763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:15.136560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:15.137038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:15.137896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:15.138376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:15.271058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:15.279214 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eed42e31-c844-4a45-946a-851ad7c7852b tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.153488 May 14 22:06:15.279784 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3241/6633] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:15 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:16.296879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:16.297473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:16.303451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:16.303951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:16.304736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:16.305192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:16.435379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:16.442956 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a28ba415-3334-467d-a028-c6c17c9224f0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.151113 May 14 22:06:16.443547 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3242/6634] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:16 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:17.460529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:17.461269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:17.469390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:17.470362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:17.470674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:17.471132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:17.603282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:17.610855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-943fda27-ac7e-4a8f-9c29-b57a323eab72 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.154340 May 14 22:06:17.611744 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3243/6635] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:17 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:18.628845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:18.629567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:18.636376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:18.636850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:18.637713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:18.638404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:18.774082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:18.781934 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-70cd3b54-7ca7-4578-8a20-706a3910ff68 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.157060 May 14 22:06:18.782566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3244/6636] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:18 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:06:19.798523 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:19.799196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:19.806123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:19.806592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:19.807376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:19.807858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:19.938856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:19.946452 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d4e40d2e-37c4-419d-9234-1181fe98e7ec tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.152191 May 14 22:06:19.947136 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3245/6637] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:19 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:20.964670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:20.965305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:20.972825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:20.973296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:20.974078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:20.974535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:21.106284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:21.113744 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b72094e3-8dbf-4159-8b91-989433a98eff tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.153047 May 14 22:06:21.114324 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3246/6638] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:20 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:22.130194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:22.130844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:22.137946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:22.138632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:22.139432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:22.139921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:22.268548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:22.276199 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00fddc3c-335f-47b8-a2cc-e6f4b3b7b925 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.149930 May 14 22:06:22.276875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3247/6639] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:22 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:23.294820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:23.295430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:23.302265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:23.302743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:23.303566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:23.304031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:23.437860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:23.445524 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b0f0b1f4-4f2f-481c-9e95-4df6f5c9c6a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.155309 May 14 22:06:23.446114 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3248/6640] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:23 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:24.463229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:24.463901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:24.471889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:24.472360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:24.473140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:24.473597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:24.614045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:24.621516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76e612fd-5fef-4986-8548-d685f4194091 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.162325 May 14 22:06:24.622120 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3249/6641] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:24 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:25.639332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:25.639963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:25.646668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:25.647147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:25.647950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:25.648409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:25.778562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:25.786316 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-75721f31-9b1f-4faf-b16c-5eb964ac56e1 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.152073 May 14 22:06:25.786897 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3250/6642] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:25 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:26.803263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:26.803966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:26.811468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:26.811973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:26.812770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:26.813236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:26.945482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:26.953259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-093739b9-1e32-4d4c-9792-9d384fb5a0f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.153939 May 14 22:06:26.953856 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3251/6643] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:26 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:27.970153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:27.970818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:27.977847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:27.978323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:27.979159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:27.979685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:28.109828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:28.117365 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e0c5e7a8-9dde-4ff8-bfb5-686d52def11d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1521 microversion: 2.1 time: 0.151236 May 14 22:06:28.118163 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3252/6644] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:27 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:29.134647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:29.135286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:29.142879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:29.143384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:29.144227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:29.144691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:29.298122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:29.305881 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-205ee19f-35b7-47b2-a693-d5a586ce2301 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1520 microversion: 2.1 time: 0.175175 May 14 22:06:29.315757 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3253/6645] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:29 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:29.315757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a8102ca7-8944-4510-b116-7b63997e6794 req-11c79fb9-6c8a-487c-a330-c8eb493682c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf3c714-c8a8-4449-b147-f06904bebbf6", "name": "network-vif-unplugged", "status": "completed", "tag": "bdd722e5-72e5-4897-95c7-913d01d9c066"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:29.320040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a8102ca7-8944-4510-b116-7b63997e6794 req-11c79fb9-6c8a-487c-a330-c8eb493682c2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:29.320535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a8102ca7-8944-4510-b116-7b63997e6794 req-11c79fb9-6c8a-487c-a330-c8eb493682c2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:29.333495 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a8102ca7-8944-4510-b116-7b63997e6794 req-11c79fb9-6c8a-487c-a330-c8eb493682c2 service nova] Creating event network-vif-unplugged:bdd722e5-72e5-4897-95c7-913d01d9c066 for instance dbf3c714-c8a8-4449-b147-f06904bebbf6 on nch1-master-1 May 14 22:06:29.338881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-a8102ca7-8944-4510-b116-7b63997e6794 req-11c79fb9-6c8a-487c-a330-c8eb493682c2 service nova] Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:06:29.351599 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a8102ca7-8944-4510-b116-7b63997e6794 req-11c79fb9-6c8a-487c-a330-c8eb493682c2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043898 May 14 22:06:29.352217 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3254/6646] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:06:30.324401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:30.325128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:30.331360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:30.331867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:30.332653 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:30.333117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:30.470511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:30.478008 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24c4396b-1dee-4bc3-9d0a-c187855f6991 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1520 microversion: 2.1 time: 0.159035 May 14 22:06:30.478584 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3255/6647] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:30 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:31.369827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b4260071-0003-4397-87bc-e7a31f58432d req-cffcea8c-c6d2-4b18-b34b-9de030d2205f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbf3c714-c8a8-4449-b147-f06904bebbf6", "tag": "bdd722e5-72e5-4897-95c7-913d01d9c066"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:31.379525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4260071-0003-4397-87bc-e7a31f58432d req-cffcea8c-c6d2-4b18-b34b-9de030d2205f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:31.384372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4260071-0003-4397-87bc-e7a31f58432d req-cffcea8c-c6d2-4b18-b34b-9de030d2205f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:31.392354 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b4260071-0003-4397-87bc-e7a31f58432d req-cffcea8c-c6d2-4b18-b34b-9de030d2205f service nova] Creating event network-changed:bdd722e5-72e5-4897-95c7-913d01d9c066 for instance dbf3c714-c8a8-4449-b147-f06904bebbf6 on nch1-master-1 May 14 22:06:31.397741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-b4260071-0003-4397-87bc-e7a31f58432d req-cffcea8c-c6d2-4b18-b34b-9de030d2205f service nova] Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:06:31.409250 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b4260071-0003-4397-87bc-e7a31f58432d req-cffcea8c-c6d2-4b18-b34b-9de030d2205f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043123 May 14 22:06:31.409885 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3256/6648] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:06:31.498535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:31.499270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:31.505657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:31.506213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:31.506955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:31.507409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:31.858191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:31.871683 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba990684-044c-42f6-9e48-1316796430a0 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1518 microversion: 2.1 time: 0.379101 May 14 22:06:31.873014 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3257/6649] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:31 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1518 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:32.893287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:32.893947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:32.900893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:32.901363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:32.902375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:32.902588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:33.040496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:33.048826 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-38195dad-a0cd-41a6-9a47-0dd0978619e6 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1515 microversion: 2.1 time: 0.160537 May 14 22:06:33.049419 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3258/6650] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:32 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:33.065487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-427c1a4e-77ae-42d6-9017-8906f4d37eeb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:33.066052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-427c1a4e-77ae-42d6-9017-8906f4d37eeb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:33.071905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-427c1a4e-77ae-42d6-9017-8906f4d37eeb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:33.072383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-427c1a4e-77ae-42d6-9017-8906f4d37eeb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:33.073177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-427c1a4e-77ae-42d6-9017-8906f4d37eeb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:33.073733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-427c1a4e-77ae-42d6-9017-8906f4d37eeb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:33.261149 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-427c1a4e-77ae-42d6-9017-8906f4d37eeb tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "POST /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6/action" status: 204 len: 0 microversion: 2.1 time: 0.199970 May 14 22:06:33.261805 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3259/6651] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:06:33 2022] POST /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6/action => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:06:33.270460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:33.271220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:33.277396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:33.282194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:33.282194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:33.282194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:33.454965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:33.462699 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9911b093-edc6-4f8b-aa60-12967b3ef1e8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1515 microversion: 2.1 time: 0.196273 May 14 22:06:33.463292 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3260/6652] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:33 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1515 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:34.480268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:34.480961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:34.487880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:34.488358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:34.489157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:34.489619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:34.635084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:34.638432 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a687637-5cb6-462c-bfe9-14d75da9af95 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1515 microversion: 2.1 time: 0.162124 May 14 22:06:34.639018 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3261/6653] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:34 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:34.849186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-044a34fd-1d99-4eb2-b10d-c320f19845ba req-d40dd4cf-b5e7-40f5-af81-11f0b8b4b38a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf3c714-c8a8-4449-b147-f06904bebbf6", "name": "network-vif-plugged", "status": "completed", "tag": "bdd722e5-72e5-4897-95c7-913d01d9c066"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:34.857346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-044a34fd-1d99-4eb2-b10d-c320f19845ba req-d40dd4cf-b5e7-40f5-af81-11f0b8b4b38a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:34.857819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-044a34fd-1d99-4eb2-b10d-c320f19845ba req-d40dd4cf-b5e7-40f5-af81-11f0b8b4b38a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:34.869438 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-044a34fd-1d99-4eb2-b10d-c320f19845ba req-d40dd4cf-b5e7-40f5-af81-11f0b8b4b38a service nova] Creating event network-vif-plugged:bdd722e5-72e5-4897-95c7-913d01d9c066 for instance dbf3c714-c8a8-4449-b147-f06904bebbf6 on nch1-master-1 May 14 22:06:34.874837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-044a34fd-1d99-4eb2-b10d-c320f19845ba req-d40dd4cf-b5e7-40f5-af81-11f0b8b4b38a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028974 May 14 22:06:34.875627 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3262/6654] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:06:35.657934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:35.658846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:35.665180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:35.665657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:35.666433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:35.666888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:35.798351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:35.805915 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a5028d3b-0178-4ecf-b0af-8bef128ac811 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1507 microversion: 2.1 time: 0.153293 May 14 22:06:35.806489 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3263/6655] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:35 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:35.822209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:35.822835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:35.828741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:35.829210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:35.829990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:35.830440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:35.959978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:35.967458 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cffb0a62-cdfe-40bc-92fa-ca037710aeaf tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1507 microversion: 2.1 time: 0.148799 May 14 22:06:35.968062 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3264/6656] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:35 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:35.983848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:35.984996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:35.990811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:35.991290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:35.992139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:35.992600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:36.122419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:36.130012 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4471f8dc-8cd7-4ea9-86d1-384ffc00ee45 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1507 microversion: 2.1 time: 0.149789 May 14 22:06:36.130589 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3265/6657] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:35 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:36.145940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:36.146463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:36.152255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:36.152737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:36.153535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:36.153998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:36.179993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:06:36.416270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-14a7e79d-91b2-4cc6-aa52-5f03253bcdab tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 204 len: 0 microversion: 2.1 time: 0.273588 May 14 22:06:36.416872 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3266/6658] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:06:36 2022] DELETE /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:06:36.435005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:36.435581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:36.442424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:36.445326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:36.445326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:36.445326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:36.470226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:06:36.579366 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.compute.api [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Instance is already in deleting state, ignoring this request May 14 22:06:36.580260 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7250d740-bca5-49fa-9193-09147d97220c tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "DELETE /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 204 len: 0 microversion: 2.1 time: 0.149689 May 14 22:06:36.580829 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3267/6659] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:06:36 2022] DELETE /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:06:36.588677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:36.589304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:36.595936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:36.596478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:36.597262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:36.597746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:36.725659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:36.733190 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b86e54ee-d689-427b-8495-75d835640dee tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1513 microversion: 2.1 time: 0.148148 May 14 22:06:36.733761 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3268/6660] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:36 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:37.750598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:37.751275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:37.758303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:37.758771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:37.759588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:37.760045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:38.302235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae4941f6dd4844a1b441ff43114b3f3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9092d803ae1249baa50f6717607e8621', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:38.309788 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0be624ae-26d1-4de6-a91d-df608e17204d tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 200 len: 1513 microversion: 2.1 time: 0.563380 May 14 22:06:38.310375 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3269/6661] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:37 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 1513 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:38.632530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-47e7b04b-8144-48f6-a40d-1b3127d88240 req-09865324-3fda-449d-9b16-0e71dd7431ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbf3c714-c8a8-4449-b147-f06904bebbf6", "name": "network-vif-deleted", "tag": "bdd722e5-72e5-4897-95c7-913d01d9c066"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:38.640400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-47e7b04b-8144-48f6-a40d-1b3127d88240 req-09865324-3fda-449d-9b16-0e71dd7431ce service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:38.641057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-47e7b04b-8144-48f6-a40d-1b3127d88240 req-09865324-3fda-449d-9b16-0e71dd7431ce service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:38.654310 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-47e7b04b-8144-48f6-a40d-1b3127d88240 req-09865324-3fda-449d-9b16-0e71dd7431ce service nova] Creating event network-vif-deleted:bdd722e5-72e5-4897-95c7-913d01d9c066 for instance dbf3c714-c8a8-4449-b147-f06904bebbf6 on nch1-master-1 May 14 22:06:38.660020 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-47e7b04b-8144-48f6-a40d-1b3127d88240 req-09865324-3fda-449d-9b16-0e71dd7431ce service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 May 14 22:06:38.660614 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3270/6662] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:06:39.125046 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:06:39.125671 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:06:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:06:39.328396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:39.329748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: dbf3c714-c8a8-4449-b147-f06904bebbf6] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:39.336203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:39.336679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:39.337466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:39.337927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:39.351789 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] HTTP exception thrown: Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 could not be found. May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Request method failure captured: May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 HTTP/1.1 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCeS-P5ZIvp7BdYCJoEucthOCfWdx4AJVjb9P4OBfltNjaqHxpSIEI-Rrz6Uxp7MS5h7nGBDhDthDEHQbL0CvElIyNfH821FHqItpD2MH4XEr5jp2f9LdqA66slPhpVatkQ5rFMHqBnxswxJPAd7EAp97FiLR-YXQqPXImuUKGS9jBg May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9092d803ae1249baa50f6717607e8621 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9092d803ae1249baa50f6717607e8621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9092d803ae1249baa50f6717607e8621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9092d803ae1249baa50f6717607e8621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9092d803ae1249baa50f6717607e8621", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9092d803ae1249baa50f6717607e8621 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerDiskConfigTestJSON-415452038-project May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ae4941f6dd4844a1b441ff43114b3f3e May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerDiskConfigTestJSON-415452038-project May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 could not be found. May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'dbf3c714-c8a8-4449-b147-f06904bebbf6'} May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 could not be found. May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 could not be found. May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:06:39.353442 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 could not be found. May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Returning 404 to user: Instance dbf3c714-c8a8-4449-b147-f06904bebbf6 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ec0a237-bae8-418b-ae22-5179a1a0a155 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6" status: 404 len: 111 microversion: 2.1 time: 0.031781 May 14 22:06:39.357095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3271/6663] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:39 2022] GET /compute/v2.1/servers/dbf3c714-c8a8-4449-b147-f06904bebbf6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:06:39.363173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:39.363712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:39.369403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:39.369879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:39.370658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:39.371118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:39.385266 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] HTTP exception thrown: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Request method failure captured: May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff HTTP/1.1 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCeS-P5ZIvp7BdYCJoEucthOCfWdx4AJVjb9P4OBfltNjaqHxpSIEI-Rrz6Uxp7MS5h7nGBDhDthDEHQbL0CvElIyNfH821FHqItpD2MH4XEr5jp2f9LdqA66slPhpVatkQ5rFMHqBnxswxJPAd7EAp97FiLR-YXQqPXImuUKGS9jBg May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9092d803ae1249baa50f6717607e8621 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9092d803ae1249baa50f6717607e8621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9092d803ae1249baa50f6717607e8621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9092d803ae1249baa50f6717607e8621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9092d803ae1249baa50f6717607e8621", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9092d803ae1249baa50f6717607e8621 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerDiskConfigTestJSON-415452038-project May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ae4941f6dd4844a1b441ff43114b3f3e May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerDiskConfigTestJSON-415452038-project May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd5eb4b18-8c1f-4d3f-b159-0c9a9b8addff'} May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:06:39.386832 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Returning 404 to user: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3c107ce-b5c2-425d-826f-9e6fade9c2f8 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 404 len: 111 microversion: 2.1 time: 0.028902 May 14 22:06:39.390572 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3272/6664] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:06:39 2022] DELETE /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:06:39.396911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:39.397543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] [instance: d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:39.403275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:39.403789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:39.404572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:39.405035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:39.418691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] HTTP exception thrown: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Request method failure captured: May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff HTTP/1.1 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCeS-P5ZIvp7BdYCJoEucthOCfWdx4AJVjb9P4OBfltNjaqHxpSIEI-Rrz6Uxp7MS5h7nGBDhDthDEHQbL0CvElIyNfH821FHqItpD2MH4XEr5jp2f9LdqA66slPhpVatkQ5rFMHqBnxswxJPAd7EAp97FiLR-YXQqPXImuUKGS9jBg May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 9092d803ae1249baa50f6717607e8621 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9092d803ae1249baa50f6717607e8621"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/9092d803ae1249baa50f6717607e8621"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/9092d803ae1249baa50f6717607e8621"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_9092d803ae1249baa50f6717607e8621", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 9092d803ae1249baa50f6717607e8621 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-415452038 May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerDiskConfigTestJSON-415452038-project May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ae4941f6dd4844a1b441ff43114b3f3e May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerDiskConfigTestJSON-415452038-project May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd5eb4b18-8c1f-4d3f-b159-0c9a9b8addff'} May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:06:39.420252 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] Returning 404 to user: Instance d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd69ee16-f3c2-4e82-9a1b-806c7938adb9 tempest-ServerDiskConfigTestJSON-415452038 tempest-ServerDiskConfigTestJSON-415452038-project] 10.222.0.52 "GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff" status: 404 len: 111 microversion: 2.1 time: 0.028306 May 14 22:06:39.424621 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3273/6665] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:39 2022] GET /compute/v2.1/servers/d5eb4b18-8c1f-4d3f-b159-0c9a9b8addff => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:06:46.568852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27c16782-3932-4283-89c8-0752e9a3744d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'create', calling method: .version_select at 0x7fb1a6dd2af0>, body: {"keypair": {"name": "tempest-keypair-1443535878", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsuiYiMxJyjz8FFmJvnWdS+LQJMGWgiV3LDB3wF2xEfVdLtTAi6D9epfPBskdyyGajYE44wj7cNTBGoCVJjll4mtcstz53YSpaovJjWM4bxjZFfcBej6br8geM9u9V70Q=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:46.592420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-27c16782-3932-4283-89c8-0752e9a3744d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for project 5b7eff5698214fe982348f81c276dc6a. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:06:46.601162 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-27c16782-3932-4283-89c8-0752e9a3744d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for user 58d7a44fb4b64d5d98bdda07c1638f20 and project 5b7eff5698214fe982348f81c276dc6a. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:06:46.685998 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27c16782-3932-4283-89c8-0752e9a3744d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238700 May 14 22:06:46.686611 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3274/6666] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:06:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:06:48.759470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1908106278", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c0f6c30-a116-462c-8817-5c68f4794dd4"}], "security_groups": [{"name": "tempest-securitygroup--2015306617"}], "key_name": "tempest-keypair-1443535878", "user_data": "}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:48.869595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] validate_networks() for [('6c0f6c30-a116-462c-8817-5c68f4794dd4', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:06:49.253550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:06:49.254000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:06:49.254958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:06:49.255456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:06:49.256053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:06:49.267116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:49.268389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:49.269240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:49.269707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:49.296702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:06:49.302983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for user 58d7a44fb4b64d5d98bdda07c1638f20 and project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:06:49.317500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:06:49.319997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:06:49.468417 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1acc743e-f305-45d3-b43d-7efa1aed76d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.713305 May 14 22:06:49.469801 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3275/6667] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:06:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:06:49.482459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6996faa6-7eed-427e-863d-00dd969e0dc9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:49.482459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6996faa6-7eed-427e-863d-00dd969e0dc9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:49.573473 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6996faa6-7eed-427e-863d-00dd969e0dc9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:49.583203 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6996faa6-7eed-427e-863d-00dd969e0dc9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1239 microversion: 2.1 time: 0.107535 May 14 22:06:49.585325 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3276/6668] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:49 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1239 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:06:50.600632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:50.601351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:50.608344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:50.608826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:50.609637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:50.610104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:50.675825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:50.683798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a4cb807-aca3-4140-9ad5-79f16aa20921 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1243 microversion: 2.1 time: 0.087217 May 14 22:06:50.684391 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3277/6669] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:50 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:51.706188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:51.706826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:51.714158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:51.714935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:51.715578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:51.716051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:51.790994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:51.799095 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a28f9663-900e-4385-a31c-868d026e1e12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1299 microversion: 2.1 time: 0.102146 May 14 22:06:51.799729 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3278/6670] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:51 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:06:52.816572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:52.821217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:52.824179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:52.824732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:52.825530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:52.825991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:53.058650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:53.071905 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d6f5be58-2e72-4658-8d2f-f903cb4dba32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1365 microversion: 2.1 time: 0.260109 May 14 22:06:53.078677 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3279/6671] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:52 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:53.317443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a8a61ae7-5e11-435a-9c1e-7e049d7cd9a7 req-772fc172-1af0-4160-a6c8-2a7a8d574f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc58112-b10e-4bd2-aa06-cf8a01e914ec", "tag": "ae175c63-6170-410c-9b6d-1ff5acafeb20"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:53.326028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a8a61ae7-5e11-435a-9c1e-7e049d7cd9a7 req-772fc172-1af0-4160-a6c8-2a7a8d574f3f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:53.326709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a8a61ae7-5e11-435a-9c1e-7e049d7cd9a7 req-772fc172-1af0-4160-a6c8-2a7a8d574f3f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:53.341719 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a8a61ae7-5e11-435a-9c1e-7e049d7cd9a7 req-772fc172-1af0-4160-a6c8-2a7a8d574f3f service nova] Creating event network-changed:ae175c63-6170-410c-9b6d-1ff5acafeb20 for instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec on nch1-master-1 May 14 22:06:53.347984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a8a61ae7-5e11-435a-9c1e-7e049d7cd9a7 req-772fc172-1af0-4160-a6c8-2a7a8d574f3f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038221 May 14 22:06:53.348670 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3280/6672] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:06:54.091415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:54.092252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:54.099389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:54.099891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:54.100707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:54.101168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:54.430597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:54.438050 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-922dd4a6-6ea7-44cb-a989-2afea61861ce tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1365 microversion: 2.1 time: 0.351987 May 14 22:06:54.438622 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3281/6673] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:54 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:55.455858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:55.456646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:55.463548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:55.464025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:55.464825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:55.465285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:55.597861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:55.605952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-655b2ee7-c514-4b87-a1a3-2fb3417ebbd0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1365 microversion: 2.1 time: 0.154103 May 14 22:06:55.606586 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3282/6674] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:55 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:56.626070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:56.627428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:56.634347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:56.634826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:56.635683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:56.636148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:56.770062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:56.777435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eaf94efa-550d-4caa-8e3a-66e5696302a4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1365 microversion: 2.1 time: 0.155436 May 14 22:06:56.778025 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3283/6675] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:56 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:57.794283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:57.794944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:57.802128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:57.802600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:57.803385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:57.803938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:57.938905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:57.947211 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9039af87-81b9-470b-b13d-2da60c1bf16d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1365 microversion: 2.1 time: 0.156883 May 14 22:06:57.947821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3284/6676] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:57 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:06:58.869632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1254d857-9dd4-4acb-ba17-8c089fefce7a req-e5b1c802-0b27-424c-9b6e-fdc8d0f89abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc58112-b10e-4bd2-aa06-cf8a01e914ec", "name": "network-vif-plugged", "status": "completed", "tag": "ae175c63-6170-410c-9b6d-1ff5acafeb20"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:06:58.878313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1254d857-9dd4-4acb-ba17-8c089fefce7a req-e5b1c802-0b27-424c-9b6e-fdc8d0f89abb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:58.878781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1254d857-9dd4-4acb-ba17-8c089fefce7a req-e5b1c802-0b27-424c-9b6e-fdc8d0f89abb service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:58.889704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1254d857-9dd4-4acb-ba17-8c089fefce7a req-e5b1c802-0b27-424c-9b6e-fdc8d0f89abb service nova] Creating event network-vif-plugged:ae175c63-6170-410c-9b6d-1ff5acafeb20 for instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec on nch1-master-1 May 14 22:06:58.895247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1254d857-9dd4-4acb-ba17-8c089fefce7a req-e5b1c802-0b27-424c-9b6e-fdc8d0f89abb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029311 May 14 22:06:58.895874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3285/6677] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:06:58.965997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:06:58.967024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:06:58.975121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:58.976022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:58.976849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:06:58.977309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:06:59.124851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:06:59.132505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fb363d79-b1a4-4533-b6b1-c9749c7bfb53 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1365 microversion: 2.1 time: 0.171120 May 14 22:06:59.133087 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3286/6678] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:06:58 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:07:00.149100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:00.149779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:00.156629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:00.157120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:00.158657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:00.159189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:00.297341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:00.305702 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60dedb7d-c50d-4bee-aaaf-f77390d4c85b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1553 microversion: 2.1 time: 0.160684 May 14 22:07:00.306294 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3287/6679] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:00 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:00.321846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-767c4c03-a694-4046-8d88-be6b498879e8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:00.322360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-767c4c03-a694-4046-8d88-be6b498879e8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:00.328468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767c4c03-a694-4046-8d88-be6b498879e8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:00.328948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767c4c03-a694-4046-8d88-be6b498879e8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:00.329830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767c4c03-a694-4046-8d88-be6b498879e8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:00.330291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-767c4c03-a694-4046-8d88-be6b498879e8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:00.409544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-767c4c03-a694-4046-8d88-be6b498879e8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090740 May 14 22:07:00.410180 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3288/6680] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 22:07:00 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:07:01.425823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:01.426464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:01.432668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:01.433146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:01.433939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:01.434406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:01.569269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:01.577186 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4b7be0ad-6c0d-4a1e-bad9-089ea5a75b34 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1553 microversion: 2.1 time: 0.156346 May 14 22:07:01.577769 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3289/6681] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:01 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:07:01.583457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-aedf160b-171d-4eb9-a513-277fc12a3ca7 req-6773811f-49e1-483a-ae82-1742c74659f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc58112-b10e-4bd2-aa06-cf8a01e914ec", "tag": "ae175c63-6170-410c-9b6d-1ff5acafeb20"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:01.591711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-aedf160b-171d-4eb9-a513-277fc12a3ca7 req-6773811f-49e1-483a-ae82-1742c74659f0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:01.592180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-aedf160b-171d-4eb9-a513-277fc12a3ca7 req-6773811f-49e1-483a-ae82-1742c74659f0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:01.603279 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-aedf160b-171d-4eb9-a513-277fc12a3ca7 req-6773811f-49e1-483a-ae82-1742c74659f0 service nova] Creating event network-changed:ae175c63-6170-410c-9b6d-1ff5acafeb20 for instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec on nch1-master-1 May 14 22:07:01.608457 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-aedf160b-171d-4eb9-a513-277fc12a3ca7 req-6773811f-49e1-483a-ae82-1742c74659f0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029568 May 14 22:07:01.609478 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3290/6682] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:07:01.616850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:01.617929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:01.624266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:01.624736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:01.625528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:01.625983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:01.836481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:01.844192 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21399fe2-654d-4e64-9684-9e8a381f3584 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1553 microversion: 2.1 time: 0.233359 May 14 22:07:01.844988 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3291/6683] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:01 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1553 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:07:02.863188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:02.863850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:02.870612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:02.871081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:02.871895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:02.872350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:03.000860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:03.009289 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ee86a67-028d-495a-955d-746e9988d33d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1672 microversion: 2.1 time: 0.150916 May 14 22:07:03.009932 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3292/6684] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:02 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:03.028468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:03.029403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:03.039336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:03.040082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:03.041292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:03.041995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:03.177738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:03.185533 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e44e76a5-8a13-4d9f-b795-a3c6533ef6f4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1672 microversion: 2.1 time: 0.161038 May 14 22:07:03.186108 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3293/6685] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:03 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:07:03.201542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:03.202526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:03.208688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:03.209159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:03.209942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:03.210393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:03.241204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:03.246982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:07:03.253251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:07:03.253689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:07:03.254180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:07:03.254606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:07:03.255031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:07:03.476705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-411acadf-6ca5-4c81-9995-ae8e7afd2634 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec/action" status: 202 len: 0 microversion: 2.1 time: 0.278815 May 14 22:07:03.477327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3294/6686] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:07:03 2022] POST /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:07:03.485436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:03.486080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:03.493268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:03.493689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:03.494493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:03.494956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:03.625247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:03.634265 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d7a6d85f-c2f3-47a8-8534-7496b87a1b30 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1681 microversion: 2.1 time: 0.152702 May 14 22:07:03.634786 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3295/6687] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:03 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:04.652454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:04.653108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:04.660386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:04.660864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:04.661662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:04.662127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:04.792644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:04.800778 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-17358177-4752-4265-ad25-43324843dfa4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1681 microversion: 2.1 time: 0.152369 May 14 22:07:04.801358 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3296/6688] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:04 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:05.818992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:05.819672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:05.826975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:05.838034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:05.838034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:05.838034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:06.034487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:06.043677 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f2053660-75bc-42f6-a786-24d9858ef058 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1681 microversion: 2.1 time: 0.229129 May 14 22:07:06.045085 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3297/6689] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:05 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1681 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:07.062246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:07.062878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:07.070238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:07.070706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:07.071503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:07.071972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:07.202714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:07.210848 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a34402e7-3eb1-4d18-b1d9-f086915d8c43 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.152578 May 14 22:07:07.211451 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3298/6690] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:07 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:08.228612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:08.229216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:08.237026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:08.237431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:08.238222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:08.238682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:08.368467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:08.375833 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be3c8312-0765-4b4e-a50b-acb81755fc47 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.151217 May 14 22:07:08.377014 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3299/6691] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:08 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:09.394307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:09.394946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:09.401823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:09.402292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:09.403073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:09.403553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:09.553179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:09.564920 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6fa2f42f-9510-46b7-8ee2-0985505560a0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.175215 May 14 22:07:09.565517 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3300/6692] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:09 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:10.584093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:10.584817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:10.591668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:10.597218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:10.597218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:10.597218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:10.726449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:10.734279 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09075673-1455-4720-8590-ff5c59a24a5e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.154859 May 14 22:07:10.734864 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3301/6693] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:10 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:11.751891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:11.752657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:11.759392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:11.759883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:11.760682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:11.761149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:11.900830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:11.909466 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3be4086b-11d9-409a-b2c0-0a57d3a73c55 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.161685 May 14 22:07:11.910043 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3302/6694] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:11 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:12.926972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:12.932309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:12.934467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:12.934936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:12.935786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:12.936225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:13.070926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:13.078534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-586fdff7-b61d-404b-9923-a95e003f8f57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.156155 May 14 22:07:13.079118 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3303/6695] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:12 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:14.096405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:14.097029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:14.103862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:14.104331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:14.105114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:14.105567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:14.231940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:14.239413 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-43a4fe55-9367-4024-be0a-5d6f232fd70a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.147628 May 14 22:07:14.240039 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3304/6696] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:14 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:15.257840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:15.258544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:15.265252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:15.265717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:15.266527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:15.267654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:15.404465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:15.412455 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1de6dbc4-d4f1-41c6-a938-8c8f3464c7a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.158756 May 14 22:07:15.413033 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3305/6697] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:15 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:16.430293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:16.430960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:16.437181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:16.437657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:16.438448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:16.438910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:16.571348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:16.578866 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b60502b-65ae-446e-887c-260329276569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.152839 May 14 22:07:16.579452 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3306/6698] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:16 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:17.596333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:17.597052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:17.603974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:17.604448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:17.605237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:17.605731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:17.738757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:17.747314 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f18f7b98-b759-4830-9dfd-2f1cc82a9311 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.154975 May 14 22:07:17.747935 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3307/6699] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:17 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:18.766417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:18.767093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:18.774217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:18.774690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:18.775504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:18.775963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:18.903994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:18.912547 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e04a7ff8-1eaf-4ce4-958a-eff62867ec39 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.150121 May 14 22:07:18.913140 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3308/6700] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:18 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:19.930212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:19.930922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:19.937769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:19.938234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:19.939016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:19.939469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:20.068017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:20.075528 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00136787-3716-4ac0-ba27-4fbe056a956f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.149871 May 14 22:07:20.076117 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3309/6701] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:19 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:21.092654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:21.093292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:21.100943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:21.101412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:21.102200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:21.102658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:21.233694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:21.241784 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-06ab51e4-2a2e-4872-8696-db1aa615d94c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.153032 May 14 22:07:21.242385 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3310/6702] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:21 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:22.258340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:22.258959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:22.268987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:22.270228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:22.271026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:22.271526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:22.400163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:22.407613 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b4e21f0-c5ed-4782-a0e5-1a3708a01e08 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.153320 May 14 22:07:22.408191 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3311/6703] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:22 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:23.425852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:23.426724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:23.433738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:23.434633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:23.435977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:23.436715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:23.585071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:23.592648 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f5c54d6-66f8-405f-b019-79d3cc40ba0a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.171754 May 14 22:07:23.593245 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3312/6704] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:23 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:24.609869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:24.610522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:24.617949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:24.618393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:24.619166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:24.619654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:24.748397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:24.756066 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab9a0ab0-352b-4121-a0c7-17fcd10e2665 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.150180 May 14 22:07:24.756643 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3313/6705] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:24 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:25.774468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:25.775229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:25.784173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:25.785554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:25.786379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:25.786840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:25.921090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:25.928748 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b623d016-242c-4176-999f-bb6d573b8d3c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.159104 May 14 22:07:25.929329 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3314/6706] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:25 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:26.946096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:26.952390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:26.953572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:26.954038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:26.954818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:26.955270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:27.089298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:27.096778 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-632eec6a-1b6f-41e2-87cc-2b9532252d2b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.154700 May 14 22:07:27.097354 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3315/6707] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:26 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:28.114440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:28.115110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:28.122066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:28.125146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:28.125146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:28.125146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:28.253699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:28.261529 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a4e089b-dde9-406d-bfb1-c6a5f989523d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.151281 May 14 22:07:28.262107 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3316/6708] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:28 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:29.279170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:29.279833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:29.287382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:29.287881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:29.288669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:29.289119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:29.429587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:29.437102 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d3c07bc5-a6ae-4ac8-ae48-ca8547eb6966 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.161963 May 14 22:07:29.437672 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3317/6709] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:29 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:30.455126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:30.455824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:30.463736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:30.464212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:30.464991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:30.465446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:30.595947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:30.604524 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d51a9547-07f3-4d13-af9d-dab0bc103213 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.153301 May 14 22:07:30.605125 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3318/6710] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:30 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:31.622206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:31.622839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:31.630089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:31.630569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:31.631354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:31.631840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:31.764005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:31.771715 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cc0bea1-7f14-4719-bb0d-dfde1582f1bf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.153437 May 14 22:07:31.772323 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3319/6711] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:31 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:32.789540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:32.790195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:32.797050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:32.797529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:32.798321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:32.798779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:32.926789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:32.934368 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9421a823-ced3-4cda-b7f1-b015f8494f22 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.148813 May 14 22:07:32.934955 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3320/6712] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:32 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:33.952853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:33.953490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:33.961081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:33.961553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:33.962344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:33.962804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:34.095213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:34.102872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9a80994a-2aaa-476b-bf1f-21b168c23e66 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.153983 May 14 22:07:34.103449 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3321/6713] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:33 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:35.120144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:35.120774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:35.127634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:35.128108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:35.128895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:35.129379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:35.278476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:35.278476 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1b85cecb-8b27-463c-b7bc-fc5a4de4d925 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.153521 May 14 22:07:35.278476 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3322/6714] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:35 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:36.288131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:36.288768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:36.295685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:36.300683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:36.300683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:36.300683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:36.433175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:36.440678 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9fbd3ee5-6b44-4fb4-8366-e7e9669ef18d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.157087 May 14 22:07:36.441258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3323/6715] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:36 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:37.458363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:37.459055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:37.465948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:37.466422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:37.467218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:37.467712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:37.601376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:37.608945 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-40640978-71c3-455c-abb2-94ef20a872b5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1686 microversion: 2.1 time: 0.155121 May 14 22:07:37.609548 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3324/6716] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:37 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:38.626379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:38.627002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:38.633901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:38.634364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:38.635143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:38.635623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:38.773969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:38.781648 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-511b980f-db89-4829-9039-4fceadcbba50 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1685 microversion: 2.1 time: 0.159357 May 14 22:07:38.782222 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3325/6717] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:38 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:39.253278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c0583e29-3e8b-4b12-ae24-83ffb8890533 req-8ab99b6d-235f-4b81-9f01-b855d9602960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc58112-b10e-4bd2-aa06-cf8a01e914ec", "name": "network-vif-unplugged", "status": "completed", "tag": "ae175c63-6170-410c-9b6d-1ff5acafeb20"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:39.261828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c0583e29-3e8b-4b12-ae24-83ffb8890533 req-8ab99b6d-235f-4b81-9f01-b855d9602960 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:39.262291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c0583e29-3e8b-4b12-ae24-83ffb8890533 req-8ab99b6d-235f-4b81-9f01-b855d9602960 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:39.274555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c0583e29-3e8b-4b12-ae24-83ffb8890533 req-8ab99b6d-235f-4b81-9f01-b855d9602960 service nova] Creating event network-vif-unplugged:ae175c63-6170-410c-9b6d-1ff5acafeb20 for instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec on nch2-master-1 May 14 22:07:39.279880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-c0583e29-3e8b-4b12-ae24-83ffb8890533 req-8ab99b6d-235f-4b81-9f01-b855d9602960 service nova] Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:07:39.290847 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c0583e29-3e8b-4b12-ae24-83ffb8890533 req-8ab99b6d-235f-4b81-9f01-b855d9602960 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041327 May 14 22:07:39.291451 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3326/6718] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:07:39.802740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:39.803469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:39.809931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:39.811128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:39.811969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:39.812435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:40.367297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:40.377363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5e72f73d-a283-4d01-8cc4-525d8530f0fa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1685 microversion: 2.1 time: 0.581191 May 14 22:07:40.378076 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3327/6719] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:39 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1685 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:41.306142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-36371e4e-1034-44aa-82ab-a5186653523e req-ca448965-e2d1-4144-a3c5-530ce571f80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dc58112-b10e-4bd2-aa06-cf8a01e914ec", "tag": "ae175c63-6170-410c-9b6d-1ff5acafeb20"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:41.315155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-36371e4e-1034-44aa-82ab-a5186653523e req-ca448965-e2d1-4144-a3c5-530ce571f80b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:41.315654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-36371e4e-1034-44aa-82ab-a5186653523e req-ca448965-e2d1-4144-a3c5-530ce571f80b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:41.327892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-36371e4e-1034-44aa-82ab-a5186653523e req-ca448965-e2d1-4144-a3c5-530ce571f80b service nova] Creating event network-changed:ae175c63-6170-410c-9b6d-1ff5acafeb20 for instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec on nch2-master-1 May 14 22:07:41.333846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-36371e4e-1034-44aa-82ab-a5186653523e req-ca448965-e2d1-4144-a3c5-530ce571f80b service nova] Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:07:41.344243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-36371e4e-1034-44aa-82ab-a5186653523e req-ca448965-e2d1-4144-a3c5-530ce571f80b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042012 May 14 22:07:41.344834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3328/6720] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:07:41.399800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:41.400531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:41.407296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:41.407296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:41.408065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:41.408506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:41.628919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:41.637003 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd896a24-f0b5-472f-9234-b542012239b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1683 microversion: 2.1 time: 0.242432 May 14 22:07:41.637586 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3329/6721] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:41 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1683 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:42.654727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:42.655452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:42.663796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:42.664357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:42.665174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:42.665644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:42.806777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:42.814877 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-771b0b8c-23df-4e41-927a-88ccc12598ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1680 microversion: 2.1 time: 0.164040 May 14 22:07:42.815502 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3330/6722] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:42 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:07:42.832102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1de224f6-e7a3-47cf-a433-5c6566e8ff06 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:42.832985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1de224f6-e7a3-47cf-a433-5c6566e8ff06 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:42.840194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de224f6-e7a3-47cf-a433-5c6566e8ff06 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:42.840699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de224f6-e7a3-47cf-a433-5c6566e8ff06 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:42.841510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de224f6-e7a3-47cf-a433-5c6566e8ff06 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:42.841973 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1de224f6-e7a3-47cf-a433-5c6566e8ff06 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:43.021474 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1de224f6-e7a3-47cf-a433-5c6566e8ff06 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec/action" status: 204 len: 0 microversion: 2.1 time: 0.193323 May 14 22:07:43.022100 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3331/6723] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:07:42 2022] POST /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:07:43.032556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:43.033687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:43.041756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:43.042226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:43.043029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:43.043540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:43.266878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:43.275285 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f0a7597-bdd6-4434-9fc1-86746aaffe44 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1680 microversion: 2.1 time: 0.248687 May 14 22:07:43.275851 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3332/6724] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:43 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:44.293248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:44.293908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:44.301128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:44.301663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:44.302575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:44.303066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:44.450441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:44.458855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd6402fd-f215-45e7-9a0c-6647d3b2d3fc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1680 microversion: 2.1 time: 0.169802 May 14 22:07:44.459621 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3333/6725] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:44 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:44.755042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e6d660c8-a091-4258-96e7-2e0f830f05f3 req-0a49f269-0a74-44e4-8488-33b96c188957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc58112-b10e-4bd2-aa06-cf8a01e914ec", "name": "network-vif-plugged", "status": "completed", "tag": "ae175c63-6170-410c-9b6d-1ff5acafeb20"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:44.765394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e6d660c8-a091-4258-96e7-2e0f830f05f3 req-0a49f269-0a74-44e4-8488-33b96c188957 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:44.765885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e6d660c8-a091-4258-96e7-2e0f830f05f3 req-0a49f269-0a74-44e4-8488-33b96c188957 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:44.779394 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e6d660c8-a091-4258-96e7-2e0f830f05f3 req-0a49f269-0a74-44e4-8488-33b96c188957 service nova] Creating event network-vif-plugged:ae175c63-6170-410c-9b6d-1ff5acafeb20 for instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec on nch2-master-1 May 14 22:07:44.785930 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e6d660c8-a091-4258-96e7-2e0f830f05f3 req-0a49f269-0a74-44e4-8488-33b96c188957 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035401 May 14 22:07:44.786821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3334/6726] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:07:45.477720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:45.478447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:45.484808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.485279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:45.486063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.486528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:45.620753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:45.628312 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a37a293-0021-4c7b-9ad4-1101459c91b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1672 microversion: 2.1 time: 0.155808 May 14 22:07:45.628898 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3335/6727] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:45 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:45.644867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:45.645500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:45.651267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.654651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:45.654651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.654651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:45.783460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:45.791809 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f69aa9eb-dceb-4b69-b56f-d76ba9139f38 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1672 microversion: 2.1 time: 0.150651 May 14 22:07:45.792427 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3336/6728] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:45 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1672 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:45.808373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:45.809136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:45.815871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.816339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:45.818125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.818607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:45.953117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:45.961357 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-556c3f15-64c1-4a3b-a207-7e7a818f71a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1672 microversion: 2.1 time: 0.156706 May 14 22:07:45.961959 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3337/6729] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:45 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:45.979945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:45.980457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:45.986396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.986804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:45.987615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:45.988067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:46.013059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:07:46.244021 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-617c46fe-78f5-4fac-b1b2-72eeb932873a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 204 len: 0 microversion: 2.1 time: 0.267314 May 14 22:07:46.244561 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3338/6730] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:07:45 2022] DELETE /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:07:46.253377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:46.254641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:46.260872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:46.261343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:46.262138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:46.262593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:46.402233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:46.414085 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0cab9f46-01fb-49cf-9ea2-29bb19ffc67d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1678 microversion: 2.1 time: 0.164728 May 14 22:07:46.414934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3339/6731] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:46 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:47.432296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:47.432934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:47.439785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:47.440247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:47.441025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:47.442146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:47.636117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:47.643825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-86e6fca6-5879-4ef1-8f88-d593480a3fec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1678 microversion: 2.1 time: 0.215464 May 14 22:07:47.644419 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3340/6732] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:47 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:48.431693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-43bc5fcb-4c0c-4380-bd75-ae4fa793dd84 req-05c51f01-d9a9-4f09-877b-a8c2ef429785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dc58112-b10e-4bd2-aa06-cf8a01e914ec", "name": "network-vif-deleted", "tag": "ae175c63-6170-410c-9b6d-1ff5acafeb20"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:48.440557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-43bc5fcb-4c0c-4380-bd75-ae4fa793dd84 req-05c51f01-d9a9-4f09-877b-a8c2ef429785 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:48.443107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-43bc5fcb-4c0c-4380-bd75-ae4fa793dd84 req-05c51f01-d9a9-4f09-877b-a8c2ef429785 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:48.457210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-43bc5fcb-4c0c-4380-bd75-ae4fa793dd84 req-05c51f01-d9a9-4f09-877b-a8c2ef429785 service nova] Creating event network-vif-deleted:ae175c63-6170-410c-9b6d-1ff5acafeb20 for instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec on nch2-master-1 May 14 22:07:48.462506 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-43bc5fcb-4c0c-4380-bd75-ae4fa793dd84 req-05c51f01-d9a9-4f09-877b-a8c2ef429785 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036758 May 14 22:07:48.463676 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3341/6733] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:07:48.662414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:48.663139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:48.670042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:48.670513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:48.671313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:48.671787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:48.737894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:48.747506 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1be75ba2-2dff-4966-8dfa-b6c2d7597949 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 200 len: 1324 microversion: 2.1 time: 0.090265 May 14 22:07:48.748327 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3342/6734] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:48 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 1324 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:49.770521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:49.771186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:49.778097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:49.778574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:49.779363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:49.779847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:49.793603 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec HTTP/1.1 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3dc58112-b10e-4bd2-aa06-cf8a01e914ec'} May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:07:49.795312 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffb29609-d573-4650-ac44-2d1aa9e47d36 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 404 len: 111 microversion: 2.1 time: 0.030874 May 14 22:07:49.799268 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3343/6735] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:49 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:07:49.814247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:49.814882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:49.821468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:49.821947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:49.822734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:49.823202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:49.836717 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec HTTP/1.1 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3dc58112-b10e-4bd2-aa06-cf8a01e914ec'} May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:07:49.838255 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b9c7b246-69be-40da-99b7-80f8a1cf359c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 404 len: 111 microversion: 2.1 time: 0.029080 May 14 22:07:49.842087 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3344/6736] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:49 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:07:49.886414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1720789031", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "6c0f6c30-a116-462c-8817-5c68f4794dd4"}], "security_groups": [{"name": "tempest-securitygroup--2015306617"}], "key_name": "tempest-keypair-1443535878", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:49.991822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] validate_networks() for [('6c0f6c30-a116-462c-8817-5c68f4794dd4', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:07:50.350504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:07:50.350955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:07:50.351456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:07:50.351918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:07:50.352358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:07:50.361390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:50.361862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:50.362684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:50.363813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:50.381299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:07:50.386581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for user 58d7a44fb4b64d5d98bdda07c1638f20 and project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:07:50.399276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:07:50.401602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:07:50.583111 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-252bd95e-0936-4ead-8283-94ab4f6be33b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700519 May 14 22:07:50.583815 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3345/6737] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:07:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:07:50.593909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5088b87a-945a-489f-911b-6f073124b5df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:50.594611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5088b87a-945a-489f-911b-6f073124b5df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:50.648379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5088b87a-945a-489f-911b-6f073124b5df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:50.655874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5088b87a-945a-489f-911b-6f073124b5df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1239 microversion: 2.1 time: 0.065795 May 14 22:07:50.656443 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3346/6738] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:50 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:51.674047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:51.674684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:51.681917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:51.682393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:51.683196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:51.683690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:51.749271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:51.757563 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-74240afc-f5b5-4b05-bbee-d2456a4b4ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1235 microversion: 2.1 time: 0.087752 May 14 22:07:51.758143 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3347/6739] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:51 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:52.776333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:52.777003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:52.784252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:52.784730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:52.785706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:52.786225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:52.851234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:52.858947 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aaffaf6d-21ec-4341-901d-897cb72a9e04 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1297 microversion: 2.1 time: 0.086586 May 14 22:07:52.859573 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3348/6740] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:52 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:53.841411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-220814ae-5238-485a-9d6a-999cf40c81f5 req-3990ab3f-1575-46dc-ae55-8b18c05377c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10494a1a-1806-43a2-97a7-489370b690d0", "tag": "8033a814-a000-4299-86cd-25366c02c28a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:53.853588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-220814ae-5238-485a-9d6a-999cf40c81f5 req-3990ab3f-1575-46dc-ae55-8b18c05377c0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:53.854206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-220814ae-5238-485a-9d6a-999cf40c81f5 req-3990ab3f-1575-46dc-ae55-8b18c05377c0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:53.867328 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-220814ae-5238-485a-9d6a-999cf40c81f5 req-3990ab3f-1575-46dc-ae55-8b18c05377c0 service nova] Creating event network-changed:8033a814-a000-4299-86cd-25366c02c28a for instance 10494a1a-1806-43a2-97a7-489370b690d0 on nch2-master-1 May 14 22:07:53.872352 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-220814ae-5238-485a-9d6a-999cf40c81f5 req-3990ab3f-1575-46dc-ae55-8b18c05377c0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036121 May 14 22:07:53.873145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3349/6741] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:07:53.880296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:53.881090 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:53.887699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:53.888173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:53.888967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:53.889580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:54.115723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:54.123343 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aace25c1-856e-46bb-9b54-31e04e21e4f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1365 microversion: 2.1 time: 0.248848 May 14 22:07:54.123962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3350/6742] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:53 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:07:55.141280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:55.141899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:55.149301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:55.149781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:55.150571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:55.151063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:55.283445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:55.291726 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-091464af-2dca-43d0-b6c3-3ccd9c44b7f3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1365 microversion: 2.1 time: 0.154433 May 14 22:07:55.292308 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3351/6743] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:55 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:56.309593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:56.310219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:56.317330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:56.317803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:56.318591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:56.319049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:56.444628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:56.452027 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21432e2b-ffee-4153-ac1f-3ea84a6f83e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1365 microversion: 2.1 time: 0.146514 May 14 22:07:56.452611 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3352/6744] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:56 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:57.469064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:57.469912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:57.477497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:57.477967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:57.478752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:57.479206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:57.605170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:57.612561 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31a95530-f798-414d-a879-d2f78e08b3b8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1365 microversion: 2.1 time: 0.147675 May 14 22:07:57.613966 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3353/6745] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:57 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:58.630512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:58.631153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:58.638520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:58.639034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:58.639860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:58.640316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:58.777199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:58.786483 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de57da3c-d156-4b43-9159-50d9c779f843 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1365 microversion: 2.1 time: 0.159947 May 14 22:07:58.787161 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3354/6746] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:58 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:07:58.791754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7cbcfd3a-8450-4759-9f31-85ff5a66b2a2 req-21e5cdb7-f12a-4b4c-bbbf-9bd6d003c145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10494a1a-1806-43a2-97a7-489370b690d0", "name": "network-vif-plugged", "status": "completed", "tag": "8033a814-a000-4299-86cd-25366c02c28a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:07:58.799654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7cbcfd3a-8450-4759-9f31-85ff5a66b2a2 req-21e5cdb7-f12a-4b4c-bbbf-9bd6d003c145 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:58.800125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7cbcfd3a-8450-4759-9f31-85ff5a66b2a2 req-21e5cdb7-f12a-4b4c-bbbf-9bd6d003c145 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:58.811626 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7cbcfd3a-8450-4759-9f31-85ff5a66b2a2 req-21e5cdb7-f12a-4b4c-bbbf-9bd6d003c145 service nova] Creating event network-vif-plugged:8033a814-a000-4299-86cd-25366c02c28a for instance 10494a1a-1806-43a2-97a7-489370b690d0 on nch2-master-1 May 14 22:07:58.817096 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7cbcfd3a-8450-4759-9f31-85ff5a66b2a2 req-21e5cdb7-f12a-4b4c-bbbf-9bd6d003c145 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028136 May 14 22:07:58.817694 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3355/6747] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:07:59.806335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:07:59.807058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:07:59.813502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:59.813970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:59.814765 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:07:59.815222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:07:59.955041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:07:59.963446 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3aa01ee2-dd9a-417b-a71a-fa1d4a9ebff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1365 microversion: 2.1 time: 0.162905 May 14 22:07:59.964052 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3356/6748] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:07:59 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:00.980687 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:00.981330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:00.988926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:00.989402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:00.990204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:00.990668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:01.119265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:01.126752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d9144b41-c426-4c5a-97a7-1e1bb9c34be5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1552 microversion: 2.1 time: 0.150013 May 14 22:08:01.127331 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3357/6749] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:00 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:01.143284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7abb12ab-4569-4176-a00f-7b871a110ef8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:01.143855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7abb12ab-4569-4176-a00f-7b871a110ef8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:01.150644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7abb12ab-4569-4176-a00f-7b871a110ef8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:01.151121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7abb12ab-4569-4176-a00f-7b871a110ef8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:01.151999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7abb12ab-4569-4176-a00f-7b871a110ef8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:01.152468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7abb12ab-4569-4176-a00f-7b871a110ef8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:01.229831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7abb12ab-4569-4176-a00f-7b871a110ef8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090144 May 14 22:08:01.230443 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3358/6750] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 22:08:01 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:08:02.240485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bad6c1c4-5cb3-445c-973e-974376bdb533 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:02.247691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bad6c1c4-5cb3-445c-973e-974376bdb533 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:02.248175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bad6c1c4-5cb3-445c-973e-974376bdb533 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:02.272270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bad6c1c4-5cb3-445c-973e-974376bdb533 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Going to try to stop instance {{(pid=130637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 22:08:02.458637 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bad6c1c4-5cb3-445c-973e-974376bdb533 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action" status: 202 len: 0 microversion: 2.1 time: 0.222306 May 14 22:08:02.459268 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3359/6751] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:08:02 2022] POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:08:02.464497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-127909b7-2c73-4cbd-996d-7b5b9b12bd38 req-e5c80c90-417f-4e54-951d-a40d19380351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10494a1a-1806-43a2-97a7-489370b690d0", "tag": "8033a814-a000-4299-86cd-25366c02c28a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:02.473125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-127909b7-2c73-4cbd-996d-7b5b9b12bd38 req-e5c80c90-417f-4e54-951d-a40d19380351 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:02.473612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-127909b7-2c73-4cbd-996d-7b5b9b12bd38 req-e5c80c90-417f-4e54-951d-a40d19380351 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:02.485680 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-127909b7-2c73-4cbd-996d-7b5b9b12bd38 req-e5c80c90-417f-4e54-951d-a40d19380351 service nova] Creating event network-changed:8033a814-a000-4299-86cd-25366c02c28a for instance 10494a1a-1806-43a2-97a7-489370b690d0 on nch2-master-1 May 14 22:08:02.491507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-127909b7-2c73-4cbd-996d-7b5b9b12bd38 req-e5c80c90-417f-4e54-951d-a40d19380351 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030887 May 14 22:08:02.492192 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3360/6752] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:08:02.497644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:02.499272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:02.507210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:02.507906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:02.510754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:02.511634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:02.717820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:02.727109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d4664717-471f-4e7f-bc51-9eb1d29fe653 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1562 microversion: 2.1 time: 0.233330 May 14 22:08:02.727978 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3361/6753] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:02 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:08:03.744957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:03.745593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:03.752727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:03.753194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:03.754535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:03.755014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:03.892395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:03.900682 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c5f31058-5407-4001-a27d-8940a6cbf165 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.159800 May 14 22:08:03.901256 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3362/6754] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:03 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:04.918291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:04.918951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:04.925886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:04.926352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:04.927157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:04.927652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:05.058539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:05.066202 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-57e5feb3-78a7-4ff7-913f-5fd219c0770e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.151733 May 14 22:08:05.067008 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3363/6755] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:04 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:06.086352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:06.087059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:06.094280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:06.094754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:06.095581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:06.096048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:06.226315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:06.233853 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-894e84a7-7ace-4334-a43e-a80690e8130c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.153175 May 14 22:08:06.234439 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3364/6756] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:06 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:07.250247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:07.250858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:07.257859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:07.260312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:07.260312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:07.260312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:07.386576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:07.394832 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4aaa1c43-7da4-45d6-b773-ba6f69ce2a77 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.147949 May 14 22:08:07.395537 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3365/6757] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:07 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:08.412822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:08.413440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:08.420607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:08.422652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:08.422652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:08.422652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:08.549874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:08.558537 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b666d4f7-a1f0-4eed-852b-47f9f26bddfb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.150234 May 14 22:08:08.564514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3366/6758] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:08 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:09.576912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:09.577666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:09.586343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:09.586816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:09.587658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:09.588121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:09.730384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:09.740438 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d1c4ee8-8bf0-40ad-b7a6-7f4b3986d0af tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.167148 May 14 22:08:09.741533 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3367/6759] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:09 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:10.759280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:10.759965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:10.766800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:10.767266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:10.768075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:10.768527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:10.900829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:10.908363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-31bb32ab-25a1-469c-953a-784d6571d6ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.153449 May 14 22:08:10.908957 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3368/6760] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:10 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:11.925916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:11.926596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:11.933661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:11.934133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:11.934932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:11.935392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:12.066764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:12.074305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d7919709-9649-40c9-a04a-6bbe36aefd41 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.152362 May 14 22:08:12.074894 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3369/6761] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:11 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:13.095950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:13.096693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:13.103910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:13.104379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:13.105168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:13.105637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:13.236611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:13.245168 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e596bd14-59b2-4bc3-8fe7-f160ca9ee781 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.153239 May 14 22:08:13.245751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3370/6762] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:13 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:14.263292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:14.263955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:14.271265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:14.271762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:14.272544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:14.272999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:14.406783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:14.415441 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-329235f6-38f7-4489-acd6-55825c34b1f8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.156227 May 14 22:08:14.416054 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3371/6763] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:14 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:15.433269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:15.433938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:15.441104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:15.441582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:15.442390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:15.442850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:15.578264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:15.586559 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b4c629e-bf4d-4db0-a7ee-c452d0828846 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.157248 May 14 22:08:15.587142 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3372/6764] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:15 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:08:16.604287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:16.604947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:16.610877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:16.611356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:16.612161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:16.613816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:16.741423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:16.749045 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e601db1a-458c-43d8-aa57-e879717c5286 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.149024 May 14 22:08:16.749723 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3373/6765] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:16 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:17.766851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:17.767508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:17.774211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:17.774708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:17.775530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:17.775999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:17.969192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:17.977605 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-169d74b2-1192-4149-ba0d-86171411c87a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.214799 May 14 22:08:17.978196 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3374/6766] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:17 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:18.994787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:18.995426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:19.002369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:19.003345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:19.004328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:19.004787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:19.132198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:19.140210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe0c850c-902e-4ec0-9f3c-297bf420b9c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.149379 May 14 22:08:19.140803 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3375/6767] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:18 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:20.158038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:20.158646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:20.167181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:20.167678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:20.168471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:20.168927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:20.300154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:20.307791 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-15d5e898-94f8-47dd-90e5-b7e99fd422b3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.153713 May 14 22:08:20.308380 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3376/6768] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:20 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:21.326211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:21.326933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:21.333760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:21.337442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:21.337442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:21.337442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:21.465040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:21.472711 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01e6b772-cc8a-4c00-b698-28f4d8f11a85 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.150862 May 14 22:08:21.473300 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3377/6769] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:21 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:08:22.490156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:22.490801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:22.497840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:22.498306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:22.499083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:22.499562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:22.626560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:22.635047 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e15570ee-fa4e-43d8-9f91-5801c99b1553 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.148895 May 14 22:08:22.635998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3378/6770] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:22 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:23.653663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:23.654305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:23.661719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:23.662186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:23.662966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:23.663419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:23.793078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:23.801504 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb913c0e-aeef-4e42-b2cb-5924be6b343b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.151792 May 14 22:08:23.802100 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3379/6771] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:23 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:08:24.820758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:24.821959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:24.829659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:24.830124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:24.831855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:24.832270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:24.964932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:24.973094 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3bc4aba2-8ac5-4bbc-9c8a-8f96819f0b32 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.158569 May 14 22:08:24.973695 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3380/6772] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:24 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:25.990243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:25.990880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:25.997959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:25.998431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:25.999301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:25.999792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:26.130818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:26.138592 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8cdd2f95-4347-459d-b28e-b415878c2f6e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.152377 May 14 22:08:26.139181 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3381/6773] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:25 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:27.156065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:27.156701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:27.164688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:27.164923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:27.165716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:27.166289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:27.297685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:27.306703 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f0cb694e-020d-4c38-897e-8a3ee9b11350 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.153099 May 14 22:08:27.306703 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3382/6774] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:27 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:28.322360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:28.322986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:28.329926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:28.330404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:28.331831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:28.332312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:28.461572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:28.469167 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a7693827-d655-4c96-a39b-d1af623aa82c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1658 microversion: 2.1 time: 0.150868 May 14 22:08:28.469752 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3383/6775] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:28 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1658 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:28.485400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:28.486390 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:28.493134 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:28.493632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:28.494474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:28.494935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:28.523242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:28.529106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:08:28.536317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:08:28.536766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:08:28.537265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:08:28.537705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:08:28.538143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:08:28.738394 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d224605d-23af-4abb-b78d-10941f5c3d21 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action" status: 202 len: 0 microversion: 2.1 time: 0.256531 May 14 22:08:28.739033 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3384/6776] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:08:28 2022] POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:08:28.746833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:28.747455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:28.753534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:28.754029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:28.754824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:28.755279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:28.885876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:28.894415 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-61fb209b-b773-40f6-84ff-4d1844c78fd5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.151108 May 14 22:08:28.895014 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3385/6777] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:28 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:29.912509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:29.913131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:29.920089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:29.920595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:29.921388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:29.921883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:30.060479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:30.070176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d27e52a-9312-4d9c-adc4-a1fb01611e0f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.162908 May 14 22:08:30.070769 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3386/6778] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:29 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:31.087961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:31.088703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:31.095317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:31.095817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:31.097863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:31.098320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:31.292832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:31.301132 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-70488cfe-815e-4812-aaf6-49414d0aabb7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1681 microversion: 2.1 time: 0.217080 May 14 22:08:31.301736 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3387/6779] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:31 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:32.318455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:32.319096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:32.325966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:32.326437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:32.327213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:32.327707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:32.457102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:32.464971 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad623a6e-21e3-4d23-a1b3-f53864bd4e8c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1686 microversion: 2.1 time: 0.150714 May 14 22:08:32.465586 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3388/6780] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:32 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1686 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:33.482340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:33.482963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:33.490641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:33.491150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:33.491970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:33.492426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:33.623400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:33.631731 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-49e1d3b9-e8a8-4739-9a57-bc3453e65381 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1685 microversion: 2.1 time: 0.153400 May 14 22:08:33.632317 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3389/6781] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:33 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:34.406788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5e979cec-7474-4e8f-bfcf-2142f5e2b1c9 req-42404dda-4469-45ac-8ac2-9b524b5842d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10494a1a-1806-43a2-97a7-489370b690d0", "name": "network-vif-unplugged", "status": "completed", "tag": "8033a814-a000-4299-86cd-25366c02c28a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:34.416075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5e979cec-7474-4e8f-bfcf-2142f5e2b1c9 req-42404dda-4469-45ac-8ac2-9b524b5842d4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:34.416516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5e979cec-7474-4e8f-bfcf-2142f5e2b1c9 req-42404dda-4469-45ac-8ac2-9b524b5842d4 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:34.428628 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5e979cec-7474-4e8f-bfcf-2142f5e2b1c9 req-42404dda-4469-45ac-8ac2-9b524b5842d4 service nova] Creating event network-vif-unplugged:8033a814-a000-4299-86cd-25366c02c28a for instance 10494a1a-1806-43a2-97a7-489370b690d0 on nch1-master-1 May 14 22:08:34.433877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-5e979cec-7474-4e8f-bfcf-2142f5e2b1c9 req-42404dda-4469-45ac-8ac2-9b524b5842d4 service nova] Instance 10494a1a-1806-43a2-97a7-489370b690d0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:08:34.445880 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5e979cec-7474-4e8f-bfcf-2142f5e2b1c9 req-42404dda-4469-45ac-8ac2-9b524b5842d4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042866 May 14 22:08:34.446895 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3390/6782] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:08:34.652151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:34.653160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:34.662845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:34.663409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:34.664376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:34.664915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:34.850323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:34.857968 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-351e6e0a-a020-4f6c-8fa9-f9cbaf315a28 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1685 microversion: 2.1 time: 0.211459 May 14 22:08:34.858560 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3391/6783] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:34 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1685 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:35.875450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:35.876125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:35.883592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:35.884071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:35.884864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:35.885326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:36.017065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:36.024732 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4bbe286b-f8d5-43f6-9e6d-180bf7f85303 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1683 microversion: 2.1 time: 0.153178 May 14 22:08:36.025322 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3392/6784] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:35 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:36.460471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b950916f-9dd9-4d44-801d-d03e2d3eda64 req-016a7e93-cbe0-4f26-ba12-0b889fdac8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10494a1a-1806-43a2-97a7-489370b690d0", "tag": "8033a814-a000-4299-86cd-25366c02c28a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:36.468599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b950916f-9dd9-4d44-801d-d03e2d3eda64 req-016a7e93-cbe0-4f26-ba12-0b889fdac8af service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:36.469065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b950916f-9dd9-4d44-801d-d03e2d3eda64 req-016a7e93-cbe0-4f26-ba12-0b889fdac8af service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:36.481313 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b950916f-9dd9-4d44-801d-d03e2d3eda64 req-016a7e93-cbe0-4f26-ba12-0b889fdac8af service nova] Creating event network-changed:8033a814-a000-4299-86cd-25366c02c28a for instance 10494a1a-1806-43a2-97a7-489370b690d0 on nch1-master-1 May 14 22:08:36.486577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-b950916f-9dd9-4d44-801d-d03e2d3eda64 req-016a7e93-cbe0-4f26-ba12-0b889fdac8af service nova] Instance 10494a1a-1806-43a2-97a7-489370b690d0 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:08:36.497237 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b950916f-9dd9-4d44-801d-d03e2d3eda64 req-016a7e93-cbe0-4f26-ba12-0b889fdac8af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040560 May 14 22:08:36.497838 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3393/6785] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:08:37.043767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:37.044495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:37.052524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:37.054710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:37.054710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:37.054710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:37.251770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:37.260000 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-639b3171-4533-435c-a53c-c2472450c4a8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1683 microversion: 2.1 time: 0.221404 May 14 22:08:37.266735 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3394/6786] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:37 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1683 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:38.277887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:38.302965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:38.302965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:38.302965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:38.302965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:38.302965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:38.416308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:38.424413 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d0cf4d9-2b9c-44f9-b923-7c4a3b738b37 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1679 microversion: 2.1 time: 0.149912 May 14 22:08:38.435345 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3395/6787] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:38 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:38.440321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4c790633-a974-4738-a76e-55fc38d325a2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:38.440884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4c790633-a974-4738-a76e-55fc38d325a2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:38.446667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c790633-a974-4738-a76e-55fc38d325a2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:38.447170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c790633-a974-4738-a76e-55fc38d325a2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:38.447997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c790633-a974-4738-a76e-55fc38d325a2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:38.448456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4c790633-a974-4738-a76e-55fc38d325a2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:38.642180 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4c790633-a974-4738-a76e-55fc38d325a2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action" status: 204 len: 0 microversion: 2.1 time: 0.205316 May 14 22:08:38.643651 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3396/6788] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:08:38 2022] POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:08:38.652361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:38.653083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:38.660783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:38.661249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:38.662034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:38.662487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:38.838791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:38.846691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-16cc2215-c6f0-4a74-a306-2db75b801f3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1679 microversion: 2.1 time: 0.198594 May 14 22:08:38.847551 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3397/6789] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:38 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:39.866549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:39.867243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:39.874043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:39.874518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:39.875318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:39.875802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:40.014023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:40.022448 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58ed4e40-3a6c-4628-8dc4-c75fcef0cf12 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1679 microversion: 2.1 time: 0.161685 May 14 22:08:40.023529 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3398/6790] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:39 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:41.040721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:41.041361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:41.048157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.048626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.049451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.049913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.178820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:41.186288 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ff7367fd-cf1d-4cec-a9e3-99d68a2a7f80 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1658 microversion: 2.1 time: 0.149455 May 14 22:08:41.186814 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3399/6791] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:41 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1658 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:41.203043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:41.203710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:41.210416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.212483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.212483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.212483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.347439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:41.355060 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-173d473c-d03e-4fb6-9f9a-055f6371d0b2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1658 microversion: 2.1 time: 0.155990 May 14 22:08:41.355795 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3400/6792] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:41 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1658 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:41.366632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8f8e2011-b1d0-48b9-83f2-762f1c7e7980 req-bbfeab6e-65dc-4ea7-bf1b-4012d115cc18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10494a1a-1806-43a2-97a7-489370b690d0", "name": "network-vif-plugged", "status": "completed", "tag": "8033a814-a000-4299-86cd-25366c02c28a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:41.368723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8f8e2011-b1d0-48b9-83f2-762f1c7e7980 req-bbfeab6e-65dc-4ea7-bf1b-4012d115cc18 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.369202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8f8e2011-b1d0-48b9-83f2-762f1c7e7980 req-bbfeab6e-65dc-4ea7-bf1b-4012d115cc18 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.381597 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8f8e2011-b1d0-48b9-83f2-762f1c7e7980 req-bbfeab6e-65dc-4ea7-bf1b-4012d115cc18 service nova] Creating event network-vif-plugged:8033a814-a000-4299-86cd-25366c02c28a for instance 10494a1a-1806-43a2-97a7-489370b690d0 on nch1-master-1 May 14 22:08:41.389471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8f8e2011-b1d0-48b9-83f2-762f1c7e7980 req-bbfeab6e-65dc-4ea7-bf1b-4012d115cc18 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029616 May 14 22:08:41.389471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3401/6793] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:08:41.392196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-005a2f01-3777-4034-b582-4d1138dfe4a6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:41.398778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005a2f01-3777-4034-b582-4d1138dfe4a6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.399251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-005a2f01-3777-4034-b582-4d1138dfe4a6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.422107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-005a2f01-3777-4034-b582-4d1138dfe4a6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Going to try to start instance {{(pid=130637) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 22:08:41.576687 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-005a2f01-3777-4034-b582-4d1138dfe4a6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action" status: 202 len: 0 microversion: 2.1 time: 0.188011 May 14 22:08:41.577300 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3402/6794] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:08:41 2022] POST /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 22:08:41.586555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:41.587300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:41.593744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.598850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.598850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:41.598850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:41.731733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:41.739420 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f37c911-0cc9-46ca-91c9-588c85a38afc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1667 microversion: 2.1 time: 0.157006 May 14 22:08:41.740047 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3403/6795] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:41 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1667 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:42.756775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:42.757436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:42.764554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:42.771456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:42.771456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:42.771456 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:42.902117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:42.910974 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf11ad64-67eb-4b85-9d93-4ab20fe81813 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1667 microversion: 2.1 time: 0.158178 May 14 22:08:42.911588 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3404/6796] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:42 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1667 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:43.929392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:43.929983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:43.936791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:43.937271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:43.938136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:43.938566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:44.074734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:44.082474 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37bc1973-d5bf-4404-b38d-6fc9829224d7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1671 microversion: 2.1 time: 0.157216 May 14 22:08:44.083064 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3405/6797] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:43 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:44.100688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:44.101268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:44.107362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:44.107877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:44.108698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:44.109157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:44.135209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:08:44.384692 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-187bf96d-3cca-4f20-b72e-cc621840aabe tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 204 len: 0 microversion: 2.1 time: 0.287288 May 14 22:08:44.385290 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3406/6798] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:08:44 2022] DELETE /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:08:44.393913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:44.394690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:44.401250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:44.401711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:44.402492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:44.402944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:44.535337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:44.542753 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-92aa5ea5-616c-42f6-a146-1d631edc9c17 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1677 microversion: 2.1 time: 0.152982 May 14 22:08:44.543332 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3407/6799] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:44 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:08:45.560804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:45.561455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:45.569212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:45.569678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:45.570511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:45.571008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:45.711453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:45.719099 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-edc7cf10-4358-4ba8-a080-bfe38fcbb573 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1677 microversion: 2.1 time: 0.162402 May 14 22:08:45.721856 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3408/6800] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:45 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:46.604591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5f3e9527-1c47-4905-9eb1-03bd7ddc1f00 req-604e97f8-12a5-48f8-9a35-c0848cef5c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10494a1a-1806-43a2-97a7-489370b690d0", "name": "network-vif-deleted", "tag": "8033a814-a000-4299-86cd-25366c02c28a"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:46.613828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5f3e9527-1c47-4905-9eb1-03bd7ddc1f00 req-604e97f8-12a5-48f8-9a35-c0848cef5c1b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:46.614296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5f3e9527-1c47-4905-9eb1-03bd7ddc1f00 req-604e97f8-12a5-48f8-9a35-c0848cef5c1b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:46.625655 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5f3e9527-1c47-4905-9eb1-03bd7ddc1f00 req-604e97f8-12a5-48f8-9a35-c0848cef5c1b service nova] Creating event network-vif-deleted:8033a814-a000-4299-86cd-25366c02c28a for instance 10494a1a-1806-43a2-97a7-489370b690d0 on nch1-master-1 May 14 22:08:46.631687 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5f3e9527-1c47-4905-9eb1-03bd7ddc1f00 req-604e97f8-12a5-48f8-9a35-c0848cef5c1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030881 May 14 22:08:46.634726 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3409/6801] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:08:46.738120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:46.738846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:46.746417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:46.747021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:46.748424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:46.749135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:46.822386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:46.830517 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60ab91b4-aafb-4338-9266-84ec62deee83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 200 len: 1324 microversion: 2.1 time: 0.097132 May 14 22:08:46.831296 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3410/6802] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:46 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 1324 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:47.847663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:47.848315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:47.855292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:47.855803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:47.856594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:47.857057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:47.871268 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 HTTP/1.1 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '10494a1a-1806-43a2-97a7-489370b690d0'} May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:08:47.872996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2e190021-132e-42bf-bc55-e9cfbd280ddf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 404 len: 111 microversion: 2.1 time: 0.031130 May 14 22:08:47.877996 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3411/6803] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:47 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:08:47.895039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:47.898786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:47.901865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:47.902338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:47.903124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:47.903633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:47.918278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 HTTP/1.1 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '10494a1a-1806-43a2-97a7-489370b690d0'} May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:08:47.919884 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8331dd4-5269-4f27-b0fa-8312f5ca4fbd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 404 len: 111 microversion: 2.1 time: 0.030751 May 14 22:08:47.924706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3412/6804] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:47 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:08:47.970464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-503981298", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "6c0f6c30-a116-462c-8817-5c68f4794dd4"}], "security_groups": [{"name": "tempest-securitygroup--2015306617"}], "key_name": "tempest-keypair-1443535878", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:48.070872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] validate_networks() for [('6c0f6c30-a116-462c-8817-5c68f4794dd4', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:08:48.758621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:08:48.759064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:08:48.759614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:08:48.760048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:08:48.760512 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:08:48.769556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:48.770025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:48.770858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:48.771313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:48.788561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:08:48.793785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for user 58d7a44fb4b64d5d98bdda07c1638f20 and project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:08:48.807022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:08:48.809396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:08:48.918904 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b455342-92ea-403f-af9f-0e65478ec1ec tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.952803 May 14 22:08:48.919592 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3413/6805] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:08:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:08:48.930288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-240315b8-1781-4860-aa8d-d4f1e87264f6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:48.930936 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-240315b8-1781-4860-aa8d-d4f1e87264f6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:48.988644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-240315b8-1781-4860-aa8d-d4f1e87264f6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:48.995670 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-240315b8-1781-4860-aa8d-d4f1e87264f6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1238 microversion: 2.1 time: 0.069407 May 14 22:08:48.996211 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3414/6806] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:48 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:50.013215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:50.013836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:50.021711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:50.027814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:50.027814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:50.027814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:50.088199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:50.096047 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c18a122d-06c1-4752-965f-095015b236b9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1234 microversion: 2.1 time: 0.086885 May 14 22:08:50.096740 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3415/6807] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:50 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:51.114045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:51.114685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:51.121639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:51.122219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:51.122923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:51.123384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:51.210685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:51.218283 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3c1c57c-8785-4bad-9da6-f4ea33b6b441 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1296 microversion: 2.1 time: 0.108313 May 14 22:08:51.218872 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3416/6808] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:51 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:52.237739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:52.238696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:52.245908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:52.246522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:52.247772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:52.248240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:52.438910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:52.450063 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2c1db18-4f79-4000-ad76-2015dcfe2b54 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1364 microversion: 2.1 time: 0.216631 May 14 22:08:52.458629 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3417/6809] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:52 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:52.464155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ee187d4c-cfe8-4d40-a3e9-156d0b4bcb1e req-17d8c6a0-7f79-4315-b43b-a1e447e1ddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:52.472810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee187d4c-cfe8-4d40-a3e9-156d0b4bcb1e req-17d8c6a0-7f79-4315-b43b-a1e447e1ddc7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:52.475919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ee187d4c-cfe8-4d40-a3e9-156d0b4bcb1e req-17d8c6a0-7f79-4315-b43b-a1e447e1ddc7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:52.485294 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ee187d4c-cfe8-4d40-a3e9-156d0b4bcb1e req-17d8c6a0-7f79-4315-b43b-a1e447e1ddc7 service nova] Creating event network-changed:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch2-master-1 May 14 22:08:52.490691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ee187d4c-cfe8-4d40-a3e9-156d0b4bcb1e req-17d8c6a0-7f79-4315-b43b-a1e447e1ddc7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030339 May 14 22:08:52.491576 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3418/6810] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:08:53.468587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:53.469313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:53.476339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:53.476823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:53.477620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:53.478084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:53.606012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:53.614059 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a6a1abfd-7696-4fa5-9660-5d9e20306e11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1364 microversion: 2.1 time: 0.150526 May 14 22:08:53.614649 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3419/6811] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:53 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:54.631959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:54.632625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:54.639495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:54.639975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:54.640763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:54.641224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:54.776663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:54.785424 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e4c24ab2-1f9a-426a-9227-88706a1e7592 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1364 microversion: 2.1 time: 0.158088 May 14 22:08:54.786010 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3420/6812] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:54 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:55.802621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:55.803297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:55.810273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:55.810748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:55.811565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:55.812028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:55.941785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:55.949165 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00685115-9a2b-418f-8685-9821038c0a57 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1364 microversion: 2.1 time: 0.150581 May 14 22:08:55.949760 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3421/6813] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:55 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:56.967139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:56.967836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:56.975729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:56.976208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:56.977009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:56.977603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:57.115397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:57.123052 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b7c1b307-5b52-491b-8eee-cdde78d90442 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1364 microversion: 2.1 time: 0.159831 May 14 22:08:57.123673 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3422/6814] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:56 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:57.179820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cf2e5415-9e7b-415a-8a28-de8efd62c4da req-e2b0c7a2-9cbc-44cc-a941-6d6652d79705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "name": "network-vif-plugged", "status": "completed", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:08:57.187861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cf2e5415-9e7b-415a-8a28-de8efd62c4da req-e2b0c7a2-9cbc-44cc-a941-6d6652d79705 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:57.188322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cf2e5415-9e7b-415a-8a28-de8efd62c4da req-e2b0c7a2-9cbc-44cc-a941-6d6652d79705 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:57.199958 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cf2e5415-9e7b-415a-8a28-de8efd62c4da req-e2b0c7a2-9cbc-44cc-a941-6d6652d79705 service nova] Creating event network-vif-plugged:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch2-master-1 May 14 22:08:57.204992 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cf2e5415-9e7b-415a-8a28-de8efd62c4da req-e2b0c7a2-9cbc-44cc-a941-6d6652d79705 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028959 May 14 22:08:57.206358 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3423/6815] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:08:58.143242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:58.144360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:58.151667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:58.152145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:58.153335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:58.154187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:58.289636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:58.297124 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-61996101-7d2b-4b91-af26-0e15ccbbbedb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1364 microversion: 2.1 time: 0.159469 May 14 22:08:58.297701 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3424/6816] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:58 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:59.314450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:59.315976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:59.323045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:59.323543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:59.324328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:59.324782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:59.456885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:08:59.464408 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f712286-1c12-4b2e-a961-23e602867840 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1552 microversion: 2.1 time: 0.154082 May 14 22:08:59.464991 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3425/6817] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:08:59 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:08:59.480700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-65aede71-c82d-4e52-bf5b-15d1560bf2b7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:08:59.481217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-65aede71-c82d-4e52-bf5b-15d1560bf2b7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:08:59.486906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65aede71-c82d-4e52-bf5b-15d1560bf2b7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:59.487374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65aede71-c82d-4e52-bf5b-15d1560bf2b7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:59.488192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65aede71-c82d-4e52-bf5b-15d1560bf2b7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:08:59.488655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65aede71-c82d-4e52-bf5b-15d1560bf2b7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:08:59.566254 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-65aede71-c82d-4e52-bf5b-15d1560bf2b7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088979 May 14 22:08:59.566807 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3426/6818] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 22:08:59 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:00.592529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:00.593533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:00.600376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:00.600848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:00.601640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:00.602100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:00.631206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:00.637371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:09:00.643832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:09:00.644280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:09:00.644777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:09:00.645233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:09:00.645643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:09:00.835179 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f08c0adf-0fae-4b7b-8173-dcbf3744f43b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d/action" status: 202 len: 0 microversion: 2.1 time: 0.247439 May 14 22:09:00.835952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3427/6819] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:09:00 2022] POST /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 22:09:00.840773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-75e7f158-ee2e-4881-8397-31da80f295a5 req-886f191e-673c-4233-8628-bc007859bc11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:00.849753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-75e7f158-ee2e-4881-8397-31da80f295a5 req-886f191e-673c-4233-8628-bc007859bc11 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:00.850247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-75e7f158-ee2e-4881-8397-31da80f295a5 req-886f191e-673c-4233-8628-bc007859bc11 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:00.864447 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-75e7f158-ee2e-4881-8397-31da80f295a5 req-886f191e-673c-4233-8628-bc007859bc11 service nova] Creating event network-changed:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch2-master-1 May 14 22:09:00.869399 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-75e7f158-ee2e-4881-8397-31da80f295a5 req-886f191e-673c-4233-8628-bc007859bc11 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032316 May 14 22:09:00.871365 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3428/6820] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:09:00.874969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:00.875715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:00.882418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:00.882935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:00.883757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:00.884216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:01.101918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:01.111187 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c496313-9858-4959-a8d7-03ab5734b85a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1561 microversion: 2.1 time: 0.239738 May 14 22:09:01.112228 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3429/6821] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:00 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1561 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:09:02.130004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:02.130649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:02.138023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:02.138432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:02.139232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:02.139736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:02.271500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:02.279947 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8819ae0a-c74f-4ec4-b3c4-86584a6a31e4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1680 microversion: 2.1 time: 0.154614 May 14 22:09:02.280563 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3430/6822] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:02 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:03.298631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:03.299381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:03.307192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:03.307727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:03.308536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:03.309080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:03.515203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:03.523566 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47bf48bf-439b-4540-aad5-d56f51544972 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1680 microversion: 2.1 time: 0.229139 May 14 22:09:03.524169 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3431/6823] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:03 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:04.541818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:04.542464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:04.549429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:04.549887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:04.551324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:04.551820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:04.678931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:04.686585 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-48612dbc-70df-4275-a769-1be9a52f60f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.148726 May 14 22:09:04.687350 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3432/6824] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:04 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:05.704316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:05.704926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:05.712148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:05.712626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:05.713452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:05.713907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:05.845667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:05.853772 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b3f6abd-66a7-422c-b75e-947ea949aa81 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.153498 May 14 22:09:05.854386 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3433/6825] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:05 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:06.871435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:06.872154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:06.879101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:06.879609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:06.880405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:06.880865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:07.008896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:07.016643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ab8d11d0-409d-41e6-9aba-bd7800d33d76 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.149224 May 14 22:09:07.017232 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3434/6826] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:06 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:08.035461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:08.036109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:08.043294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:08.043805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:08.044593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:08.045048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:08.177700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:08.189370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a7089495-6f6d-4261-be65-5351666eb6dc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.154493 May 14 22:09:08.189370 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3435/6827] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:08 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:09.203517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:09.204103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:09.211766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:09.212236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:09.213023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:09.213483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:09.345304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:09.353758 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a8645be-8ce0-4c04-b08c-ed83e571fc82 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.154298 May 14 22:09:09.354351 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3436/6828] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:09 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:10.373463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:10.374143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:10.381288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:10.381766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:10.382565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:10.383029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:10.513536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:10.521292 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b29b1f53-3ab3-4364-838c-b4a2df729cd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.151895 May 14 22:09:10.521872 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3437/6829] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:10 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:11.538716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:11.539352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:11.546350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:11.546821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:11.547663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:11.548130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:11.678247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:11.685825 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be9ee654-0652-4b7f-8fcc-677558c8d2c9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.151429 May 14 22:09:11.686414 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3438/6830] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:11 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:12.703616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:12.704283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:12.711885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:12.712361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:12.713150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:12.713609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:12.843176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:12.851220 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa8b0174-3b2f-4272-b547-9a775b0ed161 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.151563 May 14 22:09:12.851843 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3439/6831] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:12 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:13.869027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:13.869703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:13.876642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:13.877119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:13.878230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:13.878641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:14.012026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:14.020285 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1e4e536-585d-4272-a10a-67d448ea234f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.155737 May 14 22:09:14.021965 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3440/6832] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:13 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:15.039885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:15.040515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:15.048044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:15.048528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:15.049344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:15.050760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:15.184307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:15.194027 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f5695c9b-f5a9-4d30-8dbc-eaddb09c6476 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.160361 May 14 22:09:15.194642 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3441/6833] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:15 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:16.210944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:16.211611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:16.217975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:16.218397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:16.219171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:16.219655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:16.348850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:16.356384 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6d4ff45-4128-4c71-aab2-9657ee3d9569 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.149356 May 14 22:09:16.356961 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3442/6834] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:16 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:17.374366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:17.374997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:17.382615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:17.383091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:17.383913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:17.384378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:17.516527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:17.524360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-338ef988-b59b-4d77-bf19-5df2778dc8ff tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.154092 May 14 22:09:17.524952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3443/6835] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:17 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:18.541738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:18.542411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:18.549611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:18.550560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:18.551024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:18.551539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:18.689474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:18.697660 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6355e53-3140-46cc-bdc4-c08fd32765c3 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.159909 May 14 22:09:18.698249 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3444/6836] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:18 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:19.715619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:19.716216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:19.723524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:19.723995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:19.724773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:19.725224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:19.855096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:19.863171 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-67b80c86-3995-4d1f-b8d7-e91f0fd6cc83 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1685 microversion: 2.1 time: 0.151588 May 14 22:09:19.863779 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3445/6837] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:19 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:20.880975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:20.881647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:20.889121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:20.889599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:20.890431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:20.890903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:21.444556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:21.452194 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe84356a-836f-436d-8587-d259084d127f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1684 microversion: 2.1 time: 0.575757 May 14 22:09:21.452796 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3446/6838] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:20 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1684 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:21.724611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6908bfbb-2c65-4033-91ad-a2ea2205f3ac req-e0a4ac8c-e2cd-460f-a906-820f22f2cd75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "name": "network-vif-unplugged", "status": "completed", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:21.733065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6908bfbb-2c65-4033-91ad-a2ea2205f3ac req-e0a4ac8c-e2cd-460f-a906-820f22f2cd75 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:21.733538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6908bfbb-2c65-4033-91ad-a2ea2205f3ac req-e0a4ac8c-e2cd-460f-a906-820f22f2cd75 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:21.746074 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6908bfbb-2c65-4033-91ad-a2ea2205f3ac req-e0a4ac8c-e2cd-460f-a906-820f22f2cd75 service nova] Creating event network-vif-unplugged:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch1-master-1 May 14 22:09:21.751572 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-6908bfbb-2c65-4033-91ad-a2ea2205f3ac req-e0a4ac8c-e2cd-460f-a906-820f22f2cd75 service nova] Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:09:21.762865 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6908bfbb-2c65-4033-91ad-a2ea2205f3ac req-e0a4ac8c-e2cd-460f-a906-820f22f2cd75 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042937 May 14 22:09:21.763468 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3447/6839] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:22.471628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:22.472794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:22.479008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:22.479494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:22.480292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:22.480750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:22.682904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:22.691136 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-469f384b-fc24-489d-8b16-09bd48c1ac0c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1684 microversion: 2.1 time: 0.224159 May 14 22:09:22.691979 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3448/6840] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:22 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1684 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:23.708329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:23.708960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:23.716291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:23.716704 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:23.717482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:23.717935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:23.855552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:23.863231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04bd8fc7-07b7-45fa-bebd-349924736aa0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1682 microversion: 2.1 time: 0.158876 May 14 22:09:23.863845 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3449/6841] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:23 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:09:23.869651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a4856a21-7120-47ca-87e7-84c5532970af req-0d52aa90-ac21-4c00-9142-cd275b421be1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:23.877529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a4856a21-7120-47ca-87e7-84c5532970af req-0d52aa90-ac21-4c00-9142-cd275b421be1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:23.878528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a4856a21-7120-47ca-87e7-84c5532970af req-0d52aa90-ac21-4c00-9142-cd275b421be1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:23.890247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a4856a21-7120-47ca-87e7-84c5532970af req-0d52aa90-ac21-4c00-9142-cd275b421be1 service nova] Creating event network-changed:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch1-master-1 May 14 22:09:23.896418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-a4856a21-7120-47ca-87e7-84c5532970af req-0d52aa90-ac21-4c00-9142-cd275b421be1 service nova] Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:09:23.907008 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a4856a21-7120-47ca-87e7-84c5532970af req-0d52aa90-ac21-4c00-9142-cd275b421be1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042017 May 14 22:09:23.907646 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3450/6842] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:09:24.882566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:24.883285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:24.889427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:24.889895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:24.890672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:24.891125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:25.024814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:25.032357 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-094daa70-ed64-4d01-bd07-7e82599ca5ab tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1679 microversion: 2.1 time: 0.155627 May 14 22:09:25.032937 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3451/6843] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:24 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:25.048436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:25.048992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:25.055333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:25.055843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:25.056631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:25.057094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:25.094006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:25.094474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:25.095302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:25.095787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:25.116406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:09:25.121567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for user 58d7a44fb4b64d5d98bdda07c1638f20 and project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:09:25.469172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cf6c665-fd03-4511-b61f-288b71e374e0 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d/action" status: 202 len: 0 microversion: 2.1 time: 0.424161 May 14 22:09:25.469801 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3452/6844] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:09:25 2022] POST /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:09:25.478931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:25.479993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:25.487120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:25.488289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:25.489067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:25.489532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:25.690247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:25.705605 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4aa8b9d-ff8e-49d2-8734-875b1ee3b9c8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1678 microversion: 2.1 time: 0.227964 May 14 22:09:25.705605 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3453/6845] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:25 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:26.721383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:26.722619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:26.729597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:26.730060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:26.730842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:26.731302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:26.860156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:26.868521 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e3e69bb4-0ce5-4b86-85bf-0b2f34895796 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1678 microversion: 2.1 time: 0.151256 May 14 22:09:26.869092 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3454/6846] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:26 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:27.547703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-577b5ea8-6642-417e-bb9b-2f71858f3b84 req-d510012d-359a-4c67-b834-352ea8b457ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "name": "network-vif-plugged", "status": "completed", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:27.556846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-577b5ea8-6642-417e-bb9b-2f71858f3b84 req-d510012d-359a-4c67-b834-352ea8b457ea service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:27.557316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-577b5ea8-6642-417e-bb9b-2f71858f3b84 req-d510012d-359a-4c67-b834-352ea8b457ea service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:27.573096 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-577b5ea8-6642-417e-bb9b-2f71858f3b84 req-d510012d-359a-4c67-b834-352ea8b457ea service nova] Creating event network-vif-plugged:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch1-master-1 May 14 22:09:27.578569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-577b5ea8-6642-417e-bb9b-2f71858f3b84 req-d510012d-359a-4c67-b834-352ea8b457ea service nova] Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:09:27.590610 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-577b5ea8-6642-417e-bb9b-2f71858f3b84 req-d510012d-359a-4c67-b834-352ea8b457ea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109956 May 14 22:09:27.591232 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3455/6847] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:27.887226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:27.887897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:27.894942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:27.895404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:27.896210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:27.896660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:28.031424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:28.039601 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d86edf80-0d58-46f2-9735-298b1a2cdcf8 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1678 microversion: 2.1 time: 0.157480 May 14 22:09:28.040190 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3456/6848] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:27 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:29.057268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:29.057915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:29.064747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:29.065820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:29.066773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:29.067233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:29.201427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:29.210243 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9bba9ff7-6895-4039-93c3-53c21d992b5b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1678 microversion: 2.1 time: 0.156948 May 14 22:09:29.219956 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3457/6849] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:29 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:29.219956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c6f0afd6-0580-4daa-b398-08c9e0888aba req-140cd524-7a53-44ec-9a30-b5effc3d5d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "name": "network-vif-unplugged", "status": "completed", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:29.224008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c6f0afd6-0580-4daa-b398-08c9e0888aba req-140cd524-7a53-44ec-9a30-b5effc3d5d89 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:29.224478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c6f0afd6-0580-4daa-b398-08c9e0888aba req-140cd524-7a53-44ec-9a30-b5effc3d5d89 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:29.236732 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c6f0afd6-0580-4daa-b398-08c9e0888aba req-140cd524-7a53-44ec-9a30-b5effc3d5d89 service nova] Creating event network-vif-unplugged:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch2-master-1 May 14 22:09:29.247050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-c6f0afd6-0580-4daa-b398-08c9e0888aba req-140cd524-7a53-44ec-9a30-b5effc3d5d89 service nova] Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:09:29.259390 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c6f0afd6-0580-4daa-b398-08c9e0888aba req-140cd524-7a53-44ec-9a30-b5effc3d5d89 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047299 May 14 22:09:29.266423 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3458/6850] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:09:30.229059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:30.229785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:30.236163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:30.236644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:30.237472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:30.237930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:30.368097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:30.375694 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-49b318aa-d54e-4f40-9d35-8594dd70f480 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1678 microversion: 2.1 time: 0.151986 May 14 22:09:30.376272 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3459/6851] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:30 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:31.291864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b9cea1aa-1532-4990-80c6-72ee26b872a1 req-a9920f9a-f7ef-4068-acbd-0e4ab148cb4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:31.300932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b9cea1aa-1532-4990-80c6-72ee26b872a1 req-a9920f9a-f7ef-4068-acbd-0e4ab148cb4e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:31.301406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b9cea1aa-1532-4990-80c6-72ee26b872a1 req-a9920f9a-f7ef-4068-acbd-0e4ab148cb4e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:31.313555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b9cea1aa-1532-4990-80c6-72ee26b872a1 req-a9920f9a-f7ef-4068-acbd-0e4ab148cb4e service nova] Creating event network-changed:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch2-master-1 May 14 22:09:31.319392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-b9cea1aa-1532-4990-80c6-72ee26b872a1 req-a9920f9a-f7ef-4068-acbd-0e4ab148cb4e service nova] Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:09:31.330184 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b9cea1aa-1532-4990-80c6-72ee26b872a1 req-a9920f9a-f7ef-4068-acbd-0e4ab148cb4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042738 May 14 22:09:31.331362 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3460/6852] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:09:31.394053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:31.396212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:31.401432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:31.401912 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:31.403049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:31.403627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:32.051986 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:32.059730 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5b024a6f-8632-4ac5-b867-f5795014e743 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1678 microversion: 2.1 time: 0.670756 May 14 22:09:32.069948 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3461/6853] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:31 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1678 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:33.078093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:33.078756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:33.085811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.086281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.087057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.087536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.228716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:33.236539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b68b1f1-e55f-4acc-b475-f728dbe1eff4 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1671 microversion: 2.1 time: 0.162445 May 14 22:09:33.237892 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3462/6854] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:33 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:33.253763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:33.254618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:33.260582 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.261047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.261886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.262303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.393445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:33.401232 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5aa64e4a-01d3-437a-8de9-adfef35dc186 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1671 microversion: 2.1 time: 0.151884 May 14 22:09:33.402123 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3463/6855] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:33 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:33.407327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5d40ac47-bf42-4183-99f7-648e665b2e2e req-06c7a77a-3860-4f0f-a3d5-5261ea6e1695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "name": "network-vif-plugged", "status": "completed", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:33.415621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5d40ac47-bf42-4183-99f7-648e665b2e2e req-06c7a77a-3860-4f0f-a3d5-5261ea6e1695 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.416135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5d40ac47-bf42-4183-99f7-648e665b2e2e req-06c7a77a-3860-4f0f-a3d5-5261ea6e1695 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.428117 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5d40ac47-bf42-4183-99f7-648e665b2e2e req-06c7a77a-3860-4f0f-a3d5-5261ea6e1695 service nova] Creating event network-vif-plugged:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch2-master-1 May 14 22:09:33.433594 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5d40ac47-bf42-4183-99f7-648e665b2e2e req-06c7a77a-3860-4f0f-a3d5-5261ea6e1695 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030594 May 14 22:09:33.434399 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3464/6856] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:09:33.439619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:33.440988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:33.447459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.447966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.448758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.449216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.578045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:33.585809 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c4319fe-4c11-4cc3-b2ac-0c5a298c77d1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1671 microversion: 2.1 time: 0.150301 May 14 22:09:33.586388 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3465/6857] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:33 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:09:33.601814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:33.602330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:33.608255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.608730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.609549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.610007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.640664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:09:33.910984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4e6195c9-706b-485f-b20c-24855694548c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 204 len: 0 microversion: 2.1 time: 0.312287 May 14 22:09:33.911726 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3466/6858] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:09:33 2022] DELETE /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:09:33.920435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:33.921156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:33.927882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.928352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:33.929141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:33.929597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:34.066598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:34.074209 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-948e148f-c0ed-476d-b1ce-2b0c23cbfd11 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1677 microversion: 2.1 time: 0.158325 May 14 22:09:34.074962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3467/6859] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:33 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:35.091714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:35.092373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:35.099999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:35.100471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:35.101248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:35.101705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:35.256654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:35.264294 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59eaf860-ad96-4e97-844d-34e7bf858b3a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1677 microversion: 2.1 time: 0.176533 May 14 22:09:35.264887 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3468/6860] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:35 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:36.128675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8113688e-c254-4e24-98d0-658ce1a867aa req-04aae811-6eef-4190-97d6-c26ae1944149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb08a4d-6fa8-496e-9b45-07a3785eb90d", "name": "network-vif-deleted", "tag": "d398d426-0579-4af9-ba56-dd386cf6f87d"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:36.137810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8113688e-c254-4e24-98d0-658ce1a867aa req-04aae811-6eef-4190-97d6-c26ae1944149 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:36.138283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8113688e-c254-4e24-98d0-658ce1a867aa req-04aae811-6eef-4190-97d6-c26ae1944149 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:36.149759 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8113688e-c254-4e24-98d0-658ce1a867aa req-04aae811-6eef-4190-97d6-c26ae1944149 service nova] Creating event network-vif-deleted:d398d426-0579-4af9-ba56-dd386cf6f87d for instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d on nch2-master-1 May 14 22:09:36.154821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8113688e-c254-4e24-98d0-658ce1a867aa req-04aae811-6eef-4190-97d6-c26ae1944149 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030055 May 14 22:09:36.155431 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3469/6861] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:36.282991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:36.284505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:36.292070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:36.292546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:36.293534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:36.293990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:36.418647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:36.427167 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-069a0b76-49e0-440b-82ea-eaf452042009 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 200 len: 1323 microversion: 2.1 time: 0.148596 May 14 22:09:36.427926 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3470/6862] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:36 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:37.445354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:37.445997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:37.452969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:37.453437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:37.454230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:37.454688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:37.469369 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d HTTP/1.1 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '5fb08a4d-6fa8-496e-9b45-07a3785eb90d'} May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:09:37.471086 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8dcff35b-f1e7-4ed9-84d8-b31b13d44d61 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 404 len: 111 microversion: 2.1 time: 0.031664 May 14 22:09:37.475303 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3471/6863] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:37 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:09:37.491133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:37.491794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:37.498097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:37.498574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:37.499371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:37.499854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:37.513939 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d HTTP/1.1 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '5fb08a4d-6fa8-496e-9b45-07a3785eb90d'} May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:09:37.515493 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d6c43bc-f681-4dfe-b918-cc1d9a916bcd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 404 len: 111 microversion: 2.1 time: 0.030144 May 14 22:09:37.520532 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3472/6864] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:37 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:09:37.570829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-453694532", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "6c0f6c30-a116-462c-8817-5c68f4794dd4"}], "security_groups": [{"name": "tempest-securitygroup--2015306617"}], "key_name": "tempest-keypair-1443535878", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:37.674342 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] validate_networks() for [('6c0f6c30-a116-462c-8817-5c68f4794dd4', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:09:38.085980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:09:38.086424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:09:38.086923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:09:38.087384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:09:38.087845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:09:38.097236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:38.097644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:38.098485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:38.098947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:38.115600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:09:38.120858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for user 58d7a44fb4b64d5d98bdda07c1638f20 and project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:09:38.133827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:09:38.136174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:09:38.249541 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-02d4227a-8dd1-441b-bc3a-1859857d934a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.682517 May 14 22:09:38.250221 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3473/6865] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:09:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:09:38.260648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7a6d2bc9-4797-4d8e-a816-f69defde9b5d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:38.261280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7a6d2bc9-4797-4d8e-a816-f69defde9b5d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:38.317237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7a6d2bc9-4797-4d8e-a816-f69defde9b5d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:38.324315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7a6d2bc9-4797-4d8e-a816-f69defde9b5d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1238 microversion: 2.1 time: 0.067528 May 14 22:09:38.325225 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3474/6866] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:38 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:39.341534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:39.342260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:39.350816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:39.351283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:39.352199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:39.352662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:39.496397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:39.504699 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2b9d4055-d4b4-4b59-9d81-771e4a8fb018 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1234 microversion: 2.1 time: 0.167060 May 14 22:09:39.505294 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3475/6867] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:39 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1234 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:40.523036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:40.527622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:40.531145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:40.531648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:40.532459 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:40.532932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:40.610218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:40.618470 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34068713-5cc8-43a6-9460-1bfb9c1942ba tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1296 microversion: 2.1 time: 0.100037 May 14 22:09:40.619264 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3476/6868] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:40 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:41.636648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:41.637665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:41.645243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:41.645713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:41.646499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:41.646951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:41.851324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:41.865214 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c6d90bb-66f5-4bbc-b9c4-98a5489b9750 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1364 microversion: 2.1 time: 0.227671 May 14 22:09:41.865214 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3477/6869] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:41 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:09:41.866469 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c3830b27-4710-4973-96f1-6d5b52dcf50a req-c47ce4b5-bc50-4670-9933-d6d6d3777b80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:41.876652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c3830b27-4710-4973-96f1-6d5b52dcf50a req-c47ce4b5-bc50-4670-9933-d6d6d3777b80 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:41.877121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c3830b27-4710-4973-96f1-6d5b52dcf50a req-c47ce4b5-bc50-4670-9933-d6d6d3777b80 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:41.889953 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c3830b27-4710-4973-96f1-6d5b52dcf50a req-c47ce4b5-bc50-4670-9933-d6d6d3777b80 service nova] Creating event network-changed:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch2-master-1 May 14 22:09:41.896534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c3830b27-4710-4973-96f1-6d5b52dcf50a req-c47ce4b5-bc50-4670-9933-d6d6d3777b80 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033522 May 14 22:09:41.896534 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3478/6870] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:09:42.879862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:42.880532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:42.886974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:42.887455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:42.888287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:42.888751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:43.027122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:43.035540 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0fd400fc-423e-4ce0-aa4b-f00b8c697efd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1364 microversion: 2.1 time: 0.161227 May 14 22:09:43.036120 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3479/6871] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:42 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:44.053629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:44.054262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:44.061142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:44.061618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:44.062464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:44.063019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:44.195044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:44.202846 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a2ceadd-8f85-4116-902a-a923bce5fe23 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1364 microversion: 2.1 time: 0.153671 May 14 22:09:44.203424 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3480/6872] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:44 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:45.220382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:45.221184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:45.228164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:45.228644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:45.229446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:45.229914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:45.366617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:45.374082 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b2f69ba-8f71-49a9-b221-8db11c9744df tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1364 microversion: 2.1 time: 0.157632 May 14 22:09:45.374692 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3481/6873] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:45 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:45.429878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8a2d2aca-76c7-40b7-bacc-5e8d00d34b73 req-fe958202-798b-49da-9d76-5c78219a69bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "name": "network-vif-plugged", "status": "completed", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:45.437824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8a2d2aca-76c7-40b7-bacc-5e8d00d34b73 req-fe958202-798b-49da-9d76-5c78219a69bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:45.438317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8a2d2aca-76c7-40b7-bacc-5e8d00d34b73 req-fe958202-798b-49da-9d76-5c78219a69bd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:45.449650 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8a2d2aca-76c7-40b7-bacc-5e8d00d34b73 req-fe958202-798b-49da-9d76-5c78219a69bd service nova] Creating event network-vif-plugged:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch2-master-1 May 14 22:09:45.454456 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8a2d2aca-76c7-40b7-bacc-5e8d00d34b73 req-fe958202-798b-49da-9d76-5c78219a69bd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028412 May 14 22:09:45.455796 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3482/6874] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:46.393205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:46.393924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:46.400304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:46.400724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:46.401507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:46.401966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:46.534602 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:46.542415 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a867abaa-a15f-42f6-8647-a5c55e8447bc tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1364 microversion: 2.1 time: 0.154702 May 14 22:09:46.545440 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3483/6875] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:46 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:47.559741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:47.560377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:47.567601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:47.568080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:47.568875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:47.569335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:47.700628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:47.710940 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9878334c-22cb-4b15-b596-65b01fc867c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1552 microversion: 2.1 time: 0.155230 May 14 22:09:47.711556 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3484/6876] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:47 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:47.728424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-787040b7-1b01-4163-a582-991beb41e99c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:47.728868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-787040b7-1b01-4163-a582-991beb41e99c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:47.734709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-787040b7-1b01-4163-a582-991beb41e99c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:47.735184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-787040b7-1b01-4163-a582-991beb41e99c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:47.736006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-787040b7-1b01-4163-a582-991beb41e99c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:47.736470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-787040b7-1b01-4163-a582-991beb41e99c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:47.817819 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-787040b7-1b01-4163-a582-991beb41e99c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093265 May 14 22:09:47.818618 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3485/6877] 10.222.0.52 () {58 vars in 1274 bytes} [Sat May 14 22:09:47 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:49.303914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-49086449-3524-4095-baf6-d1b8a586e698 req-bb819a70-876f-49c3-a516-49de75ea69f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:49.313965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-49086449-3524-4095-baf6-d1b8a586e698 req-bb819a70-876f-49c3-a516-49de75ea69f3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:49.314443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-49086449-3524-4095-baf6-d1b8a586e698 req-bb819a70-876f-49c3-a516-49de75ea69f3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:49.327812 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-49086449-3524-4095-baf6-d1b8a586e698 req-bb819a70-876f-49c3-a516-49de75ea69f3 service nova] Creating event network-changed:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch2-master-1 May 14 22:09:49.333488 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-49086449-3524-4095-baf6-d1b8a586e698 req-bb819a70-876f-49c3-a516-49de75ea69f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098485 May 14 22:09:49.334125 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3486/6878] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:50.962110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:50.962839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:50.969145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:50.969613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:50.970400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:50.970852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:51.104995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:51.112841 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a20ad281-9dc7-4bd4-acba-d209cccf9bdf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1671 microversion: 2.1 time: 0.158330 May 14 22:09:51.113435 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3487/6879] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:50 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:51.129441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-620972ba-bc94-4442-b82e-99a8266b3c4b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fe194cc-792c-4fc5-aef4-bfc0c2f55c17"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:51.130586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-620972ba-bc94-4442-b82e-99a8266b3c4b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:51.136372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-620972ba-bc94-4442-b82e-99a8266b3c4b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:51.136839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-620972ba-bc94-4442-b82e-99a8266b3c4b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:51.137621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-620972ba-bc94-4442-b82e-99a8266b3c4b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:51.138089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-620972ba-bc94-4442-b82e-99a8266b3c4b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:51.748578 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-620972ba-bc94-4442-b82e-99a8266b3c4b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.623297 May 14 22:09:51.749340 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3488/6880] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 22:09:51 2022] POST /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:09:55.014909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:09:55.016172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:55.024628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:55.025514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:55.026414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:55.027118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:55.061768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:55.068192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:09:55.075493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:09:55.075945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:09:55.076438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:09:55.076868 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:09:55.077300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:09:55.274887 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2acd74ea-4b7f-481b-80eb-67ce603397ac tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/action" status: 202 len: 0 microversion: 2.1 time: 0.265186 May 14 22:09:55.275548 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3489/6881] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:09:55 2022] POST /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:09:55.283729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:55.284532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:55.291080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:55.291586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:55.292396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:55.292856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:55.808398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:55.821282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6db021e0-bf29-42f0-a559-d6c1cb0781e2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1726 microversion: 2.1 time: 0.540699 May 14 22:09:55.822097 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3490/6882] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:55 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1726 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:56.838532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:56.839175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:56.846579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:56.847296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:56.848082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:56.848550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:56.983901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:56.993074 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a6125a13-ce0e-4392-93ed-71c19f0d0376 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1726 microversion: 2.1 time: 0.158476 May 14 22:09:56.993738 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3491/6883] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:56 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:58.010541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:58.011192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:58.018053 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:58.018527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:58.019684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:58.020249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:58.163901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:58.171985 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe846086-361e-40d5-9e9b-6ddb63f4980b tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1726 microversion: 2.1 time: 0.165408 May 14 22:09:58.172572 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3492/6884] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:58 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1726 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:09:59.136758 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:09:59.137443 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:09:59.190252 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:09:59.191392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:09:59.198271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:59.198756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:59.199569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:09:59.200031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:09:59.329980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:09:59.338858 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-faf9f1e5-7d90-481e-aee3-13647cf26c95 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.152526 May 14 22:09:59.339428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3493/6885] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:09:59 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:00.357002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:00.357619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:00.367159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:00.367908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:00.368730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:00.369196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:00.506001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:00.514016 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f354c4cb-50c9-40b5-b930-583c2f41e54a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.161080 May 14 22:10:00.514595 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3494/6886] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:00 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:01.532289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:01.532923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:01.540821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:01.541287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:01.542072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:01.542528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:01.671574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:01.680553 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d7686b3-ff3d-4dd0-8924-0f439169923e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.152186 May 14 22:10:01.681138 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3495/6887] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:01 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:02.697822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:02.698560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:02.705434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:02.705863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:02.707167 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:02.707659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:02.837680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:02.845691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e04c39be-5b7c-47a9-ab88-dc6f6a544b18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.151842 May 14 22:10:02.846271 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3496/6888] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:02 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:03.863733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:03.864355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:03.871285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:03.871800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:03.872594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:03.873058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:04.006217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:04.014240 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71ecd5ea-801c-45bc-9027-d4ce6b19b697 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.155423 May 14 22:10:04.014825 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3497/6889] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:03 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:05.032100 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:05.032776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:05.040591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:05.041067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:05.041859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:05.042324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:05.174171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:05.182336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d474befa-4c50-402e-a6f5-22cd8e0a7585 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.154093 May 14 22:10:05.182863 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3498/6890] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:05 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:06.200033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:06.200658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:06.207944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:06.208414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:06.209189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:06.209642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:06.343919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:06.352670 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-38de4987-704f-47f4-ac62-958bb3fd535a tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.156610 May 14 22:10:06.353257 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3499/6891] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:06 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:07.370092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:07.370735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:07.377546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:07.378611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:07.379404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:07.379887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:07.509406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:07.517529 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-58949485-4bef-4057-aab9-b449c32c08f5 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.151492 May 14 22:10:07.518162 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3500/6892] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:07 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:08.535680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:08.536326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:08.543313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:08.543807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:08.544622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:08.545074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:08.681883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:08.689963 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-68ab4135-a9e2-43af-bdaa-a165bb6f5357 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.158569 May 14 22:10:08.691814 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3501/6893] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:08 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:09.709237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:09.709907 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:09.717284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:09.717761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:09.718878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:09.719598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:09.866782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:09.875673 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f96b1a32-6d6c-4f80-a592-e9301dedeff9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.170304 May 14 22:10:09.876289 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3502/6894] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:09 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:10.893992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:10.894657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:10.901543 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:10.902014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:10.902788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:10.903239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:11.030613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:11.039873 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9952ed2c-8aa0-4f33-b8d3-96afc7d92471 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.150322 May 14 22:10:11.040460 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3503/6895] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:10 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:12.056981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:12.057635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:12.064450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:12.064943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:12.067059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:12.067541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:12.206397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:12.214688 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-60fae3f5-99cb-4ed8-b8d5-bfa9b4f7376d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.161509 May 14 22:10:12.215303 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3504/6896] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:12 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:13.232230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:13.232908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:13.239824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:13.240289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:13.241069 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:13.241521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:13.371261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:13.380154 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d36176e1-7986-4e99-a115-366633325e9f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.151883 May 14 22:10:13.380737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3505/6897] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:13 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:14.398081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:14.398755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:14.405619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:14.406099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:14.406893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:14.407358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:14.550600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:14.558558 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-70be66c6-e226-4414-8d76-cfe31c41f2c7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.165541 May 14 22:10:14.559138 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3506/6898] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:14 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:15.575775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:15.576435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:15.584021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:15.584493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:15.585288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:15.585744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:15.727330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:15.736320 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de30a0c7-6190-4e1d-8bcf-4d7df374094f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1731 microversion: 2.1 time: 0.164490 May 14 22:10:15.739279 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3507/6899] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:15 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:16.756292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:16.756921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:16.763388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:16.763899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:16.764702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:16.765157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:16.963862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:16.972668 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de805ec1-8781-4a70-ab73-ddc7d3947f29 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1730 microversion: 2.1 time: 0.220606 May 14 22:10:16.973809 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3508/6900] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:16 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:17.284176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5c662adb-933f-400e-96c4-529ffc2bdf18 req-f4211aa1-e0e9-4cb6-a310-f0121ff7a279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "name": "network-vif-unplugged", "status": "completed", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:17.293192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5c662adb-933f-400e-96c4-529ffc2bdf18 req-f4211aa1-e0e9-4cb6-a310-f0121ff7a279 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:17.293666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5c662adb-933f-400e-96c4-529ffc2bdf18 req-f4211aa1-e0e9-4cb6-a310-f0121ff7a279 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:17.306995 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-5c662adb-933f-400e-96c4-529ffc2bdf18 req-f4211aa1-e0e9-4cb6-a310-f0121ff7a279 service nova] Creating event network-vif-unplugged:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch1-master-1 May 14 22:10:17.313537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-5c662adb-933f-400e-96c4-529ffc2bdf18 req-f4211aa1-e0e9-4cb6-a310-f0121ff7a279 service nova] Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:10:17.325639 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5c662adb-933f-400e-96c4-529ffc2bdf18 req-f4211aa1-e0e9-4cb6-a310-f0121ff7a279 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093751 May 14 22:10:17.326274 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3509/6901] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:10:17.991832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:17.992715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:17.999114 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:17.999745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:18.000544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:18.001005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:18.224735 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:18.232820 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d5bdb8d1-a4b6-4df3-88d1-ed4a50d4d336 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1730 microversion: 2.1 time: 0.246380 May 14 22:10:18.233488 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3510/6902] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:17 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:19.250732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:19.251374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:19.259449 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:19.259956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:19.260773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:19.261286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:19.407645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:19.416882 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96ac9a1a-8507-4175-8856-4bf744c4c5c2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1728 microversion: 2.1 time: 0.170266 May 14 22:10:19.417469 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3511/6903] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:19 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:19.422080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c0a908d5-efc4-4ba9-92a4-53e14f52b152 req-10a51756-e129-4b57-b2c3-63a925313e68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:19.430695 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c0a908d5-efc4-4ba9-92a4-53e14f52b152 req-10a51756-e129-4b57-b2c3-63a925313e68 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:19.431231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c0a908d5-efc4-4ba9-92a4-53e14f52b152 req-10a51756-e129-4b57-b2c3-63a925313e68 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:19.443278 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c0a908d5-efc4-4ba9-92a4-53e14f52b152 req-10a51756-e129-4b57-b2c3-63a925313e68 service nova] Creating event network-changed:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch1-master-1 May 14 22:10:19.448679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-c0a908d5-efc4-4ba9-92a4-53e14f52b152 req-10a51756-e129-4b57-b2c3-63a925313e68 service nova] Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:10:19.460116 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c0a908d5-efc4-4ba9-92a4-53e14f52b152 req-10a51756-e129-4b57-b2c3-63a925313e68 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041429 May 14 22:10:19.462281 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3512/6904] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:10:20.438764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:20.439495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:20.447225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:20.447741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:20.448545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:20.448987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:20.625360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:20.634372 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3f721fd8-a510-4acd-acfc-61d8bd1a764d tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1728 microversion: 2.1 time: 0.199929 May 14 22:10:20.634954 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3513/6905] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:20 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:21.652109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:21.652772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:21.659718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:21.660461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:21.661249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:21.661731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:21.788154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:21.796124 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01f4ae8b-d6da-48b4-91f3-6326a71ca2e7 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1728 microversion: 2.1 time: 0.148005 May 14 22:10:21.796701 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3514/6906] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:21 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:22.812867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:22.813517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:22.820527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:22.821007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:22.821797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:22.822246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:22.954889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:22.964038 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-895a39b8-67d9-416b-a99e-b0db1b503c6c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1728 microversion: 2.1 time: 0.155085 May 14 22:10:22.964632 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3515/6907] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:22 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:23.982242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:23.982871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:23.989928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:23.990397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:23.991179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:23.991673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:24.125475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:24.134208 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2c75d327-dbf4-4c81-afcb-b0eff31d1960 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1725 microversion: 2.1 time: 0.155866 May 14 22:10:24.143540 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3516/6908] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:23 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:24.151819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:24.152380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:24.158296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:24.158951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:24.159802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:24.160531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:24.201537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:24.202004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:24.202829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:24.203285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:24.223600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:10:24.228880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Getting quotas for user 58d7a44fb4b64d5d98bdda07c1638f20 and project 5b7eff5698214fe982348f81c276dc6a. Resources: {'cores', 'ram'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:10:24.571370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bc714dce-7c09-47b9-bdae-12eaa3ba1b60 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "POST /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/action" status: 202 len: 0 microversion: 2.1 time: 0.423234 May 14 22:10:24.572129 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3517/6909] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:10:24 2022] POST /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:10:24.581298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:24.582041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:24.591046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:24.591550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:24.592362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:24.592823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:24.769334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:24.777714 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45aea6ab-e1a6-4f43-858c-9389d53ec0cf tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.201238 May 14 22:10:24.778299 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3518/6910] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:24 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:25.795156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:25.795864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:25.803648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:25.804120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:25.804909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:25.805362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:25.937189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:25.946014 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4399539-e72b-4b64-a042-a7a95a61442c tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.154818 May 14 22:10:25.946602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3519/6911] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:25 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:25.999087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a2d27ed6-93e9-468d-bced-fed0c81c3148 req-f2654ef9-3a4d-4014-b1ca-2c1ae2d4739d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "name": "network-vif-plugged", "status": "completed", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:26.007843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a2d27ed6-93e9-468d-bced-fed0c81c3148 req-f2654ef9-3a4d-4014-b1ca-2c1ae2d4739d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:26.008311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a2d27ed6-93e9-468d-bced-fed0c81c3148 req-f2654ef9-3a4d-4014-b1ca-2c1ae2d4739d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:26.020481 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a2d27ed6-93e9-468d-bced-fed0c81c3148 req-f2654ef9-3a4d-4014-b1ca-2c1ae2d4739d service nova] Creating event network-vif-plugged:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch1-master-1 May 14 22:10:26.026025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-a2d27ed6-93e9-468d-bced-fed0c81c3148 req-f2654ef9-3a4d-4014-b1ca-2c1ae2d4739d service nova] Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:10:26.038034 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a2d27ed6-93e9-468d-bced-fed0c81c3148 req-f2654ef9-3a4d-4014-b1ca-2c1ae2d4739d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090289 May 14 22:10:26.038647 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3520/6912] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:10:26.966116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:26.969161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:26.975132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:26.975233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:26.976072 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:26.976506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:27.446660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:27.454911 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-70520ac2-4cb3-4bc5-9630-8701786d5066 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.493815 May 14 22:10:27.455994 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3521/6913] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:26 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:28.473195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:28.473836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:28.480806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:28.482585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:28.482585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:28.482585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:28.685917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:28.694829 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-55a30356-f6b6-4458-af20-b06c8c9faaaa tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.225794 May 14 22:10:28.695439 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3522/6914] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:28 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:28.961461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-c54a0568-da4f-4ab5-bb7c-5771b1f7b861 req-a507c4d7-0c22-4b03-87a9-3a16bf4284d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "name": "network-vif-unplugged", "status": "completed", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:28.969642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c54a0568-da4f-4ab5-bb7c-5771b1f7b861 req-a507c4d7-0c22-4b03-87a9-3a16bf4284d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:28.970089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-c54a0568-da4f-4ab5-bb7c-5771b1f7b861 req-a507c4d7-0c22-4b03-87a9-3a16bf4284d1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:28.982855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-c54a0568-da4f-4ab5-bb7c-5771b1f7b861 req-a507c4d7-0c22-4b03-87a9-3a16bf4284d1 service nova] Creating event network-vif-unplugged:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch2-master-1 May 14 22:10:28.988391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-c54a0568-da4f-4ab5-bb7c-5771b1f7b861 req-a507c4d7-0c22-4b03-87a9-3a16bf4284d1 service nova] Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:10:28.999322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-c54a0568-da4f-4ab5-bb7c-5771b1f7b861 req-a507c4d7-0c22-4b03-87a9-3a16bf4284d1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041898 May 14 22:10:28.999962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3523/6915] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:10:29.714426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:29.715308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:29.723883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:29.723883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:29.724343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:29.725031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:29.938515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:29.946665 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7375e87a-8a2c-4854-a52a-dd8469e0387e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.237346 May 14 22:10:29.947258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3524/6916] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:29 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:30.963337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:30.964177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:30.970965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:30.972148 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:30.972941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:30.973402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:31.113376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:31.121600 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d7985bf-a84a-4f73-8019-f5470d3f39d2 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.162282 May 14 22:10:31.122181 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3525/6917] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:30 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:31.126619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9254fd0a-7b6b-4be6-be4b-14f7ef738d3d req-051cbbde-021b-4985-a274-d2b5808e7ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:31.135833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9254fd0a-7b6b-4be6-be4b-14f7ef738d3d req-051cbbde-021b-4985-a274-d2b5808e7ad1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:31.135833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9254fd0a-7b6b-4be6-be4b-14f7ef738d3d req-051cbbde-021b-4985-a274-d2b5808e7ad1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:31.148191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9254fd0a-7b6b-4be6-be4b-14f7ef738d3d req-051cbbde-021b-4985-a274-d2b5808e7ad1 service nova] Creating event network-changed:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch2-master-1 May 14 22:10:31.153999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-9254fd0a-7b6b-4be6-be4b-14f7ef738d3d req-051cbbde-021b-4985-a274-d2b5808e7ad1 service nova] Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:10:31.166199 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9254fd0a-7b6b-4be6-be4b-14f7ef738d3d req-051cbbde-021b-4985-a274-d2b5808e7ad1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042830 May 14 22:10:31.166809 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3526/6918] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:10:32.139699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:32.140435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:32.147208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:32.147724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:32.148533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:32.148996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:32.333497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:32.341581 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de995247-691e-4c4b-8e50-ee9881a33f90 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.207123 May 14 22:10:32.342177 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3527/6919] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:32 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:33.359896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:33.360517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:33.368191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:33.368658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:33.369443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:33.369894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:33.497629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:33.507013 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ccb5397-854a-4146-9e52-c5e5f7992832 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1724 microversion: 2.1 time: 0.151063 May 14 22:10:33.507623 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3528/6920] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:33 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:34.525493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:34.526152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:34.532926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:34.533396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:34.534181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:34.535817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:34.672339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:34.680761 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a90498c-e5e8-4d1a-be10-6424f138053e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1717 microversion: 2.1 time: 0.159478 May 14 22:10:34.681337 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3529/6921] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:34 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:10:34.696850 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:34.697480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:34.703347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:34.703842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:34.704624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:34.705074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:34.838762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:34.846916 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9a01618-f793-4960-bd17-74a2c2dda196 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1717 microversion: 2.1 time: 0.153660 May 14 22:10:34.847719 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3530/6922] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:34 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:10:34.863275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:34.863908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:34.869822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:34.870346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:34.871077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:34.871556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:35.013901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:35.022993 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-359af317-62e7-415b-af33-cb5b4a91df18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1717 microversion: 2.1 time: 0.163636 May 14 22:10:35.023617 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3531/6923] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:34 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1717 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:35.041956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:35.042921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:35.050918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:35.051618 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:35.052434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:35.052931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:35.079900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:10:35.315654 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d11ac74d-f575-44b7-989a-b67dbece18ad tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 204 len: 0 microversion: 2.1 time: 0.278777 May 14 22:10:35.316878 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3532/6924] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:10:35 2022] DELETE /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:10:35.325282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:35.325993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:35.332922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:35.337970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:35.337970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:35.337970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:35.472047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:35.480197 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ee1c4e33-410c-4a27-8ec1-a379a0b82952 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1723 microversion: 2.1 time: 0.158869 May 14 22:10:35.480788 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3533/6925] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:35 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:35.636145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-224553da-906c-4674-97c4-5bb8f4acd9d9 req-57bdacf9-8c47-4f5e-9240-d10a4befd330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "name": "network-vif-plugged", "status": "completed", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:35.646326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-224553da-906c-4674-97c4-5bb8f4acd9d9 req-57bdacf9-8c47-4f5e-9240-d10a4befd330 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:35.647011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-224553da-906c-4674-97c4-5bb8f4acd9d9 req-57bdacf9-8c47-4f5e-9240-d10a4befd330 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:35.658995 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-224553da-906c-4674-97c4-5bb8f4acd9d9 req-57bdacf9-8c47-4f5e-9240-d10a4befd330 service nova] Creating event network-vif-plugged:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch2-master-1 May 14 22:10:35.664393 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-224553da-906c-4674-97c4-5bb8f4acd9d9 req-57bdacf9-8c47-4f5e-9240-d10a4befd330 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032148 May 14 22:10:35.664993 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3534/6926] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:10:36.498374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:36.499104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:36.506179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:36.506652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:36.507458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:36.507940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:36.639443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:36.649490 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23a01aa0-c856-46fd-b0eb-cff15579dcc1 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1723 microversion: 2.1 time: 0.155444 May 14 22:10:36.650080 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3535/6927] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:36 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:37.667179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:37.668937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:37.676251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:37.676737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:37.677544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:37.678009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:37.772351 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58d7a44fb4b64d5d98bdda07c1638f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7eff5698214fe982348f81c276dc6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:37.780508 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1ccc53c0-ca0d-40b4-adce-ab7b3bf0f82e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 200 len: 1655 microversion: 2.1 time: 0.117306 May 14 22:10:37.781102 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3536/6928] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:37 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 1655 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:10:37.857017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-80dadf84-96a0-47b7-837f-f52f6d724aba req-817525d0-7028-4e86-a230-719ba8f5931d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdcb0555-18ac-49e1-8d3b-a23f806b9170", "name": "network-vif-deleted", "tag": "59d9d0bb-8782-471b-b235-47363dc7a8ab"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:37.865667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-80dadf84-96a0-47b7-837f-f52f6d724aba req-817525d0-7028-4e86-a230-719ba8f5931d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:37.866129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-80dadf84-96a0-47b7-837f-f52f6d724aba req-817525d0-7028-4e86-a230-719ba8f5931d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:37.877354 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-80dadf84-96a0-47b7-837f-f52f6d724aba req-817525d0-7028-4e86-a230-719ba8f5931d service nova] Creating event network-vif-deleted:59d9d0bb-8782-471b-b235-47363dc7a8ab for instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 on nch2-master-1 May 14 22:10:37.882322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-80dadf84-96a0-47b7-837f-f52f6d724aba req-817525d0-7028-4e86-a230-719ba8f5931d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029026 May 14 22:10:37.882938 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3537/6929] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:10:38.799698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:38.801507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:38.808012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:38.808474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:38.809276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:38.809730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:38.825789 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 HTTP/1.1 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'fdcb0555-18ac-49e1-8d3b-a23f806b9170'} May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:38.827507 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ec3b73dd-c037-4ec2-bb79-c342b83d605f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 404 len: 111 microversion: 2.1 time: 0.034498 May 14 22:10:38.831798 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3538/6930] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:38 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:10:38.889379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:38.890455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:38.897030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:38.897511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:38.898314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:38.898775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:38.915580 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/os-volume_attachments HTTP/1.1 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'server_id': 'fdcb0555-18ac-49e1-8d3b-a23f806b9170'} May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:38.917227 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a32d343f-9c63-46aa-b814-1fe11d56abbb tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033537 May 14 22:10:38.923229 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3539/6931] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 22:10:38 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:10:43.415260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.415899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.422821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.423297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.424119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.424587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.438396 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 HTTP/1.1 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'fdcb0555-18ac-49e1-8d3b-a23f806b9170'} May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.440013 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a20547d9-af59-4e0e-84e9-17b6b8305677 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 404 len: 111 microversion: 2.1 time: 0.030276 May 14 22:10:43.443780 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3540/6932] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:10:43 2022] DELETE /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:10:43.449789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.450423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: fdcb0555-18ac-49e1-8d3b-a23f806b9170] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.456999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.457495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.458282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.458768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.472949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 HTTP/1.1 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'fdcb0555-18ac-49e1-8d3b-a23f806b9170'} May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.474508 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance fdcb0555-18ac-49e1-8d3b-a23f806b9170 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9dd9bc94-4222-402d-8ff6-7be3dba891d9 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170" status: 404 len: 111 microversion: 2.1 time: 0.029774 May 14 22:10:43.478921 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3541/6933] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:43 2022] GET /compute/v2.1/servers/fdcb0555-18ac-49e1-8d3b-a23f806b9170 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:10:43.483839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.484346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.490180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.490647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.491414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.491888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.505281 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d HTTP/1.1 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '5fb08a4d-6fa8-496e-9b45-07a3785eb90d'} May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.506828 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d741ee8a-e0b0-443c-9abe-943ff3287f18 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 404 len: 111 microversion: 2.1 time: 0.027938 May 14 22:10:43.511210 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3542/6934] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:10:43 2022] DELETE /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:10:43.516060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.516679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 5fb08a4d-6fa8-496e-9b45-07a3785eb90d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.522857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.523318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.524127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.524578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.538698 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d HTTP/1.1 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '5fb08a4d-6fa8-496e-9b45-07a3785eb90d'} May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.540230 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 5fb08a4d-6fa8-496e-9b45-07a3785eb90d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3c4643f0-b38c-4561-bbcf-a7412213900e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d" status: 404 len: 111 microversion: 2.1 time: 0.029003 May 14 22:10:43.544244 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3543/6935] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:43 2022] GET /compute/v2.1/servers/5fb08a4d-6fa8-496e-9b45-07a3785eb90d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:10:43.549373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.549874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.555376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.555870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.556633 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.557087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.570300 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 HTTP/1.1 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '10494a1a-1806-43a2-97a7-489370b690d0'} May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.571869 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9539e3d0-61c4-4477-a6d1-43b01b1c8fd6 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 404 len: 111 microversion: 2.1 time: 0.027292 May 14 22:10:43.576127 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3544/6936] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:10:43 2022] DELETE /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:10:43.581553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.582405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 10494a1a-1806-43a2-97a7-489370b690d0] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.588235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.588709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.589494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.589959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.604081 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 HTTP/1.1 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '10494a1a-1806-43a2-97a7-489370b690d0'} May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.605617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 10494a1a-1806-43a2-97a7-489370b690d0 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6666ba0c-e3e7-4d74-aaac-c9467b74f563 tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0" status: 404 len: 111 microversion: 2.1 time: 0.029579 May 14 22:10:43.609674 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3545/6937] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:43 2022] GET /compute/v2.1/servers/10494a1a-1806-43a2-97a7-489370b690d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:10:43.614996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.615534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.621294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.621768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.622552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.623012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.636544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec HTTP/1.1 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3dc58112-b10e-4bd2-aa06-cf8a01e914ec'} May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.638122 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-68f24ff7-bc72-46ef-9317-2325de68604f tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 404 len: 111 microversion: 2.1 time: 0.028264 May 14 22:10:43.642277 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3546/6938] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:10:43 2022] DELETE /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:10:43.647894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.648519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] [instance: 3dc58112-b10e-4bd2-aa06-cf8a01e914ec] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:43.654136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.654612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.655395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:43.655884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:43.669827 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] HTTP exception thrown: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Request method failure captured: May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec HTTP/1.1 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCf2ShhnyA999Kau0yl6Kush2lXHKNn1J8GD0inC5iXgskIqokcI8yZorBZMDl5PIKmXibaXDYEzoXQXrJYCjelvg_AJLtQ0KqjCiX1Qe_awiL_WyaacFQx37BLWbbc0MVzX991y7rwMVUBT5RYUCpKFEeuvkM3SBMcLR_xa9XMzZTg May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5b7eff5698214fe982348f81c276dc6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5b7eff5698214fe982348f81c276dc6a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 5b7eff5698214fe982348f81c276dc6a May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServerActionsTestJSON-1153994297 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 58d7a44fb4b64d5d98bdda07c1638f20 May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServerActionsTestJSON-1153994297-project May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3dc58112-b10e-4bd2-aa06-cf8a01e914ec'} May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:10:43.671347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Returning 404 to user: Instance 3dc58112-b10e-4bd2-aa06-cf8a01e914ec could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2fd07eb8-a38e-43f4-9313-c2d3256d27cd tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec" status: 404 len: 111 microversion: 2.1 time: 0.028947 May 14 22:10:43.675674 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3547/6939] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:43 2022] GET /compute/v2.1/servers/3dc58112-b10e-4bd2-aa06-cf8a01e914ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:10:43.680998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-19fba81f-d584-4e2e-ad26-a5c740516b8e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] Calling method '.version_select at 0x7fb1a46e4310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:43.790954 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-19fba81f-d584-4e2e-ad26-a5c740516b8e tempest-ServerActionsTestJSON-1153994297 tempest-ServerActionsTestJSON-1153994297-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443535878" status: 202 len: 0 microversion: 2.1 time: 0.113431 May 14 22:10:43.791559 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3548/6940] 10.222.0.52 () {58 vars in 1220 bytes} [Sat May 14 22:10:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1443535878 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:10:51.181242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-151666474", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "81333342-4e2f-413c-94f7-72e6b70d9839"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:51.235339 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] validate_networks() for [('81333342-4e2f-413c-94f7-72e6b70d9839', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:10:51.658117 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:10:51.658573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:10:51.659271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:10:51.659823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:10:51.660251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:10:51.671637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:51.672104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:51.672915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:51.673364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:51.694893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Getting quotas for project cbd3e2d31b0341d2b7131a387bfa33f2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:10:51.700102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Getting quotas for user 463dbb858c1a48b9b97114f048713624 and project cbd3e2d31b0341d2b7131a387bfa33f2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:10:51.712303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:10:51.714607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:10:51.825764 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5878b8a5-6431-4273-a8eb-2e8149829258 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756350 May 14 22:10:51.826418 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3549/6941] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:10:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:10:51.836581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6088e86a-07b0-4627-9225-c5d66de7bb9b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:51.837217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6088e86a-07b0-4627-9225-c5d66de7bb9b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:51.891022 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6088e86a-07b0-4627-9225-c5d66de7bb9b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:51.899052 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6088e86a-07b0-4627-9225-c5d66de7bb9b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1216 microversion: 2.1 time: 0.066340 May 14 22:10:51.899654 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3550/6942] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:51 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:52.916517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:52.917281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:52.925816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:52.925999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:52.927854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:52.928455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:52.992409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:53.000189 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f7cbb37-fa2e-4b26-848f-a7f14fda3d2d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1220 microversion: 2.1 time: 0.087790 May 14 22:10:53.001048 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3551/6943] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:52 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:54.017535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:54.018267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:54.028003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:54.028493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:54.029301 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:54.029764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:54.110849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:54.119126 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e0218044-9b2a-48b5-a093-d170d1b2c81b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1286 microversion: 2.1 time: 0.105576 May 14 22:10:54.119748 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3552/6944] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:54 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1286 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:55.140004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:55.140648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:55.148422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:55.149096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:55.149919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:55.150385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:55.344809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:55.352440 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cac542fc-d35e-4a1a-8748-6ad8cd7b955b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1316 microversion: 2.1 time: 0.216334 May 14 22:10:55.353021 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3553/6945] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:55 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:55.510685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-af4d125e-b5d3-4fa8-8339-9e6f9fc1d6ee req-49b65203-f57a-40a3-bccd-dfdd0342a193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df0de89-d4ff-4414-af3a-c3be6e705d5a", "tag": "c65bb543-0c28-4e42-879b-de62e70341fe"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:55.520050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-af4d125e-b5d3-4fa8-8339-9e6f9fc1d6ee req-49b65203-f57a-40a3-bccd-dfdd0342a193 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:55.520528 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-af4d125e-b5d3-4fa8-8339-9e6f9fc1d6ee req-49b65203-f57a-40a3-bccd-dfdd0342a193 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:55.532202 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-af4d125e-b5d3-4fa8-8339-9e6f9fc1d6ee req-49b65203-f57a-40a3-bccd-dfdd0342a193 service nova] Creating event network-changed:c65bb543-0c28-4e42-879b-de62e70341fe for instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a on nch2-master-1 May 14 22:10:55.537512 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-af4d125e-b5d3-4fa8-8339-9e6f9fc1d6ee req-49b65203-f57a-40a3-bccd-dfdd0342a193 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031475 May 14 22:10:55.538123 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3554/6946] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:10:56.373738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:56.374412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:56.380790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:56.381291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:56.382067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:56.382519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:56.513091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:56.521217 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-49bed93d-3765-4375-84d0-f3cafad0e814 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1316 microversion: 2.1 time: 0.152620 May 14 22:10:56.521799 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3555/6947] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:56 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:57.538228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:57.538956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:57.546024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:57.546534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:57.547341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:57.547835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:57.678736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:57.686308 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-53dd4ba1-645d-4b38-bf75-6f2fdf148ed4 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1316 microversion: 2.1 time: 0.152409 May 14 22:10:57.686887 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3556/6948] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:57 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:58.702994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:58.703689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:58.711295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:58.711808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:58.712601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:58.713060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:58.840950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:10:58.848526 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c39e6d2a-1f06-462c-8dcf-4a175dbd5ebc tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1316 microversion: 2.1 time: 0.149582 May 14 22:10:58.849114 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3557/6949] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:58 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:10:59.677360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-9c5277d8-38ff-43ee-88eb-b4311222d48d req-06dad2c8-3588-44a8-af29-f9423507e32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df0de89-d4ff-4414-af3a-c3be6e705d5a", "name": "network-vif-plugged", "status": "completed", "tag": "c65bb543-0c28-4e42-879b-de62e70341fe"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:10:59.685405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9c5277d8-38ff-43ee-88eb-b4311222d48d req-06dad2c8-3588-44a8-af29-f9423507e32d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:59.685867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-9c5277d8-38ff-43ee-88eb-b4311222d48d req-06dad2c8-3588-44a8-af29-f9423507e32d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:59.699754 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-9c5277d8-38ff-43ee-88eb-b4311222d48d req-06dad2c8-3588-44a8-af29-f9423507e32d service nova] Creating event network-vif-plugged:c65bb543-0c28-4e42-879b-de62e70341fe for instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a on nch2-master-1 May 14 22:10:59.704812 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-9c5277d8-38ff-43ee-88eb-b4311222d48d req-06dad2c8-3588-44a8-af29-f9423507e32d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031818 May 14 22:10:59.705494 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3558/6950] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:10:59.866010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:10:59.866726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:10:59.873739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:59.874203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:10:59.874974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:10:59.875426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:00.003814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:00.011452 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8beaeaa1-43a2-46ed-bbc7-0fbfd38457b6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1316 microversion: 2.1 time: 0.149623 May 14 22:11:00.012055 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3559/6951] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:10:59 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:01.028782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:01.029499 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:01.036837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:01.041568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:01.041568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:01.041568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:01.175725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:01.183628 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7c411bd-320a-4235-b44d-0f2ebdd4e01f tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1506 microversion: 2.1 time: 0.158672 May 14 22:11:01.184141 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3560/6952] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:01 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:01.241131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1631295925", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "81333342-4e2f-413c-94f7-72e6b70d9839"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:01.292900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] validate_networks() for [('81333342-4e2f-413c-94f7-72e6b70d9839', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:11:01.650984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:11:01.651460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:11:01.652003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:11:01.652431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:11:01.652859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:11:01.662587 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:01.663048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:01.663909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:01.664357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:01.683540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Getting quotas for project cbd3e2d31b0341d2b7131a387bfa33f2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:11:01.689088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Getting quotas for user 463dbb858c1a48b9b97114f048713624 and project cbd3e2d31b0341d2b7131a387bfa33f2. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:11:01.703859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:11:01.706696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:11:01.956811 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ac8a1ff-c307-411e-a9da-5b6f1d851294 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719718 May 14 22:11:01.958025 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3561/6953] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:11:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:11:01.970781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a79153c9-0c65-4134-9fd4-039daca81518 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:01.972106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a79153c9-0c65-4134-9fd4-039daca81518 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:02.026424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a79153c9-0c65-4134-9fd4-039daca81518 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:02.035218 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a79153c9-0c65-4134-9fd4-039daca81518 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1217 microversion: 2.1 time: 0.068113 May 14 22:11:02.037052 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3562/6954] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:01 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:03.052554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:03.053295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:03.061268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:03.061744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:03.062537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:03.062998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:03.124643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:03.132479 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9518e0df-cb42-44c6-b7db-4f4f5b23bbd1 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1213 microversion: 2.1 time: 0.084386 May 14 22:11:03.133058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3563/6955] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:03 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:04.150074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:04.150712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:04.157854 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:04.158337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:04.159113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:04.159667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:04.390203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:04.397776 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8735c29d-a40b-4e61-8fa6-9ede1e334815 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.251675 May 14 22:11:04.398403 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3564/6956] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:04 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:05.188253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2431d09b-16d3-4cdb-bd28-1f53acc254a9 req-dc395c2d-6b0e-46fb-be4d-60dea60e3f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b2835b-5da5-4417-82ed-696b6cfd3a9a", "tag": "826608fc-1ff0-4fa9-85ce-e41cdcd49b61"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:05.202103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2431d09b-16d3-4cdb-bd28-1f53acc254a9 req-dc395c2d-6b0e-46fb-be4d-60dea60e3f2b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:05.202811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2431d09b-16d3-4cdb-bd28-1f53acc254a9 req-dc395c2d-6b0e-46fb-be4d-60dea60e3f2b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:05.220229 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2431d09b-16d3-4cdb-bd28-1f53acc254a9 req-dc395c2d-6b0e-46fb-be4d-60dea60e3f2b service nova] Creating event network-changed:826608fc-1ff0-4fa9-85ce-e41cdcd49b61 for instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a on nch1-master-1 May 14 22:11:05.228305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2431d09b-16d3-4cdb-bd28-1f53acc254a9 req-dc395c2d-6b0e-46fb-be4d-60dea60e3f2b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046292 May 14 22:11:05.228926 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3565/6957] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:11:05.416004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:05.416917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:05.423150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:05.423663 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:05.424447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:05.424901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:05.924517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:05.935034 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1dbffc62-4eee-4086-831f-73607ed4a532 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.523221 May 14 22:11:05.935688 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3566/6958] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:05 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1317 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:11:06.952972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:06.953603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:06.960307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:06.960785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:06.961589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:06.962042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:07.088966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:07.096350 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aab4cbda-734e-4c93-84f7-a4caee42a7cb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.147317 May 14 22:11:07.097643 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3567/6959] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:06 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:08.114075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:08.114736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:08.121557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:08.122025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:08.122802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:08.123256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:08.253888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:08.262051 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6ec39aaf-f784-4d21-bdae-c5c60f8835e3 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.152234 May 14 22:11:08.262641 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3568/6960] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:08 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:09.281428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:09.281428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:09.288913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:09.289388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:09.290250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:09.290709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:09.422662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:09.430713 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-890026ef-7d7c-47eb-8d3b-16aec02792e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.155058 May 14 22:11:09.435910 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3569/6961] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:09 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:10.168365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-62f6499b-a8de-4403-a72d-245f100ebd2d req-6f9f1d34-d47a-47b0-871a-b440e578c8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b2835b-5da5-4417-82ed-696b6cfd3a9a", "name": "network-vif-plugged", "status": "completed", "tag": "826608fc-1ff0-4fa9-85ce-e41cdcd49b61"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:10.177719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-62f6499b-a8de-4403-a72d-245f100ebd2d req-6f9f1d34-d47a-47b0-871a-b440e578c8ed service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:10.178185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-62f6499b-a8de-4403-a72d-245f100ebd2d req-6f9f1d34-d47a-47b0-871a-b440e578c8ed service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:10.189108 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-62f6499b-a8de-4403-a72d-245f100ebd2d req-6f9f1d34-d47a-47b0-871a-b440e578c8ed service nova] Creating event network-vif-plugged:826608fc-1ff0-4fa9-85ce-e41cdcd49b61 for instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a on nch1-master-1 May 14 22:11:10.195022 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-62f6499b-a8de-4403-a72d-245f100ebd2d req-6f9f1d34-d47a-47b0-871a-b440e578c8ed service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030793 May 14 22:11:10.195713 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3570/6962] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:11:10.448692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:10.449416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:10.456636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:10.457119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:10.457935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:10.458394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:10.589436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:10.597285 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5555abc8-637a-48ae-a4ed-87b85a49ced9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1317 microversion: 2.1 time: 0.152789 May 14 22:11:10.597802 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3571/6963] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:10 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:11.614873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:11.615922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:11.622940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:11.623684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:11.624318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:11.624796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:11.773278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:11.781826 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4a9e1c4-8e01-49a8-889c-c5ac5027668e tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1506 microversion: 2.1 time: 0.171387 May 14 22:11:11.782428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3572/6964] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:11 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:11.803349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:11.803918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:11.810317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:11.810819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:11.811644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:11.812105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:11.844365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:11:12.125762 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e09ad2eb-82cf-4c31-a29a-b947e1089343 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 204 len: 0 microversion: 2.1 time: 0.326780 May 14 22:11:12.126282 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3573/6965] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:11:11 2022] DELETE /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:11:12.137829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:12.139255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:12.146286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:12.146790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:12.147612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:12.148071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:12.282427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:12.290982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c2069385-47dc-471d-b7e1-7863914142a6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1512 microversion: 2.1 time: 0.157908 May 14 22:11:12.291630 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3574/6966] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:12 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:13.308597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:13.309268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:13.316250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:13.316721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:13.317517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:13.317981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:13.510379 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:13.518327 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7345dada-a288-4185-aa3a-6e73cecf06f7 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1512 microversion: 2.1 time: 0.213594 May 14 22:11:13.518931 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3575/6967] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:13 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:11:13.968482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-87ec31b9-2f22-4528-9795-0abac2053f61 req-8ab8b69b-b617-4594-a981-37956d3c957a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b2835b-5da5-4417-82ed-696b6cfd3a9a", "name": "network-vif-deleted", "tag": "826608fc-1ff0-4fa9-85ce-e41cdcd49b61"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:13.977432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-87ec31b9-2f22-4528-9795-0abac2053f61 req-8ab8b69b-b617-4594-a981-37956d3c957a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:13.977906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-87ec31b9-2f22-4528-9795-0abac2053f61 req-8ab8b69b-b617-4594-a981-37956d3c957a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:13.990356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-87ec31b9-2f22-4528-9795-0abac2053f61 req-8ab8b69b-b617-4594-a981-37956d3c957a service nova] Creating event network-vif-deleted:826608fc-1ff0-4fa9-85ce-e41cdcd49b61 for instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a on nch1-master-1 May 14 22:11:13.995426 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-87ec31b9-2f22-4528-9795-0abac2053f61 req-8ab8b69b-b617-4594-a981-37956d3c957a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030654 May 14 22:11:13.996074 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3576/6968] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:11:14.536866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:14.537612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:14.543974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:14.544438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:14.545217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:14.545665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:14.576766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:14.577217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:14.577689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lazy-loading 'fault' on Instance uuid b2b2835b-5da5-4417-82ed-696b6cfd3a9a {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:11:14.620776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:14.628894 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-903f3fae-613f-4ce6-b757-8637cbf07be8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 200 len: 1307 microversion: 2.1 time: 0.097631 May 14 22:11:14.629629 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3577/6969] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:14 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:15.646699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:15.647333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:15.654238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:15.654715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:15.655527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:15.655992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:15.671360 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] HTTP exception thrown: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Request method failure captured: May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a HTTP/1.1 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCjq-xhdcGLKP9tzJPg2DGKwRPkcJn2E1UFzr__hyun9H_N_wQAtLCLxylEjTtdSpvvrMFYzbjDJI-48lt3mI5vuqIxYewRG824AiVAnZvq6k_mV3XeljX9dktI9GEwGs00CXJN_3hZlNb67PClRv0l_RXefDR3LaRGGxkzydDCPLl8 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbd3e2d31b0341d2b7131a387bfa33f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 463dbb858c1a48b9b97114f048713624 May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'b2b2835b-5da5-4417-82ed-696b6cfd3a9a'} May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:15.673102 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Returning 404 to user: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4954e58-9b5c-4d0c-bced-2203906d260b tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 404 len: 111 microversion: 2.1 time: 0.032555 May 14 22:11:15.682383 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3578/6970] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:15 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:11:15.684125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:15.684771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:15.691043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:15.691668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:15.692560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:15.693260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:15.824923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:15.833153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-63223e44-ff3f-41bf-be22-984ee2cf03e0 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1506 microversion: 2.1 time: 0.152854 May 14 22:11:15.833734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3579/6971] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:15 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:11:15.851714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1954c91f-5e69-4eb9-aebe-fc7aeb31824c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:15.852701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1954c91f-5e69-4eb9-aebe-fc7aeb31824c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 1033e79f-2fd4-42eb-a19c-dab9f8443ddd] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:15.858321 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-1954c91f-5e69-4eb9-aebe-fc7aeb31824c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] HTTP exception thrown: Instance 1033e79f-2fd4-42eb-a19c-dab9f8443ddd could not be found. May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1954c91f-5e69-4eb9-aebe-fc7aeb31824c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Request method failure captured: May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/1033e79f-2fd4-42eb-a19c-dab9f8443ddd/action HTTP/1.1 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 32 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCjq-xhdcGLKP9tzJPg2DGKwRPkcJn2E1UFzr__hyun9H_N_wQAtLCLxylEjTtdSpvvrMFYzbjDJI-48lt3mI5vuqIxYewRG824AiVAnZvq6k_mV3XeljX9dktI9GEwGs00CXJN_3hZlNb67PClRv0l_RXefDR3LaRGGxkzydDCPLl8 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbd3e2d31b0341d2b7131a387bfa33f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 463dbb858c1a48b9b97114f048713624 May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: {"resize": {"flavorRef": "452"}} May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1033e79f-2fd4-42eb-a19c-dab9f8443ddd could not be found. May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1033e79f-2fd4-42eb-a19c-dab9f8443ddd', 'body': {'resize': {'flavorRef': '452'}}} May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1033e79f-2fd4-42eb-a19c-dab9f8443ddd could not be found. May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:11:15.860723 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1033e79f-2fd4-42eb-a19c-dab9f8443ddd could not be found. May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1033e79f-2fd4-42eb-a19c-dab9f8443ddd could not be found. May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1954c91f-5e69-4eb9-aebe-fc7aeb31824c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Returning 404 to user: Instance 1033e79f-2fd4-42eb-a19c-dab9f8443ddd could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1954c91f-5e69-4eb9-aebe-fc7aeb31824c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "POST /compute/v2.1/servers/1033e79f-2fd4-42eb-a19c-dab9f8443ddd/action" status: 404 len: 111 microversion: 2.1 time: 0.015727 May 14 22:11:15.865737 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3580/6972] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:11:15 2022] POST /compute/v2.1/servers/1033e79f-2fd4-42eb-a19c-dab9f8443ddd/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:11:15.870221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:15.870851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:15.877583 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:15.878830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:15.879725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:15.880188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.017005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:16.025516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4e8fe3e1-aec8-44d2-badd-43eabfc51338 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1506 microversion: 2.1 time: 0.158029 May 14 22:11:16.026413 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3581/6973] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:15 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:16.044264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:16.044905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.051677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.052146 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.052954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.053394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.181715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:16.189260 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54c4f56d-5c05-43c4-b3a3-969421efd90a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1506 microversion: 2.1 time: 0.149276 May 14 22:11:16.189850 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3582/6974] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:16 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:11:16.205277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "40a64ccc-32bf-4b96-951d-c455e6fce3af"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:16.206311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.212085 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.212594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.213380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.213848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.243947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:16.249405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] HTTP exception thrown: Flavor 40a64ccc-32bf-4b96-951d-c455e6fce3af could not be found. May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Request method failure captured: May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a/action HTTP/1.1 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 65 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCjq-xhdcGLKP9tzJPg2DGKwRPkcJn2E1UFzr__hyun9H_N_wQAtLCLxylEjTtdSpvvrMFYzbjDJI-48lt3mI5vuqIxYewRG824AiVAnZvq6k_mV3XeljX9dktI9GEwGs00CXJN_3hZlNb67PClRv0l_RXefDR3LaRGGxkzydDCPLl8 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbd3e2d31b0341d2b7131a387bfa33f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 463dbb858c1a48b9b97114f048713624 May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: {"resize": {"flavorRef": "40a64ccc-32bf-4b96-951d-c455e6fce3af"}} May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: exception: Flavor 40a64ccc-32bf-4b96-951d-c455e6fce3af could not be found. May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '7df0de89-d4ff-4414-af3a-c3be6e705d5a', 'body': {'resize': {'flavorRef': '40a64ccc-32bf-4b96-951d-c455e6fce3af'}}} May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 14 22:11:16.252298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 40a64ccc-32bf-4b96-951d-c455e6fce3af could not be found. May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 40a64ccc-32bf-4b96-951d-c455e6fce3af could not be found. May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 40a64ccc-32bf-4b96-951d-c455e6fce3af could not be found. May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Returning 400 to user: Flavor 40a64ccc-32bf-4b96-951d-c455e6fce3af could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:11:16.256892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aea3a3d4-bd7f-47de-9213-a906a6190e66 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "POST /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a/action" status: 400 len: 107 microversion: 2.1 time: 0.053045 May 14 22:11:16.259577 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3583/6975] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:11:16 2022] POST /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a/action => generated 107 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 22:11:16.264621 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:16.265260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.272477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.272955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.276766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.276766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.410363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:16.418258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be5e7faa-6b1b-46da-a74d-2c8e6d705fe6 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1506 microversion: 2.1 time: 0.157518 May 14 22:11:16.418840 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3584/6976] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:16 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:11:16.434938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:16.435612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.441607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.442094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.442892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.443388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.577321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:16.585643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-076b1544-51b5-4631-b6dd-ad6ebd8c59c9 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1506 microversion: 2.1 time: 0.154368 May 14 22:11:16.586224 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3585/6977] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:16 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:16.601997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03b9c054-a10f-443f-adba-ea44608ee06a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03b9c054-a10f-443f-adba-ea44608ee06a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Request method failure captured: May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: request: POST /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a/action HTTP/1.1 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 29 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCjq-xhdcGLKP9tzJPg2DGKwRPkcJn2E1UFzr__hyun9H_N_wQAtLCLxylEjTtdSpvvrMFYzbjDJI-48lt3mI5vuqIxYewRG824AiVAnZvq6k_mV3XeljX9dktI9GEwGs00CXJN_3hZlNb67PClRv0l_RXefDR3LaRGGxkzydDCPLl8 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbd3e2d31b0341d2b7131a387bfa33f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 463dbb858c1a48b9b97114f048713624 May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: {"resize": {"flavorRef": ""}} May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '7df0de89-d4ff-4414-af3a-c3be6e705d5a', 'body': {'resize': {'flavorRef': ''}}} May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise error May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi On instance['resize']: May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi '' May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.604293 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-03b9c054-a10f-443f-adba-ea44608ee06a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-03b9c054-a10f-443f-adba-ea44608ee06a tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "POST /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a/action" status: 400 len: 113 microversion: 2.1 time: 0.007424 May 14 22:11:16.608840 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3586/6978] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:11:16 2022] POST /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a/action => generated 113 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 14 22:11:16.613579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:16.614204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.621541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.622013 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.622807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.623294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.752413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:16.760814 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-23673614-42e9-4b75-a3bf-cb894e4b4d8d tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1506 microversion: 2.1 time: 0.150765 May 14 22:11:16.761393 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3587/6979] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:16 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:11:16.781591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:16.783433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.788677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.789149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.789937 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.790403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.807091 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] HTTP exception thrown: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Request method failure captured: May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a HTTP/1.1 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCjq-xhdcGLKP9tzJPg2DGKwRPkcJn2E1UFzr__hyun9H_N_wQAtLCLxylEjTtdSpvvrMFYzbjDJI-48lt3mI5vuqIxYewRG824AiVAnZvq6k_mV3XeljX9dktI9GEwGs00CXJN_3hZlNb67PClRv0l_RXefDR3LaRGGxkzydDCPLl8 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbd3e2d31b0341d2b7131a387bfa33f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 463dbb858c1a48b9b97114f048713624 May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'b2b2835b-5da5-4417-82ed-696b6cfd3a9a'} May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:11:16.808719 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Returning 404 to user: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-66ac7291-ea06-43bd-8fcd-cb1e3a6beacb tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "DELETE /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 404 len: 111 microversion: 2.1 time: 0.032359 May 14 22:11:16.812694 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3588/6980] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:11:16 2022] DELETE /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:11:16.819441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:16.820103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: b2b2835b-5da5-4417-82ed-696b6cfd3a9a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.826580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.826975 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.827815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.828279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.845739 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] HTTP exception thrown: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Request method failure captured: May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a HTTP/1.1 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCjq-xhdcGLKP9tzJPg2DGKwRPkcJn2E1UFzr__hyun9H_N_wQAtLCLxylEjTtdSpvvrMFYzbjDJI-48lt3mI5vuqIxYewRG824AiVAnZvq6k_mV3XeljX9dktI9GEwGs00CXJN_3hZlNb67PClRv0l_RXefDR3LaRGGxkzydDCPLl8 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbd3e2d31b0341d2b7131a387bfa33f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 463dbb858c1a48b9b97114f048713624 May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'b2b2835b-5da5-4417-82ed-696b6cfd3a9a'} May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:16.847625 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Returning 404 to user: Instance b2b2835b-5da5-4417-82ed-696b6cfd3a9a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-be5fd0e4-8342-49ea-8782-d570b2110032 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a" status: 404 len: 111 microversion: 2.1 time: 0.033913 May 14 22:11:16.851848 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3589/6981] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:16 2022] GET /compute/v2.1/servers/b2b2835b-5da5-4417-82ed-696b6cfd3a9a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:11:16.858808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:16.859328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:16.865611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.866124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.866920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:16.867383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:16.895813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:11:17.189451 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d7af726-56ed-4e8d-b538-6fe9148f0846 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 204 len: 0 microversion: 2.1 time: 0.333974 May 14 22:11:17.190069 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3590/6982] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:11:16 2022] DELETE /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:11:17.198904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:17.199666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:17.205809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:17.207116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:17.207675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:17.208137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:17.342652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:17.350989 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-83b7ef04-dba4-4fe2-ab4a-ec1cfd56a10c tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1512 microversion: 2.1 time: 0.156326 May 14 22:11:17.351590 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3591/6983] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:17 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:18.368707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:18.369425 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:18.376327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:18.376824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:18.377680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:18.378867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:18.540620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:18.548339 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1618313e-b812-46df-8ecf-88d2e5ae1ce8 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1512 microversion: 2.1 time: 0.183600 May 14 22:11:18.548934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3592/6984] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:18 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:19.042927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2c940e84-cd62-49c8-9dd5-f814c97446ab req-939c46bb-221e-49ae-9bb4-1a91763028b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df0de89-d4ff-4414-af3a-c3be6e705d5a", "name": "network-vif-deleted", "tag": "c65bb543-0c28-4e42-879b-de62e70341fe"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:11:19.051682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2c940e84-cd62-49c8-9dd5-f814c97446ab req-939c46bb-221e-49ae-9bb4-1a91763028b0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:19.052150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2c940e84-cd62-49c8-9dd5-f814c97446ab req-939c46bb-221e-49ae-9bb4-1a91763028b0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:19.062962 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2c940e84-cd62-49c8-9dd5-f814c97446ab req-939c46bb-221e-49ae-9bb4-1a91763028b0 service nova] Creating event network-vif-deleted:c65bb543-0c28-4e42-879b-de62e70341fe for instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a on nch2-master-1 May 14 22:11:19.067952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2c940e84-cd62-49c8-9dd5-f814c97446ab req-939c46bb-221e-49ae-9bb4-1a91763028b0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028726 May 14 22:11:19.068545 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3593/6985] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:11:19.568161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:19.568887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:19.575263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:19.575773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:19.580139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:19.580139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:19.608577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:19.609043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:19.609517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lazy-loading 'fault' on Instance uuid 7df0de89-d4ff-4414-af3a-c3be6e705d5a {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:11:19.652478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '463dbb858c1a48b9b97114f048713624', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd3e2d31b0341d2b7131a387bfa33f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:11:19.661100 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6a5f0483-085a-4e15-9b66-ffafa6c90202 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 200 len: 1306 microversion: 2.1 time: 0.098651 May 14 22:11:19.661692 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3594/6986] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:19 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 1306 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:11:20.678733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:11:20.679579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] [instance: 7df0de89-d4ff-4414-af3a-c3be6e705d5a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:11:20.686141 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:20.686608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:20.687386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:11:20.687870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:11:20.702270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] HTTP exception thrown: Instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a could not be found. May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Request method failure captured: May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a HTTP/1.1 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCjq-xhdcGLKP9tzJPg2DGKwRPkcJn2E1UFzr__hyun9H_N_wQAtLCLxylEjTtdSpvvrMFYzbjDJI-48lt3mI5vuqIxYewRG824AiVAnZvq6k_mV3XeljX9dktI9GEwGs00CXJN_3hZlNb67PClRv0l_RXefDR3LaRGGxkzydDCPLl8 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cbd3e2d31b0341d2b7131a387bfa33f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cbd3e2d31b0341d2b7131a387bfa33f2", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: cbd3e2d31b0341d2b7131a387bfa33f2 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1790322467 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 463dbb858c1a48b9b97114f048713624 May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-ServersNegativeTestJSON-1790322467-project May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a could not be found. May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '7df0de89-d4ff-4414-af3a-c3be6e705d5a'} May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a could not be found. May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a could not be found. May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:11:20.703970 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a could not be found. May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] Returning 404 to user: Instance 7df0de89-d4ff-4414-af3a-c3be6e705d5a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-067577cb-40a9-4b33-bfbc-d76f46d69d27 tempest-ServersNegativeTestJSON-1790322467 tempest-ServersNegativeTestJSON-1790322467-project] 10.222.0.52 "GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a" status: 404 len: 111 microversion: 2.1 time: 0.031181 May 14 22:11:20.708721 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3595/6987] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:11:20 2022] GET /compute/v2.1/servers/7df0de89-d4ff-4414-af3a-c3be6e705d5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:12:13.167592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a78542cb-d205-41d2-8937-f6ae4b5586f3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Action: 'create', calling method: .version_select at 0x7fb1a477cca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1541032460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYD1Dm2TRIGwMzjBL6nffuKiGAArxxmqp+2anjppIt1E2Wff1iQVq8QVZL7+o2PG2QqpBWUpz1jY1fcHp0QL99spFX++odmXuHLYyIkECoCH/HqOKTbeF62Wn/egc+kjg=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:13.190807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a78542cb-d205-41d2-8937-f6ae4b5586f3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Getting quotas for project 86b19a25559c4ce7a8a6ee7c86fcab56. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:12:13.201851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a78542cb-d205-41d2-8937-f6ae4b5586f3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Getting quotas for user db572732af5342faacfc59e0841f68bf and project 86b19a25559c4ce7a8a6ee7c86fcab56. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:12:13.298516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a78542cb-d205-41d2-8937-f6ae4b5586f3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.141050 May 14 22:12:13.299133 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3596/6988] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:12:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:12:13.349280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-586510652", "imageRef": "992e821a-b6ba-4ae6-a80c-9ea72b8f78a1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1541032460", "networks": [{"uuid": "e69af344-a3df-4d17-9f0a-88390dbdf8ea"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:13.398639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] validate_networks() for [('e69af344-a3df-4d17-9f0a-88390dbdf8ea', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:12:14.087736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:12:14.088186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:12:14.088758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:12:14.089250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:12:14.089714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:12:14.098691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:14.100319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:14.100319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:14.100542 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:14.118331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Getting quotas for project 86b19a25559c4ce7a8a6ee7c86fcab56. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:12:14.123677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Getting quotas for user db572732af5342faacfc59e0841f68bf and project 86b19a25559c4ce7a8a6ee7c86fcab56. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:12:14.136661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:12:14.138954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='992e821a-b6ba-4ae6-a80c-9ea72b8f78a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:12:14.265681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e00f54a5-4f38-414c-8c58-f0f1989caab9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920890 May 14 22:12:14.266674 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3597/6989] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:12:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:12:14.276544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a876d21e-55ad-4a32-95f7-995ef1a19acf tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:14.277188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a876d21e-55ad-4a32-95f7-995ef1a19acf tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:14.334959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a876d21e-55ad-4a32-95f7-995ef1a19acf tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:14.341756 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a876d21e-55ad-4a32-95f7-995ef1a19acf tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1258 microversion: 2.1 time: 0.069143 May 14 22:12:14.342329 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3598/6990] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:14 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:15.359522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:15.360153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:15.368098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:15.368568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:15.369350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:15.369800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:15.431018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:15.438775 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5dc4359a-bac1-43de-b107-a45593c675e3 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1262 microversion: 2.1 time: 0.083207 May 14 22:12:15.439276 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3599/6991] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:15 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:16.457527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:16.458203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:16.464887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:16.465363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:16.466161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:16.466652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:16.543646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:16.551287 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2479d9a1-d7df-4a63-9ca9-7b21c30ee2ca tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1328 microversion: 2.1 time: 0.098179 May 14 22:12:16.551855 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3600/6992] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:16 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:17.580546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:17.581179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:17.588259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:17.588733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:17.589530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:17.589992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:17.759724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:17.769605 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-df59cda0-b5db-4166-afd2-b4e846830187 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.192916 May 14 22:12:17.780835 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3601/6993] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:17 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:18.789590 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:18.791291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:18.803324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:18.804373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:18.805434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:18.806111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:18.956475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:18.970904 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-feaab9a0-7bbe-4974-8d73-bb0fab861348 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.183398 May 14 22:12:18.970904 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3602/6994] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:18 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:19.990897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:19.991972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:19.999744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:20.000221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:20.001012 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:20.001465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:20.164574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:20.174996 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71954352-3ac8-4cfd-b2ce-e89f853db9a1 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.188382 May 14 22:12:20.175663 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3603/6995] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:19 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:21.260389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:21.261255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:21.268281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:21.268755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:21.269560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:21.270201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:21.408945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:21.418339 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5daadcd4-75e1-489f-9e4a-7d5c87c78594 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.163807 May 14 22:12:21.429453 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3604/6996] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:21 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:22.439925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:22.441563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:22.451335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:22.452431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:22.453694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:22.454557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:22.596983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:22.605283 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-803093f2-0bd8-4859-821e-176170c65846 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.171891 May 14 22:12:22.605874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3605/6997] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:22 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:23.624025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:23.625251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:23.633238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:23.633797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:23.634689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:23.635218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:23.779005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:23.786844 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-71f807be-b320-4dcb-a740-ea996bceee8b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.167712 May 14 22:12:23.787435 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3606/6998] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:23 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:24.804132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:24.805544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:24.813280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:24.813844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:24.814978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:24.815612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:24.966608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:24.975405 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-912157b1-6f31-40cd-9211-5b80e25207d9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.175175 May 14 22:12:24.976237 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3607/6999] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:24 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:25.994158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:25.994828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:26.001673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:26.002155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:26.002942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:26.003404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:26.129365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:26.137890 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d69ef8ef-b3f8-4ab0-bdea-9cbe5c6a7268 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.148397 May 14 22:12:26.138471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3608/7000] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:25 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:27.145800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-4728f9af-427c-4f60-83d2-9e4e69925ef0 req-3cc4614b-fe40-45b7-a467-3ec91d9a0275 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdf11a2-fc08-4bf0-ac26-b851690dc56a", "tag": "7a6b843d-6e2c-427f-b1d3-2653f31e2942"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:27.156544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4728f9af-427c-4f60-83d2-9e4e69925ef0 req-3cc4614b-fe40-45b7-a467-3ec91d9a0275 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:27.157014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-4728f9af-427c-4f60-83d2-9e4e69925ef0 req-3cc4614b-fe40-45b7-a467-3ec91d9a0275 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:27.174335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-4728f9af-427c-4f60-83d2-9e4e69925ef0 req-3cc4614b-fe40-45b7-a467-3ec91d9a0275 service nova] Creating event network-changed:7a6b843d-6e2c-427f-b1d3-2653f31e2942 for instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a on nch1-master-1 May 14 22:12:27.180210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-4728f9af-427c-4f60-83d2-9e4e69925ef0 req-3cc4614b-fe40-45b7-a467-3ec91d9a0275 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037646 May 14 22:12:27.180850 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3609/7001] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:12:27.187020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:27.187807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:27.194654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:27.196235 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:27.197165 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:27.197802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:27.414409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:27.423304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-af975d6f-33cd-4d6f-b9c2-100adc7d55cd tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.240896 May 14 22:12:27.424240 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3610/7002] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:27 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:12:28.441733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:28.442400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:28.449980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:28.450486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:28.451285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:28.451772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:28.582650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:28.590863 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1513fa2c-22fb-46e7-bea4-e01d39912445 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.153002 May 14 22:12:28.591450 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3611/7003] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:28 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:29.607884 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:29.608555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:29.615404 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:29.615913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:29.616702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:29.617825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:29.750084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:29.757950 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a170386-2779-4b39-a456-425468ab9533 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.154018 May 14 22:12:29.758542 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3612/7004] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:29 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:30.774315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:30.774965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:30.781901 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:30.782381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:30.783173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:30.783665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:30.917680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:30.925373 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7d61a6ac-add9-4e69-89a0-4c9c786bf017 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.155082 May 14 22:12:30.926232 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3613/7005] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:30 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:31.942504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:31.943137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:31.950551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:31.951017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:31.951823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:31.952277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:32.082220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:32.090224 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44e88cd7-b53e-4279-8bf0-e4755417672c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.151891 May 14 22:12:32.090818 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3614/7006] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:31 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:32.359856 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e2f2e69e-d0b1-4df4-8b22-26226d29bb9b req-957c5531-816a-4282-8343-51a281b8cce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdf11a2-fc08-4bf0-ac26-b851690dc56a", "name": "network-vif-plugged", "status": "completed", "tag": "7a6b843d-6e2c-427f-b1d3-2653f31e2942"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:32.368042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e2f2e69e-d0b1-4df4-8b22-26226d29bb9b req-957c5531-816a-4282-8343-51a281b8cce1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:32.368571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e2f2e69e-d0b1-4df4-8b22-26226d29bb9b req-957c5531-816a-4282-8343-51a281b8cce1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:32.379434 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e2f2e69e-d0b1-4df4-8b22-26226d29bb9b req-957c5531-816a-4282-8343-51a281b8cce1 service nova] Creating event network-vif-plugged:7a6b843d-6e2c-427f-b1d3-2653f31e2942 for instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a on nch1-master-1 May 14 22:12:32.385093 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e2f2e69e-d0b1-4df4-8b22-26226d29bb9b req-957c5531-816a-4282-8343-51a281b8cce1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029089 May 14 22:12:32.387727 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3615/7007] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:12:33.108647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:33.109383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:33.115749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:33.116224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:33.117071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:33.117530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:33.247665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:33.255174 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3257cfb3-b2e9-4ab4-b093-3beb9a3e4dc5 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1358 microversion: 2.1 time: 0.151696 May 14 22:12:33.255800 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3616/7008] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:33 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:34.272275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:34.272916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:34.280262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.280739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.281534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.282001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.413929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:34.424066 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e947ca88-3289-4652-a769-5b11fd641292 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1548 microversion: 2.1 time: 0.155790 May 14 22:12:34.424660 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3617/7009] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:34 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:34.446545 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:34.447181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:34.454328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.454803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.455631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.456095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.586424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:34.594062 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-76d90731-40bd-46aa-8168-a7ffa27f5fee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1548 microversion: 2.1 time: 0.153352 May 14 22:12:34.594643 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3618/7010] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:34 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:12:34.609954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:34.613281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:34.614101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Searching by: {'deleted': False, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56'} {{(pid=130637) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 14 22:12:34.619773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.620251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.621060 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.621518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.645264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.multi_cell_list [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130637) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 14 22:12:34.673033 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-99c216c4-b086-4628-b96b-d50b14e333fa tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.066491 May 14 22:12:34.678050 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3619/7011] 10.222.0.52 () {58 vars in 1124 bytes} [Sat May 14 22:12:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:12:34.686842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:34.687518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:34.693202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.693664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.694513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:34.695588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:34.824710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:34.832296 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cd15703-cf44-4a34-9afa-c70220fd3cbb tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1548 microversion: 2.1 time: 0.148972 May 14 22:12:34.833005 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3620/7012] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:34 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:36.636468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1015e7f0-b8e6-434c-bdea-76055539cd18 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ae9734-da55-464a-9282-3d7c60ec4f22"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:36.637592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1015e7f0-b8e6-434c-bdea-76055539cd18 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:36.644451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1015e7f0-b8e6-434c-bdea-76055539cd18 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:36.644928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1015e7f0-b8e6-434c-bdea-76055539cd18 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:36.645717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1015e7f0-b8e6-434c-bdea-76055539cd18 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:36.646181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1015e7f0-b8e6-434c-bdea-76055539cd18 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:37.294895 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1015e7f0-b8e6-434c-bdea-76055539cd18 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663039 May 14 22:12:37.296442 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3621/7013] 10.222.0.52 () {60 vars in 1322 bytes} [Sat May 14 22:12:36 2022] POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:12:40.612784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:40.613501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:40.620871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:40.622467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:40.622467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:40.622738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:40.765443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:40.773851 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93b88b71-c164-4926-966b-32f58c70a28e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1594 microversion: 2.1 time: 0.166063 May 14 22:12:40.774442 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3622/7014] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:40 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1594 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:12:43.093125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8583428f-d460-4022-a4a8-4437c638b460 req-0b7774de-fe26-4513-b591-82e9e2e06bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdf11a2-fc08-4bf0-ac26-b851690dc56a", "tag": "7a6b843d-6e2c-427f-b1d3-2653f31e2942"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:43.102229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8583428f-d460-4022-a4a8-4437c638b460 req-0b7774de-fe26-4513-b591-82e9e2e06bcc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:43.102697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8583428f-d460-4022-a4a8-4437c638b460 req-0b7774de-fe26-4513-b591-82e9e2e06bcc service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:43.114343 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8583428f-d460-4022-a4a8-4437c638b460 req-0b7774de-fe26-4513-b591-82e9e2e06bcc service nova] Creating event network-changed:7a6b843d-6e2c-427f-b1d3-2653f31e2942 for instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a on nch1-master-1 May 14 22:12:43.120555 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8583428f-d460-4022-a4a8-4437c638b460 req-0b7774de-fe26-4513-b591-82e9e2e06bcc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 May 14 22:12:43.121430 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3623/7015] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:12:45.340945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1068264574"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:45.341591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:45.347928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:45.348397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:45.349170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:45.349624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:45.476777 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.network.security_group_api [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Adding security group 5a2e854e-a7bd-41e8-9f83-1959e792c768 to port 7a6b843d-6e2c-427f-b1d3-2653f31e2942 May 14 22:12:45.971155 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-796dbe2a-f38b-4854-9cda-1d7d022fd708 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/action" status: 202 len: 0 microversion: 2.1 time: 0.635912 May 14 22:12:45.973025 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3624/7016] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:12:45 2022] POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:12:45.980698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d80605ce-da59-486e-ac91-431f22229fcb req-be653d8b-1a69-4d48-b684-761cc8450311 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdf11a2-fc08-4bf0-ac26-b851690dc56a", "tag": "7a6b843d-6e2c-427f-b1d3-2653f31e2942"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:12:45.993189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d80605ce-da59-486e-ac91-431f22229fcb req-be653d8b-1a69-4d48-b684-761cc8450311 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:45.994048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d80605ce-da59-486e-ac91-431f22229fcb req-be653d8b-1a69-4d48-b684-761cc8450311 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:46.007849 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d80605ce-da59-486e-ac91-431f22229fcb req-be653d8b-1a69-4d48-b684-761cc8450311 service nova] Creating event network-changed:7a6b843d-6e2c-427f-b1d3-2653f31e2942 for instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a on nch1-master-1 May 14 22:12:46.018801 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d80605ce-da59-486e-ac91-431f22229fcb req-be653d8b-1a69-4d48-b684-761cc8450311 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041260 May 14 22:12:46.019921 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3625/7017] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:12:46.029641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:12:46.030424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:12:46.038121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:46.038822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:46.039614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:12:46.040116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:12:46.291064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:12:46.299699 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c84317a9-9720-4972-8abc-677a5db07e4a tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1760 microversion: 2.1 time: 0.278457 May 14 22:12:46.302482 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3626/7018] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:12:46 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1760 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:13:08.629106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-712236af-5b2c-4505-b008-cdf61e68048e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:13:08.630094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-712236af-5b2c-4505-b008-cdf61e68048e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:08.637520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712236af-5b2c-4505-b008-cdf61e68048e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:08.637999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712236af-5b2c-4505-b008-cdf61e68048e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:08.638795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712236af-5b2c-4505-b008-cdf61e68048e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:08.639256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712236af-5b2c-4505-b008-cdf61e68048e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:08.843844 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-712236af-5b2c-4505-b008-cdf61e68048e tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/action" status: 202 len: 0 microversion: 2.1 time: 0.218532 May 14 22:13:08.844489 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3627/7019] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:13:08 2022] POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:13:08.853079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:08.853864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:08.860448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:08.860952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:08.861762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:08.862446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:09.072505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:09.081279 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2138d820-fcb9-4a58-aa57-c20acbb2fe6f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1752 microversion: 2.1 time: 0.232352 May 14 22:13:09.081874 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3628/7020] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:08 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:10.098170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:10.098812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:10.106171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:10.106637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:10.107429 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:10.107899 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:10.249055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:10.257036 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd89dae3-f596-4a06-96fa-b92c91796285 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.162796 May 14 22:13:10.257615 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3629/7021] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:10 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:11.274607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:11.275224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:11.282086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:11.282557 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:11.283344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:11.283859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:11.434124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:11.442161 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a7e524a6-ffe7-4182-8a35-2c42fdbec6a4 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.171603 May 14 22:13:11.442750 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3630/7022] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:11 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:12.463300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:12.464364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:12.471361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:12.471925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:12.472784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:12.473239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:12.639136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:12.648633 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-67ad3652-4ec6-4b4f-afe3-77b476b996b9 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.192275 May 14 22:13:12.649546 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3631/7023] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:12 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:13.669466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:13.670110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:13.677006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:13.677481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:13.678302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:13.678763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:13.830244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:13.838279 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa51ada9-abf0-420d-8ef3-0abea9dc6373 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.173617 May 14 22:13:13.839415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3632/7024] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:13 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:14.856113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:14.856785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:14.864464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:14.864955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:14.865772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:14.866234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:15.008024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:15.016428 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-727b95bf-8c8f-40c5-afeb-e94fb1649852 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.164333 May 14 22:13:15.017004 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3633/7025] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:14 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:16.033624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:16.034277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:16.041540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:16.042894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:16.043415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:16.043895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:16.189384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:16.197646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fea54b22-ed6f-4e83-941a-563f5920f473 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.167925 May 14 22:13:16.198792 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3634/7026] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:16 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:17.215893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:17.216577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:17.223330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:17.223842 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:17.224641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:17.225104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:17.373514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:17.381575 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fc84aa37-7ff9-4c0f-845f-3ea6dad6bea7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.169649 May 14 22:13:17.382096 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3635/7027] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:17 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:18.399638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:18.400309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:18.407877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:18.408375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:18.409178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:18.409639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:18.553692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:18.561894 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2c1fdff5-ef40-4628-962f-214e88c85439 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.166296 May 14 22:13:18.562413 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3636/7028] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:18 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:19.579331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:19.579999 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:19.586755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:19.587228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:19.588488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:19.588488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:19.738569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:19.746975 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-57ab265c-8226-47b4-b174-862e72310cee tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.171487 May 14 22:13:19.753167 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3637/7029] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:19 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:20.765862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:20.766521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:20.776067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:20.777533 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:20.778172 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:20.778627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:20.923092 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:20.931516 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0da22c62-2928-4287-8a53-87d6a18ad619 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.170493 May 14 22:13:20.932112 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3638/7030] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:20 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:21.949527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:21.950155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:21.956886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:21.957349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:21.958120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:21.958569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:22.102696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:22.110870 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2f9859c2-c94f-4704-85ee-10bfde432048 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.165807 May 14 22:13:22.111443 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3639/7031] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:21 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:23.127279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:23.127981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:23.134725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:23.135201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:23.136674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:23.137135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:23.279242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:23.287440 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a81d3946-291a-44a1-a548-1f2f71518d12 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.164072 May 14 22:13:23.288086 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3640/7032] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:23 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:24.304906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:24.305518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:24.312276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:24.312747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:24.313525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:24.313981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:24.453549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:24.461490 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2434e260-a789-4910-853d-3cf666ec27ba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.160632 May 14 22:13:24.462062 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3641/7033] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:24 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:25.478885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:25.479872 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:25.486751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:25.487227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:25.488076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:25.488525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:25.641232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:25.649291 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9181f7b-a760-4f03-b112-a2fad559eb3d tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1757 microversion: 2.1 time: 0.174347 May 14 22:13:25.652958 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3642/7034] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:25 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:26.668487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:13:26.669414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:26.676344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:26.676827 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:26.677658 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:26.678142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:26.825494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:13:26.834335 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00de8750-b99d-4d9f-b996-8565d291b81f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1760 microversion: 2.1 time: 0.170111 May 14 22:13:26.834998 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3643/7035] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:13:26 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1760 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:13:58.891415 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1068264574"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:13:58.892177 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:13:58.898152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:58.898637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:58.899428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:58.899917 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:59.030903 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.network.security_group_api [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Removing security group 5a2e854e-a7bd-41e8-9f83-1959e792c768 from port 7a6b843d-6e2c-427f-b1d3-2653f31e2942 May 14 22:13:59.461121 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3110a01a-d031-45ec-bf00-0ee0188b8cb7 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/action" status: 202 len: 0 microversion: 2.1 time: 0.574550 May 14 22:13:59.465313 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3644/7036] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:13:58 2022] POST /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:13:59.471646 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-487b0f74-994c-4431-a12d-02a7183d055a req-58eb8ad7-247d-4fb1-b32e-15ee1cc6462a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdf11a2-fc08-4bf0-ac26-b851690dc56a", "tag": "7a6b843d-6e2c-427f-b1d3-2653f31e2942"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:13:59.482361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-487b0f74-994c-4431-a12d-02a7183d055a req-58eb8ad7-247d-4fb1-b32e-15ee1cc6462a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:13:59.483158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-487b0f74-994c-4431-a12d-02a7183d055a req-58eb8ad7-247d-4fb1-b32e-15ee1cc6462a service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:13:59.500069 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-487b0f74-994c-4431-a12d-02a7183d055a req-58eb8ad7-247d-4fb1-b32e-15ee1cc6462a service nova] Creating event network-changed:7a6b843d-6e2c-427f-b1d3-2653f31e2942 for instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a on nch1-master-1 May 14 22:13:59.508868 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-487b0f74-994c-4431-a12d-02a7183d055a req-58eb8ad7-247d-4fb1-b32e-15ee1cc6462a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040783 May 14 22:13:59.510070 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3645/7037] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:14:00.678290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:00.679075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:00.685822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:00.686300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:00.687106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:00.687601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:00.776737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lazy-loading 'services' on Instance uuid bfdf11a2-fc08-4bf0-ac26-b851690dc56a {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:14:00.986224 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a42e65d5-9f4b-4633-97df-29474575a2e2 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments/d9ae9734-da55-464a-9282-3d7c60ec4f22" status: 202 len: 0 microversion: 2.1 time: 0.313207 May 14 22:14:00.986986 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3646/7038] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 22:14:00 2022] DELETE /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments/d9ae9734-da55-464a-9282-3d7c60ec4f22 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:14:01.051623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-90d88a0e-71bc-40d2-b46b-f6ccc5f7e59d req-9bad74c3-9f1b-4958-a764-9b38a5e59465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfdf11a2-fc08-4bf0-ac26-b851690dc56a", "tag": "7a6b843d-6e2c-427f-b1d3-2653f31e2942"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:14:01.060718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90d88a0e-71bc-40d2-b46b-f6ccc5f7e59d req-9bad74c3-9f1b-4958-a764-9b38a5e59465 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:01.061188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90d88a0e-71bc-40d2-b46b-f6ccc5f7e59d req-9bad74c3-9f1b-4958-a764-9b38a5e59465 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:01.072718 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-90d88a0e-71bc-40d2-b46b-f6ccc5f7e59d req-9bad74c3-9f1b-4958-a764-9b38a5e59465 service nova] Creating event network-changed:7a6b843d-6e2c-427f-b1d3-2653f31e2942 for instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a on nch1-master-1 May 14 22:14:01.077657 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-90d88a0e-71bc-40d2-b46b-f6ccc5f7e59d req-9bad74c3-9f1b-4958-a764-9b38a5e59465 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089341 May 14 22:14:01.082113 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3647/7039] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:14:01.083627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1a090754-a17e-4de0-a8f2-6fbce12fe37b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:01.084672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1a090754-a17e-4de0-a8f2-6fbce12fe37b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:01.091544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a090754-a17e-4de0-a8f2-6fbce12fe37b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:01.092031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a090754-a17e-4de0-a8f2-6fbce12fe37b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:01.092836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a090754-a17e-4de0-a8f2-6fbce12fe37b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:01.093294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1a090754-a17e-4de0-a8f2-6fbce12fe37b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:01.134604 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1a090754-a17e-4de0-a8f2-6fbce12fe37b tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055112 May 14 22:14:01.135324 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3648/7040] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 22:14:01 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:14:02.147222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-578c00d8-812b-413f-a2fe-1896c4be0bba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:02.148234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-578c00d8-812b-413f-a2fe-1896c4be0bba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:02.154920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-578c00d8-812b-413f-a2fe-1896c4be0bba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:02.155399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-578c00d8-812b-413f-a2fe-1896c4be0bba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:02.156250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-578c00d8-812b-413f-a2fe-1896c4be0bba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:02.156709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-578c00d8-812b-413f-a2fe-1896c4be0bba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:02.187642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-578c00d8-812b-413f-a2fe-1896c4be0bba tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045298 May 14 22:14:02.188626 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3649/7041] 10.222.0.52 () {58 vars in 1301 bytes} [Sat May 14 22:14:02 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 14 22:14:02.198198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:02.198716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:02.204733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:02.205210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:02.206000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:02.206461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:02.280191 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] HTTP exception thrown: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a is not attached to volume d9ae9734-da55-464a-9282-3d7c60ec4f22 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Request method failure captured: May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: request: DELETE /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments/d9ae9734-da55-464a-9282-3d7c60ec4f22 HTTP/1.1 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCksvAJQD3B6CLSdjDmw0nrN5GQXQbtl9K19dowtWUyWviUfzWVrxjYwEjkW_phquOLrDxtsLsiDwdFguKR-4GGdGdtAC-nxbqzeZdThgJ-r_c7MHlEFxyNsWQB6ohr6Oxdl3eK-2iIr8t63iCHGersM6-YvqoW7TfpUB7oYaSBaWHg May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 86b19a25559c4ce7a8a6ee7c86fcab56 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestMinimumBasicScenario-598422200 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b19a25559c4ce7a8a6ee7c86fcab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b19a25559c4ce7a8a6ee7c86fcab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86b19a25559c4ce7a8a6ee7c86fcab56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86b19a25559c4ce7a8a6ee7c86fcab56", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestMinimumBasicScenario-598422200 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 86b19a25559c4ce7a8a6ee7c86fcab56 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestMinimumBasicScenario-598422200 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestMinimumBasicScenario-598422200-project May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: db572732af5342faacfc59e0841f68bf May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestMinimumBasicScenario-598422200-project May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a is not attached to volume d9ae9734-da55-464a-9282-3d7c60ec4f22 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'server_id': 'bfdf11a2-fc08-4bf0-ac26-b851690dc56a', 'id': 'd9ae9734-da55-464a-9282-3d7c60ec4f22'} May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d9ae9734-da55-464a-9282-3d7c60ec4f22. May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a is not attached to volume d9ae9734-da55-464a-9282-3d7c60ec4f22 May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:14:02.288450 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:14:02.292617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:14:02.292617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:14:02.292617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a is not attached to volume d9ae9734-da55-464a-9282-3d7c60ec4f22 May 14 22:14:02.292617 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:02.292617 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Returning 404 to user: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a is not attached to volume d9ae9734-da55-464a-9282-3d7c60ec4f22 {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:14:02.292617 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cee87840-4e87-4a1f-a149-bb2dd1393129 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments/d9ae9734-da55-464a-9282-3d7c60ec4f22" status: 404 len: 154 microversion: 2.1 time: 0.095698 May 14 22:14:02.292617 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3650/7042] 10.222.0.52 () {58 vars in 1415 bytes} [Sat May 14 22:14:02 2022] DELETE /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a/os-volume_attachments/d9ae9734-da55-464a-9282-3d7c60ec4f22 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:14:06.722329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:06.722918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:06.729640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:06.730105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:06.730881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:06.731328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:06.757210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:14:07.010184 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e64c741e-c63c-47bd-89d5-8f23c8f46148 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 204 len: 0 microversion: 2.1 time: 0.291325 May 14 22:14:07.010972 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3651/7043] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:14:06 2022] DELETE /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:14:07.019105 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:07.019852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:07.025869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:07.026343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:07.027132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:07.027624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:07.160696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:07.168461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e6a88520-42dc-44dd-a740-7b16a167e9c0 tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1554 microversion: 2.1 time: 0.153302 May 14 22:14:07.169049 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3652/7044] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:07 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:08.186084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:08.186700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:08.193676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:08.194176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:08.194958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:08.195414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:08.322437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:08.330860 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b33a0e4d-5741-4ce1-a002-6d7ef96c770c tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1554 microversion: 2.1 time: 0.148828 May 14 22:14:08.331449 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3653/7045] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:08 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:09.151574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e6be92a4-99aa-4d74-810a-24d5de2155d7 req-515a6eb9-33f9-4093-90e4-97567b3d386c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfdf11a2-fc08-4bf0-ac26-b851690dc56a", "name": "network-vif-deleted", "tag": "7a6b843d-6e2c-427f-b1d3-2653f31e2942"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:14:09.159714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e6be92a4-99aa-4d74-810a-24d5de2155d7 req-515a6eb9-33f9-4093-90e4-97567b3d386c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:09.160182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e6be92a4-99aa-4d74-810a-24d5de2155d7 req-515a6eb9-33f9-4093-90e4-97567b3d386c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:09.171276 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e6be92a4-99aa-4d74-810a-24d5de2155d7 req-515a6eb9-33f9-4093-90e4-97567b3d386c service nova] Creating event network-vif-deleted:7a6b843d-6e2c-427f-b1d3-2653f31e2942 for instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a on nch1-master-1 May 14 22:14:09.176377 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e6be92a4-99aa-4d74-810a-24d5de2155d7 req-515a6eb9-33f9-4093-90e4-97567b3d386c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028712 May 14 22:14:09.176971 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3654/7046] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:14:09.349331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:09.349968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:09.356234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:09.356713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:09.357509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:09.358001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:09.422597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db572732af5342faacfc59e0841f68bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b19a25559c4ce7a8a6ee7c86fcab56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:09.432291 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a0b8d187-e89c-436b-80d1-a1f30b2ae6ff tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 200 len: 1343 microversion: 2.1 time: 0.088121 May 14 22:14:09.432888 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3655/7047] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:09 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 1343 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:10.448746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:10.449426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] [instance: bfdf11a2-fc08-4bf0-ac26-b851690dc56a] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:10.457477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:10.457945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:10.459801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:10.459801 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:10.474147 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] HTTP exception thrown: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a could not be found. May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Request method failure captured: May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a HTTP/1.1 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCksvAJQD3B6CLSdjDmw0nrN5GQXQbtl9K19dowtWUyWviUfzWVrxjYwEjkW_phquOLrDxtsLsiDwdFguKR-4GGdGdtAC-nxbqzeZdThgJ-r_c7MHlEFxyNsWQB6ohr6Oxdl3eK-2iIr8t63iCHGersM6-YvqoW7TfpUB7oYaSBaWHg May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 86b19a25559c4ce7a8a6ee7c86fcab56 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestMinimumBasicScenario-598422200 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b19a25559c4ce7a8a6ee7c86fcab56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/86b19a25559c4ce7a8a6ee7c86fcab56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/86b19a25559c4ce7a8a6ee7c86fcab56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_86b19a25559c4ce7a8a6ee7c86fcab56", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestMinimumBasicScenario-598422200 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 86b19a25559c4ce7a8a6ee7c86fcab56 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestMinimumBasicScenario-598422200 May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestMinimumBasicScenario-598422200-project May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: db572732af5342faacfc59e0841f68bf May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestMinimumBasicScenario-598422200-project May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a could not be found. May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'bfdf11a2-fc08-4bf0-ac26-b851690dc56a'} May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a could not be found. May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a could not be found. May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:14:10.475949 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a could not be found. May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Returning 404 to user: Instance bfdf11a2-fc08-4bf0-ac26-b851690dc56a could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-760fb0dc-ddbe-43fd-a0a8-f496d8bf422f tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a" status: 404 len: 111 microversion: 2.1 time: 0.032672 May 14 22:14:10.480336 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3656/7048] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:10 2022] GET /compute/v2.1/servers/bfdf11a2-fc08-4bf0-ac26-b851690dc56a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:14:10.486279 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6cf628c-9183-4163-8c61-df037a9f20bc tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] Calling method '.version_select at 0x7fb1a46e6dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:10.553252 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d6cf628c-9183-4163-8c61-df037a9f20bc tempest-TestMinimumBasicScenario-598422200 tempest-TestMinimumBasicScenario-598422200-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1541032460" status: 202 len: 0 microversion: 2.1 time: 0.071000 May 14 22:14:10.553882 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3657/7049] 10.222.0.52 () {58 vars in 1271 bytes} [Sat May 14 22:14:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1541032460 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 14 22:14:22.952597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59ff9fe6-fbac-41cd-a5fd-ca4b370a9c43 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: .version_select at 0x7fb1a45b69d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1669066810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN45lykPcYyRx3bWnOp5A0h6I/OtPY1yMIZ4ew4TI7E8dyt5V9P/pnQkhdMDA2MFsSFkdvmfMnFhC/94XV3euZZOqaFIvmWFnn7ocGHiDlggfyJIe2zKSBec5ixJAIj5EQ=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:14:22.967225 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-59ff9fe6-fbac-41cd-a5fd-ca4b370a9c43 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:14:22.972980 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-59ff9fe6-fbac-41cd-a5fd-ca4b370a9c43 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:14:23.067960 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59ff9fe6-fbac-41cd-a5fd-ca4b370a9c43 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.276408 May 14 22:14:23.068570 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3658/7050] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:14:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:14:31.343873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1087248652", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "66936228-dd70-41a6-aa56-8d5bfcefe46f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1669066810", "security_groups": [{"name": "tempest-secgroup-smoke-1984455729"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:14:31.450033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] validate_networks() for [('66936228-dd70-41a6-aa56-8d5bfcefe46f', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:14:31.990588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:14:31.991254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:14:31.991874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:14:31.992370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:14:31.992825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:14:32.004546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:32.005280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:32.006286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:32.006751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:32.024289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:14:32.030517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:14:32.046360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:14:32.048641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:14:32.180672 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a86b1800-aaf3-4dab-8d5b-114a2ed0e69f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841698 May 14 22:14:32.181368 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3659/7051] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:14:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:14:32.192597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5d4adb89-fe2b-41dd-aa48-8ea367e72324 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:32.193241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5d4adb89-fe2b-41dd-aa48-8ea367e72324 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:32.253400 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5d4adb89-fe2b-41dd-aa48-8ea367e72324 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:32.260421 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5d4adb89-fe2b-41dd-aa48-8ea367e72324 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1267 microversion: 2.1 time: 0.072426 May 14 22:14:32.270462 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3660/7052] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:32 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:14:33.277410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f3279608-bdac-47b5-9118-98583ccdc3fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:33.278893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f3279608-bdac-47b5-9118-98583ccdc3fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:33.341645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f3279608-bdac-47b5-9118-98583ccdc3fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:33.349442 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f3279608-bdac-47b5-9118-98583ccdc3fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1267 microversion: 2.1 time: 0.075874 May 14 22:14:33.350042 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3661/7053] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:33 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:34.366203 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:34.366839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:34.376329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:34.376817 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:34.377897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:34.378519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:34.443322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:34.458407 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bce66aa-9424-453e-9299-752d68ffc5d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1319 microversion: 2.1 time: 0.095972 May 14 22:14:34.459466 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3662/7054] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:34 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1319 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:14:35.482308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:35.482987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:35.490345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:35.490830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:35.491676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:35.492137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:35.709112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:35.716984 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a2b8049-19c9-4bfe-890d-1c2a66de70e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.238598 May 14 22:14:35.717965 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3663/7055] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:35 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:36.344340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-07b4c828-9b0f-4e4d-92f6-b415a2ee90f5 req-7ca104b6-22a1-4cda-9374-ce79b06bb702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8858dece-a601-4456-8053-d7737e98634d", "tag": "425c860f-f77a-422c-8a57-44b766eb2266"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:14:36.353288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-07b4c828-9b0f-4e4d-92f6-b415a2ee90f5 req-7ca104b6-22a1-4cda-9374-ce79b06bb702 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:36.353761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-07b4c828-9b0f-4e4d-92f6-b415a2ee90f5 req-7ca104b6-22a1-4cda-9374-ce79b06bb702 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:36.366250 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-07b4c828-9b0f-4e4d-92f6-b415a2ee90f5 req-7ca104b6-22a1-4cda-9374-ce79b06bb702 service nova] Creating event network-changed:425c860f-f77a-422c-8a57-44b766eb2266 for instance 8858dece-a601-4456-8053-d7737e98634d on nch2-master-1 May 14 22:14:36.372200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-07b4c828-9b0f-4e4d-92f6-b415a2ee90f5 req-7ca104b6-22a1-4cda-9374-ce79b06bb702 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031809 May 14 22:14:36.372320 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3664/7056] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:14:36.736369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:36.737098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:36.743354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:36.743867 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:36.744649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:36.745108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:36.961227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:36.968827 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6f65a35c-f326-4f4d-bbc5-b8a554e8b9fc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.238292 May 14 22:14:36.969415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3665/7057] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:36 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:37.985859 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:37.986538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:37.993478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:37.993956 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:37.994747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:37.995214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:38.129365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:38.137094 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fd5c659e-9136-46c9-b40a-fb23c58efcee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.155250 May 14 22:14:38.137713 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3666/7058] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:37 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:39.155273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:39.155966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:39.163046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:39.163553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:39.164346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:39.164805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:39.351131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:39.358671 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad32a79a-453a-43bc-b0ef-5d420988e90e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.207862 May 14 22:14:39.359248 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3667/7059] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:39 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:40.375860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:40.376526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:40.383353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:40.383948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:40.384680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:40.390665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:40.521229 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:40.529168 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2539b93-5227-4526-9bf0-67e74f6a6651 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.158011 May 14 22:14:40.529821 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3668/7060] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:40 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:41.546554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:41.547197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:41.554021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:41.554491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:41.555281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:41.555775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:41.690437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:41.697976 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bffedf5b-1708-475f-ab3c-d98d1aa7dc44 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.155478 May 14 22:14:41.698562 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3669/7061] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:41 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:42.624149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6544bcc7-d127-43a8-85c7-8390f854f50b req-d4650f83-5e2d-42f6-a9f2-6a23916b49e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8858dece-a601-4456-8053-d7737e98634d", "name": "network-vif-plugged", "status": "completed", "tag": "425c860f-f77a-422c-8a57-44b766eb2266"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:14:42.632893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6544bcc7-d127-43a8-85c7-8390f854f50b req-d4650f83-5e2d-42f6-a9f2-6a23916b49e5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:42.633346 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6544bcc7-d127-43a8-85c7-8390f854f50b req-d4650f83-5e2d-42f6-a9f2-6a23916b49e5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:42.927389 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6544bcc7-d127-43a8-85c7-8390f854f50b req-d4650f83-5e2d-42f6-a9f2-6a23916b49e5 service nova] Creating event network-vif-plugged:425c860f-f77a-422c-8a57-44b766eb2266 for instance 8858dece-a601-4456-8053-d7737e98634d on nch2-master-1 May 14 22:14:42.932484 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6544bcc7-d127-43a8-85c7-8390f854f50b req-d4650f83-5e2d-42f6-a9f2-6a23916b49e5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312312 May 14 22:14:42.933092 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3670/7062] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:14:42.938839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:42.939575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:42.945813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:42.946227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:42.947009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:42.947513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:43.151516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:43.159695 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04dcba4f-90ce-4bc4-9f5e-f7f9523acf30 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.225471 May 14 22:14:43.160262 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3671/7063] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:42 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:14:44.177411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:44.178266 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:44.185364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:44.186453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:44.187500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:44.188014 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:44.319546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:44.327837 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-971ce02c-a07b-4b1f-a4be-8f2c6d7e13cf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1393 microversion: 2.1 time: 0.154384 May 14 22:14:44.328416 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3672/7064] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:44 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:45.344594 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:45.345417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:45.352043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:45.352517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:45.353357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:45.353816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:45.489423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:45.497029 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a503270c-ba14-467a-9ced-8eb8d2f35ecd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1564 microversion: 2.1 time: 0.156573 May 14 22:14:45.497610 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3673/7065] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:45 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:45.513176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:45.513835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:45.519504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:45.519995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:45.520791 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:45.521258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:45.651522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:45.662505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-22559401-5206-498e-bb5b-23505c295faa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1564 microversion: 2.1 time: 0.152573 May 14 22:14:45.663355 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3674/7066] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:45 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:47.636870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:14:47.637534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:14:47.644081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:47.644556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:47.645466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:47.645804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:47.787970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:14:47.796327 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-95fa8aae-bb30-4178-8a7c-810887b1d9b0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1564 microversion: 2.1 time: 0.163315 May 14 22:14:47.808452 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3675/7067] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:14:47 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:14:47.808452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-e8f71b4a-6793-4003-8cea-3146d12c6f69 req-61cc750f-978c-470a-9242-515a8717525c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8858dece-a601-4456-8053-d7737e98634d", "tag": "425c860f-f77a-422c-8a57-44b766eb2266"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:14:47.810202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e8f71b4a-6793-4003-8cea-3146d12c6f69 req-61cc750f-978c-470a-9242-515a8717525c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:14:47.810732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-e8f71b4a-6793-4003-8cea-3146d12c6f69 req-61cc750f-978c-470a-9242-515a8717525c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:14:47.823114 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-e8f71b4a-6793-4003-8cea-3146d12c6f69 req-61cc750f-978c-470a-9242-515a8717525c service nova] Creating event network-changed:425c860f-f77a-422c-8a57-44b766eb2266 for instance 8858dece-a601-4456-8053-d7737e98634d on nch2-master-1 May 14 22:14:47.829601 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-e8f71b4a-6793-4003-8cea-3146d12c6f69 req-61cc750f-978c-470a-9242-515a8717525c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031334 May 14 22:14:47.830561 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3676/7068] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:15:09.422589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-11207787-e867-4136-82c8-5cce431788a2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:09.423564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-11207787-e867-4136-82c8-5cce431788a2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:09.429851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11207787-e867-4136-82c8-5cce431788a2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:09.430325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11207787-e867-4136-82c8-5cce431788a2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:09.431145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11207787-e867-4136-82c8-5cce431788a2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:09.431657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-11207787-e867-4136-82c8-5cce431788a2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:09.487412 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-11207787-e867-4136-82c8-5cce431788a2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action" status: 200 len: 24570 microversion: 2.1 time: 0.069765 May 14 22:15:09.488369 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3677/7069] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:15:09 2022] POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action => generated 24570 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:15:15.976997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a6c39aa-4cf7-4caa-b2d5-c52f1cca9a96 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:15.977677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3a6c39aa-4cf7-4caa-b2d5-c52f1cca9a96 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:15.985126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a6c39aa-4cf7-4caa-b2d5-c52f1cca9a96 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:15.986116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a6c39aa-4cf7-4caa-b2d5-c52f1cca9a96 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:15.986906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a6c39aa-4cf7-4caa-b2d5-c52f1cca9a96 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:15.987368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a6c39aa-4cf7-4caa-b2d5-c52f1cca9a96 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:16.166383 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a6c39aa-4cf7-4caa-b2d5-c52f1cca9a96 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action" status: 202 len: 0 microversion: 2.1 time: 0.193507 May 14 22:15:16.167113 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3678/7070] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:15:15 2022] POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:15:16.176192 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:16.176922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:16.183156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:16.183675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:16.184478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:16.184939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:16.319593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:16.327618 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-599bebdf-3f2b-43bb-8f00-c1a61ec67266 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1687 microversion: 2.1 time: 0.156111 May 14 22:15:16.328206 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3679/7071] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:16 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:15:17.347214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:17.347892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:17.354593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:17.355061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:17.355939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:17.356396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:17.490138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:17.497908 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9ee6ae7c-652b-4cad-a6c4-413dd440517b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1667 microversion: 2.1 time: 0.155502 May 14 22:15:17.498484 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3680/7072] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:17 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:18.590483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac5d8259-751b-49dd-88a5-8a687dbefced tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:18.591448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac5d8259-751b-49dd-88a5-8a687dbefced tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:18.598566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac5d8259-751b-49dd-88a5-8a687dbefced tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:18.599057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac5d8259-751b-49dd-88a5-8a687dbefced tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:18.599934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac5d8259-751b-49dd-88a5-8a687dbefced tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:18.600487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac5d8259-751b-49dd-88a5-8a687dbefced tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:18.650803 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac5d8259-751b-49dd-88a5-8a687dbefced tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action" status: 200 len: 32644 microversion: 2.1 time: 0.066128 May 14 22:15:18.651776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3681/7073] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:15:18 2022] POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action => generated 32644 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:15:18.662870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-09635010-3e84-4278-a933-3678bda659f9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:18.663566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-09635010-3e84-4278-a933-3678bda659f9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:18.670786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09635010-3e84-4278-a933-3678bda659f9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:18.671293 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09635010-3e84-4278-a933-3678bda659f9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:18.672119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09635010-3e84-4278-a933-3678bda659f9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:18.672588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-09635010-3e84-4278-a933-3678bda659f9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:18.893472 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-09635010-3e84-4278-a933-3678bda659f9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action" status: 202 len: 0 microversion: 2.1 time: 0.234535 May 14 22:15:18.894041 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3682/7074] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:15:18 2022] POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:15:18.902753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:18.907714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:18.909779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:18.910253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:18.911049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:18.911531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:19.052902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:19.060552 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-44304656-7dd6-4d25-ab86-d84e2b03f918 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1674 microversion: 2.1 time: 0.161988 May 14 22:15:19.061137 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3683/7075] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:18 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:20.078929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:20.080422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:20.087331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:20.090548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:20.090548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:20.090548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:20.227718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:20.235282 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6080799b-36c0-466f-bbb4-e4bf1435246b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1682 microversion: 2.1 time: 0.160381 May 14 22:15:20.236059 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3684/7076] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:20 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:20.335635 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-861e0b3e-5f2c-4287-937a-3461136605ad tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:20.336644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-861e0b3e-5f2c-4287-937a-3461136605ad tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:20.342920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-861e0b3e-5f2c-4287-937a-3461136605ad tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:20.343336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-861e0b3e-5f2c-4287-937a-3461136605ad tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:20.344161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-861e0b3e-5f2c-4287-937a-3461136605ad tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:20.344625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-861e0b3e-5f2c-4287-937a-3461136605ad tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:20.404987 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-861e0b3e-5f2c-4287-937a-3461136605ad tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action" status: 200 len: 36037 microversion: 2.1 time: 0.073371 May 14 22:15:20.405651 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3685/7077] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:15:20 2022] POST /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d/action => generated 36037 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:15:21.534349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:21.535011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:21.542725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:21.543417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:21.544257 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:21.544717 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:21.573110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:15:21.864128 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ade06a30-78e3-4814-98e3-f9582325869e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 204 len: 0 microversion: 2.1 time: 0.334814 May 14 22:15:21.864735 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3686/7078] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:15:21 2022] DELETE /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 22:15:21.929368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-98e3547f-830b-45a4-a7a5-527872449858 req-406213e4-91ff-409a-b6c9-6c5db5172dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8858dece-a601-4456-8053-d7737e98634d", "tag": "425c860f-f77a-422c-8a57-44b766eb2266"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:21.940064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-98e3547f-830b-45a4-a7a5-527872449858 req-406213e4-91ff-409a-b6c9-6c5db5172dc9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:21.940537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-98e3547f-830b-45a4-a7a5-527872449858 req-406213e4-91ff-409a-b6c9-6c5db5172dc9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:21.951088 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-98e3547f-830b-45a4-a7a5-527872449858 req-406213e4-91ff-409a-b6c9-6c5db5172dc9 service nova] Creating event network-changed:425c860f-f77a-422c-8a57-44b766eb2266 for instance 8858dece-a601-4456-8053-d7737e98634d on nch2-master-1 May 14 22:15:21.956671 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-98e3547f-830b-45a4-a7a5-527872449858 req-406213e4-91ff-409a-b6c9-6c5db5172dc9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090642 May 14 22:15:21.957437 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3687/7079] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:15:21.962243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:21.962962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:21.969033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:21.969535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:21.970920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:21.971372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:22.104558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:22.112863 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a3432556-4f9a-4165-a8bf-935605dd0ae9 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1688 microversion: 2.1 time: 0.154464 May 14 22:15:22.113443 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3688/7080] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:21 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:15:23.129793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:23.130484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:23.137224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:23.137694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:23.138475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:23.138930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:23.317116 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:23.324787 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-47ad60ea-02c2-4e47-95eb-3ba338b6d3ee tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1688 microversion: 2.1 time: 0.199003 May 14 22:15:23.325415 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3689/7081] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:23 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:24.342560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:24.343288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:24.350418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:24.350900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:24.351732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:24.352211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:24.419904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:24.427551 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a73f389d-78db-4831-af2a-de3269725a50 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 200 len: 1502 microversion: 2.1 time: 0.089014 May 14 22:15:24.434551 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3690/7082] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:24 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 1502 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:24.434551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1dd14820-2aab-4bb6-8f30-4a9b72cf8cc4 req-ac2578c9-7d2e-4d2e-a191-0b0617defc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8858dece-a601-4456-8053-d7737e98634d", "name": "network-vif-deleted", "tag": "425c860f-f77a-422c-8a57-44b766eb2266"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:24.441040 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1dd14820-2aab-4bb6-8f30-4a9b72cf8cc4 req-ac2578c9-7d2e-4d2e-a191-0b0617defc04 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:24.441510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1dd14820-2aab-4bb6-8f30-4a9b72cf8cc4 req-ac2578c9-7d2e-4d2e-a191-0b0617defc04 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:24.452584 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1dd14820-2aab-4bb6-8f30-4a9b72cf8cc4 req-ac2578c9-7d2e-4d2e-a191-0b0617defc04 service nova] Creating event network-vif-deleted:425c860f-f77a-422c-8a57-44b766eb2266 for instance 8858dece-a601-4456-8053-d7737e98634d on nch2-master-1 May 14 22:15:24.458142 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1dd14820-2aab-4bb6-8f30-4a9b72cf8cc4 req-ac2578c9-7d2e-4d2e-a191-0b0617defc04 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028863 May 14 22:15:24.458743 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3691/7083] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:15:25.447032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:25.447790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 8858dece-a601-4456-8053-d7737e98634d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:25.454809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:25.455471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:25.456284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:25.456746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:25.470286 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] HTTP exception thrown: Instance 8858dece-a601-4456-8053-d7737e98634d could not be found. May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Request method failure captured: May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d HTTP/1.1 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCm9wmrAJo2FVTZakd8NIqYe74xFo0hUsYKXW6GEV5josiKi1ryz41OMBIEI69b5uaEMAHzEBpcB5dxYN-Lt5_6bKpJP03JXjWsiyXpr2kYCmOgJFOdLihuCipdRF2oN9z7qEyz0xrtTjasJ7lxc6JQ9QSbjhs716KvpraON8MChYKc May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b433c6a39b149acb9537d5d8d32a845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2866128bc30b4a5fbbb05702047de69e May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 8858dece-a601-4456-8053-d7737e98634d could not be found. May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '8858dece-a601-4456-8053-d7737e98634d'} May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8858dece-a601-4456-8053-d7737e98634d could not be found. May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8858dece-a601-4456-8053-d7737e98634d could not be found. May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:15:25.471982 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8858dece-a601-4456-8053-d7737e98634d could not be found. May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Returning 404 to user: Instance 8858dece-a601-4456-8053-d7737e98634d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8f03e22-6563-47c0-a5df-9b783d17e73b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d" status: 404 len: 111 microversion: 2.1 time: 0.031594 May 14 22:15:25.476347 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3692/7084] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:25 2022] GET /compute/v2.1/servers/8858dece-a601-4456-8053-d7737e98634d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:15:29.337255 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c751b864-fc73-4b99-99a6-803220a4e1fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '.version_select at 0x7fb1a6bdef70>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:29.429632 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c751b864-fc73-4b99-99a6-803220a4e1fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1669066810" status: 202 len: 0 microversion: 2.1 time: 0.096378 May 14 22:15:29.430258 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3693/7085] 10.222.0.52 () {58 vars in 1283 bytes} [Sat May 14 22:15:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1669066810 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:15:29.458024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-478d22f4-b693-4d9e-8eea-865e10e2b902 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: .version_select at 0x7fb1a6aebe50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1993809632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqmo5Kuh+SWr+o6zcbmwkx6z1241qsdmoVv0vQc57QmZEz7BonaNnV580AUa+i8+T0iLhdawRQQUoMrbMJFDbn5ox7yeFtpYx7n1z01Pwkp0Z/Hc5GX0DmFUXvlOZVWJA=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:29.473275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-478d22f4-b693-4d9e-8eea-865e10e2b902 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:15:29.478432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-478d22f4-b693-4d9e-8eea-865e10e2b902 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:15:29.573315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-478d22f4-b693-4d9e-8eea-865e10e2b902 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.119826 May 14 22:15:29.573932 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3694/7086] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:15:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:15:37.822889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1509353421", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "39601261-4692-47fe-87a3-19d1b9880c98"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1993809632", "security_groups": [{"name": "tempest-secgroup-smoke-1032248252"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:37.986613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] validate_networks() for [('39601261-4692-47fe-87a3-19d1b9880c98', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:15:38.399781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:15:38.404482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:15:38.404482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:15:38.404482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:15:38.404482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:15:38.412286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:38.413061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:38.413898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:38.414363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:38.432298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:15:38.438157 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:15:38.451650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:15:38.455228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:15:38.602200 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e51f2f8c-2a68-4cdc-ab11-cb0ae243f8ba tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783186 May 14 22:15:38.602902 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3695/7087] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:15:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 14 22:15:38.615457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a57da545-26a8-4f27-af78-95a1dc24da7e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:38.615457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a57da545-26a8-4f27-af78-95a1dc24da7e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:38.717556 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a57da545-26a8-4f27-af78-95a1dc24da7e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:38.730337 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a57da545-26a8-4f27-af78-95a1dc24da7e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1267 microversion: 2.1 time: 0.120912 May 14 22:15:38.731044 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3696/7088] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:38 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1267 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:39.748416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:39.749047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:39.757315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:39.757775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:39.758578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:39.759039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:39.826198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:39.834267 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04b44cb4-580f-4495-a3cd-4197522375af tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1271 microversion: 2.1 time: 0.089653 May 14 22:15:39.836789 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3697/7089] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:39 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1271 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:40.851418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:40.852097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:40.858902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:40.859381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:40.860883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:40.861295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:40.931692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:40.940151 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-87f76b83-85c6-46b5-b588-3ec942a3101d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1337 microversion: 2.1 time: 0.092814 May 14 22:15:40.941061 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3698/7090] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:40 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1337 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:41.961199 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:41.965394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:41.969983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:41.970732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:41.971766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:41.972285 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:42.119136 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:42.127662 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-260f37f0-9bf8-4c2b-8608-38d374275526 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.170323 May 14 22:15:42.137210 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3699/7091] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:41 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:42.296725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0a9c971a-e54b-4115-b41c-a0b156c4f1a6 req-e6174f8a-e3ea-4e68-8396-eebe90fcb8e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09517bba-68d1-4033-b1a4-162101bef4e4", "tag": "a72b233b-c690-496c-aca5-54b3d1718328"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:42.306137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0a9c971a-e54b-4115-b41c-a0b156c4f1a6 req-e6174f8a-e3ea-4e68-8396-eebe90fcb8e9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:42.306611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0a9c971a-e54b-4115-b41c-a0b156c4f1a6 req-e6174f8a-e3ea-4e68-8396-eebe90fcb8e9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:42.319506 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0a9c971a-e54b-4115-b41c-a0b156c4f1a6 req-e6174f8a-e3ea-4e68-8396-eebe90fcb8e9 service nova] Creating event network-changed:a72b233b-c690-496c-aca5-54b3d1718328 for instance 09517bba-68d1-4033-b1a4-162101bef4e4 on nch2-master-1 May 14 22:15:42.325172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0a9c971a-e54b-4115-b41c-a0b156c4f1a6 req-e6174f8a-e3ea-4e68-8396-eebe90fcb8e9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032108 May 14 22:15:42.325799 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3700/7092] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:15:43.146955 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:43.147711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:43.153882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:43.154360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:43.155444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:43.155938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:43.288392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:43.295869 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9a9b911-1e9d-4619-82d5-77e54ee2ad42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.154016 May 14 22:15:43.296455 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3701/7093] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:43 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:44.313376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:44.314050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:44.320972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:44.321448 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:44.322244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:44.322707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:44.457576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:44.465061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a173604a-fe9e-45f1-b0dd-7806850eab3a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.155725 May 14 22:15:44.465644 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3702/7094] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:44 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:15:45.482489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:45.483151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:45.491016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:45.491530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:45.492350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:45.492805 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:45.623900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:45.631565 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f69b0be3-807e-474d-b4a2-2d9a939cbd4c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.153271 May 14 22:15:45.632168 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3703/7095] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:45 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:46.647751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:46.648368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:46.655059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:46.655568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:46.656591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:46.657244 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:46.797444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:46.805230 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c1aafbd8-0108-42ce-8b8b-caff18a5ce08 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.161402 May 14 22:15:46.805841 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3704/7096] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:46 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:47.823219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:47.823877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:47.831571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:47.832052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:47.832845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:47.833310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:47.965681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:47.974137 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c080993a-fbf6-42ac-a813-dd708c7cec5d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.154923 May 14 22:15:47.974719 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3705/7097] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:47 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:49.019182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-24fe83dc-cbaa-4f0c-b8da-8bc5a8046438 req-9ad560c1-13b7-496e-b949-b58b6ae1c6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09517bba-68d1-4033-b1a4-162101bef4e4", "name": "network-vif-plugged", "status": "completed", "tag": "a72b233b-c690-496c-aca5-54b3d1718328"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:49.027547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-24fe83dc-cbaa-4f0c-b8da-8bc5a8046438 req-9ad560c1-13b7-496e-b949-b58b6ae1c6e1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:49.028019 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-24fe83dc-cbaa-4f0c-b8da-8bc5a8046438 req-9ad560c1-13b7-496e-b949-b58b6ae1c6e1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:49.041129 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-24fe83dc-cbaa-4f0c-b8da-8bc5a8046438 req-9ad560c1-13b7-496e-b949-b58b6ae1c6e1 service nova] Creating event network-vif-plugged:a72b233b-c690-496c-aca5-54b3d1718328 for instance 09517bba-68d1-4033-b1a4-162101bef4e4 on nch2-master-1 May 14 22:15:49.046384 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-24fe83dc-cbaa-4f0c-b8da-8bc5a8046438 req-9ad560c1-13b7-496e-b949-b58b6ae1c6e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084189 May 14 22:15:49.047164 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3706/7098] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:15:49.052655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:49.053736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:49.060147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:49.060883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:49.061466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:49.061876 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:49.204913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:49.212541 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-712e55f9-a7b9-4fdd-9288-4912f633c361 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.164372 May 14 22:15:49.213128 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3707/7099] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:49 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:15:50.230322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:50.231017 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:50.238494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:50.238968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:50.239797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:50.240262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:50.377729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:50.385581 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bbf8e016-0a53-44aa-b2fd-f13e9da671d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1393 microversion: 2.1 time: 0.159143 May 14 22:15:50.391514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3708/7100] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:50 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:51.402818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:51.403445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:51.411333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:51.411835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:51.412630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:51.413341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:51.543419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:51.551884 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d2f63a2d-0b0d-4039-ba57-cd1c1795fc1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1566 microversion: 2.1 time: 0.153156 May 14 22:15:51.552465 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3709/7101] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:51 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:51.567822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:51.568451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:51.574115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:51.574574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:51.575359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:51.575845 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:51.709609 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:51.717681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8edce162-944e-4e9f-8470-f9c906147ce4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1566 microversion: 2.1 time: 0.153660 May 14 22:15:51.718272 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3710/7102] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:51 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:53.984006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:15:53.984841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:15:53.992796 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:53.993371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:53.994268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:53.994738 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:54.142219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:15:54.150430 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1d65194b-3d48-4690-9688-027138b63e8d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1566 microversion: 2.1 time: 0.170504 May 14 22:15:54.151113 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3711/7103] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:15:53 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:15:54.155725 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-dac1b95b-6b9e-480f-9999-5cb0f5f25780 req-5b0d6095-5659-4af6-b8d2-836f34572b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09517bba-68d1-4033-b1a4-162101bef4e4", "tag": "a72b233b-c690-496c-aca5-54b3d1718328"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:15:54.164949 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-dac1b95b-6b9e-480f-9999-5cb0f5f25780 req-5b0d6095-5659-4af6-b8d2-836f34572b69 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:15:54.165428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-dac1b95b-6b9e-480f-9999-5cb0f5f25780 req-5b0d6095-5659-4af6-b8d2-836f34572b69 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:15:54.178090 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-dac1b95b-6b9e-480f-9999-5cb0f5f25780 req-5b0d6095-5659-4af6-b8d2-836f34572b69 service nova] Creating event network-changed:a72b233b-c690-496c-aca5-54b3d1718328 for instance 09517bba-68d1-4033-b1a4-162101bef4e4 on nch2-master-1 May 14 22:15:54.183689 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-dac1b95b-6b9e-480f-9999-5cb0f5f25780 req-5b0d6095-5659-4af6-b8d2-836f34572b69 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031187 May 14 22:15:54.184307 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3712/7104] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:16:15.428591 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-10b46f4e-cb48-4117-9ecc-c371e4ff4ca8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:16:15.429651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-10b46f4e-cb48-4117-9ecc-c371e4ff4ca8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:15.436149 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10b46f4e-cb48-4117-9ecc-c371e4ff4ca8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:15.436628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10b46f4e-cb48-4117-9ecc-c371e4ff4ca8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:15.437422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10b46f4e-cb48-4117-9ecc-c371e4ff4ca8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:15.437883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10b46f4e-cb48-4117-9ecc-c371e4ff4ca8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:15.492495 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-10b46f4e-cb48-4117-9ecc-c371e4ff4ca8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4/action" status: 200 len: 24569 microversion: 2.1 time: 0.069570 May 14 22:16:15.493165 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3713/7105] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:16:15 2022] POST /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4/action => generated 24569 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:16:21.908215 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a973dfa7-8c18-4fa9-a925-040c24a94529 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:16:21.909864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a973dfa7-8c18-4fa9-a925-040c24a94529 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:21.917521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a973dfa7-8c18-4fa9-a925-040c24a94529 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:21.917988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a973dfa7-8c18-4fa9-a925-040c24a94529 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:21.918780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a973dfa7-8c18-4fa9-a925-040c24a94529 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:21.919262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a973dfa7-8c18-4fa9-a925-040c24a94529 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:22.115239 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a973dfa7-8c18-4fa9-a925-040c24a94529 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4/action" status: 202 len: 0 microversion: 2.1 time: 0.211178 May 14 22:16:22.115934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3714/7106] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:16:21 2022] POST /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:16:22.124681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:22.125347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:22.133029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:22.133506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:22.134312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:22.134774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:22.275709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:22.283314 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f05bbe12-d3b2-4068-8b15-8ef2fbea41eb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1676 microversion: 2.1 time: 0.162877 May 14 22:16:22.284473 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3715/7107] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:22 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:23.302147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:23.302799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:23.309916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:23.310396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:23.311190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:23.311684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:23.450158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:23.457977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-176bf7c3-52d8-4a7c-9d57-94c54b3fbb5a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.160218 May 14 22:16:23.458493 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3716/7108] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:23 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:24.477202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:24.478251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:24.488941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:24.489668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:24.490885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:24.491643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:24.624313 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:24.632865 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3fdd847c-f2cf-40a7-adcc-317f1f605f06 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.161993 May 14 22:16:24.633449 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3717/7109] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:24 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:25.656095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:25.656761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:25.664366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:25.664841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:25.665685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:25.666184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:25.804981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:25.812705 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-eb38aef3-56f1-4f8e-8908-63f0c8385da8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.160624 May 14 22:16:25.813288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3718/7110] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:25 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:26.830560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:26.831332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:26.838284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:26.843940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:26.843940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:26.843940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:26.970740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:26.978461 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a32b1e49-4b89-4498-bdc2-39d6c8bf3e17 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.151980 May 14 22:16:26.979039 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3719/7111] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:26 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:27.996347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:27.996974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:28.003951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:28.004426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:28.005217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:28.005674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:28.146197 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:28.153664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-45075e2f-a8d1-48a1-933e-fa823ecd8ef8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.161324 May 14 22:16:28.154408 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3720/7112] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:27 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:29.170810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:29.171445 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:29.179093 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:29.179613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:29.180409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:29.180927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:29.311629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:29.319288 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd264142-a6b4-4d31-91f8-a08131322d3c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.152480 May 14 22:16:29.319909 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3721/7113] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:29 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:30.336562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:30.347250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:30.347250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:30.347250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:30.347250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:30.347250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:30.477483 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:30.485112 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f57740c-ac57-49cf-b408-fbce9af81d9d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.152524 May 14 22:16:30.485689 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3722/7114] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:30 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:31.504129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:31.504900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:31.511682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:31.512161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:31.512954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:31.513423 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:31.647945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:31.655384 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5933432d-07e7-4554-937e-39af838825d1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.156454 May 14 22:16:31.655995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3723/7115] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:31 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:32.672988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:32.673664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:32.681616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:32.682119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:32.682931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:32.683395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:32.818665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:32.826234 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d6de7a1e-baa1-4a7c-b5fb-026dfcf62ff2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1681 microversion: 2.1 time: 0.157219 May 14 22:16:32.826823 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3724/7116] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:32 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:33.844314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:16:33.844976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:33.852679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:33.853151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:33.853938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:33.854394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:33.989649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:16:33.997302 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-549dc708-6139-4dc5-8199-0bbfa8861b18 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1684 microversion: 2.1 time: 0.157732 May 14 22:16:33.997896 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3725/7117] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:16:33 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:16:58.183946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4724e195-fbb7-44a6-892a-4fcac709073a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:16:58.184900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4724e195-fbb7-44a6-892a-4fcac709073a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:16:58.191892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4724e195-fbb7-44a6-892a-4fcac709073a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:58.192369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4724e195-fbb7-44a6-892a-4fcac709073a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:58.193154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4724e195-fbb7-44a6-892a-4fcac709073a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:16:58.193612 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4724e195-fbb7-44a6-892a-4fcac709073a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:16:58.248583 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4724e195-fbb7-44a6-892a-4fcac709073a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4/action" status: 200 len: 69140 microversion: 2.1 time: 0.068708 May 14 22:16:58.249262 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3726/7118] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:16:58 2022] POST /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4/action => generated 69140 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:17:05.372548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:05.373347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:05.381283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:05.381834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:05.382724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:05.383261 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:05.411118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:17:05.747007 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2097caf9-8da6-4df2-9a60-9da388a9ee4f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 204 len: 0 microversion: 2.1 time: 0.378930 May 14 22:17:05.747640 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3727/7119] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:17:05 2022] DELETE /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:17:05.753079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-08acddb1-5fd8-499e-90c0-6382ad98b0e9 req-37075411-3dfb-4adc-8957-530f00c07088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09517bba-68d1-4033-b1a4-162101bef4e4", "tag": "a72b233b-c690-496c-aca5-54b3d1718328"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:05.762081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-08acddb1-5fd8-499e-90c0-6382ad98b0e9 req-37075411-3dfb-4adc-8957-530f00c07088 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:05.762550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-08acddb1-5fd8-499e-90c0-6382ad98b0e9 req-37075411-3dfb-4adc-8957-530f00c07088 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:05.773982 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-08acddb1-5fd8-499e-90c0-6382ad98b0e9 req-37075411-3dfb-4adc-8957-530f00c07088 service nova] Creating event network-changed:a72b233b-c690-496c-aca5-54b3d1718328 for instance 09517bba-68d1-4033-b1a4-162101bef4e4 on nch2-master-1 May 14 22:17:05.780777 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-08acddb1-5fd8-499e-90c0-6382ad98b0e9 req-37075411-3dfb-4adc-8957-530f00c07088 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031661 May 14 22:17:05.783940 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3728/7120] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:17:05.787579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:05.788624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:05.795815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:05.796363 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:05.797174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:05.797640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:05.940123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:05.947766 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28f8cbc5-e5e3-4749-b769-2ce114e0fccc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1690 microversion: 2.1 time: 0.165141 May 14 22:17:05.948540 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3729/7121] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:05 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:17:06.965580 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:06.966241 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:06.973544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:06.974024 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:06.974836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:06.975303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:07.111610 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:07.119884 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-24fe9753-7ec4-40e8-8bda-ef8ddec05dc8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1690 microversion: 2.1 time: 0.158164 May 14 22:17:07.120471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3730/7122] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:06 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:07.800767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-065b23ff-442b-4aec-b3eb-5718c2ad09de req-3bd611e6-9d91-428c-86b5-ad297e440114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09517bba-68d1-4033-b1a4-162101bef4e4", "name": "network-vif-deleted", "tag": "a72b233b-c690-496c-aca5-54b3d1718328"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:07.813051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-065b23ff-442b-4aec-b3eb-5718c2ad09de req-3bd611e6-9d91-428c-86b5-ad297e440114 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:07.813771 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-065b23ff-442b-4aec-b3eb-5718c2ad09de req-3bd611e6-9d91-428c-86b5-ad297e440114 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:07.837160 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-065b23ff-442b-4aec-b3eb-5718c2ad09de req-3bd611e6-9d91-428c-86b5-ad297e440114 service nova] Creating event network-vif-deleted:a72b233b-c690-496c-aca5-54b3d1718328 for instance 09517bba-68d1-4033-b1a4-162101bef4e4 on nch2-master-1 May 14 22:17:07.844094 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-065b23ff-442b-4aec-b3eb-5718c2ad09de req-3bd611e6-9d91-428c-86b5-ad297e440114 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049802 May 14 22:17:07.845097 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3731/7123] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:17:08.138624 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:08.142292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:08.147032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:08.147521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:08.148344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:08.148815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:08.192419 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:08.192906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:08.193386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lazy-loading 'fault' on Instance uuid 09517bba-68d1-4033-b1a4-162101bef4e4 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:17:08.239081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:08.249835 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01a3456d-7d6c-4f70-b7e0-f0e97df5bacc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 200 len: 1357 microversion: 2.1 time: 0.115640 May 14 22:17:08.250465 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3732/7124] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:08 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:09.267310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:09.267988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 09517bba-68d1-4033-b1a4-162101bef4e4] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:09.275393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:09.275897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:09.276686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:09.277144 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:09.291743 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] HTTP exception thrown: Instance 09517bba-68d1-4033-b1a4-162101bef4e4 could not be found. May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Request method failure captured: May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 HTTP/1.1 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCm9wmrAJo2FVTZakd8NIqYe74xFo0hUsYKXW6GEV5josiKi1ryz41OMBIEI69b5uaEMAHzEBpcB5dxYN-Lt5_6bKpJP03JXjWsiyXpr2kYCmOgJFOdLihuCipdRF2oN9z7qEyz0xrtTjasJ7lxc6JQ9QSbjhs716KvpraON8MChYKc May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b433c6a39b149acb9537d5d8d32a845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2866128bc30b4a5fbbb05702047de69e May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 09517bba-68d1-4033-b1a4-162101bef4e4 could not be found. May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '09517bba-68d1-4033-b1a4-162101bef4e4'} May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09517bba-68d1-4033-b1a4-162101bef4e4 could not be found. May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09517bba-68d1-4033-b1a4-162101bef4e4 could not be found. May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:17:09.293413 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09517bba-68d1-4033-b1a4-162101bef4e4 could not be found. May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Returning 404 to user: Instance 09517bba-68d1-4033-b1a4-162101bef4e4 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d77ee398-8c5c-41f4-b13b-1789f7412b0a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4" status: 404 len: 111 microversion: 2.1 time: 0.031632 May 14 22:17:09.297298 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3733/7125] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:09 2022] GET /compute/v2.1/servers/09517bba-68d1-4033-b1a4-162101bef4e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:17:13.083044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-37ea7bb0-29e9-49f5-9cec-c19a070f2570 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '.version_select at 0x7fb1a7dcae50>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:13.151247 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-37ea7bb0-29e9-49f5-9cec-c19a070f2570 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1993809632" status: 202 len: 0 microversion: 2.1 time: 0.072150 May 14 22:17:13.152068 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3734/7126] 10.222.0.52 () {58 vars in 1283 bytes} [Sat May 14 22:17:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1993809632 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:17:13.181307 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ce3e679-ebf8-4f82-b7bf-595d65dff747 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: .version_select at 0x7fb1a6bc0af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1474515720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMSMP85nyM4cKPU5Ki2ek4C3F4nhlrAGS35uTvlWzGuca0oQs0xiQ8BhHuxbb0D+2g76lQoHsw7w+K2VQoWpAhvnzcJRpIIFP26L82ItO/JMPVSNfMpY11tj/kcLy7VtdA=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:13.197103 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7ce3e679-ebf8-4f82-b7bf-595d65dff747 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:17:13.202377 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-7ce3e679-ebf8-4f82-b7bf-595d65dff747 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:17:13.284779 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ce3e679-ebf8-4f82-b7bf-595d65dff747 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.107506 May 14 22:17:13.285395 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3735/7127] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:17:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:17:21.583866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1826067926", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "a8b25ff5-b228-4838-9fcd-9c667214a6bf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1474515720", "security_groups": [{"name": "tempest-secgroup-smoke-2004548496"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:21.698734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] validate_networks() for [('a8b25ff5-b228-4838-9fcd-9c667214a6bf', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:17:22.188639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:17:22.189097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:17:22.189626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:17:22.190059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:17:22.190500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:17:22.199632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:22.200113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:22.200972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:22.201637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:22.218855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:17:22.224991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:17:22.238361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:17:22.240752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:17:22.360974 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ced66557-b570-4f11-9231-898fecc2a7bf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.782771 May 14 22:17:22.361932 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3736/7128] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:17:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:17:22.372391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-382a9500-6be7-45f4-bdb0-9b35d6317410 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:22.372960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-382a9500-6be7-45f4-bdb0-9b35d6317410 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:22.448962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-382a9500-6be7-45f4-bdb0-9b35d6317410 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:22.454270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-382a9500-6be7-45f4-bdb0-9b35d6317410 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1267 microversion: 2.1 time: 0.085995 May 14 22:17:22.464574 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3737/7129] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:22 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:17:23.472699 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:23.473357 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:23.480792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:23.481350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:23.482236 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:23.482762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:23.559251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:23.568231 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac2b101f-83e8-4398-8403-042baaf17315 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1271 microversion: 2.1 time: 0.100053 May 14 22:17:23.568826 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3738/7130] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:23 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:24.585783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:24.586457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:24.595724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:24.596337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:24.597350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:24.597864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:24.691970 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:24.702711 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93eb9553-0722-4732-b27f-89fbf629bd97 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1327 microversion: 2.1 time: 0.121047 May 14 22:17:24.710491 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3739/7131] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:24 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:17:25.720353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:25.721755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:25.729025 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:25.729508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:25.730321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:25.730792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:25.960931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:25.968467 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dcd7522a-1b26-49eb-b2e1-263776a30ff7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.252166 May 14 22:17:25.969061 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3740/7132] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:25 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:26.630764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-25d7b389-a0b1-46da-aec0-d9121aff64da req-5e59c53a-7175-482d-a450-c7225b929fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:26.640286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-25d7b389-a0b1-46da-aec0-d9121aff64da req-5e59c53a-7175-482d-a450-c7225b929fa1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:26.640763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-25d7b389-a0b1-46da-aec0-d9121aff64da req-5e59c53a-7175-482d-a450-c7225b929fa1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:26.660691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-25d7b389-a0b1-46da-aec0-d9121aff64da req-5e59c53a-7175-482d-a450-c7225b929fa1 service nova] Creating event network-changed:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch2-master-1 May 14 22:17:26.666095 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-25d7b389-a0b1-46da-aec0-d9121aff64da req-5e59c53a-7175-482d-a450-c7225b929fa1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041311 May 14 22:17:26.670819 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3741/7133] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:17:26.987358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:26.988147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:26.994586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:26.995189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:26.996030 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:26.996492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:27.224006 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:27.231715 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8de3d8d6-4424-41d2-b6b7-abba2ca724a7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.249671 May 14 22:17:27.232307 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3742/7134] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:26 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:28.248860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:28.249527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:28.257075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:28.257576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:28.258359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:28.258816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:28.393418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:28.401296 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf917a03-8a5d-4241-8fc1-2da09eb15ba5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.156443 May 14 22:17:28.401875 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3743/7135] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:28 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:29.419804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:29.420432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:29.428178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:29.428649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:29.429439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:29.429896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:29.559071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:29.566631 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aeb49771-0a03-4253-934f-b3c60ce1d6de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.151042 May 14 22:17:29.567212 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3744/7136] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:29 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:30.583768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:30.584447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:30.591374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:30.591893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:30.592697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:30.593169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:30.729180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:30.737265 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f1f3d9f-7f4b-4628-91e1-af876b75aeac tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.157612 May 14 22:17:30.737847 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3745/7137] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:30 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:31.755119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:31.755770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:31.762616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:31.763089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:31.763909 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:31.764370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:31.896887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:31.904646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8a0e90b-eb6c-4efa-9998-41ead7a8eba8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.154521 May 14 22:17:31.905224 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3746/7138] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:31 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:32.922599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:32.923336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:32.931194 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:32.931705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:32.932502 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:32.932961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:33.063829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:33.071213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f2814066-de99-4d6f-8a78-ac67f4d57777 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.152667 May 14 22:17:33.071829 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3747/7139] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:32 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:33.467238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-baa007b2-11a9-4cea-847a-dfc3ab060689 req-748bfa1e-1f8a-4ce0-a2f0-0c1cca597699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "name": "network-vif-plugged", "status": "completed", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:33.476201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-baa007b2-11a9-4cea-847a-dfc3ab060689 req-748bfa1e-1f8a-4ce0-a2f0-0c1cca597699 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:33.476614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-baa007b2-11a9-4cea-847a-dfc3ab060689 req-748bfa1e-1f8a-4ce0-a2f0-0c1cca597699 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:33.488094 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-baa007b2-11a9-4cea-847a-dfc3ab060689 req-748bfa1e-1f8a-4ce0-a2f0-0c1cca597699 service nova] Creating event network-vif-plugged:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch2-master-1 May 14 22:17:33.493145 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-baa007b2-11a9-4cea-847a-dfc3ab060689 req-748bfa1e-1f8a-4ce0-a2f0-0c1cca597699 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029943 May 14 22:17:33.495970 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3748/7140] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:17:34.089613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:34.090341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:34.096843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:34.103026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:34.103026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:34.103026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:34.229086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:34.237261 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-202862e7-17a5-4779-826d-3cd5553a9e1d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1393 microversion: 2.1 time: 0.152781 May 14 22:17:34.237842 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3749/7141] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:34 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1393 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:35.254083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:35.254712 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:35.261504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:35.261983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:35.262773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:35.263472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:35.398077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:35.405532 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-631490ad-26fa-4869-b7eb-c3d5974618ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1565 microversion: 2.1 time: 0.155694 May 14 22:17:35.406109 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3750/7142] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:35 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:35.421340 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:35.421995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:35.428212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:35.428684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:35.429464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:35.429926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:35.561314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:35.569940 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-15c805e0-cc50-4b55-846e-160519898f21 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1565 microversion: 2.1 time: 0.152089 May 14 22:17:35.570537 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3751/7143] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:35 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:17:37.491870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:17:37.494988 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:37.499434 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:37.499940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:37.500809 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:37.501224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:37.633343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:17:37.641021 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-545b4d5d-1df8-4d6d-b138-49ecb4078a80 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1565 microversion: 2.1 time: 0.153680 May 14 22:17:37.641618 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3752/7144] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:17:37 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:17:37.649344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-42799e61-f0ca-467c-8129-03c36790b152 req-583ff1cf-8ced-4470-804f-e1c1abaa1cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:37.664028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-42799e61-f0ca-467c-8129-03c36790b152 req-583ff1cf-8ced-4470-804f-e1c1abaa1cb3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:37.664953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-42799e61-f0ca-467c-8129-03c36790b152 req-583ff1cf-8ced-4470-804f-e1c1abaa1cb3 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:37.676544 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-42799e61-f0ca-467c-8129-03c36790b152 req-583ff1cf-8ced-4470-804f-e1c1abaa1cb3 service nova] Creating event network-changed:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch2-master-1 May 14 22:17:37.681720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-42799e61-f0ca-467c-8129-03c36790b152 req-583ff1cf-8ced-4470-804f-e1c1abaa1cb3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038071 May 14 22:17:37.682648 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3753/7145] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:17:58.875743 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2a6beeec-9284-4a72-941b-e4f64efd0b22 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:17:58.876776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2a6beeec-9284-4a72-941b-e4f64efd0b22 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:17:58.884170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a6beeec-9284-4a72-941b-e4f64efd0b22 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:58.884640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a6beeec-9284-4a72-941b-e4f64efd0b22 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:58.885424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a6beeec-9284-4a72-941b-e4f64efd0b22 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:17:58.885882 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2a6beeec-9284-4a72-941b-e4f64efd0b22 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:17:58.934938 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2a6beeec-9284-4a72-941b-e4f64efd0b22 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action" status: 200 len: 24571 microversion: 2.1 time: 0.063457 May 14 22:17:58.935662 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3754/7146] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:17:58 2022] POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:18:05.327642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:18:05.328673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:05.336630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:05.337102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:05.337887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:05.338343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:05.381911 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:05.388130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Old instance type m1.heat2, new instance type m1.heat {{(pid=130637) resize /opt/stack/nova/nova/compute/api.py:4166}} May 14 22:18:05.394834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:18:05.395273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:18:05.395803 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:18:05.396228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:18:05.396664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:18:05.584082 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bbd4388-e72b-4184-a916-8fa3f2d27816 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action" status: 202 len: 0 microversion: 2.1 time: 0.260792 May 14 22:18:05.584705 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3755/7147] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:18:05 2022] POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:18:05.592611 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:05.593246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:05.599892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:05.600371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:05.601168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:05.601626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:05.738344 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:05.746273 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5c10dbb2-2293-4d33-b802-fd7d078a7380 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1693 microversion: 2.1 time: 0.157416 May 14 22:18:05.751452 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3756/7148] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:05 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:06.763397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:06.764106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:06.771673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:06.772142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:06.772933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:06.773395 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:06.905213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:06.913352 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-637917ed-d1d2-4aed-92c5-93d5180eecab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1693 microversion: 2.1 time: 0.153905 May 14 22:18:06.914194 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3757/7149] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:06 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:07.930889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:07.931554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:07.938475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:07.938953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:07.939775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:07.940240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:08.069939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:08.077440 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-59835b67-7e5e-4c91-8e22-a33ccf874a78 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1693 microversion: 2.1 time: 0.151149 May 14 22:18:08.078025 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3758/7150] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:07 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:18:09.094682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:09.095337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:09.102345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:09.105221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:09.105221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:09.105221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:09.237700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:09.245543 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6291d674-7d99-49c3-94b0-d068b4458f35 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1693 microversion: 2.1 time: 0.154840 May 14 22:18:09.246120 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3759/7151] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:09 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:10.262129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:10.262780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:10.269645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:10.270126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:10.270931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:10.271399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:10.405343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:10.414363 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cb651560-eede-4357-93d3-87c9dbf234ff tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1693 microversion: 2.1 time: 0.155960 May 14 22:18:10.414946 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3760/7152] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:10 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1693 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:11.431558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:11.432231 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:11.440302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:11.440783 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:11.441631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:11.442601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:11.578774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:11.587358 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4ef867f1-a6cb-42f7-9435-d43a4abc5b48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1693 microversion: 2.1 time: 0.159935 May 14 22:18:11.587967 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3761/7153] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:11 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:12.605519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:12.606267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:12.613555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:12.614036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:12.615781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:12.616268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:12.754283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:12.762006 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0e09ddc8-1e67-4669-9e84-dbd4a9e64da4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1693 microversion: 2.1 time: 0.160652 May 14 22:18:12.762585 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3762/7154] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:12 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:13.778879 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:13.779598 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:13.786819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:13.787274 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:13.788086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:13.788549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:13.920599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:13.929117 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-171a6d1f-ba18-4b2a-8caf-1bdf70476758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.153685 May 14 22:18:13.929997 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3763/7155] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:13 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:14.947055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:14.947772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:14.954887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:14.955440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:14.956409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:14.957280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:15.105227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:15.110768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ee2d843d-7e36-4d75-8d94-5b786bf490fe tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.168387 May 14 22:18:15.111349 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3764/7156] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:14 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:18:16.128615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:16.129238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:16.136254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:16.138739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:16.138739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:16.138739 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:16.269462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:16.277821 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-055af455-cfdb-4144-9a13-24bc4168bf36 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.153243 May 14 22:18:16.278404 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3765/7157] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:16 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:17.294855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:17.295509 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:17.302314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:17.302781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:17.304616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:17.305078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:17.443055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:17.451143 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bf774056-89c0-421c-a7e2-428c7f2bd19c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.160334 May 14 22:18:17.451782 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3766/7158] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:17 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:18.468900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:18.469570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:18.477525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:18.478378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:18.479642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:18.480549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:18.614462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:18.622155 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-48e3504a-4b7d-4c3d-b21d-dabb9a832e55 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.157233 May 14 22:18:18.622735 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3767/7159] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:18 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:19.639077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:19.639754 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:19.646599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:19.647137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:19.647958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:19.648418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:19.781599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:19.789593 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7bfbf195-9902-446b-8213-46bc6f17b98c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.154523 May 14 22:18:19.790195 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3768/7160] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:19 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:20.808309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:20.808978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:20.816161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:20.816634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:20.817421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:20.817878 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:20.962292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:20.969855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9613e0f4-6423-4480-8998-8fb96a210c28 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.165576 May 14 22:18:20.970442 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3769/7161] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:20 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:21.987160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:21.987782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:21.994825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:21.995302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:21.996126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:21.996596 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:22.129109 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:22.137343 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e9d678d0-f812-4656-a543-0049212eecca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.154165 May 14 22:18:22.137927 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3770/7162] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:21 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:23.154775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:23.155511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:23.162620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:23.163127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:23.165651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:23.166122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:23.301616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:23.309755 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f55c1457-8338-4e90-b5fd-bc0364bac0d8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.159061 May 14 22:18:23.310332 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3771/7163] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:23 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:24.327083 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:24.327786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:24.334544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:24.335018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:24.336056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:24.336514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:24.468742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:24.477478 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa88a247-afda-4f42-bcf9-79a327204a8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.154242 May 14 22:18:24.478076 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3772/7164] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:24 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:25.494280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:25.494940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:25.501778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:25.502248 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:25.503033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:25.503506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:25.636535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:25.644442 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-07949a17-c5d6-4d63-b4e5-4956f04d9ffb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.154141 May 14 22:18:25.645020 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3773/7165] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:25 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:26.661898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:26.662549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:26.670243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:26.670757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:26.671567 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:26.672027 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:26.807159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:26.814666 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f4dba5f8-bed2-4600-8caa-84298e97c7b2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.156756 May 14 22:18:26.815237 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3774/7166] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:26 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:27.833068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:27.833763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:27.841369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:27.841848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:27.842648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:27.843113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:27.974206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:27.982505 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-79f3efb4-eba4-40e3-9a07-ff9b17d5e965 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.153755 May 14 22:18:27.983124 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3775/7167] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:27 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:28.999891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:29.000560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:29.007374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:29.007877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:29.009191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:29.009651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:29.150198 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:29.157713 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9ed28bf1-076a-4b7d-a807-02272c28914e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1698 microversion: 2.1 time: 0.161848 May 14 22:18:29.158297 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3776/7168] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:28 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:30.176045 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:30.176702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:30.184401 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:30.184886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:30.185694 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:30.186227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:30.356382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:30.364295 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e37de495-d899-418d-a9f0-b87b0ddc47f0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1697 microversion: 2.1 time: 0.192231 May 14 22:18:30.365045 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3777/7169] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:30 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1697 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:30.369648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ad19b1e1-17fc-47ed-b6d0-8a4af4431c5e req-3b4bb071-455c-4b18-b822-32da06529577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "name": "network-vif-unplugged", "status": "completed", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:18:30.383265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ad19b1e1-17fc-47ed-b6d0-8a4af4431c5e req-3b4bb071-455c-4b18-b822-32da06529577 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:30.383690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ad19b1e1-17fc-47ed-b6d0-8a4af4431c5e req-3b4bb071-455c-4b18-b822-32da06529577 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:30.396704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ad19b1e1-17fc-47ed-b6d0-8a4af4431c5e req-3b4bb071-455c-4b18-b822-32da06529577 service nova] Creating event network-vif-unplugged:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch1-master-1 May 14 22:18:30.403084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-ad19b1e1-17fc-47ed-b6d0-8a4af4431c5e req-3b4bb071-455c-4b18-b822-32da06529577 service nova] Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:18:30.418857 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ad19b1e1-17fc-47ed-b6d0-8a4af4431c5e req-3b4bb071-455c-4b18-b822-32da06529577 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052512 May 14 22:18:30.419777 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3778/7170] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:18:31.383384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:31.384206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:31.390660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:31.391142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:31.392084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:31.392553 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:31.531991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:31.540557 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ddc4ccd7-a65b-4843-803b-d9a7a51b0757 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1697 microversion: 2.1 time: 0.162390 May 14 22:18:31.541147 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3779/7171] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:31 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:32.438190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-90efbe30-820f-468a-9845-d20950e5a719 req-570fce5e-9ae9-44a9-9eaa-cc689766eae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:18:32.447662 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90efbe30-820f-468a-9845-d20950e5a719 req-570fce5e-9ae9-44a9-9eaa-cc689766eae2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:32.448133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-90efbe30-820f-468a-9845-d20950e5a719 req-570fce5e-9ae9-44a9-9eaa-cc689766eae2 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:32.459664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-90efbe30-820f-468a-9845-d20950e5a719 req-570fce5e-9ae9-44a9-9eaa-cc689766eae2 service nova] Creating event network-changed:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch1-master-1 May 14 22:18:32.465277 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [req-90efbe30-820f-468a-9845-d20950e5a719 req-570fce5e-9ae9-44a9-9eaa-cc689766eae2 service nova] Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1', 'nch1-master-1'} {{(pid=130637) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 14 22:18:32.475843 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-90efbe30-820f-468a-9845-d20950e5a719 req-570fce5e-9ae9-44a9-9eaa-cc689766eae2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041419 May 14 22:18:32.476433 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3780/7172] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:18:32.563108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:32.563874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:32.570107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:32.570593 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:32.572082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:32.572559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:32.809414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:32.817106 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8c33ae28-1043-4d63-ad82-f0cd488c3eaf tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1695 microversion: 2.1 time: 0.258442 May 14 22:18:32.817697 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3781/7173] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:32 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1695 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:33.834700 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:33.835348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:33.842059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:33.842530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:33.843320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:33.843821 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:33.985367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:33.993831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-476479ff-4873-44fc-81c9-4df4eb723271 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1692 microversion: 2.1 time: 0.163210 May 14 22:18:33.994437 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3782/7174] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:33 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:34.011338 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2874d99-d8ca-4d5e-8acd-c971b24e5782 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:18:34.011925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2874d99-d8ca-4d5e-8acd-c971b24e5782 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:34.018035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2874d99-d8ca-4d5e-8acd-c971b24e5782 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:34.018506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2874d99-d8ca-4d5e-8acd-c971b24e5782 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:34.019295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2874d99-d8ca-4d5e-8acd-c971b24e5782 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:34.019846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2874d99-d8ca-4d5e-8acd-c971b24e5782 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:34.251074 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2874d99-d8ca-4d5e-8acd-c971b24e5782 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action" status: 204 len: 0 microversion: 2.1 time: 0.244370 May 14 22:18:34.251893 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3783/7175] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:18:34 2022] POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:18:34.261430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:34.262176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:34.268601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:34.269076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:34.269864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:34.270320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:34.450561 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:34.458342 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4e91b609-cacf-4f17-9b14-4bc9f9b513e8 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1692 microversion: 2.1 time: 0.201955 May 14 22:18:34.458931 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3784/7176] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:34 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:34.474965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:34.475778 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:34.481715 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:34.482185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:34.482977 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:34.483436 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:34.701190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:34.708950 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7c3d8ca5-777c-46fb-83d2-ef711632c3fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1692 microversion: 2.1 time: 0.237748 May 14 22:18:34.709539 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3785/7177] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:34 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1692 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:35.726742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:35.727394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:35.735075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:35.735588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:35.736396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:35.736857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:35.891788 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:35.899370 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8a268a6-ee99-4e56-a69c-34e192b5b522 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1692 microversion: 2.1 time: 0.177507 May 14 22:18:35.900073 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3786/7178] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:35 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:36.918562 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:18:36.919226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:36.926214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:36.926693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:36.927518 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:36.927990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:37.060736 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:18:37.068450 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6eee92ff-4996-4acc-8cdb-990a2e5d8917 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1684 microversion: 2.1 time: 0.154801 May 14 22:18:37.069037 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3787/7179] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:18:36 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:18:37.940140 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f0cbc8cc-7c03-44e4-b20e-43c47ee5df7e req-dac66719-41fc-4001-bd9a-b32d080dff7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "name": "network-vif-plugged", "status": "completed", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:18:37.949734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f0cbc8cc-7c03-44e4-b20e-43c47ee5df7e req-dac66719-41fc-4001-bd9a-b32d080dff7c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:37.950209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f0cbc8cc-7c03-44e4-b20e-43c47ee5df7e req-dac66719-41fc-4001-bd9a-b32d080dff7c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:37.961485 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f0cbc8cc-7c03-44e4-b20e-43c47ee5df7e req-dac66719-41fc-4001-bd9a-b32d080dff7c service nova] Creating event network-vif-plugged:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch1-master-1 May 14 22:18:37.966941 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f0cbc8cc-7c03-44e4-b20e-43c47ee5df7e req-dac66719-41fc-4001-bd9a-b32d080dff7c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031144 May 14 22:18:37.967579 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3788/7180] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:18:57.282325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-970cd404-ebce-46f4-ae26-ec40ff44f80c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:18:57.283284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-970cd404-ebce-46f4-ae26-ec40ff44f80c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:18:57.289902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-970cd404-ebce-46f4-ae26-ec40ff44f80c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:57.290382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-970cd404-ebce-46f4-ae26-ec40ff44f80c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:57.292670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-970cd404-ebce-46f4-ae26-ec40ff44f80c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:18:57.293178 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-970cd404-ebce-46f4-ae26-ec40ff44f80c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:18:57.345386 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-970cd404-ebce-46f4-ae26-ec40ff44f80c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action" status: 200 len: 24578 microversion: 2.1 time: 0.068343 May 14 22:18:57.346061 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3789/7181] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:18:57 2022] POST /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1/action => generated 24578 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:19:04.700720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:04.701328 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:04.708828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:04.709300 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:04.710091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:04.710547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:04.737264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:19:05.029356 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f8cfdbd-53fb-4fb0-9bea-06e9f294bc00 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 204 len: 0 microversion: 2.1 time: 0.332991 May 14 22:19:05.029970 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3790/7182] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:19:04 2022] DELETE /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:19:05.102541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6df831e1-2430-42a6-869c-998d5e6303cf req-2d274faf-d68c-4ac4-b02f-7df2fff21705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:05.112259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6df831e1-2430-42a6-869c-998d5e6303cf req-2d274faf-d68c-4ac4-b02f-7df2fff21705 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:05.112731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6df831e1-2430-42a6-869c-998d5e6303cf req-2d274faf-d68c-4ac4-b02f-7df2fff21705 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:05.123765 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6df831e1-2430-42a6-869c-998d5e6303cf req-2d274faf-d68c-4ac4-b02f-7df2fff21705 service nova] Creating event network-changed:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch1-master-1 May 14 22:19:05.128930 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6df831e1-2430-42a6-869c-998d5e6303cf req-2d274faf-d68c-4ac4-b02f-7df2fff21705 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097556 May 14 22:19:05.129540 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3791/7183] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:19:05.134903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:05.135659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:05.141877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:05.145678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:05.145678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:05.145678 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:05.280696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:05.288350 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f2c2da35-56dd-4567-bedc-75d89af596b1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1690 microversion: 2.1 time: 0.157602 May 14 22:19:05.288933 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3792/7184] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:05 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:19:06.307835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:06.308477 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:06.315437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:06.315989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:06.316823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:06.317287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:06.517952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:06.526347 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d37400b-d276-4c04-bd07-6d328d752a11 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 200 len: 1690 microversion: 2.1 time: 0.223505 May 14 22:19:06.527152 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3793/7185] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:06 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 1690 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:07.143709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2fbd0ca3-e28d-4143-940b-4401f490de77 req-03dfae3f-ecf0-4c3e-a2b4-43a570626a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1", "name": "network-vif-deleted", "tag": "89a2bee6-3e00-45ae-8ae1-e3095fa54136"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:07.152032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2fbd0ca3-e28d-4143-940b-4401f490de77 req-03dfae3f-ecf0-4c3e-a2b4-43a570626a90 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:07.152501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2fbd0ca3-e28d-4143-940b-4401f490de77 req-03dfae3f-ecf0-4c3e-a2b4-43a570626a90 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:07.163608 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2fbd0ca3-e28d-4143-940b-4401f490de77 req-03dfae3f-ecf0-4c3e-a2b4-43a570626a90 service nova] Creating event network-vif-deleted:89a2bee6-3e00-45ae-8ae1-e3095fa54136 for instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 on nch1-master-1 May 14 22:19:07.168840 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2fbd0ca3-e28d-4143-940b-4401f490de77 req-03dfae3f-ecf0-4c3e-a2b4-43a570626a90 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029108 May 14 22:19:07.169429 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3794/7186] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:19:07.545749 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:07.546386 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:07.553482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:07.553954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:07.554747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:07.555211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:07.570223 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] HTTP exception thrown: Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 could not be found. May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Request method failure captured: May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 HTTP/1.1 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCm9wmrAJo2FVTZakd8NIqYe74xFo0hUsYKXW6GEV5josiKi1ryz41OMBIEI69b5uaEMAHzEBpcB5dxYN-Lt5_6bKpJP03JXjWsiyXpr2kYCmOgJFOdLihuCipdRF2oN9z7qEyz0xrtTjasJ7lxc6JQ9QSbjhs716KvpraON8MChYKc May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b433c6a39b149acb9537d5d8d32a845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2866128bc30b4a5fbbb05702047de69e May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 could not be found. May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'd75228a5-ab6a-4d16-97c4-e2f3e68d5ef1'} May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 could not be found. May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 could not be found. May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:19:07.572089 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 could not be found. May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Returning 404 to user: Instance d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f656cd78-1e1f-41ee-98d5-2ee5b379022f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1" status: 404 len: 111 microversion: 2.1 time: 0.033622 May 14 22:19:07.576472 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3795/7187] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:07 2022] GET /compute/v2.1/servers/d75228a5-ab6a-4d16-97c4-e2f3e68d5ef1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:19:11.684364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3934cae5-04ec-441f-a362-3389be1dc14b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '.version_select at 0x7fb1a6ecd9d0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:11.761092 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3934cae5-04ec-441f-a362-3389be1dc14b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1474515720" status: 202 len: 0 microversion: 2.1 time: 0.080744 May 14 22:19:11.761687 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3796/7188] 10.222.0.52 () {58 vars in 1283 bytes} [Sat May 14 22:19:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1474515720 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:19:11.791667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-21d53713-56d7-4049-87b6-16602af03c1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: .version_select at 0x7fb1a75f5550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-271366973", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHA2oYXgmRQuu8FUmrjO+s2pyCJaVQ5sXj1FzNHAeJDVx6qYwltsD6UhMUtpato39KCrcp0ID4itAmA5r4+f6DyaYt8gZVj+gj9vh85/tvp9EUaHf3u9CUv+JPJU+uRhzA=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:11.806698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-21d53713-56d7-4049-87b6-16602af03c1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:19:11.811924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-21d53713-56d7-4049-87b6-16602af03c1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:19:11.945872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-21d53713-56d7-4049-87b6-16602af03c1a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.159033 May 14 22:19:11.946481 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3797/7189] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:19:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:19:20.016887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1461814970", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "c32ab575-95f9-4d0e-a1bf-93570ac35680"}], "key_name": "tempest-TestNetworkAdvancedServerOps-271366973", "security_groups": [{"name": "tempest-secgroup-smoke-277923274"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:20.175599 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] validate_networks() for [('c32ab575-95f9-4d0e-a1bf-93570ac35680', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:19:20.648276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:19:20.648840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:19:20.649441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:19:20.649946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:19:20.650458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:19:20.662552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:20.663383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:20.664750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:20.665474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:20.688062 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:19:20.694212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:19:20.713073 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:19:20.716674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:19:20.849099 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe1c4b57-a512-40e0-95ec-c9953cb5c4a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.838625 May 14 22:19:20.850175 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3798/7190] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:19:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:19:20.861851 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0211d2a2-da45-4546-a0ac-e9369393d2ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:20.862491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0211d2a2-da45-4546-a0ac-e9369393d2ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:20.943837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0211d2a2-da45-4546-a0ac-e9369393d2ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:20.952780 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0211d2a2-da45-4546-a0ac-e9369393d2ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1266 microversion: 2.1 time: 0.094952 May 14 22:19:20.953448 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3799/7191] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:20 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:19:21.975314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:21.975314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:21.980441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:21.980923 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:21.982163 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:21.982631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:22.076990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:22.085327 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72487999-02d1-48e5-8dd3-7b260c2732ab tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1270 microversion: 2.1 time: 0.118625 May 14 22:19:22.087454 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3800/7192] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:21 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:23.105761 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:23.107143 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:23.114775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:23.117442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:23.117442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:23.117442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:23.184642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:23.193225 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b13da746-e072-4f1d-9bd1-c9190cc0a117 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1324 microversion: 2.1 time: 0.093048 May 14 22:19:23.193845 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3801/7193] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:23 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1324 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:24.210541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:24.211256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:24.218345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:24.218826 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:24.219654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:24.220120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:24.362985 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:24.372368 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8675463a-3ba9-49b3-b57c-b69cce1de758 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.165660 May 14 22:19:24.373116 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3802/7194] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:24 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:24.631963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b4d59478-b4ce-4eb2-a4b1-242c6d69bf0f req-c7502bc1-354e-4a9a-a608-920137dd5f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1", "tag": "ce4cc68a-9bd7-418b-996a-1c9b9263d972"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:24.646131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4d59478-b4ce-4eb2-a4b1-242c6d69bf0f req-c7502bc1-354e-4a9a-a608-920137dd5f5f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:24.646958 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b4d59478-b4ce-4eb2-a4b1-242c6d69bf0f req-c7502bc1-354e-4a9a-a608-920137dd5f5f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:24.662729 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b4d59478-b4ce-4eb2-a4b1-242c6d69bf0f req-c7502bc1-354e-4a9a-a608-920137dd5f5f service nova] Creating event network-changed:ce4cc68a-9bd7-418b-996a-1c9b9263d972 for instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 on nch1-master-1 May 14 22:19:24.668348 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b4d59478-b4ce-4eb2-a4b1-242c6d69bf0f req-c7502bc1-354e-4a9a-a608-920137dd5f5f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041596 May 14 22:19:24.668973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3803/7195] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:19:25.392462 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:25.393371 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:25.399965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:25.400451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:25.401319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:25.401902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:25.544906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:25.553018 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d205da32-4c59-4622-bb75-b9b5183bbd48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.166038 May 14 22:19:25.553619 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3804/7196] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:25 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:26.570326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:26.570987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:26.578887 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:26.579372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:26.580227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:26.580698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:26.712890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:26.720834 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8c4966c-b6e7-4097-bafa-e0cee404ee42 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.154498 May 14 22:19:26.721417 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3805/7197] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:26 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:19:27.737891 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:27.738558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:27.745703 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:27.746189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:27.746993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:27.747558 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:27.882945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:27.894815 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-64cd99ed-0a6f-47f7-bf78-7d729a22050f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.160624 May 14 22:19:27.895797 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3806/7198] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:27 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:28.912353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:28.913078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:28.920926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:28.921427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:28.922221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:28.922680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:29.051417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:29.059566 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a8830d50-2ecb-4459-bb72-19547e70847b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.151162 May 14 22:19:29.060145 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3807/7199] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:28 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:30.076981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:30.077651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:30.084644 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:30.085282 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:30.086096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:30.086563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:30.223368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:30.232734 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-35909852-8daf-47f0-97c7-5de00df7d95d tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.159972 May 14 22:19:30.233794 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3808/7200] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:30 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:31.250926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:31.251548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:31.258534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:31.259005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:31.260501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:31.261373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:31.396189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:31.404258 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e84a2f2c-0464-433a-90b0-1bc8b78e7770 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.157496 May 14 22:19:31.404860 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3809/7201] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:31 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:32.195566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-078a582f-d813-41e8-96d8-b92c0b90c7ce req-ce0c67f9-5fcc-4cba-83fa-57d119850931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1", "name": "network-vif-plugged", "status": "completed", "tag": "ce4cc68a-9bd7-418b-996a-1c9b9263d972"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:32.203623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-078a582f-d813-41e8-96d8-b92c0b90c7ce req-ce0c67f9-5fcc-4cba-83fa-57d119850931 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:32.204089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-078a582f-d813-41e8-96d8-b92c0b90c7ce req-ce0c67f9-5fcc-4cba-83fa-57d119850931 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:32.215892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-078a582f-d813-41e8-96d8-b92c0b90c7ce req-ce0c67f9-5fcc-4cba-83fa-57d119850931 service nova] Creating event network-vif-plugged:ce4cc68a-9bd7-418b-996a-1c9b9263d972 for instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 on nch1-master-1 May 14 22:19:32.220966 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-078a582f-d813-41e8-96d8-b92c0b90c7ce req-ce0c67f9-5fcc-4cba-83fa-57d119850931 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029272 May 14 22:19:32.221624 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3810/7202] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:19:32.423321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:32.424077 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:32.430422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:32.430903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:32.432335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:32.432840 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:32.567070 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:32.576727 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6d2cbaff-ef98-4201-8a58-8456416670e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1391 microversion: 2.1 time: 0.158383 May 14 22:19:32.577239 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3811/7203] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:32 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:33.594254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:33.594951 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:33.601650 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:33.602111 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:33.602903 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:33.603383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:33.738897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:33.746728 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d6b620e-7238-4764-9a9d-ef2f9109eb34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1563 microversion: 2.1 time: 0.156549 May 14 22:19:33.747296 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3812/7204] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:33 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:19:33.762824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:33.763447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:33.769302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:33.769769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:33.770548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:33.771010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:33.901270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:33.908816 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2565ac61-1933-4400-ab1a-a6487e7c7cf3 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1563 microversion: 2.1 time: 0.150280 May 14 22:19:33.909389 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3813/7205] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:33 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1563 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:19:35.837125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:19:35.838860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:35.850354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:35.851133 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:35.852566 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:35.853029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:36.001691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:19:36.010059 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4147569-47a5-497a-b6b0-faf69a12ff9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1563 microversion: 2.1 time: 0.176748 May 14 22:19:36.010650 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3814/7206] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:19:35 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:19:36.015331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-45223da6-5af0-44ec-b167-0f90da5ecef7 req-5c1f5eb5-e82e-4bd6-b6d9-fd9cbca4414e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1", "tag": "ce4cc68a-9bd7-418b-996a-1c9b9263d972"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:36.023433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-45223da6-5af0-44ec-b167-0f90da5ecef7 req-5c1f5eb5-e82e-4bd6-b6d9-fd9cbca4414e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:36.023934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-45223da6-5af0-44ec-b167-0f90da5ecef7 req-5c1f5eb5-e82e-4bd6-b6d9-fd9cbca4414e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:36.037697 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-45223da6-5af0-44ec-b167-0f90da5ecef7 req-5c1f5eb5-e82e-4bd6-b6d9-fd9cbca4414e service nova] Creating event network-changed:ce4cc68a-9bd7-418b-996a-1c9b9263d972 for instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 on nch1-master-1 May 14 22:19:36.043724 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-45223da6-5af0-44ec-b167-0f90da5ecef7 req-5c1f5eb5-e82e-4bd6-b6d9-fd9cbca4414e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031595 May 14 22:19:36.044450 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3815/7207] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:19:57.257504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-04551a99-3ce1-4a90-82dd-5c390ee24148 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:19:57.258466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-04551a99-3ce1-4a90-82dd-5c390ee24148 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:19:57.264819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04551a99-3ce1-4a90-82dd-5c390ee24148 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:57.265322 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04551a99-3ce1-4a90-82dd-5c390ee24148 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:57.266112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04551a99-3ce1-4a90-82dd-5c390ee24148 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:19:57.266571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-04551a99-3ce1-4a90-82dd-5c390ee24148 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:19:57.315906 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-04551a99-3ce1-4a90-82dd-5c390ee24148 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action" status: 200 len: 24570 microversion: 2.1 time: 0.063084 May 14 22:19:57.316577 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3816/7208] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:19:57 2022] POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:20:08.406472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fa2a62f0-f065-4374-9849-3ed143f44028 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:20:08.414036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa2a62f0-f065-4374-9849-3ed143f44028 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:08.414777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fa2a62f0-f065-4374-9849-3ed143f44028 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:08.440132 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fa2a62f0-f065-4374-9849-3ed143f44028 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Going to try to stop instance {{(pid=130637) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 14 22:20:08.661009 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fa2a62f0-f065-4374-9849-3ed143f44028 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.258732 May 14 22:20:08.661550 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3817/7209] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:20:08 2022] POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:20:08.671289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:08.678139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:08.678139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:08.678645 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:08.679446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:08.679924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:08.865397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:08.873109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-109f7aad-8103-4297-be7e-5d245cd37004 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.206114 May 14 22:20:08.873681 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3818/7210] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:08 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:09.890579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:09.891259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:09.898200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:09.898677 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:09.899492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:09.900442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:10.032453 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:10.040374 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-675f4ed5-c226-4851-b182-9d56cb6820e4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.153795 May 14 22:20:10.040964 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3819/7211] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:09 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:11.058065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:11.058723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:11.065494 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:11.065967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:11.066753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:11.067218 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:11.203466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:11.211323 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ad7e6394-dfe2-4270-8919-abede59fbe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.157690 May 14 22:20:11.211934 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3820/7212] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:11 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:20:12.228409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:12.229110 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:12.236164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:12.236638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:12.237463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:12.237922 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:12.370710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:12.378512 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-91b949c7-90a0-4b87-84aa-75c6ef86bdcb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.154607 May 14 22:20:12.379095 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3821/7213] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:12 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:13.397023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:13.397668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:13.405433 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:13.405906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:13.406693 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:13.407150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:13.537150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:13.545153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-278b5d5a-42ce-4a4a-a1f3-14d99939bddc tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.152169 May 14 22:20:13.545734 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3822/7214] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:13 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:14.562227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:14.562896 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:14.570258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:14.570740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:14.571571 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:14.572061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:14.709967 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:14.717592 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c9355add-9b3f-4947-ba93-5b11824cdd9f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.159330 May 14 22:20:14.718180 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3823/7215] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:14 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:20:15.736356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:15.737034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:15.744227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:15.745539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:15.746579 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:15.747043 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:15.911315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:15.920933 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96c9f6e2-6009-416c-8557-dd12c61a956e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.189504 May 14 22:20:15.923455 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3824/7216] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:15 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:20:16.938356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:16.939036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:16.945807 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:16.946286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:16.947081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:16.947622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:17.082849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:17.091322 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0ce26d29-0158-442a-87e8-f0b1cd585930 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.157073 May 14 22:20:17.091946 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3825/7217] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:16 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:18.108546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:18.109547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:18.116507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:18.116983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:18.117785 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:18.118243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:18.263283 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:18.270922 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c72b0f5e-9e3e-4538-9027-3de9f16d885a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.166487 May 14 22:20:18.271536 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3826/7218] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:18 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:19.289577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:19.290495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:19.297902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:19.298375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:19.299156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:19.299652 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:19.428834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:19.436471 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5f86b2db-9c14-49ea-b79e-e205049e4a92 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.150958 May 14 22:20:19.437051 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3827/7219] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:19 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:20.454479 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:20.455155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:20.462082 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:20.462563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:20.464220 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:20.464688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:20.599880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:20.607691 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-15ba662d-97c1-4299-881d-db839f91fe88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.157163 May 14 22:20:20.608684 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3828/7220] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:20 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:21.625916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:21.626584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:21.633464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:21.633941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:21.634806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:21.635329 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:21.774087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:21.782460 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3bdd4ceb-d41b-4168-9bb6-bc5759f8e674 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.161067 May 14 22:20:21.783049 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3829/7221] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:21 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:22.800361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:22.801032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:22.808686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:22.809159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:22.809947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:22.810402 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:22.944883 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:22.952467 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9ca6412e-96ed-4143-a123-7a94b12efa5e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.156095 May 14 22:20:22.953048 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3830/7222] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:22 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:23.969510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:23.970187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:23.977185 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:23.977661 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:23.979039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:23.979522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:24.111892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:24.120590 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e13c82b0-addf-4887-aec3-468639f98df0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1692 microversion: 2.1 time: 0.153988 May 14 22:20:24.121177 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3831/7223] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:23 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:25.144994 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:25.145636 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:25.152534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:25.153010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:25.153799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:25.154254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:25.292894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:25.300595 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f247bae-a14c-49d2-9436-84f24acd2159 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1669 microversion: 2.1 time: 0.159681 May 14 22:20:25.301170 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3832/7224] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:25 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:26.391028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c5864ec-9e47-4560-af73-597845dee57f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:20:26.392005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c5864ec-9e47-4560-af73-597845dee57f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:26.398894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c5864ec-9e47-4560-af73-597845dee57f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:26.399375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c5864ec-9e47-4560-af73-597845dee57f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:26.400243 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c5864ec-9e47-4560-af73-597845dee57f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:26.400710 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c5864ec-9e47-4560-af73-597845dee57f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:26.452318 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c5864ec-9e47-4560-af73-597845dee57f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action" status: 200 len: 38472 microversion: 2.1 time: 0.065355 May 14 22:20:26.452987 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3833/7225] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:20:26 2022] POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action => generated 38472 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:20:26.464613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f39499d-15b7-45c6-89be-83c08421d14a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:20:26.471777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f39499d-15b7-45c6-89be-83c08421d14a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:26.472253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f39499d-15b7-45c6-89be-83c08421d14a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:26.497296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f39499d-15b7-45c6-89be-83c08421d14a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Going to try to start instance {{(pid=130637) start /opt/stack/nova/nova/compute/api.py:2730}} May 14 22:20:26.703746 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f39499d-15b7-45c6-89be-83c08421d14a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action" status: 202 len: 0 microversion: 2.1 time: 0.242931 May 14 22:20:26.707728 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3834/7226] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:20:26 2022] POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:20:26.713250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:26.713979 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:26.720992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:26.721466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:26.722264 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:26.722723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:26.860426 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:26.868343 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2747c917-9bc6-4f27-a424-0ef9fe1192fa tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1678 microversion: 2.1 time: 0.159684 May 14 22:20:26.869025 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3835/7227] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:26 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:27.886299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:27.886992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:27.893927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:27.894405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:27.895209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:27.895705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:28.033018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:28.041860 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8a94af14-12f3-47fc-8eee-092b617688c0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1678 microversion: 2.1 time: 0.158655 May 14 22:20:28.042451 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3836/7228] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:27 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:29.059314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:29.060135 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:29.067003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:29.067495 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:29.076632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:29.076632 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:29.203774 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:29.211336 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-934b0627-55f5-4319-be62-470740aee885 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1682 microversion: 2.1 time: 0.156610 May 14 22:20:29.211952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3837/7229] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:29 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:20:51.391649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82f57558-60ac-4232-b4d3-6ea7203e6355 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:20:51.392508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82f57558-60ac-4232-b4d3-6ea7203e6355 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:51.399262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82f57558-60ac-4232-b4d3-6ea7203e6355 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:51.402349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82f57558-60ac-4232-b4d3-6ea7203e6355 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:51.402349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82f57558-60ac-4232-b4d3-6ea7203e6355 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:51.402349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82f57558-60ac-4232-b4d3-6ea7203e6355 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:51.452030 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82f57558-60ac-4232-b4d3-6ea7203e6355 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action" status: 200 len: 63024 microversion: 2.1 time: 0.064322 May 14 22:20:51.452700 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3838/7230] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:20:51 2022] POST /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1/action => generated 63024 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:20:58.717471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:58.718102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:58.725834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:58.726317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:58.727119 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:58.727606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:58.754848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:20:59.028687 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e8575b03-0c2e-4af5-a1e1-5b0915af5790 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 204 len: 0 microversion: 2.1 time: 0.315636 May 14 22:20:59.029305 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3839/7231] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:20:58 2022] DELETE /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:20:59.035076 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8de9ed2d-9f69-46fd-99ed-a44d759f0d0e req-d60a9106-a384-4835-a8f4-2f550e422e72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1", "tag": "ce4cc68a-9bd7-418b-996a-1c9b9263d972"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:20:59.045535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8de9ed2d-9f69-46fd-99ed-a44d759f0d0e req-d60a9106-a384-4835-a8f4-2f550e422e72 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:59.046008 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8de9ed2d-9f69-46fd-99ed-a44d759f0d0e req-d60a9106-a384-4835-a8f4-2f550e422e72 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:59.057102 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8de9ed2d-9f69-46fd-99ed-a44d759f0d0e req-d60a9106-a384-4835-a8f4-2f550e422e72 service nova] Creating event network-changed:ce4cc68a-9bd7-418b-996a-1c9b9263d972 for instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 on nch1-master-1 May 14 22:20:59.062277 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8de9ed2d-9f69-46fd-99ed-a44d759f0d0e req-d60a9106-a384-4835-a8f4-2f550e422e72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031319 May 14 22:20:59.062890 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3840/7232] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:20:59.068002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:20:59.070347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:20:59.075515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:59.075996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:59.076811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:20:59.077397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:20:59.227087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:20:59.235650 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c8febd4a-0bfe-45c1-8b8a-c6a32dea2371 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1688 microversion: 2.1 time: 0.171484 May 14 22:20:59.236247 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3841/7233] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:20:59 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:21:00.255311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:00.256042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:00.263862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:00.264343 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:00.265166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:00.265630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:00.403068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:00.410758 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6450a615-e82c-4637-ac5f-f8fa9f82da88 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1688 microversion: 2.1 time: 0.159443 May 14 22:21:00.411345 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3842/7234] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:00 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:01.185908 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a7501193-9c91-43aa-83ec-32b07598dbd4 req-d3c3cc00-a0c3-487f-8f61-112244ef7148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1", "name": "network-vif-deleted", "tag": "ce4cc68a-9bd7-418b-996a-1c9b9263d972"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:01.194447 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a7501193-9c91-43aa-83ec-32b07598dbd4 req-d3c3cc00-a0c3-487f-8f61-112244ef7148 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:01.209664 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a7501193-9c91-43aa-83ec-32b07598dbd4 req-d3c3cc00-a0c3-487f-8f61-112244ef7148 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:01.209664 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a7501193-9c91-43aa-83ec-32b07598dbd4 req-d3c3cc00-a0c3-487f-8f61-112244ef7148 service nova] Creating event network-vif-deleted:ce4cc68a-9bd7-418b-996a-1c9b9263d972 for instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 on nch1-master-1 May 14 22:21:01.211507 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a7501193-9c91-43aa-83ec-32b07598dbd4 req-d3c3cc00-a0c3-487f-8f61-112244ef7148 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082208 May 14 22:21:01.212109 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3843/7235] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:21:01.429527 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:01.430364 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:01.437158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:01.437965 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:01.438885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:01.439353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:01.479021 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:01.480767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:01.481378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lazy-loading 'fault' on Instance uuid f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:21:01.530858 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:01.538918 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cdcb8fdf-2c6e-4ff9-87d8-ba7d0cd89991 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 200 len: 1356 microversion: 2.1 time: 0.114199 May 14 22:21:01.539642 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3844/7236] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:01 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 1356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:02.557427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:02.558206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:02.564948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:02.565431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:02.566260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:02.566726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:02.580340 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] HTTP exception thrown: Instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 could not be found. May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Request method failure captured: May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 HTTP/1.1 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCm9wmrAJo2FVTZakd8NIqYe74xFo0hUsYKXW6GEV5josiKi1ryz41OMBIEI69b5uaEMAHzEBpcB5dxYN-Lt5_6bKpJP03JXjWsiyXpr2kYCmOgJFOdLihuCipdRF2oN9z7qEyz0xrtTjasJ7lxc6JQ9QSbjhs716KvpraON8MChYKc May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b433c6a39b149acb9537d5d8d32a845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2866128bc30b4a5fbbb05702047de69e May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 could not be found. May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': 'f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1'} May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 could not be found. May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 could not be found. May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:21:02.582009 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 could not be found. May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Returning 404 to user: Instance f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-db13607e-bfa2-458b-b5c3-f6413a74ab5f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1" status: 404 len: 111 microversion: 2.1 time: 0.030051 May 14 22:21:02.586766 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3845/7237] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:02 2022] GET /compute/v2.1/servers/f76f1ee7-77f8-4ea4-a165-b86d4d01b8b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:21:06.455674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1db4bb9e-5bdd-415b-b42e-ca5ab6aeea34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '.version_select at 0x7fb1a6c7d310>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:06.593129 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1db4bb9e-5bdd-415b-b42e-ca5ab6aeea34 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-271366973" status: 202 len: 0 microversion: 2.1 time: 0.141312 May 14 22:21:06.593751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3846/7238] 10.222.0.52 () {58 vars in 1280 bytes} [Sat May 14 22:21:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-271366973 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:21:06.627088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-10884a6d-b067-45f3-a106-b05f2fb5b337 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: .version_select at 0x7fb1b4100d30>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1465304209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlZk/IMlr146HTfCfOuG2MCA5WjTGLA+s/Q1Yg7TLlxLVIINVshQ7tfHlILVTgJPinCH06KeSId/kVS83Kl6+aE2BLNfjNvFIKN5MccPn7h5hiFUy1sKBpRdbpYVXX0Q=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:06.642806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-10884a6d-b067-45f3-a106-b05f2fb5b337 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:21:06.648001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-10884a6d-b067-45f3-a106-b05f2fb5b337 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:21:06.766949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-10884a6d-b067-45f3-a106-b05f2fb5b337 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.143676 May 14 22:21:06.767524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3847/7239] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:21:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:21:15.467466 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-782025611", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "networks": [{"uuid": "f1d9af47-4b5e-410e-8520-b66049a73cf3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1465304209", "security_groups": [{"name": "tempest-secgroup-smoke-1003626990"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:15.578670 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] validate_networks() for [('f1d9af47-4b5e-410e-8520-b66049a73cf3', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:21:15.969831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:21:15.970315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:21:15.970813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:21:15.971251 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:21:15.971741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:21:15.986641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:15.990036 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:15.991004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:15.991500 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:16.010138 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:21:16.016978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Getting quotas for user 2866128bc30b4a5fbbb05702047de69e and project 2b433c6a39b149acb9537d5d8d32a845. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:21:16.032318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:21:16.035052 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:21:16.149913 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5fa35737-3847-4a94-8388-b308675d6961 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.688277 May 14 22:21:16.150886 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3848/7240] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:21:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:21:16.161365 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-78952670-ff37-4afe-b52f-cc018dd33cfd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:16.162011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-78952670-ff37-4afe-b52f-cc018dd33cfd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:16.229968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-78952670-ff37-4afe-b52f-cc018dd33cfd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:16.237652 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-78952670-ff37-4afe-b52f-cc018dd33cfd tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1266 microversion: 2.1 time: 0.080064 May 14 22:21:16.238243 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3849/7241] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:16 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:21:17.255864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:17.256613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:17.265156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:17.265799 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:17.266682 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:17.267212 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:17.338576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:17.347044 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b4a5ad86-82fd-41ba-b78e-62841fcf8184 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1270 microversion: 2.1 time: 0.095928 May 14 22:21:17.347674 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3850/7242] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:17 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:18.365206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:18.366808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:18.374638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:18.375107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:18.376187 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:18.376654 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:18.457811 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:18.466874 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b5345a8-66be-4376-8fe2-9321d9ac34d2 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1326 microversion: 2.1 time: 0.105756 May 14 22:21:18.468816 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3851/7243] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:18 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:19.485957 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:19.486642 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:19.492634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:19.493124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:19.494179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:19.494648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:19.645563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:19.653973 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5294e978-7455-49d5-9373-912f4f721ded tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.173476 May 14 22:21:19.654558 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3852/7244] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:19 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:19.989154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ecd7d9b6-b42b-4524-b0e4-b9a1227ec9dc req-11699b7a-9d1f-4687-8cad-b750dd79af6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3671556e-17bd-44f1-af6e-1a3c5127815d", "tag": "38436a42-445d-43fb-a945-05051da46ddf"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:19.997779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ecd7d9b6-b42b-4524-b0e4-b9a1227ec9dc req-11699b7a-9d1f-4687-8cad-b750dd79af6f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:20.003196 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ecd7d9b6-b42b-4524-b0e4-b9a1227ec9dc req-11699b7a-9d1f-4687-8cad-b750dd79af6f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:20.013980 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ecd7d9b6-b42b-4524-b0e4-b9a1227ec9dc req-11699b7a-9d1f-4687-8cad-b750dd79af6f service nova] Creating event network-changed:38436a42-445d-43fb-a945-05051da46ddf for instance 3671556e-17bd-44f1-af6e-1a3c5127815d on nch2-master-1 May 14 22:21:20.020201 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ecd7d9b6-b42b-4524-b0e4-b9a1227ec9dc req-11699b7a-9d1f-4687-8cad-b750dd79af6f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034698 May 14 22:21:20.020829 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3853/7245] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:21:20.673158 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:20.674011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:20.681485 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:20.682048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:20.682861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:20.683336 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:20.821914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:20.830185 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b5dc35b8-455c-4ec0-bcfd-66d281d06f3e tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.162340 May 14 22:21:20.830899 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3854/7246] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:20 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:21:21.846892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:21.847659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:21.854539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:21.855015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:21.855886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:21.856352 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:21.987038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:21.994534 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0197d6d8-b5c1-43e0-a131-a0b002a99ceb tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.151685 May 14 22:21:21.995121 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3855/7247] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:21 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:23.012184 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:23.012837 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:23.019752 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:23.020230 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:23.021020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:23.021482 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:23.157387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:23.163988 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3b527353-d59d-4bd0-ab7f-b2954ba64b87 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.155856 May 14 22:21:23.164564 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3856/7248] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:23 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:24.181742 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:24.182373 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:24.189790 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:24.190360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:24.191112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:24.191607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:24.323253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:24.331631 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7be70ce9-8aa2-4a5e-8c29-8247b8b390ca tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.153996 May 14 22:21:24.332251 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3857/7249] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:24 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:25.348886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:25.349530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:25.356335 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:25.356812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:25.357604 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:25.358065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:25.487226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:25.494677 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-fe96bc71-058b-4c19-9871-d81242b865b7 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.149828 May 14 22:21:25.495281 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3858/7250] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:25 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:26.512905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:26.513548 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:26.520478 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:26.520963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:26.521766 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:26.522309 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:26.660250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:26.668313 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9f730193-7008-466f-a16b-cdd15a1ade68 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.159964 May 14 22:21:26.668990 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3859/7251] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:26 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:26.724589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-6ff1a2c7-12e1-468d-a9c0-880936d1b15d req-9307a2fb-ade6-43a8-b8e0-44b03d38b996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3671556e-17bd-44f1-af6e-1a3c5127815d", "name": "network-vif-plugged", "status": "completed", "tag": "38436a42-445d-43fb-a945-05051da46ddf"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:26.734724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6ff1a2c7-12e1-468d-a9c0-880936d1b15d req-9307a2fb-ade6-43a8-b8e0-44b03d38b996 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:26.735195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-6ff1a2c7-12e1-468d-a9c0-880936d1b15d req-9307a2fb-ade6-43a8-b8e0-44b03d38b996 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:26.747031 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-6ff1a2c7-12e1-468d-a9c0-880936d1b15d req-9307a2fb-ade6-43a8-b8e0-44b03d38b996 service nova] Creating event network-vif-plugged:38436a42-445d-43fb-a945-05051da46ddf for instance 3671556e-17bd-44f1-af6e-1a3c5127815d on nch2-master-1 May 14 22:21:26.752449 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-6ff1a2c7-12e1-468d-a9c0-880936d1b15d req-9307a2fb-ade6-43a8-b8e0-44b03d38b996 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082177 May 14 22:21:26.753086 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3860/7252] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:21:27.686047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:27.686794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:27.693800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:27.694269 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:27.695050 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:27.695524 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:27.837806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:27.847468 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-413359cb-43a1-47ae-a561-e291dd0843de tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1392 microversion: 2.1 time: 0.165859 May 14 22:21:27.848275 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3861/7253] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:27 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:28.864547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:28.865190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:28.872098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:28.872576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:28.873370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:28.873836 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:29.002418 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:29.009866 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-822e6d18-966b-4695-816c-4f2521a4c868 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1564 microversion: 2.1 time: 0.149343 May 14 22:21:29.010448 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3862/7254] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:28 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:29.025672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:29.026238 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:29.032719 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:29.033195 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:29.033991 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:29.034454 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:29.162574 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:29.170412 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-925bdef0-3455-45a6-9592-875d76ed2044 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1564 microversion: 2.1 time: 0.148402 May 14 22:21:29.170995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3863/7255] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:29 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:31.443125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:31.443824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:31.451120 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:31.451619 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:31.452411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:31.452880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:31.590630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:31.598324 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-10aec216-2edc-4a1d-8b37-dab20067ebea tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1564 microversion: 2.1 time: 0.159166 May 14 22:21:31.598921 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3864/7256] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:31 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:21:31.603412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-954bfbb8-922f-496e-af24-6a3720233ff7 req-499c1ce2-2779-453a-a0ff-193bdf5e7ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3671556e-17bd-44f1-af6e-1a3c5127815d", "tag": "38436a42-445d-43fb-a945-05051da46ddf"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:31.612397 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-954bfbb8-922f-496e-af24-6a3720233ff7 req-499c1ce2-2779-453a-a0ff-193bdf5e7ef1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:31.612873 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-954bfbb8-922f-496e-af24-6a3720233ff7 req-499c1ce2-2779-453a-a0ff-193bdf5e7ef1 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:31.627321 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-954bfbb8-922f-496e-af24-6a3720233ff7 req-499c1ce2-2779-453a-a0ff-193bdf5e7ef1 service nova] Creating event network-changed:38436a42-445d-43fb-a945-05051da46ddf for instance 3671556e-17bd-44f1-af6e-1a3c5127815d on nch2-master-1 May 14 22:21:31.633272 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-954bfbb8-922f-496e-af24-6a3720233ff7 req-499c1ce2-2779-453a-a0ff-193bdf5e7ef1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033103 May 14 22:21:31.634206 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3865/7257] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:21:52.880501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-92597f4a-507f-493c-a259-d5ddba03b111 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:52.881584 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-92597f4a-507f-493c-a259-d5ddba03b111 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:52.888107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92597f4a-507f-493c-a259-d5ddba03b111 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:52.888608 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92597f4a-507f-493c-a259-d5ddba03b111 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:52.889392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92597f4a-507f-493c-a259-d5ddba03b111 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:52.889875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92597f4a-507f-493c-a259-d5ddba03b111 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:52.940006 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-92597f4a-507f-493c-a259-d5ddba03b111 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action" status: 200 len: 24572 microversion: 2.1 time: 0.063973 May 14 22:21:52.940706 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3866/7258] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:21:52 2022] POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action => generated 24572 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:21:59.368674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:21:59.369311 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:59.377079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:59.377554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:59.378334 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:59.378794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:59.402690 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lazy-loading 'flavor' on Instance uuid 3671556e-17bd-44f1-af6e-1a3c5127815d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:21:59.665063 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9d2025d9-cdf9-44c2-a711-9b4ff30a42c5 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action" status: 202 len: 0 microversion: 2.1 time: 0.300453 May 14 22:21:59.666172 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3867/7259] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:21:59 2022] POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:21:59.675010 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:21:59.675763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:21:59.681962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:59.682435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:59.683865 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:21:59.684327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:21:59.821245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:21:59.829066 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9952d06f-afc5-41c4-bd16-a64ae9d2d6ef tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1690 microversion: 2.1 time: 0.158181 May 14 22:21:59.829640 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3868/7260] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:21:59 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:00.846296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:00.846996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:00.853798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:00.854308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:00.855112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:00.855613 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:00.986933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:00.994419 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a2d1d4be-7a28-471b-91ae-e01a1a378472 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1673 microversion: 2.1 time: 0.152113 May 14 22:22:00.994988 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3869/7261] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:00 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:02.087544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e2a6136e-1fc1-407e-97c4-0fbacc4490ce tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:02.088506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e2a6136e-1fc1-407e-97c4-0fbacc4490ce tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:02.096247 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2a6136e-1fc1-407e-97c4-0fbacc4490ce tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:02.096726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2a6136e-1fc1-407e-97c4-0fbacc4490ce tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:02.097520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2a6136e-1fc1-407e-97c4-0fbacc4490ce tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:02.097982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e2a6136e-1fc1-407e-97c4-0fbacc4490ce tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:02.145861 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e2a6136e-1fc1-407e-97c4-0fbacc4490ce tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action" status: 200 len: 35490 microversion: 2.1 time: 0.062176 May 14 22:22:02.146524 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3870/7262] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:22:02 2022] POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action => generated 35490 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:22:02.158189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d5ceded-a447-43b1-9cbe-107dcf10eb14 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:02.158833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d5ceded-a447-43b1-9cbe-107dcf10eb14 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:02.166015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d5ceded-a447-43b1-9cbe-107dcf10eb14 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:02.166488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d5ceded-a447-43b1-9cbe-107dcf10eb14 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:02.167276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d5ceded-a447-43b1-9cbe-107dcf10eb14 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:02.167763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d5ceded-a447-43b1-9cbe-107dcf10eb14 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:02.338605 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d5ceded-a447-43b1-9cbe-107dcf10eb14 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action" status: 202 len: 0 microversion: 2.1 time: 0.184137 May 14 22:22:02.339411 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3871/7263] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:22:02 2022] POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:22:02.352625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:02.353348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:02.359942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:02.360411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:02.361221 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:02.361696 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:02.524853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:02.532697 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7ab5b6da-efe1-4844-89cb-1d09207728f1 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1679 microversion: 2.1 time: 0.184187 May 14 22:22:02.533417 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3872/7264] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:02 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:03.551161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:03.551880 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:03.559416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:03.559913 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:03.560708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:03.561169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:03.697211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:03.704992 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-559185fc-f5e0-4b6a-8c69-f293d0c79c8c tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1679 microversion: 2.1 time: 0.157797 May 14 22:22:03.705572 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3873/7265] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:03 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:04.722306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:04.722987 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:04.730326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:04.731039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:04.731843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:04.732310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:04.864832 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:04.873157 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-669540d4-1d24-4bdf-9fab-a90c1dd1cc48 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1682 microversion: 2.1 time: 0.154848 May 14 22:22:04.873733 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3874/7266] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:04 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:04.976863 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aba79aeb-f76a-418e-9107-339e326e65a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:04.977776 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aba79aeb-f76a-418e-9107-339e326e65a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:04.984475 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba79aeb-f76a-418e-9107-339e326e65a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:04.984959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba79aeb-f76a-418e-9107-339e326e65a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:04.985746 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba79aeb-f76a-418e-9107-339e326e65a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:04.986206 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aba79aeb-f76a-418e-9107-339e326e65a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:05.026827 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aba79aeb-f76a-418e-9107-339e326e65a0 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action" status: 200 len: 35490 microversion: 2.1 time: 0.053907 May 14 22:22:05.027802 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3875/7267] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:22:04 2022] POST /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d/action => generated 35490 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:22:06.197897 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:06.198497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:06.208438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:06.208921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:06.209720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:06.210179 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:06.240245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:22:06.495794 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afc1908f-aa99-44c7-be3b-1f423ac7490f tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 204 len: 0 microversion: 2.1 time: 0.302112 May 14 22:22:06.511962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3876/7268] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:22:06 2022] DELETE /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 22:22:06.511962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-a9de7915-3b9f-42d7-ac18-29edeedc74b0 req-13241e12-4e53-48bd-8aa1-cf1d3b676928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3671556e-17bd-44f1-af6e-1a3c5127815d", "tag": "38436a42-445d-43fb-a945-05051da46ddf"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:06.519058 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a9de7915-3b9f-42d7-ac18-29edeedc74b0 req-13241e12-4e53-48bd-8aa1-cf1d3b676928 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:06.519666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-a9de7915-3b9f-42d7-ac18-29edeedc74b0 req-13241e12-4e53-48bd-8aa1-cf1d3b676928 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:06.534440 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-a9de7915-3b9f-42d7-ac18-29edeedc74b0 req-13241e12-4e53-48bd-8aa1-cf1d3b676928 service nova] Creating event network-changed:38436a42-445d-43fb-a945-05051da46ddf for instance 3671556e-17bd-44f1-af6e-1a3c5127815d on nch2-master-1 May 14 22:22:06.539570 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-a9de7915-3b9f-42d7-ac18-29edeedc74b0 req-13241e12-4e53-48bd-8aa1-cf1d3b676928 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036999 May 14 22:22:06.540810 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3877/7269] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:22:06.546921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:06.547606 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:06.554028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:06.554505 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:06.555349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:06.555844 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:06.702005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:06.709680 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2d886352-df4a-4396-bed3-5149765f7836 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1688 microversion: 2.1 time: 0.167638 May 14 22:22:06.710265 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3878/7270] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:06 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:22:07.727683 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:07.728383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:07.735573 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:07.736049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:07.736831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:07.737291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:07.935151 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:07.942941 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d94ed97e-42c5-47df-ad4e-fdd22d7618d4 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1688 microversion: 2.1 time: 0.219188 May 14 22:22:07.943545 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3879/7271] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:07 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1688 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:08.614727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8ebb47eb-1469-4e65-8cf6-2fe48949d4de req-9c17c5d8-94fc-4341-8cc6-205371ec1422 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3671556e-17bd-44f1-af6e-1a3c5127815d", "name": "network-vif-deleted", "tag": "38436a42-445d-43fb-a945-05051da46ddf"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:08.624814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8ebb47eb-1469-4e65-8cf6-2fe48949d4de req-9c17c5d8-94fc-4341-8cc6-205371ec1422 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:08.625288 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8ebb47eb-1469-4e65-8cf6-2fe48949d4de req-9c17c5d8-94fc-4341-8cc6-205371ec1422 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:08.636690 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8ebb47eb-1469-4e65-8cf6-2fe48949d4de req-9c17c5d8-94fc-4341-8cc6-205371ec1422 service nova] Creating event network-vif-deleted:38436a42-445d-43fb-a945-05051da46ddf for instance 3671556e-17bd-44f1-af6e-1a3c5127815d on nch2-master-1 May 14 22:22:08.641726 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8ebb47eb-1469-4e65-8cf6-2fe48949d4de req-9c17c5d8-94fc-4341-8cc6-205371ec1422 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030868 May 14 22:22:08.642331 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3880/7272] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:22:08.962487 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:08.964087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:08.971292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:08.978324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:08.978324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:08.978324 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:09.007889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:09.008361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:09.008833 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lazy-loading 'fault' on Instance uuid 3671556e-17bd-44f1-af6e-1a3c5127815d {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:22:09.051639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2866128bc30b4a5fbbb05702047de69e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b433c6a39b149acb9537d5d8d32a845', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:09.060287 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-de1ab4ab-20b7-4e5a-a6d8-3d6f029f334a tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 200 len: 1356 microversion: 2.1 time: 0.102651 May 14 22:22:09.060848 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3881/7273] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:08 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:10.079972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:10.080659 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] [instance: 3671556e-17bd-44f1-af6e-1a3c5127815d] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:10.088233 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:10.088716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:10.089532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:10.090493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:10.109223 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] HTTP exception thrown: Instance 3671556e-17bd-44f1-af6e-1a3c5127815d could not be found. May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Request method failure captured: May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d HTTP/1.1 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCm9wmrAJo2FVTZakd8NIqYe74xFo0hUsYKXW6GEV5josiKi1ryz41OMBIEI69b5uaEMAHzEBpcB5dxYN-Lt5_6bKpJP03JXjWsiyXpr2kYCmOgJFOdLihuCipdRF2oN9z7qEyz0xrtTjasJ7lxc6JQ9QSbjhs716KvpraON8MChYKc May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2b433c6a39b149acb9537d5d8d32a845"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2b433c6a39b149acb9537d5d8d32a845", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: 2b433c6a39b149acb9537d5d8d32a845 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1326105574 May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: 2866128bc30b4a5fbbb05702047de69e May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1326105574-project May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 3671556e-17bd-44f1-af6e-1a3c5127815d could not be found. May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '3671556e-17bd-44f1-af6e-1a3c5127815d'} May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3671556e-17bd-44f1-af6e-1a3c5127815d could not be found. May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3671556e-17bd-44f1-af6e-1a3c5127815d could not be found. May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:22:10.110931 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3671556e-17bd-44f1-af6e-1a3c5127815d could not be found. May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Returning 404 to user: Instance 3671556e-17bd-44f1-af6e-1a3c5127815d could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2dad3f49-f5a4-4370-914e-d9b6c6ed1e9b tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d" status: 404 len: 111 microversion: 2.1 time: 0.036565 May 14 22:22:10.115834 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3882/7274] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:10 2022] GET /compute/v2.1/servers/3671556e-17bd-44f1-af6e-1a3c5127815d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:22:13.912362 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34316ac5-45e4-4589-bfc6-ef2260f16680 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] Calling method '.version_select at 0x7fb1a78f2dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:13.992221 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34316ac5-45e4-4589-bfc6-ef2260f16680 tempest-TestNetworkAdvancedServerOps-1326105574 tempest-TestNetworkAdvancedServerOps-1326105574-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1465304209" status: 202 len: 0 microversion: 2.1 time: 0.083660 May 14 22:22:13.992807 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3883/7275] 10.222.0.52 () {58 vars in 1283 bytes} [Sat May 14 22:22:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1465304209 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:22:29.124535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f490797f-2fb9-4396-a34b-497759aaec16 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Action: 'create', calling method: .version_select at 0x7fb1a6f570d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1811719576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJi3im+hmHE+xEq8tI4anXe6EKaxxJcr/vuq/Cf4k1HNNU5dSE5u6THzxn1CuCJge6SeiOwBTkUcGrhagBAQ21MHQcCHKG47aDY/BCzxlTevZwXxbQVM05/L/CyJPXKv7g=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:29.139756 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f490797f-2fb9-4396-a34b-497759aaec16 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:22:29.145481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-f490797f-2fb9-4396-a34b-497759aaec16 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for user b3ec4b155d344282909459de93091eee and project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:22:29.279747 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f490797f-2fb9-4396-a34b-497759aaec16 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.352657 May 14 22:22:29.280700 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3884/7276] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:22:28 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:22:31.672538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-247533764", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1811719576", "security_groups": [{"name": "tempest-secgroup-smoke-1143389141"}], "networks": [{"uuid": "8f586cab-f67f-42d7-b347-7d19c0252875"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:31.789866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] validate_networks() for [('8f586cab-f67f-42d7-b347-7d19c0252875', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:22:32.359813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:22:32.360424 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:22:32.360934 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:22:32.361546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:22:32.362026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:22:32.371933 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:32.372254 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:32.373226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:32.373698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:32.394291 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:22:32.400784 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for user b3ec4b155d344282909459de93091eee and project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:22:32.418526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:22:32.421427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:22:32.572646 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d75a980-7f69-4183-a4e4-46d269fef89a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.905542 May 14 22:22:32.574832 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3885/7277] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:22:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:22:32.593263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a678e697-7f5c-4b66-8b56-bb1c428d6bf3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:32.597155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a678e697-7f5c-4b66-8b56-bb1c428d6bf3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:32.668299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a678e697-7f5c-4b66-8b56-bb1c428d6bf3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:32.678315 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a678e697-7f5c-4b66-8b56-bb1c428d6bf3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1246 microversion: 2.1 time: 0.089704 May 14 22:22:32.679962 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3886/7278] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:32 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:22:33.696718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:33.697374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:33.705359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:33.705825 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:33.717946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:33.717946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:33.771150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:33.778720 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1200085f-6591-4bd1-a400-5bee01730d47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1250 microversion: 2.1 time: 0.086192 May 14 22:22:33.779312 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3887/7279] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:33 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:34.796601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:34.797245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:34.804200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:34.804676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:34.805748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:34.806217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:34.874484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:34.882468 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9caac70d-90ce-4a2b-b090-285194672871 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1306 microversion: 2.1 time: 0.090267 May 14 22:22:34.885946 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3888/7280] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:34 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:35.899981 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:35.900628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:35.907568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:35.908048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:35.908898 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:35.909356 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:36.048692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:36.062141 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-43ea5292-5481-4a55-ace8-695ef532a351 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.166137 May 14 22:22:36.062780 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3889/7281] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:35 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:36.316302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-ec3d81a0-a41f-40bc-9024-443009a196f2 req-9e97cf1b-ddfe-4996-a975-fdfc5fcd5d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:36.326097 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ec3d81a0-a41f-40bc-9024-443009a196f2 req-9e97cf1b-ddfe-4996-a975-fdfc5fcd5d7f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:36.326568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-ec3d81a0-a41f-40bc-9024-443009a196f2 req-9e97cf1b-ddfe-4996-a975-fdfc5fcd5d7f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:36.338479 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-ec3d81a0-a41f-40bc-9024-443009a196f2 req-9e97cf1b-ddfe-4996-a975-fdfc5fcd5d7f service nova] Creating event network-changed:9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01 for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e on nch2-master-1 May 14 22:22:36.349176 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-ec3d81a0-a41f-40bc-9024-443009a196f2 req-9e97cf1b-ddfe-4996-a975-fdfc5fcd5d7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036505 May 14 22:22:36.349805 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3890/7282] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:22:37.080532 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:37.081260 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:37.087706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:37.088190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:37.088984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:37.089450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:37.222061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:37.229707 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3a4c0f6a-471a-47a5-84b2-049cecd343dd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.154376 May 14 22:22:37.230295 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3891/7283] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:37 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:38.246846 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:38.247513 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:38.254410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:38.254881 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:38.255692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:38.256147 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:38.388954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:38.396442 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7b6a7ff2-5ea5-4cf1-91e1-b068aa5ed200 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.153660 May 14 22:22:38.397034 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3892/7284] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:38 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:39.413439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:39.414047 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:39.421589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:39.422067 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:39.422855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:39.423319 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:39.551890 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:39.560148 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6c81abbe-75e2-4eda-88a3-755eb946a798 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.150753 May 14 22:22:39.560728 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3893/7285] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:39 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:40.577823 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:40.578496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:40.585240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:40.585723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:40.586547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:40.587007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:40.720730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:40.728305 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2abd7040-4a06-47e0-8090-eb912c8f01ca tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.155207 May 14 22:22:40.728894 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3894/7286] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:40 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:41.745914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:41.746674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:41.754852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:41.755368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:41.756175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:41.756665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:41.893078 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:41.900604 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-35d0f0cd-739c-4fc3-831d-9e2f27d2e5c4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.158783 May 14 22:22:41.901185 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3895/7287] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:41 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:42.917270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:42.917915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:42.925795 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:42.926270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:42.927079 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:42.927581 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:43.063877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:43.071264 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-401525e6-1814-4632-ad68-1f0c4302a3ae tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.158549 May 14 22:22:43.071884 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3896/7288] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:42 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:43.136708 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-967e6b34-617b-4b3d-8ee7-3d85162b7304 req-695c65f8-43cd-413e-b74d-cf524370a8b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "name": "network-vif-plugged", "status": "completed", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:43.145210 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-967e6b34-617b-4b3d-8ee7-3d85162b7304 req-695c65f8-43cd-413e-b74d-cf524370a8b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:43.145672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-967e6b34-617b-4b3d-8ee7-3d85162b7304 req-695c65f8-43cd-413e-b74d-cf524370a8b7 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:43.157094 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-967e6b34-617b-4b3d-8ee7-3d85162b7304 req-695c65f8-43cd-413e-b74d-cf524370a8b7 service nova] Creating event network-vif-plugged:9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01 for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e on nch2-master-1 May 14 22:22:43.162509 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-967e6b34-617b-4b3d-8ee7-3d85162b7304 req-695c65f8-43cd-413e-b74d-cf524370a8b7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029460 May 14 22:22:43.163208 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3897/7289] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:22:44.088816 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:44.090600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:44.097224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:44.097706 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:44.098497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:44.098959 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:44.237169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:44.250453 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7f300038-79cf-4c59-902b-97fe83b10b66 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1372 microversion: 2.1 time: 0.165580 May 14 22:22:44.251201 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3898/7290] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:44 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:45.267812 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:45.268452 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:45.275292 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:45.275800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:45.276595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:45.277055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:45.407159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:45.414614 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-80d71460-67eb-41c6-b184-cab7be0a119d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1556 microversion: 2.1 time: 0.150954 May 14 22:22:45.415187 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3899/7291] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:45 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:45.430798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:22:45.431421 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:22:45.437569 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:45.438038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:45.438820 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:45.439278 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:45.574245 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:22:45.582013 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a6db7b12-5b1b-4090-88f2-aac174ef1491 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1556 microversion: 2.1 time: 0.154700 May 14 22:22:45.582597 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3900/7292] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:22:45 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:22:47.552460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-74b37309-e97b-4787-a11b-f3f882e20a83 req-53792d78-4679-4874-b2f2-c005fcb94ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:22:47.561007 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-74b37309-e97b-4787-a11b-f3f882e20a83 req-53792d78-4679-4874-b2f2-c005fcb94ffd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:22:47.561480 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-74b37309-e97b-4787-a11b-f3f882e20a83 req-53792d78-4679-4874-b2f2-c005fcb94ffd service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:22:47.572620 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-74b37309-e97b-4787-a11b-f3f882e20a83 req-53792d78-4679-4874-b2f2-c005fcb94ffd service nova] Creating event network-changed:9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01 for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e on nch2-master-1 May 14 22:22:47.578281 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-74b37309-e97b-4787-a11b-f3f882e20a83 req-53792d78-4679-4874-b2f2-c005fcb94ffd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029665 May 14 22:22:47.579080 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3901/7293] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:24:42.805352 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 22:24:42.809777 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:24:42.810444 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:42.818589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:42.818589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:42.818589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:42.818589 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:42.842145 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lazy-loading 'flavor' on Instance uuid 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:24:43.496696 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e11c9542-b994-4def-b7d2-f47e957ca318 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "POST /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e/action" status: 202 len: 0 microversion: 2.1 time: 0.693624 May 14 22:24:43.497335 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3902/7294] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:24:42 2022] POST /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:24:43.506925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:43.507681 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:43.514748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:43.515271 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:43.516284 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:43.516744 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:43.650086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:43.658211 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b86f5427-5e04-4bea-a71f-cd6b7b3e61f5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.155449 May 14 22:24:43.658789 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3903/7295] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:43 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:44.676272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:44.676935 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:44.685259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:44.685734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:44.687074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:44.687560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:44.692895 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39148. May 14 22:24:44.825588 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:44.834320 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6cadbb50-7ff2-492f-bd88-263398501123 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.162042 May 14 22:24:44.834901 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3904/7296] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:44 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:45.852316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:45.853071 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:45.861049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:45.866748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:45.866748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:45.866748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:45.996211 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:46.004977 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0b3c7f8b-03d9-4d16-862d-bbcf1a650fb3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.156666 May 14 22:24:46.005617 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3905/7297] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:45 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:47.021627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:47.022246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:47.028828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:47.029299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:47.030361 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:47.030818 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:47.167620 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:47.175402 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d75c33e2-1cb4-4db0-a8b1-9e32d3d51942 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.157743 May 14 22:24:47.176034 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3906/7298] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:47 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:48.192576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:48.193170 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:48.200048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:48.200521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:48.201318 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:48.201782 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:48.333950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:48.341543 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dd616fa6-e526-40a1-b950-4d9467620308 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.152947 May 14 22:24:48.342620 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3907/7299] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:48 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:49.359202 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:49.359866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:49.366629 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:49.367104 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:49.367928 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:49.368394 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:49.497750 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:49.505287 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-041f5b2c-9f17-4d9d-b406-2a6c543b2819 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.150723 May 14 22:24:49.505866 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3908/7300] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:49 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:50.523393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:50.524051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:50.531651 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:50.532128 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:50.532915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:50.533374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:50.664860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:50.673351 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3aae8a59-363d-45be-9d82-4eb3a61b6ad5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.153881 May 14 22:24:50.673937 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3909/7301] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:50 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:51.690550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:51.691213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:51.698031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:51.698536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:51.699325 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:51.699822 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:51.829767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:51.837381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d910b661-57bd-4bf6-bd07-f555454cafc3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.150957 May 14 22:24:51.837967 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3910/7302] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:51 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:52.855370 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:52.856087 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:52.863396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:52.863902 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:52.864698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:52.865160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:53.000684 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:53.008199 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c9477c41-7c6f-4f26-9d3b-2777a0922880 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.156779 May 14 22:24:53.008787 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3911/7303] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:52 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:54.024963 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:54.025615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:54.032680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:54.037769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:54.037769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:54.037769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:54.172492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:54.180210 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0049d063-a8d6-44be-8b10-cf72b5918244 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1702 microversion: 2.1 time: 0.159142 May 14 22:24:54.180722 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3912/7304] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:54 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1702 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:55.198016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:55.198676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:55.206063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:55.206537 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:55.207331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:55.207830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:55.338188 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:55.345768 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-bd798239-8fdc-4c0f-8ef1-fb8696296b47 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1702 microversion: 2.1 time: 0.151870 May 14 22:24:55.346356 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3913/7305] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:55 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1702 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:56.362391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:56.363115 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:56.369944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:56.370420 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:56.371224 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:56.371757 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:56.508431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:56.517061 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-024cd46e-9d90-4ef5-8611-1b74292e8a7f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.158812 May 14 22:24:56.517776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3914/7306] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:56 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:57.534348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:57.534997 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:57.552074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:57.552952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:57.554023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:57.554711 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:57.724011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:57.733142 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d6b5a829-46f0-4e4b-b468-eb758e725272 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.202276 May 14 22:24:57.734101 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3915/7307] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:57 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:57.739522 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-cf3b42ee-805e-46e2-a776-d7ef51ce3485 req-04f460e5-b21c-4f68-90fa-997d309658c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "name": "network-vif-plugged", "status": "completed", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:24:57.748775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cf3b42ee-805e-46e2-a776-d7ef51ce3485 req-04f460e5-b21c-4f68-90fa-997d309658c5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:57.749740 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-cf3b42ee-805e-46e2-a776-d7ef51ce3485 req-04f460e5-b21c-4f68-90fa-997d309658c5 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:57.764581 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-cf3b42ee-805e-46e2-a776-d7ef51ce3485 req-04f460e5-b21c-4f68-90fa-997d309658c5 service nova] Creating event network-vif-plugged:9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01 for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e on nch2-master-1 May 14 22:24:57.777622 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-cf3b42ee-805e-46e2-a776-d7ef51ce3485 req-04f460e5-b21c-4f68-90fa-997d309658c5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041995 May 14 22:24:57.778638 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3916/7308] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:24:58.752270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:58.753015 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:58.760341 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:58.761080 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:58.762066 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:58.762555 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:58.919276 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:24:58.930009 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3d0f0c14-aa38-4c19-a448-ce1460cf93b9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.183251 May 14 22:24:58.932072 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3917/7309] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:58 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:24:59.240499 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:24:59.241424 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:24:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:24:59.949267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:24:59.950320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:24:59.957655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:59.958189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:24:59.958877 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:24:59.959403 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:00.102691 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:00.110424 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ac85a824-45bb-4aa6-bb35-97772b23fdbc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.165263 May 14 22:25:00.111003 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3918/7310] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:24:59 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:01.128814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:01.129575 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:01.137061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:01.137595 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:01.138393 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:01.138978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:01.286510 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:01.295623 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-50f0d606-ae10-4ab5-8a71-48760acdbf29 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.170126 May 14 22:25:01.296438 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3919/7311] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:01 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:02.313414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:02.314051 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:02.323770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:02.323770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:02.323770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:02.324798 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:02.470428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:02.478515 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-72845aaa-eb61-4e03-bbf3-02e8fa84708e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.169576 May 14 22:25:02.479454 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3920/7312] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:02 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:03.496501 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:03.497181 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:03.505000 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:03.505484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:03.506294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:03.506758 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:03.647391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:03.656835 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-28ec4403-4755-49d0-a274-86f370d79a55 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.164253 May 14 22:25:03.664609 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3921/7313] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:03 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:25:04.675830 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:04.676511 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:04.684666 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:04.685182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:04.686564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:04.687023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:04.848446 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:04.858712 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aaac4483-fe45-441a-a5cc-877ce692fee9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.187709 May 14 22:25:04.859428 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3922/7314] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:04 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:05.877534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:05.878213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:05.884396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:05.884871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:05.885702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:05.886156 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:06.020150 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:06.028401 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c43fc7eb-aa58-4bdc-9560-b234666808fc tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.156029 May 14 22:25:06.028988 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3923/7315] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:05 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:07.047249 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:07.047947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:07.054855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:07.055331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:07.056161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:07.056622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:07.194064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:07.199325 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-00300930-59a9-4483-85a4-9ce39993abec tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1697 microversion: 2.1 time: 0.156775 May 14 22:25:07.199958 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3924/7316] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:07 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:08.219041 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:08.219722 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:08.226692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:08.227173 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:08.228005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:08.228464 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:08.384508 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:08.393123 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b27d511f-4094-4b36-a2b1-a0d2a053d9d3 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1679 microversion: 2.1 time: 0.180144 May 14 22:25:08.394865 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3925/7317] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:08 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:09.411841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:09.412472 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:09.419385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:09.420385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:09.421331 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:09.421792 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:09.628751 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:09.636492 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b727e8d5-e18b-45ae-8d13-709809ac93fd tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1679 microversion: 2.1 time: 0.228716 May 14 22:25:09.637083 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3926/7318] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:09 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:10.654772 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:10.655440 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:10.662442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:10.662925 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:10.663753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:10.664226 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:10.798689 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:10.806332 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f9373105-626a-45d4-a212-57d7e203ac74 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1622 microversion: 2.1 time: 0.155767 May 14 22:25:10.806917 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3927/7319] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:10 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1622 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:25:10.822855 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-93f2939c-b508-4999-a67f-2a928a9cbe67 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:25:10.826889 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-93f2939c-b508-4999-a67f-2a928a9cbe67 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:10.830726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93f2939c-b508-4999-a67f-2a928a9cbe67 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:10.831208 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93f2939c-b508-4999-a67f-2a928a9cbe67 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:10.832088 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93f2939c-b508-4999-a67f-2a928a9cbe67 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:10.832549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-93f2939c-b508-4999-a67f-2a928a9cbe67 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:11.020303 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-93f2939c-b508-4999-a67f-2a928a9cbe67 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "POST /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e/action" status: 202 len: 0 microversion: 2.1 time: 0.200994 May 14 22:25:11.020880 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3928/7320] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:25:10 2022] POST /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:25:11.028762 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:11.029838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:11.036183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:11.036667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:11.037565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:11.038028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:11.172101 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:11.179907 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-34d77163-6ffd-4160-98bd-372b5657de35 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1630 microversion: 2.1 time: 0.154802 May 14 22:25:11.180498 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3929/7321] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:11 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1630 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:11.647685 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-5e39d18c-a4c0-4ab2-8fd2-5814b60e52e7 req-a2f9f9a8-dd9c-4a02-ab48-5f01b188ab7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "name": "network-vif-unplugged", "status": "completed", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:25:11.657354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5e39d18c-a4c0-4ab2-8fd2-5814b60e52e7 req-a2f9f9a8-dd9c-4a02-ab48-5f01b188ab7f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:11.657954 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-5e39d18c-a4c0-4ab2-8fd2-5814b60e52e7 req-a2f9f9a8-dd9c-4a02-ab48-5f01b188ab7f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:11.670914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.compute.server_external_events [req-5e39d18c-a4c0-4ab2-8fd2-5814b60e52e7 req-a2f9f9a8-dd9c-4a02-ab48-5f01b188ab7f service nova] Unable to find a host for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e. Dropping event network-vif-unplugged {{(pid=130637) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 14 22:25:11.670914 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-5e39d18c-a4c0-4ab2-8fd2-5814b60e52e7 req-a2f9f9a8-dd9c-4a02-ab48-5f01b188ab7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027806 May 14 22:25:11.671381 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3930/7322] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 14 22:25:12.197680 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:12.198310 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:12.205023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:12.205521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:12.206305 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:12.206760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:12.340460 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:12.349113 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f13f3229-6ecf-4e20-a043-60a010e5bad2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1630 microversion: 2.1 time: 0.155311 May 14 22:25:12.349701 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3931/7323] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:12 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1630 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:13.366228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:13.366861 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:13.373804 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:13.374253 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:13.375049 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:13.375534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:13.520813 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:13.528992 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1c0c2ea4-71b1-4e32-a89b-62c220063e2e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.164778 May 14 22:25:13.530380 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3932/7324] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:13 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:14.547427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:14.548174 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:14.556287 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:14.561468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:14.561468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:14.561468 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:14.712437 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:14.721437 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-43c42096-c80a-41d3-baf6-9885868fda28 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.178212 May 14 22:25:14.722200 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3933/7325] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:14 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:15.739540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:15.740219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:15.747504 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:15.748849 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:15.749839 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:15.750378 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:15.899978 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:15.910280 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0f8f3bdf-fee1-4878-8187-37ee731df6a9 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.174585 May 14 22:25:15.920632 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3934/7326] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:15 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:16.928538 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:16.929993 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:16.937497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:16.937974 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:16.938930 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:16.939387 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:17.509848 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:17.520251 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7328777e-fa60-4a60-88a0-a66cbf8d502e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.594034 May 14 22:25:17.520251 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3935/7327] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:16 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:18.539852 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:18.540968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:18.549668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:18.550200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:18.550961 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:18.555536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:18.699870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:18.707683 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5ae3e9f2-2a92-4a1e-9c20-3acb368db43d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.171912 May 14 22:25:18.708504 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3936/7328] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:18 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:19.727258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:19.728438 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:19.734142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:19.734615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:19.735422 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:19.735983 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:19.887028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:19.895887 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f59edbd7-67a7-493d-a0c2-769ee77fdda6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.173407 May 14 22:25:19.896904 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3937/7329] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:19 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:20.915270 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:20.917171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:20.925943 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:20.926702 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:20.927531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:20.928154 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:21.091096 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:21.099729 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f1307379-04a6-4055-b066-ddcfdaa4d87b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.188696 May 14 22:25:21.100422 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3938/7330] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:20 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:22.118389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:22.119046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:22.126924 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:22.127410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:22.128237 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:22.128748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:22.263389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:22.271000 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6de8780d-afa5-4756-90ac-196e58792899 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.156838 May 14 22:25:22.271606 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3939/7331] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:22 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:23.288443 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:23.289068 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:23.296688 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:23.297161 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:23.297940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:23.298396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:23.432250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:23.440401 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-575e4397-6d92-456b-b353-72f388bbd373 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.155991 May 14 22:25:23.440981 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3940/7332] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:23 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:24.457944 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:24.458614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:24.465430 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:24.465893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:24.467246 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:24.467732 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:24.597675 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:24.605192 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-983aee37-3460-4de9-9c8b-54155bb6bb8e tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.151395 May 14 22:25:24.605767 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3941/7333] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:24 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:25:25.622648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:25.623428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:25.630451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:25.630920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:25.631789 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:25.632232 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:25.770407 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:25.778368 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e069ed39-fe9d-4364-ba18-85a28ca18836 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.159737 May 14 22:25:25.779514 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3942/7334] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:25 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:25.784031 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d0995214-0961-416b-b960-cd0dbc94b040 req-7c00d594-f1be-4764-b86b-723a6151a464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "name": "network-vif-plugged", "status": "completed", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:25:25.791806 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d0995214-0961-416b-b960-cd0dbc94b040 req-7c00d594-f1be-4764-b86b-723a6151a464 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:25.792535 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d0995214-0961-416b-b960-cd0dbc94b040 req-7c00d594-f1be-4764-b86b-723a6151a464 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:25.804023 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d0995214-0961-416b-b960-cd0dbc94b040 req-7c00d594-f1be-4764-b86b-723a6151a464 service nova] Creating event network-vif-plugged:9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01 for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e on nch2-master-1 May 14 22:25:25.813812 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d0995214-0961-416b-b960-cd0dbc94b040 req-7c00d594-f1be-4764-b86b-723a6151a464 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028592 May 14 22:25:25.813812 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3943/7335] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:25:26.797753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:26.798484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:26.805565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:26.806042 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:26.806841 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:26.807299 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:26.950461 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:26.958138 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b8a6b7da-ef12-413c-8def-db14d82264ad tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.165081 May 14 22:25:26.958616 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3944/7336] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:26 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:25:27.975950 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:27.976625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:27.984219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:27.984692 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:27.985577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:27.986033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:28.127303 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:28.134979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-088a1725-d012-4cdb-a32c-b9a5e29edccf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1688 microversion: 2.1 time: 0.163127 May 14 22:25:28.135582 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3945/7337] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:27 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:25:29.152488 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:25:29.153180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:25:29.160910 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:29.161409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:29.162228 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:25:29.162718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:25:29.296358 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:25:29.303997 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-665dfb23-2129-4fba-8610-282a041ba760 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1675 microversion: 2.1 time: 0.155363 May 14 22:25:29.304603 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3946/7338] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:25:29 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:39.920125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:39.920759 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:39.928554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:39.929281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:39.931046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:39.931563 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:39.960001 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:26:40.210512 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5cbc3fc6-7d31-4d9b-a7bb-f457542d1b0c tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 204 len: 0 microversion: 2.1 time: 0.295463 May 14 22:26:40.211249 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3947/7339] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:26:39 2022] DELETE /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:26:40.273457 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-888d6267-6c5f-4b2f-9c58-4e05a8e8aa40 req-074bea4d-73ab-4caf-9833-f6fa39439823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:26:40.281649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-888d6267-6c5f-4b2f-9c58-4e05a8e8aa40 req-074bea4d-73ab-4caf-9833-f6fa39439823 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:40.282376 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-888d6267-6c5f-4b2f-9c58-4e05a8e8aa40 req-074bea4d-73ab-4caf-9833-f6fa39439823 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:40.294245 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-888d6267-6c5f-4b2f-9c58-4e05a8e8aa40 req-074bea4d-73ab-4caf-9833-f6fa39439823 service nova] Creating event network-changed:9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01 for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e on nch2-master-1 May 14 22:26:40.299852 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-888d6267-6c5f-4b2f-9c58-4e05a8e8aa40 req-074bea4d-73ab-4caf-9833-f6fa39439823 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087147 May 14 22:26:40.300560 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3948/7340] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:26:40.305585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:40.306308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:40.312541 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:40.313026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:40.313905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:40.314368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:40.460416 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:40.466872 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5642f9c5-681f-4c04-8582-cb22bdaa089d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.165132 May 14 22:26:40.467445 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3949/7341] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:40 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:26:41.486035 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:41.486748 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:41.493716 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:41.494183 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:41.494960 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:41.495412 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:41.738875 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:41.746452 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5319ceae-3b9a-406e-8dc9-deae306c186d tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1681 microversion: 2.1 time: 0.264970 May 14 22:26:41.747273 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3950/7342] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:41 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1681 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:42.315709 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-be4f7063-fd91-48dc-b19a-44f6f9ebae54 req-a95629b9-66bf-4dec-b564-ccb73b036292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e", "name": "network-vif-deleted", "tag": "9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:26:42.324028 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-be4f7063-fd91-48dc-b19a-44f6f9ebae54 req-a95629b9-66bf-4dec-b564-ccb73b036292 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:42.324439 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-be4f7063-fd91-48dc-b19a-44f6f9ebae54 req-a95629b9-66bf-4dec-b564-ccb73b036292 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:42.338948 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-be4f7063-fd91-48dc-b19a-44f6f9ebae54 req-a95629b9-66bf-4dec-b564-ccb73b036292 service nova] Creating event network-vif-deleted:9bea71fc-6f8d-4ee1-ab7f-aa45aec17f01 for instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e on nch2-master-1 May 14 22:26:42.343752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-be4f7063-fd91-48dc-b19a-44f6f9ebae54 req-a95629b9-66bf-4dec-b564-ccb73b036292 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033145 May 14 22:26:42.344389 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3951/7343] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:26:42.765455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:42.766176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:42.775176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:42.775686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:42.776486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:42.776940 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:42.810201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:42.810600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:42.811074 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lazy-loading 'fault' on Instance uuid 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:26:42.854869 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:42.862766 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-1f41fa35-bf2b-4d3e-af12-acbb2f9b2126 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 200 len: 1336 microversion: 2.1 time: 0.102297 May 14 22:26:42.863361 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3952/7344] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:42 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 1336 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:43.880417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:43.881102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:43.888038 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:43.888516 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:43.889294 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:43.889787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:43.905070 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] HTTP exception thrown: Instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e could not be found. May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Request method failure captured: May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e HTTP/1.1 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCueJNWrgPMmjeWl42Bc1f_F98_FRZrHqL58uQhLEeH3dxn8pOV4ayueg3A35hwgiduVdfFzTu_8lJWMeU_UIh7yIEvKXw7TZJxmeBeAeg8-cQ3RKb70FNmrJVcMKbNXySsKbLrleXtgORfErt1QcivFxkhbVcbEUgQ6TOpnV8lsJWU May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a339e577d4bb4a4d8bc280b4edab9ef8 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestShelveInstance-207090090 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a339e577d4bb4a4d8bc280b4edab9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a339e577d4bb4a4d8bc280b4edab9ef8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a339e577d4bb4a4d8bc280b4edab9ef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a339e577d4bb4a4d8bc280b4edab9ef8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestShelveInstance-207090090 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a339e577d4bb4a4d8bc280b4edab9ef8 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestShelveInstance-207090090 May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestShelveInstance-207090090-project May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b3ec4b155d344282909459de93091eee May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestShelveInstance-207090090-project May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e could not be found. May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e'} May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e could not be found. May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e could not be found. May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:26:43.906779 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e could not be found. May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Returning 404 to user: Instance 14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:26:43.912152 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0954e93a-a511-4a8a-9e84-e2140ade18b4 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e" status: 404 len: 111 microversion: 2.1 time: 0.031906 May 14 22:26:43.913948 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3953/7345] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:43 2022] GET /compute/v2.1/servers/14a3c5ce-c3d9-4551-ba1f-6e9d692fc54e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:26:44.169592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aa66dcec-7e49-4f93-a4b5-46338865d731 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '.version_select at 0x7fb1a767d820>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:44.251367 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aa66dcec-7e49-4f93-a4b5-46338865d731 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1811719576" status: 202 len: 0 microversion: 2.1 time: 0.085966 May 14 22:26:44.252008 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3954/7346] 10.222.0.52 () {58 vars in 1253 bytes} [Sat May 14 22:26:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1811719576 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:26:44.276972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-9269a4cf-8a52-4b8e-8c20-6059d9df27be tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Action: 'create', calling method: .version_select at 0x7fb1b40e55e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-479039676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqITi7Rx/tSMBLU18Y+VA8g2XCbk/UGtz/RJeq4OUI6MpTvZb38jrb7F4k0a3PP0ORO5OHG0oFlhEsi8xHAegeYbLGDdvEjDr8aGBCOgCF6gE886XIR4xeqy7e2tWnJ9A=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:26:44.292065 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9269a4cf-8a52-4b8e-8c20-6059d9df27be tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:26:44.297605 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-9269a4cf-8a52-4b8e-8c20-6059d9df27be tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for user b3ec4b155d344282909459de93091eee and project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:26:44.382623 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-9269a4cf-8a52-4b8e-8c20-6059d9df27be tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.109616 May 14 22:26:44.383236 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3955/7347] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:26:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:26:50.053258 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1786932552", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-479039676", "security_groups": [{"name": "tempest-secgroup-smoke-137591914"}], "networks": [{"uuid": "8f586cab-f67f-42d7-b347-7d19c0252875"}], "block_device_mapping_v2": [{"uuid": "e821e22e-91d9-4342-8936-37eac17a4aee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:26:50.163124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] validate_networks() for [('8f586cab-f67f-42d7-b347-7d19c0252875', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:26:50.540490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:26:50.540941 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:26:50.543102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:26:50.543102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:26:50.543102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:26:50.551701 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:50.552176 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:50.553011 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:50.553514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:50.573315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:26:50.578976 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Getting quotas for user b3ec4b155d344282909459de93091eee and project a339e577d4bb4a4d8bc280b4edab9ef8. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:26:50.638410 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:26:50.640638 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e821e22e-91d9-4342-8936-37eac17a4aee',volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:26:51.028892 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0531aa92-b2e1-4b5b-b8fb-82f264923e1a tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.980961 May 14 22:26:51.029549 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3956/7348] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:26:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:26:51.039857 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aef0a494-2e52-4ab8-8701-8e60679f0432 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:51.040489 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aef0a494-2e52-4ab8-8701-8e60679f0432 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:51.101122 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aef0a494-2e52-4ab8-8701-8e60679f0432 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:51.108153 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aef0a494-2e52-4ab8-8701-8e60679f0432 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1088 microversion: 2.1 time: 0.071990 May 14 22:26:51.117904 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3957/7349] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:51 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1088 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:52.125915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:52.126592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:52.134004 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:52.134476 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:52.135275 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:52.135763 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:52.198234 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:52.205831 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4a867ecf-faef-484a-9548-65828b064289 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1130 microversion: 2.1 time: 0.083935 May 14 22:26:52.206604 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3958/7350] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:52 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1130 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:26:53.223862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:53.224900 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:53.232003 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:53.232546 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:53.233549 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:53.234091 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:53.305745 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:53.313513 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-dcdfb01d-3340-47ee-b897-68a738256e99 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1204 microversion: 2.1 time: 0.094288 May 14 22:26:53.314142 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3959/7351] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:53 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1204 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:54.336729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:54.337385 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:54.346046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:54.346520 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:54.347321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:54.348630 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:54.542186 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:54.550249 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4f636adb-232a-47a9-aeac-39cabea6a3b2 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1271 microversion: 2.1 time: 0.222075 May 14 22:26:54.551995 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3960/7352] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:54 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:54.687098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f4d92f63-9456-47a8-8751-3ad3bf7347f5 req-c901cd3e-6789-4ce3-8d72-c2fd789c2fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1807a9cf-27e1-4e53-9cb5-241ee06dbf42", "tag": "51e78f77-ae8a-4665-80f1-339f2dbd48de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:26:54.695552 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f4d92f63-9456-47a8-8751-3ad3bf7347f5 req-c901cd3e-6789-4ce3-8d72-c2fd789c2fd9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:54.696023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f4d92f63-9456-47a8-8751-3ad3bf7347f5 req-c901cd3e-6789-4ce3-8d72-c2fd789c2fd9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:54.708133 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f4d92f63-9456-47a8-8751-3ad3bf7347f5 req-c901cd3e-6789-4ce3-8d72-c2fd789c2fd9 service nova] Creating event network-changed:51e78f77-ae8a-4665-80f1-339f2dbd48de for instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 on nch1-master-1 May 14 22:26:54.713164 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f4d92f63-9456-47a8-8751-3ad3bf7347f5 req-c901cd3e-6789-4ce3-8d72-c2fd789c2fd9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030663 May 14 22:26:54.714271 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3961/7353] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:26:55.569374 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:55.571032 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:55.580794 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:55.581267 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:55.582124 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:55.582578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:55.721327 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:55.729997 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a4b88c96-137a-4828-9fde-f968cb84f7cf tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1259 microversion: 2.1 time: 0.165920 May 14 22:26:55.730576 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3962/7354] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:55 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:56.749667 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:56.750355 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:56.757800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:56.758273 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:56.759059 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:56.759539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:56.898723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:56.906264 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-282fa663-54fa-487d-a285-d57da489f4a0 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1259 microversion: 2.1 time: 0.160553 May 14 22:26:56.906853 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3963/7355] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:56 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:57.923616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:57.924296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:57.931565 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:57.932039 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:57.932834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:57.933296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:58.063354 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:58.071137 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-96613ba6-f503-4a2e-8e17-7462faf96a46 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1259 microversion: 2.1 time: 0.151461 May 14 22:26:58.079489 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3964/7356] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:57 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:26:59.088392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:26:59.089029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:26:59.096044 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:59.096519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:59.097431 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:26:59.097894 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:26:59.231256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:26:59.238782 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e5148c9d-93dd-41a2-a069-6c1448a570a7 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1259 microversion: 2.1 time: 0.154306 May 14 22:26:59.239360 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3965/7357] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:26:59 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:27:00.256281 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:27:00.256995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:27:00.263874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:00.264348 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:00.265166 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:00.265625 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:00.396622 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:27:00.404213 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-92716b42-fd59-4c13-8541-43098bf25384 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1259 microversion: 2.1 time: 0.152542 May 14 22:27:00.408040 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3966/7358] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:27:00 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:27:01.422396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:27:01.423033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:27:01.430551 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:01.431023 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:01.431847 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:01.432333 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:01.569332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:27:01.576737 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e5b9bbbc-7479-419d-ab91-1695228e246f tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1259 microversion: 2.1 time: 0.158844 May 14 22:27:01.577313 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3967/7359] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:27:01 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:27:02.277673 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-0cdac138-1695-4bb5-9212-80a84a3d35ea req-b784a4d3-2a38-420d-8632-c69bc5599c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1807a9cf-27e1-4e53-9cb5-241ee06dbf42", "name": "network-vif-plugged", "status": "completed", "tag": "51e78f77-ae8a-4665-80f1-339f2dbd48de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:27:02.287204 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0cdac138-1695-4bb5-9212-80a84a3d35ea req-b784a4d3-2a38-420d-8632-c69bc5599c73 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:02.287698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-0cdac138-1695-4bb5-9212-80a84a3d35ea req-b784a4d3-2a38-420d-8632-c69bc5599c73 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:02.299435 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-0cdac138-1695-4bb5-9212-80a84a3d35ea req-b784a4d3-2a38-420d-8632-c69bc5599c73 service nova] Creating event network-vif-plugged:51e78f77-ae8a-4665-80f1-339f2dbd48de for instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 on nch1-master-1 May 14 22:27:02.304955 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-0cdac138-1695-4bb5-9212-80a84a3d35ea req-b784a4d3-2a38-420d-8632-c69bc5599c73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086280 May 14 22:27:02.305573 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3968/7360] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:27:02.594016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:27:02.594747 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:27:02.602057 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:02.602544 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:02.603337 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:02.603838 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:02.749866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:27:02.757563 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0708bc7e-9ff4-4142-8a15-6c7e6bd4a696 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1259 microversion: 2.1 time: 0.167906 May 14 22:27:02.758147 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3969/7361] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:27:02 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:27:03.774559 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:27:03.775242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:27:03.782921 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:03.783389 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:03.784298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:03.784760 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:03.919733 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:27:03.928109 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-022315d7-0ee7-4969-afa5-ddaf2cadfc33 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1443 microversion: 2.1 time: 0.157141 May 14 22:27:03.928704 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3970/7362] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:27:03 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:27:03.943992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:27:03.944627 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:27:03.950626 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:03.951095 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:03.951918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:03.952380 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:04.079164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:27:04.087399 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c64f2e3f-aff8-485f-a333-e7b7ec7a40f6 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1443 microversion: 2.1 time: 0.147216 May 14 22:27:04.088019 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3971/7363] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:27:03 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1443 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:27:05.922123 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-91faa420-d269-483d-b73c-180c5ac18c1f req-37809aee-444c-412a-98b9-a1f48432056b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1807a9cf-27e1-4e53-9cb5-241ee06dbf42", "tag": "51e78f77-ae8a-4665-80f1-339f2dbd48de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:27:05.932576 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-91faa420-d269-483d-b73c-180c5ac18c1f req-37809aee-444c-412a-98b9-a1f48432056b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:27:05.933308 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-91faa420-d269-483d-b73c-180c5ac18c1f req-37809aee-444c-412a-98b9-a1f48432056b service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:27:05.945540 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-91faa420-d269-483d-b73c-180c5ac18c1f req-37809aee-444c-412a-98b9-a1f48432056b service nova] Creating event network-changed:51e78f77-ae8a-4665-80f1-339f2dbd48de for instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 on nch1-master-1 May 14 22:27:05.950643 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-91faa420-d269-483d-b73c-180c5ac18c1f req-37809aee-444c-412a-98b9-a1f48432056b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033122 May 14 22:27:05.951267 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3972/7364] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:29:59.161706 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:29:59.162406 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:29:59.254826 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:29:59.254991 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:29:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:30:13.851592 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:30:13.852241 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:30:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:30:22.020121 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 22:30:22.020947 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c695e059-b959-4273-91a2-45f2e7e76964] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 22:30:22.074497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8f9e6295-8bde-40fc-a656-a4ce09127a11 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:30:22.076164 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8f9e6295-8bde-40fc-a656-a4ce09127a11 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:22.082648 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f9e6295-8bde-40fc-a656-a4ce09127a11 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:22.083126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f9e6295-8bde-40fc-a656-a4ce09127a11 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:22.083948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f9e6295-8bde-40fc-a656-a4ce09127a11 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:22.084481 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f9e6295-8bde-40fc-a656-a4ce09127a11 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:23.031788 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] [c695e059-b959-4273-91a2-45f2e7e76964] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39772. May 14 22:30:23.032582 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 39768. May 14 22:30:23.036681 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8f9e6295-8bde-40fc-a656-a4ce09127a11 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "POST /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42/action" status: 200 len: 24564 microversion: 2.1 time: 1.018127 May 14 22:30:23.039077 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3973/7365] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:30:22 2022] POST /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42/action => generated 24564 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 14 22:30:24.081493 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:24.082201 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:24.090592 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:24.091055 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:24.092405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:24.092405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:24.121526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:30:24.430630 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ffc65520-af2a-41c3-8c45-1a93f9f31033 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "DELETE /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 204 len: 0 microversion: 2.1 time: 0.353069 May 14 22:30:24.433666 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3974/7366] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:30:24 2022] DELETE /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:30:24.436919 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-f6ed86b0-f83d-4dbe-bd9d-84a9755565ee req-ebc54f3e-2963-48bb-860c-058cdbf1bc0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1807a9cf-27e1-4e53-9cb5-241ee06dbf42", "tag": "51e78f77-ae8a-4665-80f1-339f2dbd48de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:30:24.446491 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f6ed86b0-f83d-4dbe-bd9d-84a9755565ee req-ebc54f3e-2963-48bb-860c-058cdbf1bc0f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:24.446946 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-f6ed86b0-f83d-4dbe-bd9d-84a9755565ee req-ebc54f3e-2963-48bb-860c-058cdbf1bc0f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:24.457979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-f6ed86b0-f83d-4dbe-bd9d-84a9755565ee req-ebc54f3e-2963-48bb-860c-058cdbf1bc0f service nova] Creating event network-changed:51e78f77-ae8a-4665-80f1-339f2dbd48de for instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 on nch1-master-1 May 14 22:30:24.463337 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-f6ed86b0-f83d-4dbe-bd9d-84a9755565ee req-ebc54f3e-2963-48bb-860c-058cdbf1bc0f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 May 14 22:30:24.463973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3975/7367] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:30:24.470728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:24.471455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:24.480641 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:24.482414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:24.482414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:24.482815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:24.679506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:24.688241 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-280c5b43-39a3-47c0-8e72-6113dbabcf45 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1567 microversion: 2.1 time: 0.222924 May 14 22:30:24.688751 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3976/7368] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:24 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:30:25.709214 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:25.709916 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:25.721560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:25.727330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:25.727330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:25.727330 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:25.965427 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:25.974944 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b7b57af6-1f7d-4c8e-9653-8495ba936627 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1567 microversion: 2.1 time: 0.269700 May 14 22:30:25.979111 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3977/7369] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:25 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:30:26.658697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d002ea84-11a6-4150-9af0-adc7980e637d req-c225f416-7f0e-4c0b-abae-1a91cdf123d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1807a9cf-27e1-4e53-9cb5-241ee06dbf42", "name": "network-vif-deleted", "tag": "51e78f77-ae8a-4665-80f1-339f2dbd48de"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:30:26.666797 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d002ea84-11a6-4150-9af0-adc7980e637d req-c225f416-7f0e-4c0b-abae-1a91cdf123d9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:26.667262 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d002ea84-11a6-4150-9af0-adc7980e637d req-c225f416-7f0e-4c0b-abae-1a91cdf123d9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:26.679270 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d002ea84-11a6-4150-9af0-adc7980e637d req-c225f416-7f0e-4c0b-abae-1a91cdf123d9 service nova] Creating event network-vif-deleted:51e78f77-ae8a-4665-80f1-339f2dbd48de for instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 on nch1-master-1 May 14 22:30:26.684994 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d002ea84-11a6-4150-9af0-adc7980e637d req-c225f416-7f0e-4c0b-abae-1a91cdf123d9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029977 May 14 22:30:26.685590 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3978/7370] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:30:26.997843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:26.998992 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:27.005564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:27.006484 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:27.007113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:27.007616 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:27.077698 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3ec4b155d344282909459de93091eee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a339e577d4bb4a4d8bc280b4edab9ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:27.085728 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b515c359-00e4-453a-9d7b-c98a31a2edd5 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 200 len: 1219 microversion: 2.1 time: 0.094083 May 14 22:30:27.086539 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3979/7371] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:26 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:30:28.104018 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:28.104730 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] [instance: 1807a9cf-27e1-4e53-9cb5-241ee06dbf42] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:28.111640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:28.112121 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:28.112920 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:28.113383 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:28.127054 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] HTTP exception thrown: Instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 could not be found. May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Request method failure captured: May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 HTTP/1.1 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigCueJNWrgPMmjeWl42Bc1f_F98_FRZrHqL58uQhLEeH3dxn8pOV4ayueg3A35hwgiduVdfFzTu_8lJWMeU_UIh7yIEvKXw7TZJxmeBeAeg8-cQ3RKb70FNmrJVcMKbNXySsKbLrleXtgORfErt1QcivFxkhbVcbEUgQ6TOpnV8lsJWU May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: a339e577d4bb4a4d8bc280b4edab9ef8 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestShelveInstance-207090090 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a339e577d4bb4a4d8bc280b4edab9ef8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a339e577d4bb4a4d8bc280b4edab9ef8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a339e577d4bb4a4d8bc280b4edab9ef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a339e577d4bb4a4d8bc280b4edab9ef8", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestShelveInstance-207090090 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: a339e577d4bb4a4d8bc280b4edab9ef8 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestShelveInstance-207090090 May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestShelveInstance-207090090-project May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: b3ec4b155d344282909459de93091eee May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestShelveInstance-207090090-project May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 could not be found. May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '1807a9cf-27e1-4e53-9cb5-241ee06dbf42'} May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 could not be found. May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 could not be found. May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:30:28.130486 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 could not be found. May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Returning 404 to user: Instance 1807a9cf-27e1-4e53-9cb5-241ee06dbf42 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-65dccfab-a641-4a2e-a47d-bf14247d1835 tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42" status: 404 len: 111 microversion: 2.1 time: 0.031062 May 14 22:30:28.136084 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3980/7372] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:28 2022] GET /compute/v2.1/servers/1807a9cf-27e1-4e53-9cb5-241ee06dbf42 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:30:28.331939 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d31a1def-34ec-43de-9805-5787c3b2c44b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] Calling method '.version_select at 0x7fb1a77b1dc0>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:28.435746 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d31a1def-34ec-43de-9805-5787c3b2c44b tempest-TestShelveInstance-207090090 tempest-TestShelveInstance-207090090-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-479039676" status: 202 len: 0 microversion: 2.1 time: 0.107843 May 14 22:30:28.436430 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3981/7373] 10.222.0.52 () {58 vars in 1250 bytes} [Sat May 14 22:30:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-479039676 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:30:50.682048 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-704c462b-aa03-4d9f-b54d-9ec267da8a7b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Action: 'create', calling method: .version_select at 0x7fb1a47533a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1877215158", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1sOF4uzT8LSYf1MqzsrEMvoH+0sQCd/dUXcAkoAJEddAPCTOndicL2BEO43icAlCzecTD67EbXiF5FSgsPuQxmZIbNiB7NqofFiThfkHX/qMeuM7jU8UO9oZs6MBdCTw=="}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:30:50.699089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-704c462b-aa03-4d9f-b54d-9ec267da8a7b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Getting quotas for project d2345189dd994ee0adc9391fe9f6856a. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:30:50.704586 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-704c462b-aa03-4d9f-b54d-9ec267da8a7b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Getting quotas for user ccf50d85a6f2498f872254d47d1e70de and project d2345189dd994ee0adc9391fe9f6856a. Resources: {'key_pairs'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:30:50.815388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-704c462b-aa03-4d9f-b54d-9ec267da8a7b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.332514 May 14 22:30:50.816018 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3982/7374] 10.222.0.52 () {60 vars in 1158 bytes} [Sat May 14 22:30:50 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:30:53.199409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1743435550", "imageRef": "b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1877215158", "security_groups": [{"name": "tempest-secgroup-smoke-1265276093"}], "networks": [{"uuid": "9fa141f3-b6eb-4248-a92d-d98a9dd45ae7"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:30:53.309964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] validate_networks() for [('9fa141f3-b6eb-4248-a92d-d98a9dd45ae7', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:30:53.765655 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:30:53.766099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:30:53.766601 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:30:53.767034 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:30:53.767471 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:30:53.776540 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:53.777005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:53.777862 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:53.778321 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:53.795280 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Getting quotas for project d2345189dd994ee0adc9391fe9f6856a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:30:53.800623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Getting quotas for user ccf50d85a6f2498f872254d47d1e70de and project d2345189dd994ee0adc9391fe9f6856a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:30:53.813931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:30:53.816368 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b1b30a17-4fb4-4d05-9f8c-cb82afc1e28e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:30:53.952132 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8f76a5d0-c014-443e-8006-acbe3551ce3a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758172 May 14 22:30:53.952973 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3983/7375] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:30:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:30:53.962316 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-afb55843-5d1d-44fc-89d6-da80196819dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:53.963585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-afb55843-5d1d-44fc-89d6-da80196819dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:54.023268 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-afb55843-5d1d-44fc-89d6-da80196819dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:54.033259 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-afb55843-5d1d-44fc-89d6-da80196819dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1249 microversion: 2.1 time: 0.074560 May 14 22:30:54.034233 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3984/7376] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:53 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1249 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:30:55.053259 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d36a3706-6fef-48e1-afb3-1a6c95f508b7 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:55.055996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d36a3706-6fef-48e1-afb3-1a6c95f508b7 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:55.117323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d36a3706-6fef-48e1-afb3-1a6c95f508b7 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:55.122928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d36a3706-6fef-48e1-afb3-1a6c95f508b7 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1249 microversion: 2.1 time: 0.075766 May 14 22:30:55.123745 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3985/7377] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:55 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:30:56.139918 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:56.140578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:56.148718 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:56.149126 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:56.149938 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:56.151020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:56.216286 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:56.223947 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-4d84f35e-60b6-4fd7-9f1b-d6eb704ada23 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1301 microversion: 2.1 time: 0.088142 May 14 22:30:56.224977 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3986/7378] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:56 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:30:57.241834 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:57.242474 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:57.249631 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:57.250108 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:57.250914 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:57.251382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:57.520768 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:57.528606 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae998a12-e25f-40c6-a2d1-8d2ba103e429 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1375 microversion: 2.1 time: 0.290742 May 14 22:30:57.529198 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3987/7379] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:57 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1375 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:30:58.401643 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-2ea5439f-e568-4f50-bb2b-ee2308281fb2 req-22658002-ea42-4b46-aafb-f660b4c3f2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f91aea-b795-489b-a0fa-38d25ed0ec87", "tag": "d0e8112a-0d9c-4b09-9a04-be02d4535f10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:30:58.410998 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2ea5439f-e568-4f50-bb2b-ee2308281fb2 req-22658002-ea42-4b46-aafb-f660b4c3f2d6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:58.411470 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-2ea5439f-e568-4f50-bb2b-ee2308281fb2 req-22658002-ea42-4b46-aafb-f660b4c3f2d6 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:58.424535 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-2ea5439f-e568-4f50-bb2b-ee2308281fb2 req-22658002-ea42-4b46-aafb-f660b4c3f2d6 service nova] Creating event network-changed:d0e8112a-0d9c-4b09-9a04-be02d4535f10 for instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 on nch2-master-1 May 14 22:30:58.429855 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-2ea5439f-e568-4f50-bb2b-ee2308281fb2 req-22658002-ea42-4b46-aafb-f660b4c3f2d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032213 May 14 22:30:58.430628 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3988/7380] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:30:58.546175 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:58.547568 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:58.554131 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:58.554600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:58.555392 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:58.555871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:58.778046 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:58.789219 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-abbdebce-eb03-446e-88a3-7aa5a78e9f5c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1375 microversion: 2.1 time: 0.247667 May 14 22:30:58.790119 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3989/7381] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:58 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1375 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:30:59.808947 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:30:59.809637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:30:59.816435 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:59.816904 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:59.817686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:30:59.818137 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:30:59.954490 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:30:59.961922 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-7523bd5a-a3b0-41e3-a9ac-79e4880934dd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1375 microversion: 2.1 time: 0.157411 May 14 22:30:59.962500 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3990/7382] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:30:59 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:31:00.979966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:31:00.980603 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:31:00.987672 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:00.988375 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:00.989213 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:00.989634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:01.133205 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:31:01.141771 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-98226b13-7348-4121-ad9d-ff7a6673bc64 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1375 microversion: 2.1 time: 0.166446 May 14 22:31:01.142407 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3991/7383] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:31:00 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:31:02.164414 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:31:02.165075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:31:02.173160 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:02.173640 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:02.174441 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:02.175263 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:02.312966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:31:02.320642 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-edc36712-a959-412e-8041-0cf53fd6327f tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1375 microversion: 2.1 time: 0.160271 May 14 22:31:02.321233 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3992/7384] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:31:02 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:31:03.125222 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-b36b7944-8fe8-4b20-9ba2-6ec3e6f7bcc9 req-d7cb111d-0bf7-4a4b-af98-817bbe47101d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f91aea-b795-489b-a0fa-38d25ed0ec87", "name": "network-vif-plugged", "status": "completed", "tag": "d0e8112a-0d9c-4b09-9a04-be02d4535f10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:31:03.133731 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b36b7944-8fe8-4b20-9ba2-6ec3e6f7bcc9 req-d7cb111d-0bf7-4a4b-af98-817bbe47101d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:03.134239 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-b36b7944-8fe8-4b20-9ba2-6ec3e6f7bcc9 req-d7cb111d-0bf7-4a4b-af98-817bbe47101d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:03.145704 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-b36b7944-8fe8-4b20-9ba2-6ec3e6f7bcc9 req-d7cb111d-0bf7-4a4b-af98-817bbe47101d service nova] Creating event network-vif-plugged:d0e8112a-0d9c-4b09-9a04-be02d4535f10 for instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 on nch2-master-1 May 14 22:31:03.151388 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-b36b7944-8fe8-4b20-9ba2-6ec3e6f7bcc9 req-d7cb111d-0bf7-4a4b-af98-817bbe47101d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029495 May 14 22:31:03.152024 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3993/7385] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:31:03.338932 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:31:03.339764 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:31:03.346094 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:03.346564 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:03.347353 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:03.347870 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:03.479296 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:31:03.486752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ba1dc526-7424-46ad-929f-2d1109b69c9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1375 microversion: 2.1 time: 0.152956 May 14 22:31:03.487332 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3994/7386] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:31:03 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:31:04.504182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:31:04.504895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:31:04.512020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:04.512506 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:04.513302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:04.513767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:04.656531 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:31:04.663967 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ae9fff0e-62e2-44c6-8399-822973c32448 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1375 microversion: 2.1 time: 0.163675 May 14 22:31:04.664549 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3995/7387] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:31:04 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:31:05.681153 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:31:05.682773 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:31:05.689647 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:05.702705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:05.702705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:05.702705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:05.823674 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:31:05.831203 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b12b3dac-40b9-498d-b67a-8c40831afb9b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1559 microversion: 2.1 time: 0.153969 May 14 22:31:05.831815 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3996/7388] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:31:05 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:31:05.847802 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:31:05.848465 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:31:05.854966 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:05.855432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:05.856250 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:05.856713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:05.991171 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:31:05.998954 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-91eb33cc-8cff-409d-9666-1754d56c79f2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1559 microversion: 2.1 time: 0.154688 May 14 22:31:05.999557 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3997/7389] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:31:05 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:31:08.100398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-12769dfe-2c3f-4c00-8df5-152113290ec8 req-cde9eea3-c21e-4110-a67a-c11ff1492ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f91aea-b795-489b-a0fa-38d25ed0ec87", "tag": "d0e8112a-0d9c-4b09-9a04-be02d4535f10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:31:08.109002 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-12769dfe-2c3f-4c00-8df5-152113290ec8 req-cde9eea3-c21e-4110-a67a-c11ff1492ff0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:31:08.109570 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-12769dfe-2c3f-4c00-8df5-152113290ec8 req-cde9eea3-c21e-4110-a67a-c11ff1492ff0 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:31:08.122097 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-12769dfe-2c3f-4c00-8df5-152113290ec8 req-cde9eea3-c21e-4110-a67a-c11ff1492ff0 service nova] Creating event network-changed:d0e8112a-0d9c-4b09-9a04-be02d4535f10 for instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 on nch2-master-1 May 14 22:31:08.127531 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-12769dfe-2c3f-4c00-8df5-152113290ec8 req-cde9eea3-c21e-4110-a67a-c11ff1492ff0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090843 May 14 22:31:08.128263 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3998/7390] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:33:02.308524 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c695e059-b959-4273-91a2-45f2e7e76964] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 14 22:33:02.309379 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] AMQP server on 10.222.0.52:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 14 22:33:02.313770 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-b2f66b5a-ace4-435a-9c16-58c5b00d5195 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-56770088"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:33:02.314906 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-b2f66b5a-ace4-435a-9c16-58c5b00d5195 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:02.321345 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2f66b5a-ace4-435a-9c16-58c5b00d5195 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:02.321814 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2f66b5a-ace4-435a-9c16-58c5b00d5195 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:02.322597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2f66b5a-ace4-435a-9c16-58c5b00d5195 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:02.323054 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-b2f66b5a-ace4-435a-9c16-58c5b00d5195 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:02.789117 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-b2f66b5a-ace4-435a-9c16-58c5b00d5195 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "POST /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87/action" status: 202 len: 0 microversion: 2.1 time: 0.482529 May 14 22:33:02.789793 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 3999/7391] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:33:02 2022] POST /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 14 22:33:09.608746 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] [c695e059-b959-4273-91a2-45f2e7e76964] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 40144. May 14 22:33:09.610752 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a21905d-c92a-4a9e-9923-5b575f45c267] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 40146. May 14 22:33:09.660312 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-23e7c241-1b68-456f-acd6-dcf16df1451c req-6422829b-c0fb-4558-850b-c477ff983c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f91aea-b795-489b-a0fa-38d25ed0ec87", "name": "network-vif-plugged", "status": "completed", "tag": "d0e8112a-0d9c-4b09-9a04-be02d4535f10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:33:09.671729 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-23e7c241-1b68-456f-acd6-dcf16df1451c req-6422829b-c0fb-4558-850b-c477ff983c73 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:09.672127 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-23e7c241-1b68-456f-acd6-dcf16df1451c req-6422829b-c0fb-4558-850b-c477ff983c73 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:09.684979 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-23e7c241-1b68-456f-acd6-dcf16df1451c req-6422829b-c0fb-4558-850b-c477ff983c73 service nova] Creating event network-vif-plugged:d0e8112a-0d9c-4b09-9a04-be02d4535f10 for instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 on nch2-master-1 May 14 22:33:09.690564 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-23e7c241-1b68-456f-acd6-dcf16df1451c req-6422829b-c0fb-4558-850b-c477ff983c73 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102611 May 14 22:33:09.691363 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4000/7392] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:33:17.403995 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1323856523", "imageRef": "f89bcfed-235c-4927-9dae-ca49d886d6ab", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1877215158", "security_groups": [{"name": "tempest-secgroup-smoke-1265276093"}], "networks": [{"uuid": "9fa141f3-b6eb-4248-a92d-d98a9dd45ae7"}]}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:33:17.557139 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.network.neutron [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] validate_networks() for [('9fa141f3-b6eb-4248-a92d-d98a9dd45ae7', None, None, None, None, None)] {{(pid=130637) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 14 22:33:18.037519 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Flavor limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 14 22:33:18.037962 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Image limits 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 14 22:33:18.038458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Flavor pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 14 22:33:18.038886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Image pref 0:0:0 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 14 22:33:18.039317 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.virt.hardware [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130637) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 14 22:33:18.049369 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:18.049824 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:18.053290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:18.053290 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:18.068550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Getting quotas for project d2345189dd994ee0adc9391fe9f6856a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 14 22:33:18.073786 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.quota [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Getting quotas for user ccf50d85a6f2498f872254d47d1e70de and project d2345189dd994ee0adc9391fe9f6856a. Resources: {'cores', 'ram', 'instances'} {{(pid=130637) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 14 22:33:18.086399 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Going to run 1 instances... {{(pid=130637) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 14 22:33:18.088984 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f89bcfed-235c-4927-9dae-ca49d886d6ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130637) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 14 22:33:18.208210 ncdv-master-1 devstack@n-api.service[130637]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [09734ecc-08e3-483c-a1fe-e05b8ab6055a] AMQP server on 10.222.0.52:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 14 22:33:19.170386 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:33:19.171278 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:33:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.52) !!! May 14 22:33:19.215309 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [09734ecc-08e3-483c-a1fe-e05b8ab6055a] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 40224. May 14 22:33:19.219378 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-c95ce304-76e9-410b-8cfb-d590afb11bb1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.821010 May 14 22:33:19.220089 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4001/7393] 10.222.0.52 () {60 vars in 1146 bytes} [Sat May 14 22:33:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 14 22:33:19.229829 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-30d80769-2b84-4075-acda-ba211711195e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:19.230517 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-30d80769-2b84-4075-acda-ba211711195e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:19.283529 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-30d80769-2b84-4075-acda-ba211711195e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:19.290172 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-30d80769-2b84-4075-acda-ba211711195e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1249 microversion: 2.1 time: 0.064057 May 14 22:33:19.290776 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4002/7394] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:19 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1249 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:20.307458 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-01d17c0d-e6e3-4677-9253-d552d6ebdbb0 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:20.308714 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-01d17c0d-e6e3-4677-9253-d552d6ebdbb0 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:20.363451 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-01d17c0d-e6e3-4677-9253-d552d6ebdbb0 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:20.370128 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-01d17c0d-e6e3-4677-9253-d552d6ebdbb0 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1249 microversion: 2.1 time: 0.066602 May 14 22:33:20.370827 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4003/7395] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:20 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1249 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:33:21.387871 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:21.388515 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:21.395780 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:21.396256 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:21.397056 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:21.397514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:21.459637 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:21.467707 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d7ead97c-7a26-48da-ac1e-3733a6d472f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1253 microversion: 2.1 time: 0.084739 May 14 22:33:21.468288 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4004/7396] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:21 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:21.556996 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-bc0e8222-0f1d-4a53-ac3c-4b59e0dd698c req-effd8061-0bd9-40ca-a02f-f32f39d0e33e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f91aea-b795-489b-a0fa-38d25ed0ec87", "name": "network-vif-unplugged", "status": "completed", "tag": "d0e8112a-0d9c-4b09-9a04-be02d4535f10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:33:21.565808 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-bc0e8222-0f1d-4a53-ac3c-4b59e0dd698c req-effd8061-0bd9-40ca-a02f-f32f39d0e33e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:21.568734 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-bc0e8222-0f1d-4a53-ac3c-4b59e0dd698c req-effd8061-0bd9-40ca-a02f-f32f39d0e33e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:21.577481 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-bc0e8222-0f1d-4a53-ac3c-4b59e0dd698c req-effd8061-0bd9-40ca-a02f-f32f39d0e33e service nova] Creating event network-vif-unplugged:d0e8112a-0d9c-4b09-9a04-be02d4535f10 for instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 on nch2-master-1 May 14 22:33:21.584549 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-bc0e8222-0f1d-4a53-ac3c-4b59e0dd698c req-effd8061-0bd9-40ca-a02f-f32f39d0e33e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031201 May 14 22:33:21.585163 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4005/7397] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:33:22.486496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:22.487384 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:22.493767 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:22.494242 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:22.495033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:22.496142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:22.564081 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:22.571808 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5486e5f8-cdc3-46c3-a46c-35a7f5bcdaba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1253 microversion: 2.1 time: 0.090469 May 14 22:33:22.572331 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4006/7398] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:22 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1253 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:23.589972 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:23.590815 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:23.597585 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:23.598061 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:23.598860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:23.599320 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:23.678968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:23.687323 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0d36ab1a-eab8-4a40-9454-a42cf4c19da3 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1319 microversion: 2.1 time: 0.101868 May 14 22:33:23.687968 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4007/7399] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:23 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:24.705860 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:24.707359 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:24.716227 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:24.716726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:24.717623 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:24.718155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:24.873191 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:24.882106 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-a56ebca0-d035-478c-aace-abc4470fed7a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.180537 May 14 22:33:24.892236 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4008/7400] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:24 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:25.906102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:25.906102 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:25.913020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:25.913417 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:25.914217 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:25.914697 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:26.060381 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:26.068419 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-82fe5e77-7ebb-44ba-a91c-d08ff912f950 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.170177 May 14 22:33:26.069011 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4009/7401] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:25 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:33:27.085705 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:27.086366 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:27.094142 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:27.094614 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:27.095413 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:27.096112 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:27.242200 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:27.251381 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-aedfb11f-fa8f-4454-aa72-a0083e2b7015 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.169451 May 14 22:33:27.253398 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4010/7402] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:27 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:28.270089 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:28.271547 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:28.279432 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:28.279931 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:28.280726 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:28.281182 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:28.425463 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:28.434031 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-575e2ae1-eb5c-40e3-b51f-b6a12efed992 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.169028 May 14 22:33:28.434630 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4011/7403] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:28 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:29.455534 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:29.457793 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:29.470521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:29.474064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:29.474064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:29.474064 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:29.685107 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:29.696083 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d8b47e4a-a1ff-4d20-90eb-03cc0d04f9ed tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.249053 May 14 22:33:29.704397 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4012/7404] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:29 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:33:30.639189 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-df337f08-53b9-4fbc-9e7d-812ca59aa885 req-65d0305b-bbde-4a2c-9bc5-31db28569c60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514867a7-9f66-4419-8f1f-954d5cda68bf", "tag": "8b686020-d3a6-4bd1-94f4-8dca867ca4f9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:33:30.661905 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-df337f08-53b9-4fbc-9e7d-812ca59aa885 req-65d0305b-bbde-4a2c-9bc5-31db28569c60 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:30.662741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-df337f08-53b9-4fbc-9e7d-812ca59aa885 req-65d0305b-bbde-4a2c-9bc5-31db28569c60 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:30.695049 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-df337f08-53b9-4fbc-9e7d-812ca59aa885 req-65d0305b-bbde-4a2c-9bc5-31db28569c60 service nova] Creating event network-changed:8b686020-d3a6-4bd1-94f4-8dca867ca4f9 for instance 514867a7-9f66-4419-8f1f-954d5cda68bf on nch1-master-1 May 14 22:33:30.702304 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-df337f08-53b9-4fbc-9e7d-812ca59aa885 req-65d0305b-bbde-4a2c-9bc5-31db28569c60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238852 May 14 22:33:30.712107 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4013/7405] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:33:30.722098 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:30.723099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:30.747168 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:30.747990 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:30.748969 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:30.749600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:30.914304 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:30.924001 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0302a560-a53e-4abb-beb2-083c1fe579ec tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.206098 May 14 22:33:30.924607 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4014/7406] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:30 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:33:31.942926 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:31.943597 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:31.951240 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:31.951737 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:31.952530 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:31.952989 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:32.091005 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:32.098607 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0a46a49b-c3fc-41e6-b01c-e7d0f487abf9 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.159739 May 14 22:33:32.099201 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4015/7407] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:31 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:33.115391 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:33.116075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:33.123315 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:33.123800 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:33.124577 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:33.125029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:33.254964 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:33.262622 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-54824ac0-fabf-40c6-91a9-d26553f9843b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.151152 May 14 22:33:33.266374 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4016/7408] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:33 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:34.280020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:34.280676 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:34.288037 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:34.290169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:34.290169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:34.290169 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:34.420405 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:34.428102 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e5231fa8-3bb1-4d40-92fa-00fb86aeb6f4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.152795 May 14 22:33:34.428686 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4017/7409] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:34 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:35.445129 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:35.445781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:35.452831 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:35.454118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:35.454118 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:35.454526 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:35.588265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:35.595688 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cc62b3dd-83d5-420c-8807-1f8d79d4e64c tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.154466 May 14 22:33:35.596275 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4018/7410] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:35 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:36.613289 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:36.614888 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:36.623707 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:36.624668 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:36.625728 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:36.626411 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:36.774219 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:36.783667 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-2ce94784-f6af-4770-9453-15bcdba2efbd tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.174814 May 14 22:33:36.784358 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4019/7411] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:36 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:37.800895 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:37.801578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:37.808332 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:37.809298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:37.810099 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:37.810550 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:37.952496 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:37.959897 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-ccee0dbd-bdc2-49b1-91c6-9c73ce32bf14 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.162961 May 14 22:33:37.960471 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4020/7412] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:37 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:38.128864 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1f1008fc-624d-4ec4-a85d-ac656a0705ae req-549c2580-e009-4b49-a69a-ac8ea8875d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514867a7-9f66-4419-8f1f-954d5cda68bf", "name": "network-vif-plugged", "status": "completed", "tag": "8b686020-d3a6-4bd1-94f4-8dca867ca4f9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:33:38.137720 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1f1008fc-624d-4ec4-a85d-ac656a0705ae req-549c2580-e009-4b49-a69a-ac8ea8875d9f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:38.138209 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1f1008fc-624d-4ec4-a85d-ac656a0705ae req-549c2580-e009-4b49-a69a-ac8ea8875d9f service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:38.149355 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1f1008fc-624d-4ec4-a85d-ac656a0705ae req-549c2580-e009-4b49-a69a-ac8ea8875d9f service nova] Creating event network-vif-plugged:8b686020-d3a6-4bd1-94f4-8dca867ca4f9 for instance 514867a7-9f66-4419-8f1f-954d5cda68bf on nch1-master-1 May 14 22:33:38.155098 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1f1008fc-624d-4ec4-a85d-ac656a0705ae req-549c2580-e009-4b49-a69a-ac8ea8875d9f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030051 May 14 22:33:38.155765 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4021/7413] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:33:38.978893 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:38.979657 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:38.985885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:38.986350 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:38.987125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:38.987615 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:39.120020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:39.128025 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7c5470f-2e12-4847-bc18-f97207b89cd2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1375 microversion: 2.1 time: 0.154178 May 14 22:33:39.128608 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4022/7414] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:38 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:40.146063 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:40.207853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:40.207853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:40.207853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:40.207853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:40.207853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:40.297525 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:40.306023 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-f6bb0652-da67-4cb4-b04b-9723c2f77486 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1559 microversion: 2.1 time: 0.164391 May 14 22:33:40.306602 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4023/7415] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:40 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:40.321753 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:33:40.322382 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:33:40.328679 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:40.329155 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:40.329948 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:40.330409 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:40.469885 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:33:40.477464 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d47cc291-4dd2-4492-a497-b9243638661b tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1559 microversion: 2.1 time: 0.159484 May 14 22:33:40.478048 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4024/7416] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:33:40 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:33:42.790507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-d32a4a4a-0dd4-4ca3-bc26-8a683bdb1bd8 req-0186f50a-a67e-44d3-9d4a-8e4cbcdd646d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514867a7-9f66-4419-8f1f-954d5cda68bf", "tag": "8b686020-d3a6-4bd1-94f4-8dca867ca4f9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:33:42.790507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d32a4a4a-0dd4-4ca3-bc26-8a683bdb1bd8 req-0186f50a-a67e-44d3-9d4a-8e4cbcdd646d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:33:42.790507 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-d32a4a4a-0dd4-4ca3-bc26-8a683bdb1bd8 req-0186f50a-a67e-44d3-9d4a-8e4cbcdd646d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:33:42.797647 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-d32a4a4a-0dd4-4ca3-bc26-8a683bdb1bd8 req-0186f50a-a67e-44d3-9d4a-8e4cbcdd646d service nova] Creating event network-changed:8b686020-d3a6-4bd1-94f4-8dca867ca4f9 for instance 514867a7-9f66-4419-8f1f-954d5cda68bf on nch1-master-1 May 14 22:33:42.802594 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-d32a4a4a-0dd4-4ca3-bc26-8a683bdb1bd8 req-0186f50a-a67e-44d3-9d4a-8e4cbcdd646d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030135 May 14 22:33:42.803208 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4025/7417] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:35:11.968600 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-531c29ca-74b8-4e26-9a8a-8d1873da8e58 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1497320765"}} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:35:11.969721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-531c29ca-74b8-4e26-9a8a-8d1873da8e58 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:11.976314 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-531c29ca-74b8-4e26-9a8a-8d1873da8e58 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:11.976787 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-531c29ca-74b8-4e26-9a8a-8d1873da8e58 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:11.977927 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-531c29ca-74b8-4e26-9a8a-8d1873da8e58 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:11.978639 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-531c29ca-74b8-4e26-9a8a-8d1873da8e58 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:12.478752 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-531c29ca-74b8-4e26-9a8a-8d1873da8e58 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "POST /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf/action" status: 202 len: 0 microversion: 2.1 time: 0.516938 May 14 22:35:12.479410 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4026/7418] 10.222.0.52 () {60 vars in 1277 bytes} [Sat May 14 22:35:11 2022] POST /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 14 22:35:18.612649 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-1e3d8ee7-6bdd-409d-9f7f-08a6bbe9bca2 req-885bc5b2-0d99-48be-8908-3fc1e166b0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514867a7-9f66-4419-8f1f-954d5cda68bf", "name": "network-vif-plugged", "status": "completed", "tag": "8b686020-d3a6-4bd1-94f4-8dca867ca4f9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:35:18.622298 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1e3d8ee7-6bdd-409d-9f7f-08a6bbe9bca2 req-885bc5b2-0d99-48be-8908-3fc1e166b0e8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:18.622775 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-1e3d8ee7-6bdd-409d-9f7f-08a6bbe9bca2 req-885bc5b2-0d99-48be-8908-3fc1e166b0e8 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:18.645758 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-1e3d8ee7-6bdd-409d-9f7f-08a6bbe9bca2 req-885bc5b2-0d99-48be-8908-3fc1e166b0e8 service nova] Creating event network-vif-plugged:8b686020-d3a6-4bd1-94f4-8dca867ca4f9 for instance 514867a7-9f66-4419-8f1f-954d5cda68bf on nch1-master-1 May 14 22:35:18.652123 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-1e3d8ee7-6bdd-409d-9f7f-08a6bbe9bca2 req-885bc5b2-0d99-48be-8908-3fc1e166b0e8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044906 May 14 22:35:18.653056 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4027/7419] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:35:27.949713 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:27.950388 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:27.956723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:27.957302 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:27.958113 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:27.958727 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:27.986216 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:35:28.331539 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-cd80b274-2c35-4658-88ac-7d808297e7e8 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "DELETE /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 204 len: 0 microversion: 2.1 time: 0.386750 May 14 22:35:28.332564 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4028/7420] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:35:27 2022] DELETE /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 14 22:35:28.338125 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-7ec1275c-5206-4075-b63b-1868e387d787 req-ae117ecf-eaac-48fb-898f-2d8c2ee0219d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514867a7-9f66-4419-8f1f-954d5cda68bf", "tag": "8b686020-d3a6-4bd1-94f4-8dca867ca4f9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:35:28.346560 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7ec1275c-5206-4075-b63b-1868e387d787 req-ae117ecf-eaac-48fb-898f-2d8c2ee0219d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:28.360265 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-7ec1275c-5206-4075-b63b-1868e387d787 req-ae117ecf-eaac-48fb-898f-2d8c2ee0219d service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:28.360265 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-7ec1275c-5206-4075-b63b-1868e387d787 req-ae117ecf-eaac-48fb-898f-2d8c2ee0219d service nova] Creating event network-changed:8b686020-d3a6-4bd1-94f4-8dca867ca4f9 for instance 514867a7-9f66-4419-8f1f-954d5cda68bf on nch1-master-1 May 14 22:35:28.363508 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-7ec1275c-5206-4075-b63b-1868e387d787 req-ae117ecf-eaac-48fb-898f-2d8c2ee0219d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029541 May 14 22:35:28.364208 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4029/7421] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:35:28.369769 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:28.370492 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:28.377634 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:28.378106 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:28.378915 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:28.379367 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:28.598514 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:35:28.607503 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-d70de528-a5af-4857-801e-4dac4fa31835 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1684 microversion: 2.1 time: 0.242118 May 14 22:35:28.608245 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4030/7422] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:28 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1684 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:35:29.625874 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:29.626607 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:29.634326 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:29.634819 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:29.635628 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:29.636086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:29.847349 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:35:29.854928 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-27d7ad9c-8391-4e00-bd50-f26d5ec7190e tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1684 microversion: 2.1 time: 0.233020 May 14 22:35:29.855566 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4031/7423] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:29 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1684 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:35:30.402372 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-8f48cf5d-7a19-4ca6-8e8b-967c09d86f53 req-789ab54a-0276-4916-b33b-08f70b047fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514867a7-9f66-4419-8f1f-954d5cda68bf", "name": "network-vif-deleted", "tag": "8b686020-d3a6-4bd1-94f4-8dca867ca4f9"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:35:30.410398 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8f48cf5d-7a19-4ca6-8e8b-967c09d86f53 req-789ab54a-0276-4916-b33b-08f70b047fe9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:30.413929 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-8f48cf5d-7a19-4ca6-8e8b-967c09d86f53 req-789ab54a-0276-4916-b33b-08f70b047fe9 service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:30.425949 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-8f48cf5d-7a19-4ca6-8e8b-967c09d86f53 req-789ab54a-0276-4916-b33b-08f70b047fe9 service nova] Creating event network-vif-deleted:8b686020-d3a6-4bd1-94f4-8dca867ca4f9 for instance 514867a7-9f66-4419-8f1f-954d5cda68bf on nch1-master-1 May 14 22:35:30.431702 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-8f48cf5d-7a19-4ca6-8e8b-967c09d86f53 req-789ab54a-0276-4916-b33b-08f70b047fe9 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 May 14 22:35:30.432322 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4032/7424] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 14 22:35:30.875723 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:30.876455 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:30.884853 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:30.889467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:30.889467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:30.889467 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:30.922578 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:30.922968 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:30.923892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.objects.instance [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lazy-loading 'fault' on Instance uuid 514867a7-9f66-4419-8f1f-954d5cda68bf {{(pid=130637) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 14 22:35:30.972442 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:35:30.980891 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-3517b3de-234b-40f3-9dbb-4e7fc5abaef2 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 200 len: 1339 microversion: 2.1 time: 0.111077 May 14 22:35:30.981468 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4033/7425] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:30 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 1339 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:35:31.998835 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:31.999450 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 514867a7-9f66-4419-8f1f-954d5cda68bf] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:32.006660 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:32.007130 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:32.007953 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:32.008406 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:32.022349 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] HTTP exception thrown: Instance 514867a7-9f66-4419-8f1f-954d5cda68bf could not be found. May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Request method failure captured: May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf HTTP/1.1 May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigC2UGo2IQpikSQM-dhT7HP_pSq9myj6lcBorxxe1AIY2AR6R0gTYZBanijYScFVmg6lWr8f-BafIsSUxgpucSfXNAyageEILlz4zH337vAdvWbMKb_6FnZaU9dpOMWiFju3gUryKmuOIKco9e3HpuTSpF9yBtAjrmkGJ22XNxDu4icQ May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d2345189dd994ee0adc9391fe9f6856a May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestSnapshotPattern-946616794 May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2345189dd994ee0adc9391fe9f6856a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2345189dd994ee0adc9391fe9f6856a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2345189dd994ee0adc9391fe9f6856a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2345189dd994ee0adc9391fe9f6856a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestSnapshotPattern-946616794 May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d2345189dd994ee0adc9391fe9f6856a May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestSnapshotPattern-946616794 May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestSnapshotPattern-946616794-project May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ccf50d85a6f2498f872254d47d1e70de May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestSnapshotPattern-946616794-project May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 514867a7-9f66-4419-8f1f-954d5cda68bf could not be found. May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '514867a7-9f66-4419-8f1f-954d5cda68bf'} May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514867a7-9f66-4419-8f1f-954d5cda68bf could not be found. May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514867a7-9f66-4419-8f1f-954d5cda68bf could not be found. May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:35:32.024075 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514867a7-9f66-4419-8f1f-954d5cda68bf could not be found. May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Returning 404 to user: Instance 514867a7-9f66-4419-8f1f-954d5cda68bf could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-457f89fb-a1ef-42f9-bd65-7a9aa824c011 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf" status: 404 len: 111 microversion: 2.1 time: 0.030603 May 14 22:35:32.028952 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4034/7426] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:31 2022] GET /compute/v2.1/servers/514867a7-9f66-4419-8f1f-954d5cda68bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 14 22:35:34.250323 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:34.250942 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:34.258554 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:34.259016 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:34.259843 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:34.260306 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:34.285810 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Going to try to terminate instance {{(pid=130637) delete /opt/stack/nova/nova/compute/api.py:2664}} May 14 22:35:34.566224 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-8ae666b9-fa05-4935-bb0e-488b53b78817 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "DELETE /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 204 len: 0 microversion: 2.1 time: 0.319591 May 14 22:35:34.566933 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4035/7427] 10.222.0.52 () {58 vars in 1238 bytes} [Sat May 14 22:35:34 2022] DELETE /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 14 22:35:34.572779 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-354dad5f-42b2-4ee3-a6bc-7324318e98e5 req-cb85b0ac-c550-4d66-acb7-9a74ff6d244e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f91aea-b795-489b-a0fa-38d25ed0ec87", "tag": "d0e8112a-0d9c-4b09-9a04-be02d4535f10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:35:34.580721 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-354dad5f-42b2-4ee3-a6bc-7324318e98e5 req-cb85b0ac-c550-4d66-acb7-9a74ff6d244e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:34.581180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-354dad5f-42b2-4ee3-a6bc-7324318e98e5 req-cb85b0ac-c550-4d66-acb7-9a74ff6d244e service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:34.593620 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-354dad5f-42b2-4ee3-a6bc-7324318e98e5 req-cb85b0ac-c550-4d66-acb7-9a74ff6d244e service nova] Creating event network-changed:d0e8112a-0d9c-4b09-9a04-be02d4535f10 for instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 on nch2-master-1 May 14 22:35:34.598652 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-354dad5f-42b2-4ee3-a6bc-7324318e98e5 req-cb85b0ac-c550-4d66-acb7-9a74ff6d244e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030163 May 14 22:35:34.599890 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4036/7428] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:35:34.605029 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:34.605781 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:34.612026 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:34.612497 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:34.613295 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:34.613755 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:34.749669 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:35:34.757303 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-6246fc5a-804c-48f1-bd39-a19ee6ee450a tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1684 microversion: 2.1 time: 0.156184 May 14 22:35:34.757887 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4037/7429] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:34 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 14 22:35:35.774272 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:35.774945 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:35.781886 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:35.782360 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:35.783159 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:35.783665 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:35.948190 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:35:35.955826 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-e7568f32-33fd-410f-8109-b0311d2b0fb4 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1684 microversion: 2.1 time: 0.185726 May 14 22:35:35.956404 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4038/7430] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:35 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1684 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:35:36.973536 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:36.975020 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:36.982347 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:36.982686 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:36.983521 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:36.983982 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:37.054866 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.policy [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccf50d85a6f2498f872254d47d1e70de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2345189dd994ee0adc9391fe9f6856a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130637) authorize /opt/stack/nova/nova/policy.py:199}} May 14 22:35:37.062483 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-12400dd0-a678-4499-9098-befb230d91ba tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 200 len: 1497 microversion: 2.1 time: 0.092951 May 14 22:35:37.063058 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4039/7431] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:36 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 1497 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 14 22:35:37.067428 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [req-81cf61e7-51a3-4b1f-afa0-4164d02c60c2 req-efa1e33c-24ae-401a-b9ad-b803c67b614c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f91aea-b795-489b-a0fa-38d25ed0ec87", "name": "network-vif-deleted", "tag": "d0e8112a-0d9c-4b09-9a04-be02d4535f10"}]} {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 14 22:35:37.076033 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-81cf61e7-51a3-4b1f-afa0-4164d02c60c2 req-efa1e33c-24ae-401a-b9ad-b803c67b614c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:37.076503 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [req-81cf61e7-51a3-4b1f-afa0-4164d02c60c2 req-efa1e33c-24ae-401a-b9ad-b803c67b614c service nova] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:37.088499 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.compute.server_external_events [req-81cf61e7-51a3-4b1f-afa0-4164d02c60c2 req-efa1e33c-24ae-401a-b9ad-b803c67b614c service nova] Creating event network-vif-deleted:d0e8112a-0d9c-4b09-9a04-be02d4535f10 for instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 on nch2-master-1 May 14 22:35:37.093425 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [req-81cf61e7-51a3-4b1f-afa0-4164d02c60c2 req-efa1e33c-24ae-401a-b9ad-b803c67b614c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029218 May 14 22:35:37.094031 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4040/7432] 10.222.0.52 () {64 vars in 1317 bytes} [Sat May 14 22:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 14 22:35:38.080724 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:38.081396 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.compute.api [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] [instance: 97f91aea-b795-489b-a0fa-38d25ed0ec87] Fetching instance by UUID {{(pid=130637) get /opt/stack/nova/nova/compute/api.py:2920}} May 14 22:35:38.087828 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:38.088297 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:38.089086 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 14 22:35:38.089539 ncdv-master-1 devstack@n-api.service[130637]: DEBUG oslo_concurrency.lockutils [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Lock "eee792cc-a6a2-4967-ae25-d7f56985c297" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130637) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 14 22:35:38.103444 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.wsgi [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] HTTP exception thrown: Instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 could not be found. May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Request method failure captured: May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: request: GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 HTTP/1.1 May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: Accept: application/json May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: Accept-Encoding: identity May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: Connection: close May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: Content-Length: 0 May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: Content-Type: application/json May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: Host: 10.222.0.52 May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: Openstack-System-Scope: None May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: User-Agent: python-urllib3/1.26.9 May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Auth-Token: gAAAAABigC2UGo2IQpikSQM-dhT7HP_pSq9myj6lcBorxxe1AIY2AR6R0gTYZBanijYScFVmg6lWr8f-BafIsSUxgpucSfXNAyageEILlz4zH337vAdvWbMKb_6FnZaU9dpOMWiFju3gUryKmuOIKco9e3HpuTSpF9yBtAjrmkGJ22XNxDu4icQ May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Id: None May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Domain-Name: None May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Identity-Status: Confirmed May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Is-Admin-Project: True May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Id: default May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Domain-Name: Default May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Id: d2345189dd994ee0adc9391fe9f6856a May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Project-Name: tempest-TestSnapshotPattern-946616794 May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Role: reader,member May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Roles: reader,member May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2345189dd994ee0adc9391fe9f6856a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d2345189dd994ee0adc9391fe9f6856a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d2345189dd994ee0adc9391fe9f6856a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d2345189dd994ee0adc9391fe9f6856a", "adminURL": "http://10.222.0.52:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}] May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant: tempest-TestSnapshotPattern-946616794 May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Id: d2345189dd994ee0adc9391fe9f6856a May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-Tenant-Name: tempest-TestSnapshotPattern-946616794 May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-User: tempest-TestSnapshotPattern-946616794-project May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Id: default May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-User-Domain-Name: Default May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-User-Id: ccf50d85a6f2498f872254d47d1e70de May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: X-User-Name: tempest-TestSnapshotPattern-946616794-project May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: method: > May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: exception: Instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 could not be found. May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: action_args: {'id': '97f91aea-b795-489b-a0fa-38d25ed0ec87'} May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 could not be found. May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 could not be found. May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 14 22:35:38.105180 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 could not be found. May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: ERROR nova.api.openstack.wsgi May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Returning 404 to user: Instance 97f91aea-b795-489b-a0fa-38d25ed0ec87 could not be found. {{(pid=130637) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-0255145d-7d22-4f96-90a8-f965a6c619c1 tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87" status: 404 len: 111 microversion: 2.1 time: 0.031233 May 14 22:35:38.109741 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4041/7433] 10.222.0.52 () {58 vars in 1235 bytes} [Sat May 14 22:35:38 2022] GET /compute/v2.1/servers/97f91aea-b795-489b-a0fa-38d25ed0ec87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 14 22:35:38.347892 ncdv-master-1 devstack@n-api.service[130637]: DEBUG nova.api.openstack.wsgi [None req-5678b395-5750-4d1a-b3cd-d02c283132de tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] Calling method '.version_select at 0x7fb1a6abd160>' {{(pid=130637) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 14 22:35:38.452714 ncdv-master-1 devstack@n-api.service[130637]: INFO nova.api.openstack.requestlog [None req-5678b395-5750-4d1a-b3cd-d02c283132de tempest-TestSnapshotPattern-946616794 tempest-TestSnapshotPattern-946616794-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1877215158" status: 202 len: 0 microversion: 2.1 time: 0.108948 May 14 22:35:38.453321 ncdv-master-1 devstack@n-api.service[130637]: [pid: 130637|app: 0|req: 4042/7434] 10.222.0.52 () {58 vars in 1256 bytes} [Sat May 14 22:35:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1877215158 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 14 22:38:19.180787 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:38:19.181522 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:38:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:38:19.267596 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:38:19.267763 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:38:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:38:33.864982 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:38:33.865799 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:41:39.189067 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:41:39.189743 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:41:39.275001 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:41:39.275248 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 14 22:41:53.874585 ncdv-master-1 devstack@n-api.service[130637]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 14 22:41:53.875787 ncdv-master-1 devstack@n-api.service[130637]: Sat May 14 22:41:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!